Nov 29 16:05:48 user nova-compute[75245]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75245) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75245) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75245) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 29 16:05:48 user nova-compute[75245]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:05:48 user nova-compute[75245]: INFO nova.virt.driver [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 29 16:05:48 user nova-compute[75245]: INFO nova.compute.provider_config [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] Acquiring lock "singleton_lock" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] Acquired lock "singleton_lock" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] Releasing lock "singleton_lock" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] Full set of CONF: {{(pid=75245) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] ******************************************************************************** {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] Configuration options gathered from: {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] ================================================================================ {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] allow_resize_to_same_host      = True {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] arq_binding_timeout            = 300 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] backdoor_port                  = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] backdoor_socket                = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] block_device_allocate_retries  = 300 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] block_device_allocate_retries_interval = 5 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] cert                           = self.pem {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] compute_monitors               = [] {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] config_dir                     = [] {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] config_drive_format            = iso9660 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] config_source                  = [] {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] console_host                   = user {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] control_exchange               = nova {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] cpu_allocation_ratio           = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] daemon                         = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] debug                          = True {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] default_access_ip_network_name = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] default_availability_zone      = nova {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] default_ephemeral_format       = ext4 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] default_green_pool_size        = 1000 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] default_schedule_zone          = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] disk_allocation_ratio          = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] enable_new_services            = True {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] enabled_apis                   = ['osapi_compute'] {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] enabled_ssl_apis               = [] {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] flat_injected                  = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] force_config_drive             = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] force_raw_images               = True {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] graceful_shutdown_timeout      = 5 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] heal_instance_info_cache_interval = 60 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] host                           = user {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] instance_build_timeout         = 0 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] instance_delete_interval       = 300 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] instance_format                = [instance: %(uuid)s]  {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] instance_name_template         = instance-%08x {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] instance_usage_audit           = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] instance_usage_audit_period    = month {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] internal_service_availability_zone = internal {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] key                            = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] live_migration_retry_count     = 30 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] log_config_append              = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] log_dir                        = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] log_file                       = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] log_options                    = True {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] log_rotate_interval            = 1 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] log_rotate_interval_type       = days {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] log_rotation_type              = none {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] long_rpc_timeout               = 1800 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] max_concurrent_builds          = 10 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] max_concurrent_live_migrations = 1 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] max_concurrent_snapshots       = 5 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] max_local_block_devices        = 3 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] max_logfile_count              = 30 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] max_logfile_size_mb            = 200 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] maximum_instance_delete_attempts = 5 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] metadata_listen                = 0.0.0.0 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] metadata_listen_port           = 8775 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] metadata_workers               = 3 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] migrate_max_retries            = -1 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] mkisofs_cmd                    = genisoimage {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] my_ip                          = 10.0.0.210 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] network_allocate_retries       = 0 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] osapi_compute_listen_port      = 8774 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] osapi_compute_unique_server_name_scope =  {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] osapi_compute_workers          = 3 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] password_length                = 12 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] periodic_enable                = True {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] periodic_fuzzy_delay           = 60 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] pointer_model                  = ps2mouse {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] preallocate_images             = none {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] publish_errors                 = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] pybasedir                      = /opt/stack/nova {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] ram_allocation_ratio           = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] rate_limit_burst               = 0 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] rate_limit_except_level        = CRITICAL {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] rate_limit_interval            = 0 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] reboot_timeout                 = 0 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] reclaim_instance_interval      = 0 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] record                         = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] reimage_timeout_per_gb         = 60 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] report_interval                = 120 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] rescue_timeout                 = 0 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] reserved_host_cpus             = 0 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] reserved_host_disk_mb          = 0 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] reserved_host_memory_mb        = 512 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] reserved_huge_pages            = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] resize_confirm_window          = 0 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] resize_fs_using_block_device   = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] resume_guests_state_on_host_boot = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] rpc_response_timeout           = 60 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] run_external_periodic_tasks    = True {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] running_deleted_instance_action = reap {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] running_deleted_instance_poll_interval = 1800 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] running_deleted_instance_timeout = 0 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] scheduler_instance_sync_interval = 120 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] service_down_time              = 720 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] servicegroup_driver            = db {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] shelved_offload_time           = 0 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] shelved_poll_interval          = 3600 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] shutdown_timeout               = 0 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] source_is_ipv6                 = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] ssl_only                       = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] state_path                     = /opt/stack/data/nova {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] sync_power_state_interval      = 600 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] sync_power_state_pool_size     = 1000 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] syslog_log_facility            = LOG_USER {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] tempdir                        = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] timeout_nbd                    = 10 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] transport_url                  = **** {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] update_resources_interval      = 0 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] use_cow_images                 = True {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] use_eventlog                   = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] use_journal                    = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] use_json                       = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] use_rootwrap_daemon            = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] use_stderr                     = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] use_syslog                     = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] vcpu_pin_set                   = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] vif_plugging_is_fatal          = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] vif_plugging_timeout           = 0 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] virt_mkfs                      = [] {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] volume_usage_poll_interval     = 0 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] watch_log_file                 = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] web                            = /usr/share/spice-html5 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] oslo_concurrency.disable_process_locking = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] api.auth_strategy              = keystone {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] api.compute_link_prefix        = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] api.dhcp_domain                = novalocal {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] api.enable_instance_password   = True {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] api.glance_link_prefix         = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] api.instance_list_per_project_cells = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] api.list_records_by_skipping_down_cells = True {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] api.local_metadata_per_cell    = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] api.max_limit                  = 1000 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] api.metadata_cache_expiration  = 15 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] api.neutron_default_tenant_id  = default {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] api.use_forwarded_for          = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] api.use_neutron_default_nets   = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] api.vendordata_dynamic_targets = [] {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] api.vendordata_jsonfile_path   = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] cache.backend                  = dogpile.cache.memcached {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] cache.backend_argument         = **** {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] cache.config_prefix            = cache.oslo {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] cache.dead_timeout             = 60.0 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] cache.debug_cache_backend      = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] cache.enable_retry_client      = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] cache.enable_socket_keepalive  = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] cache.enabled                  = True {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] cache.expiration_time          = 600 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] cache.hashclient_retry_attempts = 2 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] cache.memcache_dead_retry      = 300 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] cache.memcache_password        =  {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] cache.memcache_pool_maxsize    = 10 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] cache.memcache_sasl_enabled    = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] cache.memcache_username        =  {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] cache.proxies                  = [] {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] cache.retry_attempts           = 2 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] cache.retry_delay              = 0.0 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] cache.socket_keepalive_count   = 1 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] cache.socket_keepalive_idle    = 1 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] cache.socket_keepalive_interval = 1 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] cache.tls_allowed_ciphers      = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] cache.tls_cafile               = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] cache.tls_certfile             = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] cache.tls_enabled              = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] cache.tls_keyfile              = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] cinder.auth_section            = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] cinder.auth_type               = password {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] cinder.cafile                  = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] cinder.certfile                = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] cinder.collect_timing          = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] cinder.cross_az_attach         = True {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] cinder.debug                   = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] cinder.endpoint_template       = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] cinder.http_retries            = 3 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] cinder.insecure                = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] cinder.keyfile                 = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] cinder.os_region_name          = RegionOne {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] cinder.split_loggers           = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] cinder.timeout                 = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] compute.cpu_dedicated_set      = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] compute.cpu_shared_set         = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] compute.image_type_exclude_list = [] {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] compute.max_concurrent_disk_ops = 0 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] compute.max_disk_devices_to_attach = -1 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] compute.resource_provider_association_refresh = 300 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] compute.shutdown_retry_interval = 10 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] conductor.workers              = 3 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] console.allowed_origins        = [] {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] console.ssl_ciphers            = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] console.ssl_minimum_version    = default {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] consoleauth.token_ttl          = 600 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] cyborg.cafile                  = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] cyborg.certfile                = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] cyborg.collect_timing          = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] cyborg.connect_retries         = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] cyborg.connect_retry_delay     = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] cyborg.endpoint_override       = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] cyborg.insecure                = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] cyborg.keyfile                 = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] cyborg.max_version             = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] cyborg.min_version             = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] cyborg.region_name             = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] cyborg.service_name            = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] cyborg.service_type            = accelerator {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] cyborg.split_loggers           = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] cyborg.status_code_retries     = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] cyborg.status_code_retry_delay = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] cyborg.timeout                 = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] cyborg.version                 = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] database.backend               = sqlalchemy {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] database.connection            = **** {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] database.connection_debug      = 0 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] database.connection_parameters =  {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] database.connection_recycle_time = 3600 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] database.connection_trace      = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] database.db_inc_retry_interval = True {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] database.db_max_retries        = 20 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] database.db_max_retry_interval = 10 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] database.db_retry_interval     = 1 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] database.max_overflow          = 50 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] database.max_pool_size         = 5 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] database.max_retries           = 10 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] database.mysql_wsrep_sync_wait = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] database.pool_timeout          = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] database.retry_interval        = 10 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] database.slave_connection      = **** {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] database.sqlite_synchronous    = True {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] api_database.backend           = sqlalchemy {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] api_database.connection        = **** {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] api_database.connection_debug  = 0 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] api_database.connection_parameters =  {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] api_database.connection_recycle_time = 3600 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] api_database.connection_trace  = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] api_database.db_inc_retry_interval = True {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] api_database.db_max_retries    = 20 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] api_database.db_max_retry_interval = 10 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] api_database.db_retry_interval = 1 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] api_database.max_overflow      = 50 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] api_database.max_pool_size     = 5 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] api_database.max_retries       = 10 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] api_database.pool_timeout      = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] api_database.retry_interval    = 10 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] api_database.slave_connection  = **** {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] api_database.sqlite_synchronous = True {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] devices.enabled_mdev_types     = [] {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] ephemeral_storage_encryption.enabled = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] glance.api_servers             = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] glance.cafile                  = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] glance.certfile                = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] glance.collect_timing          = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] glance.connect_retries         = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] glance.connect_retry_delay     = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] glance.debug                   = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] glance.default_trusted_certificate_ids = [] {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] glance.enable_certificate_validation = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] glance.enable_rbd_download     = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] glance.endpoint_override       = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] glance.insecure                = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] glance.keyfile                 = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] glance.max_version             = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] glance.min_version             = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] glance.num_retries             = 3 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] glance.rbd_ceph_conf           =  {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] glance.rbd_connect_timeout     = 5 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] glance.rbd_pool                =  {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] glance.rbd_user                =  {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] glance.region_name             = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] glance.service_name            = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] glance.service_type            = image {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] glance.split_loggers           = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] glance.status_code_retries     = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] glance.status_code_retry_delay = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] glance.timeout                 = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] glance.verify_glance_signatures = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] glance.version                 = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] guestfs.debug                  = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] hyperv.config_drive_cdrom      = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] hyperv.config_drive_inject_password = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] hyperv.enable_instance_metrics_collection = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] hyperv.enable_remotefx         = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] hyperv.instances_path_share    =  {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] hyperv.iscsi_initiator_list    = [] {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] hyperv.limit_cpu_features      = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] hyperv.power_state_check_timeframe = 60 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] hyperv.use_multipath_io        = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] hyperv.volume_attach_retry_count = 10 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] hyperv.vswitch_name            = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] mks.enabled                    = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] image_cache.manager_interval   = 2400 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] image_cache.precache_concurrency = 1 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] image_cache.remove_unused_base_images = True {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] image_cache.subdirectory_name  = _base {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] ironic.api_max_retries         = 60 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] ironic.api_retry_interval      = 2 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] ironic.auth_section            = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] ironic.auth_type               = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] ironic.cafile                  = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] ironic.certfile                = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] ironic.collect_timing          = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] ironic.conductor_group         = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] ironic.connect_retries         = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] ironic.connect_retry_delay     = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] ironic.endpoint_override       = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] ironic.insecure                = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] ironic.keyfile                 = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] ironic.max_version             = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] ironic.min_version             = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] ironic.peer_list               = [] {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] ironic.region_name             = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] ironic.serial_console_state_timeout = 10 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] ironic.service_name            = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] ironic.service_type            = baremetal {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] ironic.split_loggers           = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] ironic.status_code_retries     = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] ironic.status_code_retry_delay = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] ironic.timeout                 = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] ironic.version                 = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] key_manager.fixed_key          = **** {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] barbican.barbican_api_version  = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] barbican.barbican_endpoint     = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] barbican.barbican_endpoint_type = public {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] barbican.barbican_region_name  = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] barbican.cafile                = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] barbican.certfile              = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] barbican.collect_timing        = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] barbican.insecure              = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] barbican.keyfile               = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] barbican.number_of_retries     = 60 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] barbican.retry_delay           = 1 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] barbican.send_service_user_token = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] barbican.split_loggers         = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] barbican.timeout               = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] barbican.verify_ssl            = True {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] barbican.verify_ssl_path       = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] barbican_service_user.auth_section = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] barbican_service_user.auth_type = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] barbican_service_user.cafile   = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] barbican_service_user.certfile = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] barbican_service_user.collect_timing = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] barbican_service_user.insecure = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] barbican_service_user.keyfile  = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] barbican_service_user.split_loggers = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] barbican_service_user.timeout  = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] vault.approle_role_id          = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] vault.approle_secret_id        = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] vault.cafile                   = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] vault.certfile                 = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] vault.collect_timing           = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] vault.insecure                 = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] vault.keyfile                  = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] vault.kv_mountpoint            = secret {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] vault.kv_path                  = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] vault.kv_version               = 2 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] vault.namespace                = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] vault.root_token_id            = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] vault.split_loggers            = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] vault.ssl_ca_crt_file          = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] vault.timeout                  = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] vault.use_ssl                  = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] keystone.auth_section          = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] keystone.auth_type             = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] keystone.cafile                = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] keystone.certfile              = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] keystone.collect_timing        = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] keystone.connect_retries       = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] keystone.connect_retry_delay   = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] keystone.endpoint_override     = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] keystone.insecure              = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] keystone.keyfile               = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] keystone.max_version           = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] keystone.min_version           = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] keystone.region_name           = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] keystone.service_name          = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] keystone.service_type          = identity {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] keystone.split_loggers         = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] keystone.status_code_retries   = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] keystone.status_code_retry_delay = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] keystone.timeout               = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] keystone.version               = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.connection_uri         =  {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.cpu_mode               = custom {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: WARNING oslo_config.cfg [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.cpu_power_governor_high = performance {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.cpu_power_governor_low = powersave {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.cpu_power_management   = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.device_detach_attempts = 8 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.device_detach_timeout  = 20 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.disk_cachemodes        = [] {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.disk_prefix            = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.enabled_perf_events    = [] {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.file_backed_memory     = 0 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.gid_maps               = [] {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.hw_disk_discard        = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.hw_machine_type        = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.images_rbd_glance_store_name =  {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.images_rbd_pool        = rbd {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.images_type            = default {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.images_volume_group    = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.inject_key             = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.inject_partition       = -2 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.inject_password        = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.iscsi_iface            = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.iser_use_multipath     = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.live_migration_bandwidth = 0 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.live_migration_downtime = 500 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.live_migration_inbound_addr = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.live_migration_permit_post_copy = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.live_migration_scheme  = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.live_migration_timeout_action = abort {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.live_migration_tunnelled = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: WARNING oslo_config.cfg [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 29 16:05:48 user nova-compute[75245]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 29 16:05:48 user nova-compute[75245]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 29 16:05:48 user nova-compute[75245]: and ``live_migration_inbound_addr`` respectively.
Nov 29 16:05:48 user nova-compute[75245]: ).  Its value may be silently ignored in the future.
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.live_migration_with_native_tls = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.max_queues             = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.nfs_mount_options      = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.num_memory_encrypted_guests = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.num_pcie_ports         = 0 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.pmem_namespaces        = [] {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.quobyte_client_cfg     = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.rbd_secret_uuid        = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.rbd_user               = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.remote_filesystem_transport = ssh {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.rescue_image_id        = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.rescue_kernel_id       = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.rescue_ramdisk_id      = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.rx_queue_size          = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.smbfs_mount_options    =  {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.snapshot_compression   = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.snapshot_image_format  = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.sparse_logical_volumes = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.swtpm_enabled          = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.swtpm_group            = tss {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.swtpm_user             = tss {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.sysinfo_serial         = unique {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.tb_cache_size          = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.tx_queue_size          = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.uid_maps               = [] {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.use_virtio_for_bridges = True {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.virt_type              = kvm {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.volume_clear           = zero {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.volume_clear_size      = 0 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.volume_use_multipath   = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.vzstorage_cache_path   = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.vzstorage_mount_user   = stack {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] neutron.auth_section           = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] neutron.auth_type              = password {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] neutron.cafile                 = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] neutron.certfile               = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] neutron.collect_timing         = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] neutron.connect_retries        = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] neutron.connect_retry_delay    = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] neutron.default_floating_pool  = public {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] neutron.endpoint_override      = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] neutron.extension_sync_interval = 600 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] neutron.http_retries           = 3 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] neutron.insecure               = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] neutron.keyfile                = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] neutron.max_version            = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] neutron.min_version            = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] neutron.ovs_bridge             = br-int {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] neutron.physnets               = [] {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] neutron.region_name            = RegionOne {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] neutron.service_metadata_proxy = True {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] neutron.service_name           = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] neutron.service_type           = network {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] neutron.split_loggers          = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] neutron.status_code_retries    = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] neutron.status_code_retry_delay = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] neutron.timeout                = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] neutron.version                = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] notifications.bdms_in_notifications = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] notifications.default_level    = INFO {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] notifications.notification_format = unversioned {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] notifications.notify_on_state_change = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] pci.alias                      = [] {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:48 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] pci.device_spec                = [] {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] pci.report_in_placement        = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] placement.auth_section         = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] placement.auth_type            = password {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] placement.cafile               = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] placement.certfile             = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] placement.collect_timing       = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] placement.connect_retries      = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] placement.connect_retry_delay  = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] placement.default_domain_id    = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] placement.default_domain_name  = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] placement.domain_id            = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] placement.domain_name          = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] placement.endpoint_override    = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] placement.insecure             = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] placement.keyfile              = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] placement.max_version          = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] placement.min_version          = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] placement.password             = **** {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] placement.project_domain_id    = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] placement.project_domain_name  = Default {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] placement.project_id           = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] placement.project_name         = service {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] placement.region_name          = RegionOne {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] placement.service_name         = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] placement.service_type         = placement {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] placement.split_loggers        = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] placement.status_code_retries  = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] placement.status_code_retry_delay = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] placement.system_scope         = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] placement.timeout              = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] placement.trust_id             = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] placement.user_domain_id       = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] placement.user_domain_name     = Default {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] placement.user_id              = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] placement.username             = placement {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] placement.version              = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] quota.cores                    = 20 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] quota.count_usage_from_placement = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] quota.injected_file_content_bytes = 10240 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] quota.injected_file_path_length = 255 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] quota.injected_files           = 5 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] quota.instances                = 10 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] quota.key_pairs                = 100 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] quota.metadata_items           = 128 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] quota.ram                      = 51200 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] quota.recheck_quota            = True {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] quota.server_group_members     = 10 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] quota.server_groups            = 10 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] rdp.enabled                    = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] scheduler.image_metadata_prefilter = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] scheduler.max_attempts         = 3 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] scheduler.max_placement_results = 1000 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] scheduler.query_placement_for_image_type_support = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] scheduler.workers              = 3 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] filter_scheduler.host_subset_size = 1 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] filter_scheduler.isolated_hosts = [] {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] filter_scheduler.isolated_images = [] {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] filter_scheduler.pci_in_placement = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] filter_scheduler.track_instance_changes = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] metrics.required               = True {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] metrics.weight_multiplier      = 1.0 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] metrics.weight_setting         = [] {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] serial_console.enabled         = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] serial_console.port_range      = 10000:20000 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] serial_console.serialproxy_port = 6083 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] service_user.auth_section      = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] service_user.auth_type         = password {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] service_user.cafile            = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] service_user.certfile          = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] service_user.collect_timing    = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] service_user.insecure          = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] service_user.keyfile           = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] service_user.send_service_user_token = True {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] service_user.split_loggers     = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] service_user.timeout           = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] spice.agent_enabled            = True {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] spice.enabled                  = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] spice.html5proxy_port          = 6082 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] spice.image_compression        = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] spice.jpeg_compression         = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] spice.playback_compression     = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] spice.server_listen            = 127.0.0.1 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] spice.streaming_mode           = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] spice.zlib_compression         = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] upgrade_levels.baseapi         = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] upgrade_levels.compute         = auto {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] upgrade_levels.conductor       = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] upgrade_levels.scheduler       = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] vendordata_dynamic_auth.auth_section = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] vendordata_dynamic_auth.auth_type = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] vendordata_dynamic_auth.cafile = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] vendordata_dynamic_auth.certfile = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] vendordata_dynamic_auth.insecure = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] vendordata_dynamic_auth.keyfile = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] vendordata_dynamic_auth.timeout = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] vmware.api_retry_count         = 10 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] vmware.ca_file                 = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] vmware.cache_prefix            = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] vmware.cluster_name            = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] vmware.connection_pool_size    = 10 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] vmware.console_delay_seconds   = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] vmware.datastore_regex         = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] vmware.host_ip                 = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] vmware.host_password           = **** {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] vmware.host_port               = 443 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] vmware.host_username           = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] vmware.insecure                = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] vmware.integration_bridge      = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] vmware.maximum_objects         = 100 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] vmware.pbm_default_policy      = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] vmware.pbm_enabled             = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] vmware.pbm_wsdl_location       = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] vmware.serial_port_proxy_uri   = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] vmware.serial_port_service_uri = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] vmware.task_poll_interval      = 0.5 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] vmware.use_linked_clone        = True {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] vmware.vnc_keymap              = en-us {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] vmware.vnc_port                = 5900 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] vmware.vnc_port_total          = 10000 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] vnc.auth_schemes               = ['none'] {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] vnc.enabled                    = True {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] vnc.novncproxy_port            = 6080 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] vnc.server_listen              = 0.0.0.0 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] vnc.vencrypt_ca_certs          = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] vnc.vencrypt_client_cert       = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] vnc.vencrypt_client_key        = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] workarounds.disable_rootwrap   = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] workarounds.enable_numa_live_migration = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] workarounds.libvirt_disable_apic = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] wsgi.client_socket_timeout     = 900 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] wsgi.default_pool_size         = 1000 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] wsgi.keep_alive                = True {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] wsgi.max_header_line           = 16384 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] wsgi.ssl_ca_file               = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] wsgi.ssl_cert_file             = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] wsgi.ssl_key_file              = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] wsgi.tcp_keepidle              = 600 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] zvm.ca_file                    = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] zvm.cloud_connector_url        = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] zvm.reachable_timeout          = 300 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] oslo_policy.enforce_new_defaults = True {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] oslo_policy.enforce_scope      = True {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] oslo_policy.policy_default_rule = default {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] oslo_policy.policy_file        = policy.yaml {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] profiler.connection_string     = messaging:// {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] profiler.enabled               = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] profiler.es_doc_type           = notification {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] profiler.es_scroll_size        = 10000 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] profiler.es_scroll_time        = 2m {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] profiler.filter_error_trace    = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] profiler.hmac_keys             = **** {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] profiler.sentinel_service_name = mymaster {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] profiler.socket_timeout        = 0.1 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] profiler.trace_requests        = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] profiler.trace_sqlalchemy      = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] profiler_jaeger.process_tags   = {} {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] profiler_jaeger.service_name_prefix = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] profiler_otlp.service_name_prefix = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] remote_debug.host              = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] remote_debug.port              = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] oslo_messaging_rabbit.ssl      = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] oslo_messaging_notifications.retry = -1 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] oslo_messaging_notifications.transport_url = **** {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] oslo_limit.auth_section        = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] oslo_limit.auth_type           = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] oslo_limit.cafile              = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] oslo_limit.certfile            = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] oslo_limit.collect_timing      = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] oslo_limit.connect_retries     = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] oslo_limit.connect_retry_delay = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] oslo_limit.endpoint_id         = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] oslo_limit.endpoint_override   = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] oslo_limit.insecure            = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] oslo_limit.keyfile             = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] oslo_limit.max_version         = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] oslo_limit.min_version         = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] oslo_limit.region_name         = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] oslo_limit.service_name        = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] oslo_limit.service_type        = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] oslo_limit.split_loggers       = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] oslo_limit.status_code_retries = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] oslo_limit.status_code_retry_delay = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] oslo_limit.timeout             = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] oslo_limit.valid_interfaces    = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] oslo_limit.version             = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] oslo_reports.file_event_handler = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] oslo_reports.log_dir           = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] vif_plug_ovs_privileged.group  = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] vif_plug_ovs_privileged.user   = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] os_vif_linux_bridge.flat_interface = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] os_vif_ovs.isolate_vif         = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] os_vif_ovs.per_port_bridge     = False {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] os_brick.lock_path             = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] privsep_osbrick.capabilities   = [21] {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] privsep_osbrick.group          = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] privsep_osbrick.helper_command = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] privsep_osbrick.user           = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] nova_sys_admin.group           = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] nova_sys_admin.helper_command  = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] nova_sys_admin.user            = None {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG oslo_service.service [None req-35995af9-6dc0-4cdd-bbaa-4db3d76ef1ab None None] ******************************************************************************** {{(pid=75245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 29 16:05:49 user nova-compute[75245]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 29 16:05:49 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Connecting to libvirt: qemu:///system {{(pid=75245) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:508}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f0d4d5a2380> {{(pid=75245) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:514}}
Nov 29 16:05:49 user nova-compute[75245]: libvirt:  error : internal error: could not initialize domain event timer
Nov 29 16:05:49 user nova-compute[75245]: WARNING nova.virt.libvirt.host [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 29 16:05:49 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f0d4d5a2380> {{(pid=75245) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:535}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Starting native event thread {{(pid=75245) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:494}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Starting green dispatch thread {{(pid=75245) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:500}}
Nov 29 16:05:49 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Starting connection event dispatch thread {{(pid=75245) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Nov 29 16:05:49 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Connection event '1' reason 'None'
Nov 29 16:05:49 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 29 16:05:49 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.mount [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Initialising _HostMountState generation 0 {{(pid=75245) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 29 16:05:56 user nova-compute[75245]: INFO nova.virt.libvirt.host [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Libvirt host capabilities <capabilities>
Nov 29 16:05:56 user nova-compute[75245]:   <host>
Nov 29 16:05:56 user nova-compute[75245]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 29 16:05:56 user nova-compute[75245]:     <cpu>
Nov 29 16:05:56 user nova-compute[75245]:       <arch>x86_64</arch>
Nov 29 16:05:56 user nova-compute[75245]:       <model>IvyBridge-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <vendor>Intel</vendor>
Nov 29 16:05:56 user nova-compute[75245]:       <microcode version='1070'/>
Nov 29 16:05:56 user nova-compute[75245]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 29 16:05:56 user nova-compute[75245]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature name='ss'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature name='vmx'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature name='pcid'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature name='osxsave'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature name='hypervisor'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature name='arat'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature name='tsc_adjust'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature name='md-clear'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature name='stibp'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature name='arch-capabilities'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature name='ssbd'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature name='invtsc'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature name='rsba'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature name='skip-l1dfl-vmentry'/>
Nov 29 16:05:56 user nova-compute[75245]:       <pages unit='KiB' size='4'/>
Nov 29 16:05:56 user nova-compute[75245]:       <pages unit='KiB' size='2048'/>
Nov 29 16:05:56 user nova-compute[75245]:     </cpu>
Nov 29 16:05:56 user nova-compute[75245]:     <power_management>
Nov 29 16:05:56 user nova-compute[75245]:       <suspend_mem/>
Nov 29 16:05:56 user nova-compute[75245]:       <suspend_disk/>
Nov 29 16:05:56 user nova-compute[75245]:       <suspend_hybrid/>
Nov 29 16:05:56 user nova-compute[75245]:     </power_management>
Nov 29 16:05:56 user nova-compute[75245]:     <iommu support='no'/>
Nov 29 16:05:56 user nova-compute[75245]:     <migration_features>
Nov 29 16:05:56 user nova-compute[75245]:       <live/>
Nov 29 16:05:56 user nova-compute[75245]:       <uri_transports>
Nov 29 16:05:56 user nova-compute[75245]:         <uri_transport>tcp</uri_transport>
Nov 29 16:05:56 user nova-compute[75245]:         <uri_transport>rdma</uri_transport>
Nov 29 16:05:56 user nova-compute[75245]:       </uri_transports>
Nov 29 16:05:56 user nova-compute[75245]:     </migration_features>
Nov 29 16:05:56 user nova-compute[75245]:     <topology>
Nov 29 16:05:56 user nova-compute[75245]:       <cells num='2'>
Nov 29 16:05:56 user nova-compute[75245]:         <cell id='0'>
Nov 29 16:05:56 user nova-compute[75245]:           <memory unit='KiB'>8189224</memory>
Nov 29 16:05:56 user nova-compute[75245]:           <pages unit='KiB' size='4'>2047306</pages>
Nov 29 16:05:56 user nova-compute[75245]:           <pages unit='KiB' size='2048'>0</pages>
Nov 29 16:05:56 user nova-compute[75245]:           <distances>
Nov 29 16:05:56 user nova-compute[75245]:             <sibling id='0' value='10'/>
Nov 29 16:05:56 user nova-compute[75245]:             <sibling id='1' value='20'/>
Nov 29 16:05:56 user nova-compute[75245]:           </distances>
Nov 29 16:05:56 user nova-compute[75245]:           <cpus num='6'>
Nov 29 16:05:56 user nova-compute[75245]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 29 16:05:56 user nova-compute[75245]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 29 16:05:56 user nova-compute[75245]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 29 16:05:56 user nova-compute[75245]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 29 16:05:56 user nova-compute[75245]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 29 16:05:56 user nova-compute[75245]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 29 16:05:56 user nova-compute[75245]:           </cpus>
Nov 29 16:05:56 user nova-compute[75245]:         </cell>
Nov 29 16:05:56 user nova-compute[75245]:         <cell id='1'>
Nov 29 16:05:56 user nova-compute[75245]:           <memory unit='KiB'>8206460</memory>
Nov 29 16:05:56 user nova-compute[75245]:           <pages unit='KiB' size='4'>2051615</pages>
Nov 29 16:05:56 user nova-compute[75245]:           <pages unit='KiB' size='2048'>0</pages>
Nov 29 16:05:56 user nova-compute[75245]:           <distances>
Nov 29 16:05:56 user nova-compute[75245]:             <sibling id='0' value='20'/>
Nov 29 16:05:56 user nova-compute[75245]:             <sibling id='1' value='10'/>
Nov 29 16:05:56 user nova-compute[75245]:           </distances>
Nov 29 16:05:56 user nova-compute[75245]:           <cpus num='6'>
Nov 29 16:05:56 user nova-compute[75245]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 29 16:05:56 user nova-compute[75245]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 29 16:05:56 user nova-compute[75245]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 29 16:05:56 user nova-compute[75245]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 29 16:05:56 user nova-compute[75245]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 29 16:05:56 user nova-compute[75245]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 29 16:05:56 user nova-compute[75245]:           </cpus>
Nov 29 16:05:56 user nova-compute[75245]:         </cell>
Nov 29 16:05:56 user nova-compute[75245]:       </cells>
Nov 29 16:05:56 user nova-compute[75245]:     </topology>
Nov 29 16:05:56 user nova-compute[75245]:     <cache>
Nov 29 16:05:56 user nova-compute[75245]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 29 16:05:56 user nova-compute[75245]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 29 16:05:56 user nova-compute[75245]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 29 16:05:56 user nova-compute[75245]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 29 16:05:56 user nova-compute[75245]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 29 16:05:56 user nova-compute[75245]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 29 16:05:56 user nova-compute[75245]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 29 16:05:56 user nova-compute[75245]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 29 16:05:56 user nova-compute[75245]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 29 16:05:56 user nova-compute[75245]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 29 16:05:56 user nova-compute[75245]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 29 16:05:56 user nova-compute[75245]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 29 16:05:56 user nova-compute[75245]:     </cache>
Nov 29 16:05:56 user nova-compute[75245]:     <secmodel>
Nov 29 16:05:56 user nova-compute[75245]:       <model>apparmor</model>
Nov 29 16:05:56 user nova-compute[75245]:       <doi>0</doi>
Nov 29 16:05:56 user nova-compute[75245]:     </secmodel>
Nov 29 16:05:56 user nova-compute[75245]:     <secmodel>
Nov 29 16:05:56 user nova-compute[75245]:       <model>dac</model>
Nov 29 16:05:56 user nova-compute[75245]:       <doi>0</doi>
Nov 29 16:05:56 user nova-compute[75245]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 29 16:05:56 user nova-compute[75245]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 29 16:05:56 user nova-compute[75245]:     </secmodel>
Nov 29 16:05:56 user nova-compute[75245]:   </host>
Nov 29 16:05:56 user nova-compute[75245]:   <guest>
Nov 29 16:05:56 user nova-compute[75245]:     <os_type>hvm</os_type>
Nov 29 16:05:56 user nova-compute[75245]:     <arch name='alpha'>
Nov 29 16:05:56 user nova-compute[75245]:       <wordsize>64</wordsize>
Nov 29 16:05:56 user nova-compute[75245]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='4'>clipper</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <domain type='qemu'/>
Nov 29 16:05:56 user nova-compute[75245]:     </arch>
Nov 29 16:05:56 user nova-compute[75245]:     <features>
Nov 29 16:05:56 user nova-compute[75245]:       <cpuselection/>
Nov 29 16:05:56 user nova-compute[75245]:       <deviceboot/>
Nov 29 16:05:56 user nova-compute[75245]:       <disksnapshot default='on' toggle='no'/>
Nov 29 16:05:56 user nova-compute[75245]:     </features>
Nov 29 16:05:56 user nova-compute[75245]:   </guest>
Nov 29 16:05:56 user nova-compute[75245]:   <guest>
Nov 29 16:05:56 user nova-compute[75245]:     <os_type>hvm</os_type>
Nov 29 16:05:56 user nova-compute[75245]:     <arch name='armv6l'>
Nov 29 16:05:56 user nova-compute[75245]:       <wordsize>32</wordsize>
Nov 29 16:05:56 user nova-compute[75245]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>integratorcp</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>borzoi</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>spitz</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2'>nuri</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2'>musca-b1</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>versatileab</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>kzm</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2'>musca-a</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2'>smdkc210</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>sx1</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>z2</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>tosa</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='4'>sabrelite</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>realview-eb</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>n810</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>n800</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>versatilepb</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>terrier</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>mainstone</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='4'>midway</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>musicpal</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>microbit</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>cubieboard</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>verdex</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>netduino2</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='4'>raspi2b</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>cheetah</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='4'>highbank</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>akita</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>connex</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>collie</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>raspi0</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <domain type='qemu'/>
Nov 29 16:05:56 user nova-compute[75245]:     </arch>
Nov 29 16:05:56 user nova-compute[75245]:     <features>
Nov 29 16:05:56 user nova-compute[75245]:       <cpuselection/>
Nov 29 16:05:56 user nova-compute[75245]:       <deviceboot/>
Nov 29 16:05:56 user nova-compute[75245]:       <disksnapshot default='on' toggle='no'/>
Nov 29 16:05:56 user nova-compute[75245]:     </features>
Nov 29 16:05:56 user nova-compute[75245]:   </guest>
Nov 29 16:05:56 user nova-compute[75245]:   <guest>
Nov 29 16:05:56 user nova-compute[75245]:     <os_type>hvm</os_type>
Nov 29 16:05:56 user nova-compute[75245]:     <arch name='armv7l'>
Nov 29 16:05:56 user nova-compute[75245]:       <wordsize>32</wordsize>
Nov 29 16:05:56 user nova-compute[75245]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>integratorcp</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>borzoi</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>spitz</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2'>nuri</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2'>musca-b1</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>versatileab</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>kzm</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2'>musca-a</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2'>smdkc210</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>sx1</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>z2</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>tosa</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='4'>sabrelite</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>realview-eb</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>n810</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>n800</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>versatilepb</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>terrier</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>mainstone</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='4'>midway</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>musicpal</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>microbit</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>cubieboard</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>verdex</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>netduino2</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='4'>raspi2b</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>cheetah</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='4'>highbank</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>akita</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>connex</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>collie</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>raspi0</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <domain type='qemu'/>
Nov 29 16:05:56 user nova-compute[75245]:     </arch>
Nov 29 16:05:56 user nova-compute[75245]:     <features>
Nov 29 16:05:56 user nova-compute[75245]:       <cpuselection/>
Nov 29 16:05:56 user nova-compute[75245]:       <deviceboot/>
Nov 29 16:05:56 user nova-compute[75245]:       <disksnapshot default='on' toggle='no'/>
Nov 29 16:05:56 user nova-compute[75245]:     </features>
Nov 29 16:05:56 user nova-compute[75245]:   </guest>
Nov 29 16:05:56 user nova-compute[75245]:   <guest>
Nov 29 16:05:56 user nova-compute[75245]:     <os_type>hvm</os_type>
Nov 29 16:05:56 user nova-compute[75245]:     <arch name='aarch64'>
Nov 29 16:05:56 user nova-compute[75245]:       <wordsize>64</wordsize>
Nov 29 16:05:56 user nova-compute[75245]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>integratorcp</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>borzoi</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>spitz</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2'>nuri</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2'>musca-b1</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>versatileab</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>kzm</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2'>musca-a</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2'>smdkc210</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>sx1</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>z2</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>tosa</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='4'>sabrelite</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>realview-eb</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>n810</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>n800</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>versatilepb</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>terrier</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>mainstone</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='4'>midway</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>musicpal</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>microbit</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>cubieboard</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>verdex</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>netduino2</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='4'>raspi3b</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='4'>raspi2b</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>cheetah</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='4'>highbank</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>akita</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>connex</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>collie</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>raspi0</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <domain type='qemu'/>
Nov 29 16:05:56 user nova-compute[75245]:     </arch>
Nov 29 16:05:56 user nova-compute[75245]:     <features>
Nov 29 16:05:56 user nova-compute[75245]:       <acpi default='on' toggle='yes'/>
Nov 29 16:05:56 user nova-compute[75245]:       <cpuselection/>
Nov 29 16:05:56 user nova-compute[75245]:       <deviceboot/>
Nov 29 16:05:56 user nova-compute[75245]:       <disksnapshot default='on' toggle='no'/>
Nov 29 16:05:56 user nova-compute[75245]:     </features>
Nov 29 16:05:56 user nova-compute[75245]:   </guest>
Nov 29 16:05:56 user nova-compute[75245]:   <guest>
Nov 29 16:05:56 user nova-compute[75245]:     <os_type>hvm</os_type>
Nov 29 16:05:56 user nova-compute[75245]:     <arch name='cris'>
Nov 29 16:05:56 user nova-compute[75245]:       <wordsize>32</wordsize>
Nov 29 16:05:56 user nova-compute[75245]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <domain type='qemu'/>
Nov 29 16:05:56 user nova-compute[75245]:     </arch>
Nov 29 16:05:56 user nova-compute[75245]:     <features>
Nov 29 16:05:56 user nova-compute[75245]:       <cpuselection/>
Nov 29 16:05:56 user nova-compute[75245]:       <deviceboot/>
Nov 29 16:05:56 user nova-compute[75245]:       <disksnapshot default='on' toggle='no'/>
Nov 29 16:05:56 user nova-compute[75245]:     </features>
Nov 29 16:05:56 user nova-compute[75245]:   </guest>
Nov 29 16:05:56 user nova-compute[75245]:   <guest>
Nov 29 16:05:56 user nova-compute[75245]:     <os_type>hvm</os_type>
Nov 29 16:05:56 user nova-compute[75245]:     <arch name='i686'>
Nov 29 16:05:56 user nova-compute[75245]:       <wordsize>32</wordsize>
Nov 29 16:05:56 user nova-compute[75245]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>x-remote</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>isapc</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='288'>microvm</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <domain type='qemu'/>
Nov 29 16:05:56 user nova-compute[75245]:       <domain type='kvm'/>
Nov 29 16:05:56 user nova-compute[75245]:     </arch>
Nov 29 16:05:56 user nova-compute[75245]:     <features>
Nov 29 16:05:56 user nova-compute[75245]:       <pae/>
Nov 29 16:05:56 user nova-compute[75245]:       <nonpae/>
Nov 29 16:05:56 user nova-compute[75245]:       <acpi default='on' toggle='yes'/>
Nov 29 16:05:56 user nova-compute[75245]:       <apic default='on' toggle='no'/>
Nov 29 16:05:56 user nova-compute[75245]:       <cpuselection/>
Nov 29 16:05:56 user nova-compute[75245]:       <deviceboot/>
Nov 29 16:05:56 user nova-compute[75245]:       <disksnapshot default='on' toggle='no'/>
Nov 29 16:05:56 user nova-compute[75245]:     </features>
Nov 29 16:05:56 user nova-compute[75245]:   </guest>
Nov 29 16:05:56 user nova-compute[75245]:   <guest>
Nov 29 16:05:56 user nova-compute[75245]:     <os_type>hvm</os_type>
Nov 29 16:05:56 user nova-compute[75245]:     <arch name='m68k'>
Nov 29 16:05:56 user nova-compute[75245]:       <wordsize>32</wordsize>
Nov 29 16:05:56 user nova-compute[75245]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>an5206</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>q800</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>next-cube</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <domain type='qemu'/>
Nov 29 16:05:56 user nova-compute[75245]:     </arch>
Nov 29 16:05:56 user nova-compute[75245]:     <features>
Nov 29 16:05:56 user nova-compute[75245]:       <cpuselection/>
Nov 29 16:05:56 user nova-compute[75245]:       <deviceboot/>
Nov 29 16:05:56 user nova-compute[75245]:       <disksnapshot default='on' toggle='no'/>
Nov 29 16:05:56 user nova-compute[75245]:     </features>
Nov 29 16:05:56 user nova-compute[75245]:   </guest>
Nov 29 16:05:56 user nova-compute[75245]:   <guest>
Nov 29 16:05:56 user nova-compute[75245]:     <os_type>hvm</os_type>
Nov 29 16:05:56 user nova-compute[75245]:     <arch name='microblaze'>
Nov 29 16:05:56 user nova-compute[75245]:       <wordsize>32</wordsize>
Nov 29 16:05:56 user nova-compute[75245]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <domain type='qemu'/>
Nov 29 16:05:56 user nova-compute[75245]:     </arch>
Nov 29 16:05:56 user nova-compute[75245]:     <features>
Nov 29 16:05:56 user nova-compute[75245]:       <cpuselection/>
Nov 29 16:05:56 user nova-compute[75245]:       <deviceboot/>
Nov 29 16:05:56 user nova-compute[75245]:       <disksnapshot default='on' toggle='no'/>
Nov 29 16:05:56 user nova-compute[75245]:     </features>
Nov 29 16:05:56 user nova-compute[75245]:   </guest>
Nov 29 16:05:56 user nova-compute[75245]:   <guest>
Nov 29 16:05:56 user nova-compute[75245]:     <os_type>hvm</os_type>
Nov 29 16:05:56 user nova-compute[75245]:     <arch name='microblazeel'>
Nov 29 16:05:56 user nova-compute[75245]:       <wordsize>32</wordsize>
Nov 29 16:05:56 user nova-compute[75245]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <domain type='qemu'/>
Nov 29 16:05:56 user nova-compute[75245]:     </arch>
Nov 29 16:05:56 user nova-compute[75245]:     <features>
Nov 29 16:05:56 user nova-compute[75245]:       <cpuselection/>
Nov 29 16:05:56 user nova-compute[75245]:       <deviceboot/>
Nov 29 16:05:56 user nova-compute[75245]:       <disksnapshot default='on' toggle='no'/>
Nov 29 16:05:56 user nova-compute[75245]:     </features>
Nov 29 16:05:56 user nova-compute[75245]:   </guest>
Nov 29 16:05:56 user nova-compute[75245]:   <guest>
Nov 29 16:05:56 user nova-compute[75245]:     <os_type>hvm</os_type>
Nov 29 16:05:56 user nova-compute[75245]:     <arch name='mips'>
Nov 29 16:05:56 user nova-compute[75245]:       <wordsize>32</wordsize>
Nov 29 16:05:56 user nova-compute[75245]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='16'>malta</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>mipssim</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <domain type='qemu'/>
Nov 29 16:05:56 user nova-compute[75245]:     </arch>
Nov 29 16:05:56 user nova-compute[75245]:     <features>
Nov 29 16:05:56 user nova-compute[75245]:       <cpuselection/>
Nov 29 16:05:56 user nova-compute[75245]:       <deviceboot/>
Nov 29 16:05:56 user nova-compute[75245]:       <disksnapshot default='on' toggle='no'/>
Nov 29 16:05:56 user nova-compute[75245]:     </features>
Nov 29 16:05:56 user nova-compute[75245]:   </guest>
Nov 29 16:05:56 user nova-compute[75245]:   <guest>
Nov 29 16:05:56 user nova-compute[75245]:     <os_type>hvm</os_type>
Nov 29 16:05:56 user nova-compute[75245]:     <arch name='mipsel'>
Nov 29 16:05:56 user nova-compute[75245]:       <wordsize>32</wordsize>
Nov 29 16:05:56 user nova-compute[75245]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='16'>malta</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>mipssim</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <domain type='qemu'/>
Nov 29 16:05:56 user nova-compute[75245]:     </arch>
Nov 29 16:05:56 user nova-compute[75245]:     <features>
Nov 29 16:05:56 user nova-compute[75245]:       <cpuselection/>
Nov 29 16:05:56 user nova-compute[75245]:       <deviceboot/>
Nov 29 16:05:56 user nova-compute[75245]:       <disksnapshot default='on' toggle='no'/>
Nov 29 16:05:56 user nova-compute[75245]:     </features>
Nov 29 16:05:56 user nova-compute[75245]:   </guest>
Nov 29 16:05:56 user nova-compute[75245]:   <guest>
Nov 29 16:05:56 user nova-compute[75245]:     <os_type>hvm</os_type>
Nov 29 16:05:56 user nova-compute[75245]:     <arch name='mips64'>
Nov 29 16:05:56 user nova-compute[75245]:       <wordsize>64</wordsize>
Nov 29 16:05:56 user nova-compute[75245]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='16'>malta</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>mipssim</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>pica61</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>magnum</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <domain type='qemu'/>
Nov 29 16:05:56 user nova-compute[75245]:     </arch>
Nov 29 16:05:56 user nova-compute[75245]:     <features>
Nov 29 16:05:56 user nova-compute[75245]:       <cpuselection/>
Nov 29 16:05:56 user nova-compute[75245]:       <deviceboot/>
Nov 29 16:05:56 user nova-compute[75245]:       <disksnapshot default='on' toggle='no'/>
Nov 29 16:05:56 user nova-compute[75245]:     </features>
Nov 29 16:05:56 user nova-compute[75245]:   </guest>
Nov 29 16:05:56 user nova-compute[75245]:   <guest>
Nov 29 16:05:56 user nova-compute[75245]:     <os_type>hvm</os_type>
Nov 29 16:05:56 user nova-compute[75245]:     <arch name='mips64el'>
Nov 29 16:05:56 user nova-compute[75245]:       <wordsize>64</wordsize>
Nov 29 16:05:56 user nova-compute[75245]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='16'>malta</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>mipssim</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>pica61</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>magnum</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='16'>boston</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <domain type='qemu'/>
Nov 29 16:05:56 user nova-compute[75245]:     </arch>
Nov 29 16:05:56 user nova-compute[75245]:     <features>
Nov 29 16:05:56 user nova-compute[75245]:       <cpuselection/>
Nov 29 16:05:56 user nova-compute[75245]:       <deviceboot/>
Nov 29 16:05:56 user nova-compute[75245]:       <disksnapshot default='on' toggle='no'/>
Nov 29 16:05:56 user nova-compute[75245]:     </features>
Nov 29 16:05:56 user nova-compute[75245]:   </guest>
Nov 29 16:05:56 user nova-compute[75245]:   <guest>
Nov 29 16:05:56 user nova-compute[75245]:     <os_type>hvm</os_type>
Nov 29 16:05:56 user nova-compute[75245]:     <arch name='ppc'>
Nov 29 16:05:56 user nova-compute[75245]:       <wordsize>32</wordsize>
Nov 29 16:05:56 user nova-compute[75245]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>g3beige</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>mac99</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='32'>ppce500</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>pegasos2</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>sam460ex</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>bamboo</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>40p</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>ref405ep</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>taihu</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <domain type='qemu'/>
Nov 29 16:05:56 user nova-compute[75245]:     </arch>
Nov 29 16:05:56 user nova-compute[75245]:     <features>
Nov 29 16:05:56 user nova-compute[75245]:       <cpuselection/>
Nov 29 16:05:56 user nova-compute[75245]:       <deviceboot/>
Nov 29 16:05:56 user nova-compute[75245]:       <disksnapshot default='on' toggle='no'/>
Nov 29 16:05:56 user nova-compute[75245]:     </features>
Nov 29 16:05:56 user nova-compute[75245]:   </guest>
Nov 29 16:05:56 user nova-compute[75245]:   <guest>
Nov 29 16:05:56 user nova-compute[75245]:     <os_type>hvm</os_type>
Nov 29 16:05:56 user nova-compute[75245]:     <arch name='ppc64'>
Nov 29 16:05:56 user nova-compute[75245]:       <wordsize>64</wordsize>
Nov 29 16:05:56 user nova-compute[75245]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2048'>powernv9</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>taihu</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2048'>powernv10</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='32'>ppce500</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>40p</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>pegasos2</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>bamboo</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>g3beige</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>mac99</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>sam460ex</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>ref405ep</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2048'>powernv8</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <domain type='qemu'/>
Nov 29 16:05:56 user nova-compute[75245]:     </arch>
Nov 29 16:05:56 user nova-compute[75245]:     <features>
Nov 29 16:05:56 user nova-compute[75245]:       <cpuselection/>
Nov 29 16:05:56 user nova-compute[75245]:       <deviceboot/>
Nov 29 16:05:56 user nova-compute[75245]:       <disksnapshot default='on' toggle='no'/>
Nov 29 16:05:56 user nova-compute[75245]:     </features>
Nov 29 16:05:56 user nova-compute[75245]:   </guest>
Nov 29 16:05:56 user nova-compute[75245]:   <guest>
Nov 29 16:05:56 user nova-compute[75245]:     <os_type>hvm</os_type>
Nov 29 16:05:56 user nova-compute[75245]:     <arch name='ppc64le'>
Nov 29 16:05:56 user nova-compute[75245]:       <wordsize>64</wordsize>
Nov 29 16:05:56 user nova-compute[75245]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2048'>powernv9</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>taihu</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2048'>powernv10</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='32'>ppce500</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>40p</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>pegasos2</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>bamboo</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>g3beige</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>mac99</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>sam460ex</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>ref405ep</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2048'>powernv8</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <domain type='qemu'/>
Nov 29 16:05:56 user nova-compute[75245]:     </arch>
Nov 29 16:05:56 user nova-compute[75245]:     <features>
Nov 29 16:05:56 user nova-compute[75245]:       <cpuselection/>
Nov 29 16:05:56 user nova-compute[75245]:       <deviceboot/>
Nov 29 16:05:56 user nova-compute[75245]:       <disksnapshot default='on' toggle='no'/>
Nov 29 16:05:56 user nova-compute[75245]:     </features>
Nov 29 16:05:56 user nova-compute[75245]:   </guest>
Nov 29 16:05:56 user nova-compute[75245]:   <guest>
Nov 29 16:05:56 user nova-compute[75245]:     <os_type>hvm</os_type>
Nov 29 16:05:56 user nova-compute[75245]:     <arch name='riscv32'>
Nov 29 16:05:56 user nova-compute[75245]:       <wordsize>32</wordsize>
Nov 29 16:05:56 user nova-compute[75245]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='8'>spike</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>opentitan</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='5'>sifive_u</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>sifive_e</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='8'>virt</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <domain type='qemu'/>
Nov 29 16:05:56 user nova-compute[75245]:     </arch>
Nov 29 16:05:56 user nova-compute[75245]:     <features>
Nov 29 16:05:56 user nova-compute[75245]:       <cpuselection/>
Nov 29 16:05:56 user nova-compute[75245]:       <deviceboot/>
Nov 29 16:05:56 user nova-compute[75245]:       <disksnapshot default='on' toggle='no'/>
Nov 29 16:05:56 user nova-compute[75245]:     </features>
Nov 29 16:05:56 user nova-compute[75245]:   </guest>
Nov 29 16:05:56 user nova-compute[75245]:   <guest>
Nov 29 16:05:56 user nova-compute[75245]:     <os_type>hvm</os_type>
Nov 29 16:05:56 user nova-compute[75245]:     <arch name='riscv64'>
Nov 29 16:05:56 user nova-compute[75245]:       <wordsize>64</wordsize>
Nov 29 16:05:56 user nova-compute[75245]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='8'>spike</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='5'>sifive_u</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>shakti_c</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>sifive_e</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='8'>virt</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <domain type='qemu'/>
Nov 29 16:05:56 user nova-compute[75245]:     </arch>
Nov 29 16:05:56 user nova-compute[75245]:     <features>
Nov 29 16:05:56 user nova-compute[75245]:       <cpuselection/>
Nov 29 16:05:56 user nova-compute[75245]:       <deviceboot/>
Nov 29 16:05:56 user nova-compute[75245]:       <disksnapshot default='on' toggle='no'/>
Nov 29 16:05:56 user nova-compute[75245]:     </features>
Nov 29 16:05:56 user nova-compute[75245]:   </guest>
Nov 29 16:05:56 user nova-compute[75245]:   <guest>
Nov 29 16:05:56 user nova-compute[75245]:     <os_type>hvm</os_type>
Nov 29 16:05:56 user nova-compute[75245]:     <arch name='s390x'>
Nov 29 16:05:56 user nova-compute[75245]:       <wordsize>64</wordsize>
Nov 29 16:05:56 user nova-compute[75245]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <domain type='qemu'/>
Nov 29 16:05:56 user nova-compute[75245]:     </arch>
Nov 29 16:05:56 user nova-compute[75245]:     <features>
Nov 29 16:05:56 user nova-compute[75245]:       <cpuselection/>
Nov 29 16:05:56 user nova-compute[75245]:       <deviceboot/>
Nov 29 16:05:56 user nova-compute[75245]:       <disksnapshot default='on' toggle='no'/>
Nov 29 16:05:56 user nova-compute[75245]:     </features>
Nov 29 16:05:56 user nova-compute[75245]:   </guest>
Nov 29 16:05:56 user nova-compute[75245]:   <guest>
Nov 29 16:05:56 user nova-compute[75245]:     <os_type>hvm</os_type>
Nov 29 16:05:56 user nova-compute[75245]:     <arch name='sh4'>
Nov 29 16:05:56 user nova-compute[75245]:       <wordsize>32</wordsize>
Nov 29 16:05:56 user nova-compute[75245]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>shix</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>r2d</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <domain type='qemu'/>
Nov 29 16:05:56 user nova-compute[75245]:     </arch>
Nov 29 16:05:56 user nova-compute[75245]:     <features>
Nov 29 16:05:56 user nova-compute[75245]:       <cpuselection/>
Nov 29 16:05:56 user nova-compute[75245]:       <deviceboot/>
Nov 29 16:05:56 user nova-compute[75245]:       <disksnapshot default='on' toggle='no'/>
Nov 29 16:05:56 user nova-compute[75245]:     </features>
Nov 29 16:05:56 user nova-compute[75245]:   </guest>
Nov 29 16:05:56 user nova-compute[75245]:   <guest>
Nov 29 16:05:56 user nova-compute[75245]:     <os_type>hvm</os_type>
Nov 29 16:05:56 user nova-compute[75245]:     <arch name='sh4eb'>
Nov 29 16:05:56 user nova-compute[75245]:       <wordsize>64</wordsize>
Nov 29 16:05:56 user nova-compute[75245]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>shix</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>r2d</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <domain type='qemu'/>
Nov 29 16:05:56 user nova-compute[75245]:     </arch>
Nov 29 16:05:56 user nova-compute[75245]:     <features>
Nov 29 16:05:56 user nova-compute[75245]:       <cpuselection/>
Nov 29 16:05:56 user nova-compute[75245]:       <deviceboot/>
Nov 29 16:05:56 user nova-compute[75245]:       <disksnapshot default='on' toggle='no'/>
Nov 29 16:05:56 user nova-compute[75245]:     </features>
Nov 29 16:05:56 user nova-compute[75245]:   </guest>
Nov 29 16:05:56 user nova-compute[75245]:   <guest>
Nov 29 16:05:56 user nova-compute[75245]:     <os_type>hvm</os_type>
Nov 29 16:05:56 user nova-compute[75245]:     <arch name='sparc'>
Nov 29 16:05:56 user nova-compute[75245]:       <wordsize>32</wordsize>
Nov 29 16:05:56 user nova-compute[75245]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>SS-5</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='4'>SS-20</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>LX</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>SS-4</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='4'>SS-10</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>Voyager</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <domain type='qemu'/>
Nov 29 16:05:56 user nova-compute[75245]:     </arch>
Nov 29 16:05:56 user nova-compute[75245]:     <features>
Nov 29 16:05:56 user nova-compute[75245]:       <cpuselection/>
Nov 29 16:05:56 user nova-compute[75245]:       <deviceboot/>
Nov 29 16:05:56 user nova-compute[75245]:       <disksnapshot default='on' toggle='no'/>
Nov 29 16:05:56 user nova-compute[75245]:     </features>
Nov 29 16:05:56 user nova-compute[75245]:   </guest>
Nov 29 16:05:56 user nova-compute[75245]:   <guest>
Nov 29 16:05:56 user nova-compute[75245]:     <os_type>hvm</os_type>
Nov 29 16:05:56 user nova-compute[75245]:     <arch name='sparc64'>
Nov 29 16:05:56 user nova-compute[75245]:       <wordsize>64</wordsize>
Nov 29 16:05:56 user nova-compute[75245]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>sun4u</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>niagara</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>sun4v</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <domain type='qemu'/>
Nov 29 16:05:56 user nova-compute[75245]:     </arch>
Nov 29 16:05:56 user nova-compute[75245]:     <features>
Nov 29 16:05:56 user nova-compute[75245]:       <cpuselection/>
Nov 29 16:05:56 user nova-compute[75245]:       <deviceboot/>
Nov 29 16:05:56 user nova-compute[75245]:       <disksnapshot default='on' toggle='no'/>
Nov 29 16:05:56 user nova-compute[75245]:     </features>
Nov 29 16:05:56 user nova-compute[75245]:   </guest>
Nov 29 16:05:56 user nova-compute[75245]:   <guest>
Nov 29 16:05:56 user nova-compute[75245]:     <os_type>hvm</os_type>
Nov 29 16:05:56 user nova-compute[75245]:     <arch name='x86_64'>
Nov 29 16:05:56 user nova-compute[75245]:       <wordsize>64</wordsize>
Nov 29 16:05:56 user nova-compute[75245]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>x-remote</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='1'>isapc</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='288'>microvm</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <domain type='qemu'/>
Nov 29 16:05:56 user nova-compute[75245]:       <domain type='kvm'/>
Nov 29 16:05:56 user nova-compute[75245]:     </arch>
Nov 29 16:05:56 user nova-compute[75245]:     <features>
Nov 29 16:05:56 user nova-compute[75245]:       <acpi default='on' toggle='yes'/>
Nov 29 16:05:56 user nova-compute[75245]:       <apic default='on' toggle='no'/>
Nov 29 16:05:56 user nova-compute[75245]:       <cpuselection/>
Nov 29 16:05:56 user nova-compute[75245]:       <deviceboot/>
Nov 29 16:05:56 user nova-compute[75245]:       <disksnapshot default='on' toggle='no'/>
Nov 29 16:05:56 user nova-compute[75245]:     </features>
Nov 29 16:05:56 user nova-compute[75245]:   </guest>
Nov 29 16:05:56 user nova-compute[75245]:   <guest>
Nov 29 16:05:56 user nova-compute[75245]:     <os_type>hvm</os_type>
Nov 29 16:05:56 user nova-compute[75245]:     <arch name='xtensa'>
Nov 29 16:05:56 user nova-compute[75245]:       <wordsize>32</wordsize>
Nov 29 16:05:56 user nova-compute[75245]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='4'>sim</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='32'>kc705</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='32'>ml605</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='32'>virt</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='32'>lx200</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='32'>lx60</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <domain type='qemu'/>
Nov 29 16:05:56 user nova-compute[75245]:     </arch>
Nov 29 16:05:56 user nova-compute[75245]:     <features>
Nov 29 16:05:56 user nova-compute[75245]:       <cpuselection/>
Nov 29 16:05:56 user nova-compute[75245]:       <deviceboot/>
Nov 29 16:05:56 user nova-compute[75245]:       <disksnapshot default='on' toggle='no'/>
Nov 29 16:05:56 user nova-compute[75245]:     </features>
Nov 29 16:05:56 user nova-compute[75245]:   </guest>
Nov 29 16:05:56 user nova-compute[75245]:   <guest>
Nov 29 16:05:56 user nova-compute[75245]:     <os_type>hvm</os_type>
Nov 29 16:05:56 user nova-compute[75245]:     <arch name='xtensaeb'>
Nov 29 16:05:56 user nova-compute[75245]:       <wordsize>32</wordsize>
Nov 29 16:05:56 user nova-compute[75245]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='4'>sim</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='32'>kc705</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='32'>ml605</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='32'>virt</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='32'>lx200</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='32'>lx60</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 29 16:05:56 user nova-compute[75245]:       <domain type='qemu'/>
Nov 29 16:05:56 user nova-compute[75245]:     </arch>
Nov 29 16:05:56 user nova-compute[75245]:     <features>
Nov 29 16:05:56 user nova-compute[75245]:       <cpuselection/>
Nov 29 16:05:56 user nova-compute[75245]:       <deviceboot/>
Nov 29 16:05:56 user nova-compute[75245]:       <disksnapshot default='on' toggle='no'/>
Nov 29 16:05:56 user nova-compute[75245]:     </features>
Nov 29 16:05:56 user nova-compute[75245]:   </guest>
Nov 29 16:05:56 user nova-compute[75245]: </capabilities>
Nov 29 16:05:56 user nova-compute[75245]: 
Nov 29 16:05:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75245) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 16:05:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75245) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 16:05:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=75245) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 16:05:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75245) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 16:05:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75245) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 16:05:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75245) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 16:05:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75245) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 16:05:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75245) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 16:05:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75245) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 16:05:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75245) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 16:05:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75245) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 16:05:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Getting domain capabilities for i686 via machine types: {'pc', 'ubuntu', 'q35', 'ubuntu-q35'} {{(pid=75245) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 16:05:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 29 16:05:56 user nova-compute[75245]: <domainCapabilities>
Nov 29 16:05:56 user nova-compute[75245]:   <path>/usr/bin/qemu-system-i386</path>
Nov 29 16:05:56 user nova-compute[75245]:   <domain>kvm</domain>
Nov 29 16:05:56 user nova-compute[75245]:   <machine>pc-i440fx-6.2</machine>
Nov 29 16:05:56 user nova-compute[75245]:   <arch>i686</arch>
Nov 29 16:05:56 user nova-compute[75245]:   <vcpu max='255'/>
Nov 29 16:05:56 user nova-compute[75245]:   <iothreads supported='yes'/>
Nov 29 16:05:56 user nova-compute[75245]:   <os supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:     <enum name='firmware'/>
Nov 29 16:05:56 user nova-compute[75245]:     <loader supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 29 16:05:56 user nova-compute[75245]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 29 16:05:56 user nova-compute[75245]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 29 16:05:56 user nova-compute[75245]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 29 16:05:56 user nova-compute[75245]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='type'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>rom</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>pflash</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='readonly'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>yes</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>no</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='secure'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>no</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:     </loader>
Nov 29 16:05:56 user nova-compute[75245]:   </os>
Nov 29 16:05:56 user nova-compute[75245]:   <cpu>
Nov 29 16:05:56 user nova-compute[75245]:     <mode name='host-passthrough' supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='hostPassthroughMigratable'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>off</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:     </mode>
Nov 29 16:05:56 user nova-compute[75245]:     <mode name='maximum' supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='maximumMigratable'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>on</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>off</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:     </mode>
Nov 29 16:05:56 user nova-compute[75245]:     <mode name='host-model' supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <vendor>Intel</vendor>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='ss'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='vmx'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='pcid'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='hypervisor'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='arat'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='umip'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='md-clear'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='stibp'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='ssbd'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='ibpb'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='ibrs'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='amd-stibp'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='disable' name='erms'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='disable' name='lm'/>
Nov 29 16:05:56 user nova-compute[75245]:     </mode>
Nov 29 16:05:56 user nova-compute[75245]:     <mode name='custom' supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>qemu64</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>qemu32</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>phenom</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>pentium3</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>pentium2</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>pentium</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>n270</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>kvm64</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>kvm32</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>coreduo</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>core2duo</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>athlon</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Westmere-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Westmere</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Snowridge</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Skylake-Server</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Skylake-Client</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>SandyBridge</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Penryn</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Opteron_G5</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Opteron_G4</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Opteron_G3</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Opteron_G2</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Opteron_G1</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Nehalem-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Nehalem</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>IvyBridge</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Icelake-Server</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Haswell</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>EPYC-Rome</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>EPYC-Milan</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>EPYC</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Dhyana</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Cooperlake</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Conroe</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Broadwell</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>486</model>
Nov 29 16:05:56 user nova-compute[75245]:     </mode>
Nov 29 16:05:56 user nova-compute[75245]:   </cpu>
Nov 29 16:05:56 user nova-compute[75245]:   <memoryBacking supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:     <enum name='sourceType'>
Nov 29 16:05:56 user nova-compute[75245]:       <value>file</value>
Nov 29 16:05:56 user nova-compute[75245]:       <value>anonymous</value>
Nov 29 16:05:56 user nova-compute[75245]:       <value>memfd</value>
Nov 29 16:05:56 user nova-compute[75245]:     </enum>
Nov 29 16:05:56 user nova-compute[75245]:   </memoryBacking>
Nov 29 16:05:56 user nova-compute[75245]:   <devices>
Nov 29 16:05:56 user nova-compute[75245]:     <disk supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='diskDevice'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>disk</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>cdrom</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>floppy</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>lun</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='bus'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>ide</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>fdc</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>scsi</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>virtio</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>usb</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>sata</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='model'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>virtio</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>virtio-transitional</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>virtio-non-transitional</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:     </disk>
Nov 29 16:05:56 user nova-compute[75245]:     <graphics supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='type'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>sdl</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>vnc</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>spice</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>egl-headless</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:     </graphics>
Nov 29 16:05:56 user nova-compute[75245]:     <video supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='modelType'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>vga</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>cirrus</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>vmvga</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>qxl</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>virtio</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>none</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>bochs</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>ramfb</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:     </video>
Nov 29 16:05:56 user nova-compute[75245]:     <hostdev supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='mode'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>subsystem</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='startupPolicy'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>default</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>mandatory</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>requisite</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>optional</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='subsysType'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>usb</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>pci</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>scsi</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='capsType'/>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='pciBackend'/>
Nov 29 16:05:56 user nova-compute[75245]:     </hostdev>
Nov 29 16:05:56 user nova-compute[75245]:     <rng supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='model'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>virtio</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>virtio-transitional</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>virtio-non-transitional</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='backendModel'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>random</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>egd</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>builtin</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:     </rng>
Nov 29 16:05:56 user nova-compute[75245]:     <filesystem supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='driverType'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>path</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>handle</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>virtiofs</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:     </filesystem>
Nov 29 16:05:56 user nova-compute[75245]:     <tpm supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='model'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>tpm-tis</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>tpm-crb</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='backendModel'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>passthrough</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>emulator</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:     </tpm>
Nov 29 16:05:56 user nova-compute[75245]:   </devices>
Nov 29 16:05:56 user nova-compute[75245]:   <features>
Nov 29 16:05:56 user nova-compute[75245]:     <gic supported='no'/>
Nov 29 16:05:56 user nova-compute[75245]:     <vmcoreinfo supported='yes'/>
Nov 29 16:05:56 user nova-compute[75245]:     <genid supported='yes'/>
Nov 29 16:05:56 user nova-compute[75245]:     <backingStoreInput supported='yes'/>
Nov 29 16:05:56 user nova-compute[75245]:     <backup supported='yes'/>
Nov 29 16:05:56 user nova-compute[75245]:     <sev supported='no'/>
Nov 29 16:05:56 user nova-compute[75245]:   </features>
Nov 29 16:05:56 user nova-compute[75245]: </domainCapabilities>
Nov 29 16:05:56 user nova-compute[75245]:  {{(pid=75245) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 16:05:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 29 16:05:56 user nova-compute[75245]: <domainCapabilities>
Nov 29 16:05:56 user nova-compute[75245]:   <path>/usr/bin/qemu-system-i386</path>
Nov 29 16:05:56 user nova-compute[75245]:   <domain>kvm</domain>
Nov 29 16:05:56 user nova-compute[75245]:   <machine>pc-i440fx-jammy</machine>
Nov 29 16:05:56 user nova-compute[75245]:   <arch>i686</arch>
Nov 29 16:05:56 user nova-compute[75245]:   <vcpu max='255'/>
Nov 29 16:05:56 user nova-compute[75245]:   <iothreads supported='yes'/>
Nov 29 16:05:56 user nova-compute[75245]:   <os supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:     <enum name='firmware'/>
Nov 29 16:05:56 user nova-compute[75245]:     <loader supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 29 16:05:56 user nova-compute[75245]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 29 16:05:56 user nova-compute[75245]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 29 16:05:56 user nova-compute[75245]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 29 16:05:56 user nova-compute[75245]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='type'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>rom</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>pflash</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='readonly'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>yes</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>no</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='secure'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>no</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:     </loader>
Nov 29 16:05:56 user nova-compute[75245]:   </os>
Nov 29 16:05:56 user nova-compute[75245]:   <cpu>
Nov 29 16:05:56 user nova-compute[75245]:     <mode name='host-passthrough' supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='hostPassthroughMigratable'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>off</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:     </mode>
Nov 29 16:05:56 user nova-compute[75245]:     <mode name='maximum' supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='maximumMigratable'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>on</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>off</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:     </mode>
Nov 29 16:05:56 user nova-compute[75245]:     <mode name='host-model' supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <vendor>Intel</vendor>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='ss'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='vmx'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='pcid'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='hypervisor'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='arat'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='umip'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='md-clear'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='stibp'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='ssbd'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='ibpb'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='ibrs'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='amd-stibp'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='disable' name='erms'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='disable' name='lm'/>
Nov 29 16:05:56 user nova-compute[75245]:     </mode>
Nov 29 16:05:56 user nova-compute[75245]:     <mode name='custom' supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>qemu64</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>qemu32</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>phenom</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>pentium3</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>pentium2</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>pentium</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>n270</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>kvm64</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>kvm32</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>coreduo</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>core2duo</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>athlon</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Westmere-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Westmere</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Snowridge</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Skylake-Server</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Skylake-Client</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>SandyBridge</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Penryn</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Opteron_G5</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Opteron_G4</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Opteron_G3</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Opteron_G2</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Opteron_G1</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Nehalem-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Nehalem</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>IvyBridge</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Icelake-Server</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Haswell</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>EPYC-Rome</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>EPYC-Milan</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>EPYC</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Dhyana</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Cooperlake</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Conroe</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Broadwell</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>486</model>
Nov 29 16:05:56 user nova-compute[75245]:     </mode>
Nov 29 16:05:56 user nova-compute[75245]:   </cpu>
Nov 29 16:05:56 user nova-compute[75245]:   <memoryBacking supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:     <enum name='sourceType'>
Nov 29 16:05:56 user nova-compute[75245]:       <value>file</value>
Nov 29 16:05:56 user nova-compute[75245]:       <value>anonymous</value>
Nov 29 16:05:56 user nova-compute[75245]:       <value>memfd</value>
Nov 29 16:05:56 user nova-compute[75245]:     </enum>
Nov 29 16:05:56 user nova-compute[75245]:   </memoryBacking>
Nov 29 16:05:56 user nova-compute[75245]:   <devices>
Nov 29 16:05:56 user nova-compute[75245]:     <disk supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='diskDevice'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>disk</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>cdrom</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>floppy</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>lun</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='bus'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>ide</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>fdc</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>scsi</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>virtio</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>usb</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>sata</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='model'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>virtio</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>virtio-transitional</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>virtio-non-transitional</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:     </disk>
Nov 29 16:05:56 user nova-compute[75245]:     <graphics supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='type'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>sdl</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>vnc</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>spice</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>egl-headless</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:     </graphics>
Nov 29 16:05:56 user nova-compute[75245]:     <video supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='modelType'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>vga</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>cirrus</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>vmvga</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>qxl</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>virtio</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>none</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>bochs</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>ramfb</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:     </video>
Nov 29 16:05:56 user nova-compute[75245]:     <hostdev supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='mode'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>subsystem</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='startupPolicy'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>default</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>mandatory</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>requisite</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>optional</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='subsysType'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>usb</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>pci</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>scsi</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='capsType'/>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='pciBackend'/>
Nov 29 16:05:56 user nova-compute[75245]:     </hostdev>
Nov 29 16:05:56 user nova-compute[75245]:     <rng supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='model'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>virtio</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>virtio-transitional</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>virtio-non-transitional</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='backendModel'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>random</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>egd</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>builtin</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:     </rng>
Nov 29 16:05:56 user nova-compute[75245]:     <filesystem supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='driverType'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>path</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>handle</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>virtiofs</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:     </filesystem>
Nov 29 16:05:56 user nova-compute[75245]:     <tpm supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='model'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>tpm-tis</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>tpm-crb</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='backendModel'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>passthrough</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>emulator</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:     </tpm>
Nov 29 16:05:56 user nova-compute[75245]:   </devices>
Nov 29 16:05:56 user nova-compute[75245]:   <features>
Nov 29 16:05:56 user nova-compute[75245]:     <gic supported='no'/>
Nov 29 16:05:56 user nova-compute[75245]:     <vmcoreinfo supported='yes'/>
Nov 29 16:05:56 user nova-compute[75245]:     <genid supported='yes'/>
Nov 29 16:05:56 user nova-compute[75245]:     <backingStoreInput supported='yes'/>
Nov 29 16:05:56 user nova-compute[75245]:     <backup supported='yes'/>
Nov 29 16:05:56 user nova-compute[75245]:     <sev supported='no'/>
Nov 29 16:05:56 user nova-compute[75245]:   </features>
Nov 29 16:05:56 user nova-compute[75245]: </domainCapabilities>
Nov 29 16:05:56 user nova-compute[75245]:  {{(pid=75245) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 16:05:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 29 16:05:56 user nova-compute[75245]: <domainCapabilities>
Nov 29 16:05:56 user nova-compute[75245]:   <path>/usr/bin/qemu-system-i386</path>
Nov 29 16:05:56 user nova-compute[75245]:   <domain>kvm</domain>
Nov 29 16:05:56 user nova-compute[75245]:   <machine>pc-q35-6.2</machine>
Nov 29 16:05:56 user nova-compute[75245]:   <arch>i686</arch>
Nov 29 16:05:56 user nova-compute[75245]:   <vcpu max='288'/>
Nov 29 16:05:56 user nova-compute[75245]:   <iothreads supported='yes'/>
Nov 29 16:05:56 user nova-compute[75245]:   <os supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:     <enum name='firmware'/>
Nov 29 16:05:56 user nova-compute[75245]:     <loader supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 29 16:05:56 user nova-compute[75245]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 29 16:05:56 user nova-compute[75245]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 29 16:05:56 user nova-compute[75245]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 29 16:05:56 user nova-compute[75245]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='type'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>rom</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>pflash</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='readonly'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>yes</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>no</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='secure'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>no</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:     </loader>
Nov 29 16:05:56 user nova-compute[75245]:   </os>
Nov 29 16:05:56 user nova-compute[75245]:   <cpu>
Nov 29 16:05:56 user nova-compute[75245]:     <mode name='host-passthrough' supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='hostPassthroughMigratable'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>off</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:     </mode>
Nov 29 16:05:56 user nova-compute[75245]:     <mode name='maximum' supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='maximumMigratable'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>on</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>off</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:     </mode>
Nov 29 16:05:56 user nova-compute[75245]:     <mode name='host-model' supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <vendor>Intel</vendor>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='ss'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='vmx'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='pcid'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='hypervisor'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='arat'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='umip'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='md-clear'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='stibp'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='ssbd'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='ibpb'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='ibrs'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='amd-stibp'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='disable' name='erms'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='disable' name='lm'/>
Nov 29 16:05:56 user nova-compute[75245]:     </mode>
Nov 29 16:05:56 user nova-compute[75245]:     <mode name='custom' supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>qemu64</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>qemu32</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>phenom</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>pentium3</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>pentium2</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>pentium</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>n270</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>kvm64</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>kvm32</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>coreduo</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>core2duo</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>athlon</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Westmere-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Westmere</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Snowridge</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Skylake-Server</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Skylake-Client</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>SandyBridge</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Penryn</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Opteron_G5</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Opteron_G4</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Opteron_G3</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Opteron_G2</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Opteron_G1</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Nehalem-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Nehalem</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>IvyBridge</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Icelake-Server</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Haswell</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>EPYC-Rome</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>EPYC-Milan</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>EPYC</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Dhyana</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Cooperlake</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Conroe</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Broadwell</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>486</model>
Nov 29 16:05:56 user nova-compute[75245]:     </mode>
Nov 29 16:05:56 user nova-compute[75245]:   </cpu>
Nov 29 16:05:56 user nova-compute[75245]:   <memoryBacking supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:     <enum name='sourceType'>
Nov 29 16:05:56 user nova-compute[75245]:       <value>file</value>
Nov 29 16:05:56 user nova-compute[75245]:       <value>anonymous</value>
Nov 29 16:05:56 user nova-compute[75245]:       <value>memfd</value>
Nov 29 16:05:56 user nova-compute[75245]:     </enum>
Nov 29 16:05:56 user nova-compute[75245]:   </memoryBacking>
Nov 29 16:05:56 user nova-compute[75245]:   <devices>
Nov 29 16:05:56 user nova-compute[75245]:     <disk supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='diskDevice'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>disk</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>cdrom</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>floppy</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>lun</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='bus'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>fdc</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>scsi</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>virtio</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>usb</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>sata</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='model'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>virtio</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>virtio-transitional</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>virtio-non-transitional</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:     </disk>
Nov 29 16:05:56 user nova-compute[75245]:     <graphics supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='type'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>sdl</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>vnc</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>spice</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>egl-headless</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:     </graphics>
Nov 29 16:05:56 user nova-compute[75245]:     <video supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='modelType'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>vga</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>cirrus</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>vmvga</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>qxl</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>virtio</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>none</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>bochs</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>ramfb</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:     </video>
Nov 29 16:05:56 user nova-compute[75245]:     <hostdev supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='mode'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>subsystem</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='startupPolicy'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>default</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>mandatory</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>requisite</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>optional</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='subsysType'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>usb</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>pci</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>scsi</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='capsType'/>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='pciBackend'/>
Nov 29 16:05:56 user nova-compute[75245]:     </hostdev>
Nov 29 16:05:56 user nova-compute[75245]:     <rng supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='model'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>virtio</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>virtio-transitional</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>virtio-non-transitional</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='backendModel'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>random</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>egd</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>builtin</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:     </rng>
Nov 29 16:05:56 user nova-compute[75245]:     <filesystem supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='driverType'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>path</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>handle</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>virtiofs</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:     </filesystem>
Nov 29 16:05:56 user nova-compute[75245]:     <tpm supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='model'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>tpm-tis</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>tpm-crb</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='backendModel'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>passthrough</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>emulator</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:     </tpm>
Nov 29 16:05:56 user nova-compute[75245]:   </devices>
Nov 29 16:05:56 user nova-compute[75245]:   <features>
Nov 29 16:05:56 user nova-compute[75245]:     <gic supported='no'/>
Nov 29 16:05:56 user nova-compute[75245]:     <vmcoreinfo supported='yes'/>
Nov 29 16:05:56 user nova-compute[75245]:     <genid supported='yes'/>
Nov 29 16:05:56 user nova-compute[75245]:     <backingStoreInput supported='yes'/>
Nov 29 16:05:56 user nova-compute[75245]:     <backup supported='yes'/>
Nov 29 16:05:56 user nova-compute[75245]:     <sev supported='no'/>
Nov 29 16:05:56 user nova-compute[75245]:   </features>
Nov 29 16:05:56 user nova-compute[75245]: </domainCapabilities>
Nov 29 16:05:56 user nova-compute[75245]:  {{(pid=75245) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 16:05:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 29 16:05:56 user nova-compute[75245]: <domainCapabilities>
Nov 29 16:05:56 user nova-compute[75245]:   <path>/usr/bin/qemu-system-i386</path>
Nov 29 16:05:56 user nova-compute[75245]:   <domain>kvm</domain>
Nov 29 16:05:56 user nova-compute[75245]:   <machine>pc-q35-jammy</machine>
Nov 29 16:05:56 user nova-compute[75245]:   <arch>i686</arch>
Nov 29 16:05:56 user nova-compute[75245]:   <vcpu max='288'/>
Nov 29 16:05:56 user nova-compute[75245]:   <iothreads supported='yes'/>
Nov 29 16:05:56 user nova-compute[75245]:   <os supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:     <enum name='firmware'/>
Nov 29 16:05:56 user nova-compute[75245]:     <loader supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 29 16:05:56 user nova-compute[75245]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 29 16:05:56 user nova-compute[75245]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 29 16:05:56 user nova-compute[75245]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 29 16:05:56 user nova-compute[75245]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='type'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>rom</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>pflash</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='readonly'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>yes</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>no</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='secure'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>no</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:     </loader>
Nov 29 16:05:56 user nova-compute[75245]:   </os>
Nov 29 16:05:56 user nova-compute[75245]:   <cpu>
Nov 29 16:05:56 user nova-compute[75245]:     <mode name='host-passthrough' supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='hostPassthroughMigratable'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>off</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:     </mode>
Nov 29 16:05:56 user nova-compute[75245]:     <mode name='maximum' supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='maximumMigratable'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>on</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>off</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:     </mode>
Nov 29 16:05:56 user nova-compute[75245]:     <mode name='host-model' supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <vendor>Intel</vendor>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='ss'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='vmx'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='pcid'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='hypervisor'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='arat'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='umip'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='md-clear'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='stibp'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='ssbd'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='ibpb'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='ibrs'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='amd-stibp'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='disable' name='erms'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='disable' name='lm'/>
Nov 29 16:05:56 user nova-compute[75245]:     </mode>
Nov 29 16:05:56 user nova-compute[75245]:     <mode name='custom' supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>qemu64</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>qemu32</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>phenom</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>pentium3</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>pentium2</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>pentium</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>n270</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>kvm64</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>kvm32</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>coreduo</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>core2duo</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>athlon</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Westmere-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Westmere</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Snowridge</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Skylake-Server</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Skylake-Client</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>SandyBridge</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Penryn</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Opteron_G5</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Opteron_G4</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Opteron_G3</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Opteron_G2</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Opteron_G1</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Nehalem-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Nehalem</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>IvyBridge</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Icelake-Server</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Haswell</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>EPYC-Rome</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>EPYC-Milan</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>EPYC</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Dhyana</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Cooperlake</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Conroe</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Broadwell</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>486</model>
Nov 29 16:05:56 user nova-compute[75245]:     </mode>
Nov 29 16:05:56 user nova-compute[75245]:   </cpu>
Nov 29 16:05:56 user nova-compute[75245]:   <memoryBacking supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:     <enum name='sourceType'>
Nov 29 16:05:56 user nova-compute[75245]:       <value>file</value>
Nov 29 16:05:56 user nova-compute[75245]:       <value>anonymous</value>
Nov 29 16:05:56 user nova-compute[75245]:       <value>memfd</value>
Nov 29 16:05:56 user nova-compute[75245]:     </enum>
Nov 29 16:05:56 user nova-compute[75245]:   </memoryBacking>
Nov 29 16:05:56 user nova-compute[75245]:   <devices>
Nov 29 16:05:56 user nova-compute[75245]:     <disk supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='diskDevice'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>disk</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>cdrom</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>floppy</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>lun</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='bus'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>fdc</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>scsi</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>virtio</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>usb</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>sata</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='model'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>virtio</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>virtio-transitional</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>virtio-non-transitional</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:     </disk>
Nov 29 16:05:56 user nova-compute[75245]:     <graphics supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='type'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>sdl</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>vnc</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>spice</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>egl-headless</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:     </graphics>
Nov 29 16:05:56 user nova-compute[75245]:     <video supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='modelType'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>vga</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>cirrus</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>vmvga</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>qxl</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>virtio</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>none</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>bochs</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>ramfb</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:     </video>
Nov 29 16:05:56 user nova-compute[75245]:     <hostdev supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='mode'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>subsystem</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='startupPolicy'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>default</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>mandatory</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>requisite</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>optional</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='subsysType'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>usb</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>pci</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>scsi</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='capsType'/>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='pciBackend'/>
Nov 29 16:05:56 user nova-compute[75245]:     </hostdev>
Nov 29 16:05:56 user nova-compute[75245]:     <rng supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='model'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>virtio</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>virtio-transitional</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>virtio-non-transitional</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='backendModel'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>random</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>egd</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>builtin</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:     </rng>
Nov 29 16:05:56 user nova-compute[75245]:     <filesystem supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='driverType'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>path</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>handle</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>virtiofs</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:     </filesystem>
Nov 29 16:05:56 user nova-compute[75245]:     <tpm supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='model'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>tpm-tis</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>tpm-crb</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='backendModel'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>passthrough</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>emulator</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:     </tpm>
Nov 29 16:05:56 user nova-compute[75245]:   </devices>
Nov 29 16:05:56 user nova-compute[75245]:   <features>
Nov 29 16:05:56 user nova-compute[75245]:     <gic supported='no'/>
Nov 29 16:05:56 user nova-compute[75245]:     <vmcoreinfo supported='yes'/>
Nov 29 16:05:56 user nova-compute[75245]:     <genid supported='yes'/>
Nov 29 16:05:56 user nova-compute[75245]:     <backingStoreInput supported='yes'/>
Nov 29 16:05:56 user nova-compute[75245]:     <backup supported='yes'/>
Nov 29 16:05:56 user nova-compute[75245]:     <sev supported='no'/>
Nov 29 16:05:56 user nova-compute[75245]:   </features>
Nov 29 16:05:56 user nova-compute[75245]: </domainCapabilities>
Nov 29 16:05:56 user nova-compute[75245]:  {{(pid=75245) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 16:05:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=75245) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 16:05:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75245) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 16:05:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75245) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 16:05:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75245) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 16:05:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75245) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 16:05:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75245) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 16:05:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75245) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 16:05:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75245) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 16:05:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75245) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 16:05:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75245) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 16:05:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75245) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 16:05:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75245) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 16:05:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75245) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 16:05:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75245) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 16:05:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75245) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 16:05:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75245) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 16:05:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75245) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 16:05:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=75245) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 16:05:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75245) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 16:05:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75245) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 16:05:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75245) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 16:05:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=75245) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 16:05:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75245) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 16:05:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75245) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 16:05:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75245) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 16:05:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75245) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 16:05:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75245) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 16:05:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75245) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 16:05:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75245) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 16:05:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75245) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 16:05:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75245) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 16:05:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75245) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 16:05:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75245) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 16:05:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75245) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 16:05:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75245) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 16:05:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75245) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 16:05:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75245) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 16:05:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75245) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 16:05:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'ubuntu', 'q35', 'ubuntu-q35'} {{(pid=75245) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 16:05:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 29 16:05:56 user nova-compute[75245]: <domainCapabilities>
Nov 29 16:05:56 user nova-compute[75245]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 29 16:05:56 user nova-compute[75245]:   <domain>kvm</domain>
Nov 29 16:05:56 user nova-compute[75245]:   <machine>pc-i440fx-6.2</machine>
Nov 29 16:05:56 user nova-compute[75245]:   <arch>x86_64</arch>
Nov 29 16:05:56 user nova-compute[75245]:   <vcpu max='255'/>
Nov 29 16:05:56 user nova-compute[75245]:   <iothreads supported='yes'/>
Nov 29 16:05:56 user nova-compute[75245]:   <os supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:     <enum name='firmware'>
Nov 29 16:05:56 user nova-compute[75245]:       <value>efi</value>
Nov 29 16:05:56 user nova-compute[75245]:     </enum>
Nov 29 16:05:56 user nova-compute[75245]:     <loader supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='type'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>rom</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>pflash</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='readonly'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>yes</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>no</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='secure'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>no</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:     </loader>
Nov 29 16:05:56 user nova-compute[75245]:   </os>
Nov 29 16:05:56 user nova-compute[75245]:   <cpu>
Nov 29 16:05:56 user nova-compute[75245]:     <mode name='host-passthrough' supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='hostPassthroughMigratable'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>on</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>off</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:     </mode>
Nov 29 16:05:56 user nova-compute[75245]:     <mode name='maximum' supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='maximumMigratable'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>on</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>off</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:     </mode>
Nov 29 16:05:56 user nova-compute[75245]:     <mode name='host-model' supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <vendor>Intel</vendor>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='ss'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='vmx'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='pcid'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='hypervisor'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='arat'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='umip'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='md-clear'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='stibp'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='ssbd'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='invtsc'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='ibpb'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='ibrs'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='amd-stibp'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='rsba'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='pschange-mc-no'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='disable' name='erms'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 16:05:56 user nova-compute[75245]:     </mode>
Nov 29 16:05:56 user nova-compute[75245]:     <mode name='custom' supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>qemu64</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>qemu32</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>phenom</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>pentium3</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>pentium2</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>pentium</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>n270</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>kvm64</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>kvm32</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>coreduo</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>core2duo</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>athlon</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>Westmere-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>Westmere</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Snowridge</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Skylake-Server</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Skylake-Client</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>SandyBridge</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>Penryn</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Opteron_G5</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Opteron_G4</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Opteron_G3</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Opteron_G2</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>Opteron_G1</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>Nehalem</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>IvyBridge</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Icelake-Server</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Haswell</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>EPYC-Rome</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>EPYC-Milan</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>EPYC</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Dhyana</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Cooperlake</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>Conroe</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Broadwell</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>486</model>
Nov 29 16:05:56 user nova-compute[75245]:     </mode>
Nov 29 16:05:56 user nova-compute[75245]:   </cpu>
Nov 29 16:05:56 user nova-compute[75245]:   <memoryBacking supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:     <enum name='sourceType'>
Nov 29 16:05:56 user nova-compute[75245]:       <value>file</value>
Nov 29 16:05:56 user nova-compute[75245]:       <value>anonymous</value>
Nov 29 16:05:56 user nova-compute[75245]:       <value>memfd</value>
Nov 29 16:05:56 user nova-compute[75245]:     </enum>
Nov 29 16:05:56 user nova-compute[75245]:   </memoryBacking>
Nov 29 16:05:56 user nova-compute[75245]:   <devices>
Nov 29 16:05:56 user nova-compute[75245]:     <disk supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='diskDevice'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>disk</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>cdrom</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>floppy</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>lun</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='bus'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>ide</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>fdc</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>scsi</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>virtio</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>usb</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>sata</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='model'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>virtio</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>virtio-transitional</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>virtio-non-transitional</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:     </disk>
Nov 29 16:05:56 user nova-compute[75245]:     <graphics supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='type'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>sdl</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>vnc</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>spice</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>egl-headless</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:     </graphics>
Nov 29 16:05:56 user nova-compute[75245]:     <video supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='modelType'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>vga</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>cirrus</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>vmvga</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>qxl</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>virtio</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>none</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>bochs</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>ramfb</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:     </video>
Nov 29 16:05:56 user nova-compute[75245]:     <hostdev supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='mode'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>subsystem</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='startupPolicy'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>default</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>mandatory</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>requisite</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>optional</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='subsysType'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>usb</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>pci</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>scsi</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='capsType'/>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='pciBackend'/>
Nov 29 16:05:56 user nova-compute[75245]:     </hostdev>
Nov 29 16:05:56 user nova-compute[75245]:     <rng supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='model'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>virtio</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>virtio-transitional</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>virtio-non-transitional</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='backendModel'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>random</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>egd</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>builtin</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:     </rng>
Nov 29 16:05:56 user nova-compute[75245]:     <filesystem supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='driverType'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>path</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>handle</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>virtiofs</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:     </filesystem>
Nov 29 16:05:56 user nova-compute[75245]:     <tpm supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='model'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>tpm-tis</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>tpm-crb</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='backendModel'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>passthrough</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>emulator</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:     </tpm>
Nov 29 16:05:56 user nova-compute[75245]:   </devices>
Nov 29 16:05:56 user nova-compute[75245]:   <features>
Nov 29 16:05:56 user nova-compute[75245]:     <gic supported='no'/>
Nov 29 16:05:56 user nova-compute[75245]:     <vmcoreinfo supported='yes'/>
Nov 29 16:05:56 user nova-compute[75245]:     <genid supported='yes'/>
Nov 29 16:05:56 user nova-compute[75245]:     <backingStoreInput supported='yes'/>
Nov 29 16:05:56 user nova-compute[75245]:     <backup supported='yes'/>
Nov 29 16:05:56 user nova-compute[75245]:     <sev supported='no'/>
Nov 29 16:05:56 user nova-compute[75245]:   </features>
Nov 29 16:05:56 user nova-compute[75245]: </domainCapabilities>
Nov 29 16:05:56 user nova-compute[75245]:  {{(pid=75245) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 16:05:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 29 16:05:56 user nova-compute[75245]: <domainCapabilities>
Nov 29 16:05:56 user nova-compute[75245]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 29 16:05:56 user nova-compute[75245]:   <domain>kvm</domain>
Nov 29 16:05:56 user nova-compute[75245]:   <machine>pc-i440fx-jammy</machine>
Nov 29 16:05:56 user nova-compute[75245]:   <arch>x86_64</arch>
Nov 29 16:05:56 user nova-compute[75245]:   <vcpu max='255'/>
Nov 29 16:05:56 user nova-compute[75245]:   <iothreads supported='yes'/>
Nov 29 16:05:56 user nova-compute[75245]:   <os supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:     <enum name='firmware'>
Nov 29 16:05:56 user nova-compute[75245]:       <value>efi</value>
Nov 29 16:05:56 user nova-compute[75245]:     </enum>
Nov 29 16:05:56 user nova-compute[75245]:     <loader supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='type'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>rom</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>pflash</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='readonly'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>yes</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>no</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='secure'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>no</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:     </loader>
Nov 29 16:05:56 user nova-compute[75245]:   </os>
Nov 29 16:05:56 user nova-compute[75245]:   <cpu>
Nov 29 16:05:56 user nova-compute[75245]:     <mode name='host-passthrough' supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='hostPassthroughMigratable'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>on</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>off</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:     </mode>
Nov 29 16:05:56 user nova-compute[75245]:     <mode name='maximum' supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='maximumMigratable'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>on</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>off</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:     </mode>
Nov 29 16:05:56 user nova-compute[75245]:     <mode name='host-model' supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <vendor>Intel</vendor>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='ss'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='vmx'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='pcid'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='hypervisor'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='arat'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='umip'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='md-clear'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='stibp'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='ssbd'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='invtsc'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='ibpb'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='ibrs'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='amd-stibp'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='rsba'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='pschange-mc-no'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='disable' name='erms'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 16:05:56 user nova-compute[75245]:     </mode>
Nov 29 16:05:56 user nova-compute[75245]:     <mode name='custom' supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>qemu64</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>qemu32</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>phenom</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>pentium3</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>pentium2</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>pentium</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>n270</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>kvm64</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>kvm32</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>coreduo</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>core2duo</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>athlon</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>Westmere-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>Westmere</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Snowridge</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Skylake-Server</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Skylake-Client</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>SandyBridge</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>Penryn</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Opteron_G5</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Opteron_G4</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Opteron_G3</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Opteron_G2</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>Opteron_G1</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>Nehalem</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>IvyBridge</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Icelake-Server</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Haswell</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>EPYC-Rome</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>EPYC-Milan</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>EPYC</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Dhyana</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Cooperlake</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>Conroe</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Broadwell</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>486</model>
Nov 29 16:05:56 user nova-compute[75245]:     </mode>
Nov 29 16:05:56 user nova-compute[75245]:   </cpu>
Nov 29 16:05:56 user nova-compute[75245]:   <memoryBacking supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:     <enum name='sourceType'>
Nov 29 16:05:56 user nova-compute[75245]:       <value>file</value>
Nov 29 16:05:56 user nova-compute[75245]:       <value>anonymous</value>
Nov 29 16:05:56 user nova-compute[75245]:       <value>memfd</value>
Nov 29 16:05:56 user nova-compute[75245]:     </enum>
Nov 29 16:05:56 user nova-compute[75245]:   </memoryBacking>
Nov 29 16:05:56 user nova-compute[75245]:   <devices>
Nov 29 16:05:56 user nova-compute[75245]:     <disk supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='diskDevice'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>disk</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>cdrom</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>floppy</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>lun</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='bus'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>ide</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>fdc</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>scsi</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>virtio</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>usb</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>sata</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='model'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>virtio</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>virtio-transitional</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>virtio-non-transitional</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:     </disk>
Nov 29 16:05:56 user nova-compute[75245]:     <graphics supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='type'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>sdl</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>vnc</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>spice</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>egl-headless</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:     </graphics>
Nov 29 16:05:56 user nova-compute[75245]:     <video supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='modelType'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>vga</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>cirrus</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>vmvga</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>qxl</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>virtio</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>none</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>bochs</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>ramfb</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:     </video>
Nov 29 16:05:56 user nova-compute[75245]:     <hostdev supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='mode'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>subsystem</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='startupPolicy'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>default</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>mandatory</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>requisite</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>optional</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='subsysType'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>usb</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>pci</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>scsi</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='capsType'/>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='pciBackend'/>
Nov 29 16:05:56 user nova-compute[75245]:     </hostdev>
Nov 29 16:05:56 user nova-compute[75245]:     <rng supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='model'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>virtio</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>virtio-transitional</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>virtio-non-transitional</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='backendModel'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>random</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>egd</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>builtin</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:     </rng>
Nov 29 16:05:56 user nova-compute[75245]:     <filesystem supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='driverType'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>path</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>handle</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>virtiofs</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:     </filesystem>
Nov 29 16:05:56 user nova-compute[75245]:     <tpm supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='model'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>tpm-tis</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>tpm-crb</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='backendModel'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>passthrough</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>emulator</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:     </tpm>
Nov 29 16:05:56 user nova-compute[75245]:   </devices>
Nov 29 16:05:56 user nova-compute[75245]:   <features>
Nov 29 16:05:56 user nova-compute[75245]:     <gic supported='no'/>
Nov 29 16:05:56 user nova-compute[75245]:     <vmcoreinfo supported='yes'/>
Nov 29 16:05:56 user nova-compute[75245]:     <genid supported='yes'/>
Nov 29 16:05:56 user nova-compute[75245]:     <backingStoreInput supported='yes'/>
Nov 29 16:05:56 user nova-compute[75245]:     <backup supported='yes'/>
Nov 29 16:05:56 user nova-compute[75245]:     <sev supported='no'/>
Nov 29 16:05:56 user nova-compute[75245]:   </features>
Nov 29 16:05:56 user nova-compute[75245]: </domainCapabilities>
Nov 29 16:05:56 user nova-compute[75245]:  {{(pid=75245) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 16:05:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 29 16:05:56 user nova-compute[75245]: <domainCapabilities>
Nov 29 16:05:56 user nova-compute[75245]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 29 16:05:56 user nova-compute[75245]:   <domain>kvm</domain>
Nov 29 16:05:56 user nova-compute[75245]:   <machine>pc-q35-6.2</machine>
Nov 29 16:05:56 user nova-compute[75245]:   <arch>x86_64</arch>
Nov 29 16:05:56 user nova-compute[75245]:   <vcpu max='288'/>
Nov 29 16:05:56 user nova-compute[75245]:   <iothreads supported='yes'/>
Nov 29 16:05:56 user nova-compute[75245]:   <os supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:     <enum name='firmware'>
Nov 29 16:05:56 user nova-compute[75245]:       <value>efi</value>
Nov 29 16:05:56 user nova-compute[75245]:     </enum>
Nov 29 16:05:56 user nova-compute[75245]:     <loader supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 29 16:05:56 user nova-compute[75245]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 29 16:05:56 user nova-compute[75245]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='type'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>rom</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>pflash</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='readonly'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>yes</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>no</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='secure'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>yes</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>no</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:     </loader>
Nov 29 16:05:56 user nova-compute[75245]:   </os>
Nov 29 16:05:56 user nova-compute[75245]:   <cpu>
Nov 29 16:05:56 user nova-compute[75245]:     <mode name='host-passthrough' supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='hostPassthroughMigratable'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>on</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>off</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:     </mode>
Nov 29 16:05:56 user nova-compute[75245]:     <mode name='maximum' supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='maximumMigratable'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>on</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>off</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:     </mode>
Nov 29 16:05:56 user nova-compute[75245]:     <mode name='host-model' supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <vendor>Intel</vendor>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='ss'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='vmx'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='pcid'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='hypervisor'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='arat'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='umip'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='md-clear'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='stibp'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='ssbd'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='invtsc'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='ibpb'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='ibrs'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='amd-stibp'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='rsba'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='pschange-mc-no'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='disable' name='erms'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 16:05:56 user nova-compute[75245]:     </mode>
Nov 29 16:05:56 user nova-compute[75245]:     <mode name='custom' supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>qemu64</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>qemu32</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>phenom</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>pentium3</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>pentium2</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>pentium</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>n270</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>kvm64</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>kvm32</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>coreduo</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>core2duo</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>athlon</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>Westmere-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>Westmere</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Snowridge</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Skylake-Server</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Skylake-Client</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>SandyBridge</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>Penryn</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Opteron_G5</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Opteron_G4</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Opteron_G3</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Opteron_G2</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>Opteron_G1</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>Nehalem</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>IvyBridge</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Icelake-Server</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Haswell</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>EPYC-Rome</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>EPYC-Milan</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>EPYC</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Dhyana</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Cooperlake</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>Conroe</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Broadwell</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>486</model>
Nov 29 16:05:56 user nova-compute[75245]:     </mode>
Nov 29 16:05:56 user nova-compute[75245]:   </cpu>
Nov 29 16:05:56 user nova-compute[75245]:   <memoryBacking supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:     <enum name='sourceType'>
Nov 29 16:05:56 user nova-compute[75245]:       <value>file</value>
Nov 29 16:05:56 user nova-compute[75245]:       <value>anonymous</value>
Nov 29 16:05:56 user nova-compute[75245]:       <value>memfd</value>
Nov 29 16:05:56 user nova-compute[75245]:     </enum>
Nov 29 16:05:56 user nova-compute[75245]:   </memoryBacking>
Nov 29 16:05:56 user nova-compute[75245]:   <devices>
Nov 29 16:05:56 user nova-compute[75245]:     <disk supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='diskDevice'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>disk</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>cdrom</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>floppy</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>lun</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='bus'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>fdc</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>scsi</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>virtio</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>usb</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>sata</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='model'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>virtio</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>virtio-transitional</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>virtio-non-transitional</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:     </disk>
Nov 29 16:05:56 user nova-compute[75245]:     <graphics supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='type'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>sdl</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>vnc</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>spice</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>egl-headless</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:     </graphics>
Nov 29 16:05:56 user nova-compute[75245]:     <video supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='modelType'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>vga</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>cirrus</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>vmvga</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>qxl</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>virtio</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>none</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>bochs</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>ramfb</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:     </video>
Nov 29 16:05:56 user nova-compute[75245]:     <hostdev supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='mode'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>subsystem</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='startupPolicy'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>default</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>mandatory</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>requisite</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>optional</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='subsysType'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>usb</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>pci</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>scsi</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='capsType'/>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='pciBackend'/>
Nov 29 16:05:56 user nova-compute[75245]:     </hostdev>
Nov 29 16:05:56 user nova-compute[75245]:     <rng supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='model'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>virtio</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>virtio-transitional</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>virtio-non-transitional</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='backendModel'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>random</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>egd</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>builtin</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:     </rng>
Nov 29 16:05:56 user nova-compute[75245]:     <filesystem supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='driverType'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>path</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>handle</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>virtiofs</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:     </filesystem>
Nov 29 16:05:56 user nova-compute[75245]:     <tpm supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='model'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>tpm-tis</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>tpm-crb</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='backendModel'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>passthrough</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>emulator</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:     </tpm>
Nov 29 16:05:56 user nova-compute[75245]:   </devices>
Nov 29 16:05:56 user nova-compute[75245]:   <features>
Nov 29 16:05:56 user nova-compute[75245]:     <gic supported='no'/>
Nov 29 16:05:56 user nova-compute[75245]:     <vmcoreinfo supported='yes'/>
Nov 29 16:05:56 user nova-compute[75245]:     <genid supported='yes'/>
Nov 29 16:05:56 user nova-compute[75245]:     <backingStoreInput supported='yes'/>
Nov 29 16:05:56 user nova-compute[75245]:     <backup supported='yes'/>
Nov 29 16:05:56 user nova-compute[75245]:     <sev supported='no'/>
Nov 29 16:05:56 user nova-compute[75245]:   </features>
Nov 29 16:05:56 user nova-compute[75245]: </domainCapabilities>
Nov 29 16:05:56 user nova-compute[75245]:  {{(pid=75245) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 16:05:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 29 16:05:56 user nova-compute[75245]: <domainCapabilities>
Nov 29 16:05:56 user nova-compute[75245]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 29 16:05:56 user nova-compute[75245]:   <domain>kvm</domain>
Nov 29 16:05:56 user nova-compute[75245]:   <machine>pc-q35-jammy</machine>
Nov 29 16:05:56 user nova-compute[75245]:   <arch>x86_64</arch>
Nov 29 16:05:56 user nova-compute[75245]:   <vcpu max='288'/>
Nov 29 16:05:56 user nova-compute[75245]:   <iothreads supported='yes'/>
Nov 29 16:05:56 user nova-compute[75245]:   <os supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:     <enum name='firmware'>
Nov 29 16:05:56 user nova-compute[75245]:       <value>efi</value>
Nov 29 16:05:56 user nova-compute[75245]:     </enum>
Nov 29 16:05:56 user nova-compute[75245]:     <loader supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 29 16:05:56 user nova-compute[75245]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 29 16:05:56 user nova-compute[75245]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='type'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>rom</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>pflash</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='readonly'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>yes</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>no</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='secure'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>yes</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>no</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:     </loader>
Nov 29 16:05:56 user nova-compute[75245]:   </os>
Nov 29 16:05:56 user nova-compute[75245]:   <cpu>
Nov 29 16:05:56 user nova-compute[75245]:     <mode name='host-passthrough' supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='hostPassthroughMigratable'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>on</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>off</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:     </mode>
Nov 29 16:05:56 user nova-compute[75245]:     <mode name='maximum' supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='maximumMigratable'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>on</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>off</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:     </mode>
Nov 29 16:05:56 user nova-compute[75245]:     <mode name='host-model' supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <vendor>Intel</vendor>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='ss'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='vmx'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='pcid'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='hypervisor'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='arat'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='umip'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='md-clear'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='stibp'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='ssbd'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='invtsc'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='ibpb'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='ibrs'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='amd-stibp'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='rsba'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='require' name='pschange-mc-no'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='disable' name='erms'/>
Nov 29 16:05:56 user nova-compute[75245]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 16:05:56 user nova-compute[75245]:     </mode>
Nov 29 16:05:56 user nova-compute[75245]:     <mode name='custom' supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>qemu64</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>qemu32</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>phenom</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>pentium3</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>pentium2</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>pentium</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>n270</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>kvm64</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>kvm32</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>coreduo</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>core2duo</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>athlon</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>Westmere-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>Westmere</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Snowridge</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Skylake-Server</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Skylake-Client</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>SandyBridge</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>Penryn</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Opteron_G5</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Opteron_G4</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Opteron_G3</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Opteron_G2</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>Opteron_G1</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>Nehalem</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>IvyBridge</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Icelake-Server</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Haswell</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>EPYC-Rome</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>EPYC-Milan</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>EPYC</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Dhyana</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Cooperlake</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>Conroe</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='no'>Broadwell</model>
Nov 29 16:05:56 user nova-compute[75245]:       <model usable='yes'>486</model>
Nov 29 16:05:56 user nova-compute[75245]:     </mode>
Nov 29 16:05:56 user nova-compute[75245]:   </cpu>
Nov 29 16:05:56 user nova-compute[75245]:   <memoryBacking supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:     <enum name='sourceType'>
Nov 29 16:05:56 user nova-compute[75245]:       <value>file</value>
Nov 29 16:05:56 user nova-compute[75245]:       <value>anonymous</value>
Nov 29 16:05:56 user nova-compute[75245]:       <value>memfd</value>
Nov 29 16:05:56 user nova-compute[75245]:     </enum>
Nov 29 16:05:56 user nova-compute[75245]:   </memoryBacking>
Nov 29 16:05:56 user nova-compute[75245]:   <devices>
Nov 29 16:05:56 user nova-compute[75245]:     <disk supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='diskDevice'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>disk</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>cdrom</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>floppy</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>lun</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='bus'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>fdc</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>scsi</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>virtio</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>usb</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>sata</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='model'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>virtio</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>virtio-transitional</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>virtio-non-transitional</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:     </disk>
Nov 29 16:05:56 user nova-compute[75245]:     <graphics supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='type'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>sdl</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>vnc</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>spice</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>egl-headless</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:     </graphics>
Nov 29 16:05:56 user nova-compute[75245]:     <video supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='modelType'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>vga</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>cirrus</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>vmvga</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>qxl</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>virtio</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>none</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>bochs</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>ramfb</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:     </video>
Nov 29 16:05:56 user nova-compute[75245]:     <hostdev supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='mode'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>subsystem</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='startupPolicy'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>default</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>mandatory</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>requisite</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>optional</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='subsysType'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>usb</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>pci</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>scsi</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='capsType'/>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='pciBackend'/>
Nov 29 16:05:56 user nova-compute[75245]:     </hostdev>
Nov 29 16:05:56 user nova-compute[75245]:     <rng supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='model'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>virtio</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>virtio-transitional</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>virtio-non-transitional</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='backendModel'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>random</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>egd</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>builtin</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:     </rng>
Nov 29 16:05:56 user nova-compute[75245]:     <filesystem supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='driverType'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>path</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>handle</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>virtiofs</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:     </filesystem>
Nov 29 16:05:56 user nova-compute[75245]:     <tpm supported='yes'>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='model'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>tpm-tis</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>tpm-crb</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:       <enum name='backendModel'>
Nov 29 16:05:56 user nova-compute[75245]:         <value>passthrough</value>
Nov 29 16:05:56 user nova-compute[75245]:         <value>emulator</value>
Nov 29 16:05:56 user nova-compute[75245]:       </enum>
Nov 29 16:05:56 user nova-compute[75245]:     </tpm>
Nov 29 16:05:56 user nova-compute[75245]:   </devices>
Nov 29 16:05:56 user nova-compute[75245]:   <features>
Nov 29 16:05:56 user nova-compute[75245]:     <gic supported='no'/>
Nov 29 16:05:56 user nova-compute[75245]:     <vmcoreinfo supported='yes'/>
Nov 29 16:05:56 user nova-compute[75245]:     <genid supported='yes'/>
Nov 29 16:05:56 user nova-compute[75245]:     <backingStoreInput supported='yes'/>
Nov 29 16:05:56 user nova-compute[75245]:     <backup supported='yes'/>
Nov 29 16:05:56 user nova-compute[75245]:     <sev supported='no'/>
Nov 29 16:05:56 user nova-compute[75245]:   </features>
Nov 29 16:05:56 user nova-compute[75245]: </domainCapabilities>
Nov 29 16:05:56 user nova-compute[75245]:  {{(pid=75245) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 16:05:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75245) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 16:05:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75245) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 16:05:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75245) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 16:05:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75245) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 16:05:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Checking secure boot support for host arch (x86_64) {{(pid=75245) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Nov 29 16:05:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Checking secure boot support for host arch (x86_64) {{(pid=75245) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Nov 29 16:05:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Checking secure boot support for host arch (x86_64) {{(pid=75245) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Nov 29 16:05:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Checking secure boot support for host arch (x86_64) {{(pid=75245) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Nov 29 16:05:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Checking secure boot support for host arch (x86_64) {{(pid=75245) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Nov 29 16:05:56 user nova-compute[75245]: INFO nova.virt.libvirt.host [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Secure Boot support detected
Nov 29 16:05:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] cpu compare xml: <cpu match="exact">
Nov 29 16:05:56 user nova-compute[75245]:   <model>Nehalem</model>
Nov 29 16:05:56 user nova-compute[75245]: </cpu>
Nov 29 16:05:56 user nova-compute[75245]:  {{(pid=75245) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10020}}
Nov 29 16:05:56 user nova-compute[75245]: INFO nova.virt.node [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Generated node identity dcc0ed27-167e-4f3a-a0de-183bb144a50c
Nov 29 16:05:56 user nova-compute[75245]: INFO nova.virt.node [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Wrote node identity dcc0ed27-167e-4f3a-a0de-183bb144a50c to /opt/stack/data/nova/compute_id
Nov 29 16:05:56 user nova-compute[75245]: WARNING nova.compute.manager [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Compute nodes ['dcc0ed27-167e-4f3a-a0de-183bb144a50c'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 29 16:05:56 user nova-compute[75245]: INFO nova.compute.manager [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 29 16:05:56 user nova-compute[75245]: WARNING nova.compute.manager [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 29 16:05:56 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:05:56 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:05:56 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:05:56 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Auditing locally available compute resources for user (node: user) {{(pid=75245) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 16:05:56 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:05:56 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:05:56 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Hypervisor/Node resource view: name=user free_ram=10940MB free_disk=26.18429946899414GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75245) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 16:05:56 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:05:56 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:05:56 user nova-compute[75245]: WARNING nova.compute.resource_tracker [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] No compute node record for user:dcc0ed27-167e-4f3a-a0de-183bb144a50c: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host dcc0ed27-167e-4f3a-a0de-183bb144a50c could not be found.
Nov 29 16:05:57 user nova-compute[75245]: INFO nova.compute.resource_tracker [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Compute node record created for user:user with uuid: dcc0ed27-167e-4f3a-a0de-183bb144a50c
Nov 29 16:05:57 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 16:05:57 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 16:05:57 user nova-compute[75245]: INFO nova.scheduler.client.report [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] [req-ddd55a8d-8e22-4a62-b3fa-9f8e6bb7f234] Created resource provider record via placement API for resource provider with UUID dcc0ed27-167e-4f3a-a0de-183bb144a50c and name user.
Nov 29 16:05:57 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75245) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1797}}
Nov 29 16:05:57 user nova-compute[75245]: INFO nova.virt.libvirt.host [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] kernel doesn't support AMD SEV
Nov 29 16:05:57 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Updating inventory in ProviderTree for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 16:05:57 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75245) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 16:05:57 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Libvirt baseline CPU <cpu>
Nov 29 16:05:57 user nova-compute[75245]:   <arch>x86_64</arch>
Nov 29 16:05:57 user nova-compute[75245]:   <model>Nehalem</model>
Nov 29 16:05:57 user nova-compute[75245]:   <vendor>Intel</vendor>
Nov 29 16:05:57 user nova-compute[75245]:   <topology sockets="6" cores="1" threads="1"/>
Nov 29 16:05:57 user nova-compute[75245]: </cpu>
Nov 29 16:05:57 user nova-compute[75245]:  {{(pid=75245) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12510}}
Nov 29 16:05:57 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Updated inventory for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 29 16:05:57 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Updating resource provider dcc0ed27-167e-4f3a-a0de-183bb144a50c generation from 0 to 1 during operation: update_inventory {{(pid=75245) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 29 16:05:57 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Updating inventory in ProviderTree for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 16:05:57 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Updating resource provider dcc0ed27-167e-4f3a-a0de-183bb144a50c generation from 1 to 2 during operation: update_traits {{(pid=75245) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 29 16:05:57 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Compute_service record updated for user:user {{(pid=75245) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 16:05:57 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.644s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:05:57 user nova-compute[75245]: DEBUG nova.service [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Creating RPC server for service compute {{(pid=75245) start /opt/stack/nova/nova/service.py:182}}
Nov 29 16:05:57 user nova-compute[75245]: DEBUG nova.service [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] Join ServiceGroup membership for this service compute {{(pid=75245) start /opt/stack/nova/nova/service.py:199}}
Nov 29 16:05:57 user nova-compute[75245]: DEBUG nova.servicegroup.drivers.db [None req-d5df0899-50dc-4cb9-b862-ef0360ef65b7 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75245) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 29 16:06:41 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:06:41 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:06:48 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:06:48 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:06:48 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Starting heal instance info cache {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 16:06:48 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Rebuilding the list of instances to heal {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 16:06:48 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Didn't find any instances for network info cache update. {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 16:06:48 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:06:48 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:06:48 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:06:48 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:06:48 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:06:48 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:06:48 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75245) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 16:06:48 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:06:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:06:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:06:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:06:48 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75245) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 16:06:48 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:06:48 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:06:48 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Hypervisor/Node resource view: name=user free_ram=10373MB free_disk=26.088153839111328GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75245) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 16:06:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:06:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:06:49 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 16:06:49 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 16:06:49 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:06:49 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:06:49 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Compute_service record updated for user:user {{(pid=75245) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 16:06:49 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.156s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:07:49 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:07:49 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:07:49 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Starting heal instance info cache {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 16:07:49 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Rebuilding the list of instances to heal {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 16:07:49 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Didn't find any instances for network info cache update. {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 16:07:49 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:07:49 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:07:49 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:07:49 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:07:49 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:07:49 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75245) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 16:07:49 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:07:49 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:07:49 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Hypervisor/Node resource view: name=user free_ram=10333MB free_disk=26.15331268310547GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75245) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 16:07:49 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:07:49 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:07:49 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 16:07:49 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 16:07:49 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:07:49 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:07:49 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Compute_service record updated for user:user {{(pid=75245) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 16:07:49 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.150s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:07:49 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:07:49 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:07:49 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:07:49 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:07:49 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:07:49 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75245) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 16:07:50 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:08:49 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:08:49 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:08:49 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Starting heal instance info cache {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 16:08:49 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Rebuilding the list of instances to heal {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 16:08:49 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Didn't find any instances for network info cache update. {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 16:08:49 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:08:49 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:08:49 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:08:49 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:08:49 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:08:49 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:08:49 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:08:49 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75245) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 16:08:49 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:08:49 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:08:49 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Hypervisor/Node resource view: name=user free_ram=10326MB free_disk=25.90683364868164GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75245) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 16:08:49 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:08:49 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:08:49 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 16:08:49 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 16:08:49 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:08:49 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:08:49 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Compute_service record updated for user:user {{(pid=75245) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 16:08:49 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.130s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:08:50 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:08:50 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75245) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 16:08:51 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:08:52 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:09:49 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:09:49 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:09:50 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:09:50 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Starting heal instance info cache {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 16:09:50 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Rebuilding the list of instances to heal {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 16:09:50 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Didn't find any instances for network info cache update. {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 16:09:50 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:09:50 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:09:50 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:09:50 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:09:50 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:09:50 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75245) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 16:09:50 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:09:50 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:09:50 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Hypervisor/Node resource view: name=user free_ram=9600MB free_disk=25.903865814208984GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75245) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 16:09:50 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:09:50 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:09:51 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 16:09:51 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 16:09:51 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:09:51 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:09:51 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Compute_service record updated for user:user {{(pid=75245) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 16:09:51 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.176s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:09:52 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:09:52 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:09:52 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:09:52 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:09:52 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75245) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 16:09:54 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:09:58 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Acquiring lock "738c0d7a-af77-41f7-9206-0e6b1f18a154" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:09:58 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Lock "738c0d7a-af77-41f7-9206-0e6b1f18a154" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:09:58 user nova-compute[75245]: DEBUG nova.compute.manager [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] [instance: 738c0d7a-af77-41f7-9206-0e6b1f18a154] Starting instance... {{(pid=75245) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 16:09:58 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Acquiring lock "6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:09:58 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Lock "6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:09:58 user nova-compute[75245]: DEBUG nova.compute.manager [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] [instance: 6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7] Starting instance... {{(pid=75245) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 16:09:58 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:09:58 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:09:58 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75245) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 16:09:58 user nova-compute[75245]: INFO nova.compute.claims [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] [instance: 6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7] Claim successful on node user
Nov 29 16:09:58 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:09:59 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:09:59 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:09:59 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.335s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:09:59 user nova-compute[75245]: DEBUG nova.compute.manager [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] [instance: 6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7] Start building networks asynchronously for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 16:09:59 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.327s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:09:59 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75245) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 16:09:59 user nova-compute[75245]: INFO nova.compute.claims [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] [instance: 738c0d7a-af77-41f7-9206-0e6b1f18a154] Claim successful on node user
Nov 29 16:09:59 user nova-compute[75245]: DEBUG nova.compute.manager [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] [instance: 6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7] Allocating IP information in the background. {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 16:09:59 user nova-compute[75245]: DEBUG nova.network.neutron [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] [instance: 6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7] allocate_for_instance() {{(pid=75245) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 16:09:59 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] [instance: 6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 16:09:59 user nova-compute[75245]: DEBUG nova.compute.manager [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] [instance: 6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7] Start building block device mappings for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 16:09:59 user nova-compute[75245]: DEBUG nova.compute.manager [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] [instance: 6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7] Start spawning the instance on the hypervisor. {{(pid=75245) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 16:09:59 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] [instance: 6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7] Creating instance directory {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 16:09:59 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] [instance: 6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7] Creating image(s)
Nov 29 16:09:59 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Acquiring lock "/opt/stack/data/nova/instances/6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:09:59 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Lock "/opt/stack/data/nova/instances/6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:09:59 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Lock "/opt/stack/data/nova/instances/6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:09:59 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Acquiring lock "d654f7206043e05d3525550b0fc885556eb999f8" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:09:59 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:09:59 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:09:59 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:10:00 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.709s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:10:00 user nova-compute[75245]: DEBUG nova.compute.manager [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] [instance: 738c0d7a-af77-41f7-9206-0e6b1f18a154] Start building networks asynchronously for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 16:10:00 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8.part --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:10:00 user nova-compute[75245]: DEBUG nova.policy [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '97d9ea0d0a1842649850d631bed11ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17fcceabdcb74404971adda76fd4e48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75245) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 16:10:00 user nova-compute[75245]: DEBUG nova.compute.manager [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] [instance: 738c0d7a-af77-41f7-9206-0e6b1f18a154] Allocating IP information in the background. {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 16:10:00 user nova-compute[75245]: DEBUG nova.network.neutron [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] [instance: 738c0d7a-af77-41f7-9206-0e6b1f18a154] allocate_for_instance() {{(pid=75245) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 16:10:00 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] [instance: 738c0d7a-af77-41f7-9206-0e6b1f18a154] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 16:10:00 user nova-compute[75245]: DEBUG nova.compute.manager [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] [instance: 738c0d7a-af77-41f7-9206-0e6b1f18a154] Start building block device mappings for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 16:10:00 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8.part --force-share --output=json" returned: 0 in 0.191s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:10:00 user nova-compute[75245]: DEBUG nova.virt.images [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] a291d9c3-be02-4c6c-9649-4b45c5b7f487 was qcow2, converting to raw {{(pid=75245) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 16:10:00 user nova-compute[75245]: DEBUG nova.privsep.utils [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75245) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 16:10:00 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8.part /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8.converted {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:10:00 user nova-compute[75245]: DEBUG nova.policy [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cde8c21d201447c09429d4e043050086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f499a0ff13e421b88e2712a21784fe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75245) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 16:10:00 user nova-compute[75245]: DEBUG nova.compute.manager [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] [instance: 738c0d7a-af77-41f7-9206-0e6b1f18a154] Start spawning the instance on the hypervisor. {{(pid=75245) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 16:10:00 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] [instance: 738c0d7a-af77-41f7-9206-0e6b1f18a154] Creating instance directory {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 16:10:00 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] [instance: 738c0d7a-af77-41f7-9206-0e6b1f18a154] Creating image(s)
Nov 29 16:10:00 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Acquiring lock "/opt/stack/data/nova/instances/738c0d7a-af77-41f7-9206-0e6b1f18a154/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:10:00 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Lock "/opt/stack/data/nova/instances/738c0d7a-af77-41f7-9206-0e6b1f18a154/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.003s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:10:00 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Lock "/opt/stack/data/nova/instances/738c0d7a-af77-41f7-9206-0e6b1f18a154/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:10:00 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Acquiring lock "d654f7206043e05d3525550b0fc885556eb999f8" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:10:00 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8.part /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8.converted" returned: 0 in 0.406s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:10:00 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8.converted --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:10:01 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8.converted --force-share --output=json" returned: 0 in 0.253s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:10:01 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.549s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:10:01 user nova-compute[75245]: INFO oslo.privsep.daemon [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpcxdfv1h8/privsep.sock']
Nov 29 16:10:01 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.410s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:10:01 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:10:01 user sudo[84536]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpcxdfv1h8/privsep.sock
Nov 29 16:10:01 user sudo[84536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 29 16:10:02 user nova-compute[75245]: DEBUG nova.network.neutron [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] [instance: 6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7] Successfully created port: de56e47e-57ae-4e15-9d07-57eca8971e14 {{(pid=75245) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 16:10:02 user nova-compute[75245]: DEBUG nova.network.neutron [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] [instance: 738c0d7a-af77-41f7-9206-0e6b1f18a154] Successfully created port: 6868c459-7c16-48e4-8806-577f44063ef2 {{(pid=75245) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 16:10:03 user sudo[84536]: pam_unix(sudo:session): session closed for user root
Nov 29 16:10:03 user nova-compute[75245]: INFO oslo.privsep.daemon [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Spawned new privsep daemon via rootwrap
Nov 29 16:10:03 user nova-compute[75245]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 29 16:10:03 user nova-compute[75245]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 29 16:10:03 user nova-compute[75245]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 29 16:10:03 user nova-compute[75245]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84539
Nov 29 16:10:03 user nova-compute[75245]: WARNING oslo_privsep.priv_context [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] privsep daemon already running
Nov 29 16:10:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:10:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:10:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.185s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:10:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Acquiring lock "d654f7206043e05d3525550b0fc885556eb999f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:10:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:10:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:10:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.241s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:10:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Acquiring lock "d654f7206043e05d3525550b0fc885556eb999f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:10:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.154s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:10:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/738c0d7a-af77-41f7-9206-0e6b1f18a154/disk 1073741824 {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:10:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/738c0d7a-af77-41f7-9206-0e6b1f18a154/disk 1073741824" returned: 0 in 0.064s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:10:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.222s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:10:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:10:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.225s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:10:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:10:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.209s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:10:03 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Checking if we can resize image /opt/stack/data/nova/instances/738c0d7a-af77-41f7-9206-0e6b1f18a154/disk. size=1073741824 {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 16:10:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/738c0d7a-af77-41f7-9206-0e6b1f18a154/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:10:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.216s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:10:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7/disk 1073741824 {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG nova.network.neutron [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] [instance: 6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7] Successfully updated port: de56e47e-57ae-4e15-9d07-57eca8971e14 {{(pid=75245) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7/disk 1073741824" returned: 0 in 0.057s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Acquiring lock "refresh_cache-6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Acquired lock "refresh_cache-6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG nova.network.neutron [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] [instance: 6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/738c0d7a-af77-41f7-9206-0e6b1f18a154/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Cannot resize image /opt/stack/data/nova/instances/738c0d7a-af77-41f7-9206-0e6b1f18a154/disk to a smaller size. {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] [instance: 738c0d7a-af77-41f7-9206-0e6b1f18a154] Created local disks {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] [instance: 738c0d7a-af77-41f7-9206-0e6b1f18a154] Ensure instance console log exists: /opt/stack/data/nova/instances/738c0d7a-af77-41f7-9206-0e6b1f18a154/console.log {{(pid=75245) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG nova.network.neutron [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] [instance: 6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7] Instance cache missing network info. {{(pid=75245) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.279s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7/disk. size=1073741824 {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG nova.network.neutron [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] [instance: 738c0d7a-af77-41f7-9206-0e6b1f18a154] Successfully updated port: 6868c459-7c16-48e4-8806-577f44063ef2 {{(pid=75245) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Acquiring lock "ed9a6a4e-2e7d-443c-82ef-f14f11d32c81" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "ed9a6a4e-2e7d-443c-82ef-f14f11d32c81" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Acquiring lock "refresh_cache-738c0d7a-af77-41f7-9206-0e6b1f18a154" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Acquired lock "refresh_cache-738c0d7a-af77-41f7-9206-0e6b1f18a154" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG nova.network.neutron [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] [instance: 738c0d7a-af77-41f7-9206-0e6b1f18a154] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG nova.compute.manager [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] Starting instance... {{(pid=75245) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Acquiring lock "3ab9d7cd-79cd-4c9b-8608-c1ef0f333305" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lock "3ab9d7cd-79cd-4c9b-8608-c1ef0f333305" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG nova.compute.manager [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Starting instance... {{(pid=75245) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG nova.network.neutron [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] [instance: 738c0d7a-af77-41f7-9206-0e6b1f18a154] Instance cache missing network info. {{(pid=75245) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG nova.compute.manager [req-944dd9a8-7fff-4577-a5ee-66e8285bf11d req-eb439240-e501-4edb-bc23-16901218a3f9 service nova] [instance: 6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7] Received event network-changed-de56e47e-57ae-4e15-9d07-57eca8971e14 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG nova.compute.manager [req-944dd9a8-7fff-4577-a5ee-66e8285bf11d req-eb439240-e501-4edb-bc23-16901218a3f9 service nova] [instance: 6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7] Refreshing instance network info cache due to event network-changed-de56e47e-57ae-4e15-9d07-57eca8971e14. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-944dd9a8-7fff-4577-a5ee-66e8285bf11d req-eb439240-e501-4edb-bc23-16901218a3f9 service nova] Acquiring lock "refresh_cache-6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Cannot resize image /opt/stack/data/nova/instances/6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7/disk to a smaller size. {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] [instance: 6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7] Created local disks {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] [instance: 6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7] Ensure instance console log exists: /opt/stack/data/nova/instances/6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7/console.log {{(pid=75245) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75245) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 16:10:04 user nova-compute[75245]: INFO nova.compute.claims [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] Claim successful on node user
Nov 29 16:10:04 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG nova.compute.manager [req-e57808cb-dab0-4c75-acad-98798a19abda req-295c3293-49d1-4445-a3e8-7bf3b3aadf26 service nova] [instance: 738c0d7a-af77-41f7-9206-0e6b1f18a154] Received event network-changed-6868c459-7c16-48e4-8806-577f44063ef2 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG nova.compute.manager [req-e57808cb-dab0-4c75-acad-98798a19abda req-295c3293-49d1-4445-a3e8-7bf3b3aadf26 service nova] [instance: 738c0d7a-af77-41f7-9206-0e6b1f18a154] Refreshing instance network info cache due to event network-changed-6868c459-7c16-48e4-8806-577f44063ef2. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-e57808cb-dab0-4c75-acad-98798a19abda req-295c3293-49d1-4445-a3e8-7bf3b3aadf26 service nova] Acquiring lock "refresh_cache-738c0d7a-af77-41f7-9206-0e6b1f18a154" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG nova.network.neutron [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] [instance: 6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7] Updating instance_info_cache with network_info: [{"id": "de56e47e-57ae-4e15-9d07-57eca8971e14", "address": "fa:16:3e:cc:b6:56", "network": {"id": "04f30281-e256-4d60-82d2-89004740b1b8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-649945802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17fcceabdcb74404971adda76fd4e48d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde56e47e-57", "ovs_interfaceid": "de56e47e-57ae-4e15-9d07-57eca8971e14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Releasing lock "refresh_cache-6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG nova.compute.manager [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] [instance: 6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7] Instance network_info: |[{"id": "de56e47e-57ae-4e15-9d07-57eca8971e14", "address": "fa:16:3e:cc:b6:56", "network": {"id": "04f30281-e256-4d60-82d2-89004740b1b8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-649945802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17fcceabdcb74404971adda76fd4e48d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde56e47e-57", "ovs_interfaceid": "de56e47e-57ae-4e15-9d07-57eca8971e14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-944dd9a8-7fff-4577-a5ee-66e8285bf11d req-eb439240-e501-4edb-bc23-16901218a3f9 service nova] Acquired lock "refresh_cache-6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG nova.network.neutron [req-944dd9a8-7fff-4577-a5ee-66e8285bf11d req-eb439240-e501-4edb-bc23-16901218a3f9 service nova] [instance: 6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7] Refreshing network info cache for port de56e47e-57ae-4e15-9d07-57eca8971e14 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] [instance: 6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7] Start _get_guest_xml network_info=[{"id": "de56e47e-57ae-4e15-9d07-57eca8971e14", "address": "fa:16:3e:cc:b6:56", "network": {"id": "04f30281-e256-4d60-82d2-89004740b1b8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-649945802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17fcceabdcb74404971adda76fd4e48d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde56e47e-57", "ovs_interfaceid": "de56e47e-57ae-4e15-9d07-57eca8971e14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'a291d9c3-be02-4c6c-9649-4b45c5b7f487'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 16:10:04 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:10:04 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:10:04 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] CPU controller missing on host. {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] CPU controller found on host. {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75245) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T16:06:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Flavor limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Image limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Flavor pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Image pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Got 1 possible topologies {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG nova.privsep.utils [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75245) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:09:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1366697277',display_name='tempest-ServersNegativeTestJSON-server-1366697277',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1366697277',id=2,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='17fcceabdcb74404971adda76fd4e48d',ramdisk_id='',reservation_id='r-mqw20ccf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1566439864',owner_user_name='tempest-ServersNegativeTestJSON-1566439864-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:10:00Z,user_data=None,user_id='97d9ea0d0a1842649850d631bed11ac1',uuid=6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de56e47e-57ae-4e15-9d07-57eca8971e14", "address": "fa:16:3e:cc:b6:56", "network": {"id": "04f30281-e256-4d60-82d2-89004740b1b8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-649945802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17fcceabdcb74404971adda76fd4e48d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde56e47e-57", "ovs_interfaceid": "de56e47e-57ae-4e15-9d07-57eca8971e14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Converting VIF {"id": "de56e47e-57ae-4e15-9d07-57eca8971e14", "address": "fa:16:3e:cc:b6:56", "network": {"id": "04f30281-e256-4d60-82d2-89004740b1b8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-649945802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17fcceabdcb74404971adda76fd4e48d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde56e47e-57", "ovs_interfaceid": "de56e47e-57ae-4e15-9d07-57eca8971e14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:b6:56,bridge_name='br-int',has_traffic_filtering=True,id=de56e47e-57ae-4e15-9d07-57eca8971e14,network=Network(04f30281-e256-4d60-82d2-89004740b1b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde56e47e-57') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG nova.objects.instance [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Lazy-loading 'pci_devices' on Instance uuid 6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] [instance: 6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7] End _get_guest_xml xml=<domain type="kvm">
Nov 29 16:10:04 user nova-compute[75245]:   <uuid>6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7</uuid>
Nov 29 16:10:04 user nova-compute[75245]:   <name>instance-00000002</name>
Nov 29 16:10:04 user nova-compute[75245]:   <memory>524288</memory>
Nov 29 16:10:04 user nova-compute[75245]:   <vcpu>1</vcpu>
Nov 29 16:10:04 user nova-compute[75245]:   <metadata>
Nov 29 16:10:04 user nova-compute[75245]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 16:10:04 user nova-compute[75245]:       <nova:package version="0.0.0"/>
Nov 29 16:10:04 user nova-compute[75245]:       <nova:name>tempest-ServersNegativeTestJSON-server-1366697277</nova:name>
Nov 29 16:10:04 user nova-compute[75245]:       <nova:creationTime>2023-11-29 16:10:04</nova:creationTime>
Nov 29 16:10:04 user nova-compute[75245]:       <nova:flavor name="m1.tiny">
Nov 29 16:10:04 user nova-compute[75245]:         <nova:memory>512</nova:memory>
Nov 29 16:10:04 user nova-compute[75245]:         <nova:disk>1</nova:disk>
Nov 29 16:10:04 user nova-compute[75245]:         <nova:swap>0</nova:swap>
Nov 29 16:10:04 user nova-compute[75245]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 16:10:04 user nova-compute[75245]:         <nova:vcpus>1</nova:vcpus>
Nov 29 16:10:04 user nova-compute[75245]:       </nova:flavor>
Nov 29 16:10:04 user nova-compute[75245]:       <nova:owner>
Nov 29 16:10:04 user nova-compute[75245]:         <nova:user uuid="97d9ea0d0a1842649850d631bed11ac1">tempest-ServersNegativeTestJSON-1566439864-project-member</nova:user>
Nov 29 16:10:04 user nova-compute[75245]:         <nova:project uuid="17fcceabdcb74404971adda76fd4e48d">tempest-ServersNegativeTestJSON-1566439864</nova:project>
Nov 29 16:10:04 user nova-compute[75245]:       </nova:owner>
Nov 29 16:10:04 user nova-compute[75245]:       <nova:root type="image" uuid="a291d9c3-be02-4c6c-9649-4b45c5b7f487"/>
Nov 29 16:10:04 user nova-compute[75245]:       <nova:ports>
Nov 29 16:10:04 user nova-compute[75245]:         <nova:port uuid="de56e47e-57ae-4e15-9d07-57eca8971e14">
Nov 29 16:10:04 user nova-compute[75245]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 29 16:10:04 user nova-compute[75245]:         </nova:port>
Nov 29 16:10:04 user nova-compute[75245]:       </nova:ports>
Nov 29 16:10:04 user nova-compute[75245]:     </nova:instance>
Nov 29 16:10:04 user nova-compute[75245]:   </metadata>
Nov 29 16:10:04 user nova-compute[75245]:   <sysinfo type="smbios">
Nov 29 16:10:04 user nova-compute[75245]:     <system>
Nov 29 16:10:04 user nova-compute[75245]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 16:10:04 user nova-compute[75245]:       <entry name="product">OpenStack Nova</entry>
Nov 29 16:10:04 user nova-compute[75245]:       <entry name="version">0.0.0</entry>
Nov 29 16:10:04 user nova-compute[75245]:       <entry name="serial">6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7</entry>
Nov 29 16:10:04 user nova-compute[75245]:       <entry name="uuid">6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7</entry>
Nov 29 16:10:04 user nova-compute[75245]:       <entry name="family">Virtual Machine</entry>
Nov 29 16:10:04 user nova-compute[75245]:     </system>
Nov 29 16:10:04 user nova-compute[75245]:   </sysinfo>
Nov 29 16:10:04 user nova-compute[75245]:   <os>
Nov 29 16:10:04 user nova-compute[75245]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 16:10:04 user nova-compute[75245]:     <boot dev="hd"/>
Nov 29 16:10:04 user nova-compute[75245]:     <smbios mode="sysinfo"/>
Nov 29 16:10:04 user nova-compute[75245]:   </os>
Nov 29 16:10:04 user nova-compute[75245]:   <features>
Nov 29 16:10:04 user nova-compute[75245]:     <acpi/>
Nov 29 16:10:04 user nova-compute[75245]:     <apic/>
Nov 29 16:10:04 user nova-compute[75245]:     <vmcoreinfo/>
Nov 29 16:10:04 user nova-compute[75245]:   </features>
Nov 29 16:10:04 user nova-compute[75245]:   <clock offset="utc">
Nov 29 16:10:04 user nova-compute[75245]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 16:10:04 user nova-compute[75245]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 16:10:04 user nova-compute[75245]:     <timer name="hpet" present="no"/>
Nov 29 16:10:04 user nova-compute[75245]:   </clock>
Nov 29 16:10:04 user nova-compute[75245]:   <cpu mode="custom" match="exact">
Nov 29 16:10:04 user nova-compute[75245]:     <model>Nehalem</model>
Nov 29 16:10:04 user nova-compute[75245]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 16:10:04 user nova-compute[75245]:   </cpu>
Nov 29 16:10:04 user nova-compute[75245]:   <devices>
Nov 29 16:10:04 user nova-compute[75245]:     <disk type="file" device="disk">
Nov 29 16:10:04 user nova-compute[75245]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 16:10:04 user nova-compute[75245]:       <source file="/opt/stack/data/nova/instances/6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7/disk"/>
Nov 29 16:10:04 user nova-compute[75245]:       <target dev="vda" bus="virtio"/>
Nov 29 16:10:04 user nova-compute[75245]:     </disk>
Nov 29 16:10:04 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 16:10:04 user nova-compute[75245]:       <mac address="fa:16:3e:cc:b6:56"/>
Nov 29 16:10:04 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:10:04 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 16:10:04 user nova-compute[75245]:       <target dev="tapde56e47e-57"/>
Nov 29 16:10:04 user nova-compute[75245]:     </interface>
Nov 29 16:10:04 user nova-compute[75245]:     <serial type="pty">
Nov 29 16:10:04 user nova-compute[75245]:       <log file="/opt/stack/data/nova/instances/6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7/console.log" append="off"/>
Nov 29 16:10:04 user nova-compute[75245]:     </serial>
Nov 29 16:10:04 user nova-compute[75245]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 16:10:04 user nova-compute[75245]:     <video>
Nov 29 16:10:04 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:10:04 user nova-compute[75245]:     </video>
Nov 29 16:10:04 user nova-compute[75245]:     <rng model="virtio">
Nov 29 16:10:04 user nova-compute[75245]:       <backend model="random">/dev/urandom</backend>
Nov 29 16:10:04 user nova-compute[75245]:     </rng>
Nov 29 16:10:04 user nova-compute[75245]:     <controller type="usb" index="0" model="none"/>
Nov 29 16:10:04 user nova-compute[75245]:     <memballoon model="virtio">
Nov 29 16:10:04 user nova-compute[75245]:       <stats period="10"/>
Nov 29 16:10:04 user nova-compute[75245]:     </memballoon>
Nov 29 16:10:04 user nova-compute[75245]:   </devices>
Nov 29 16:10:04 user nova-compute[75245]: </domain>
Nov 29 16:10:04 user nova-compute[75245]:  {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:09:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1366697277',display_name='tempest-ServersNegativeTestJSON-server-1366697277',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1366697277',id=2,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='17fcceabdcb74404971adda76fd4e48d',ramdisk_id='',reservation_id='r-mqw20ccf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1566439864',owner_user_name='tempest-ServersNegativeTestJSON-1566439864-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:10:00Z,user_data=None,user_id='97d9ea0d0a1842649850d631bed11ac1',uuid=6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de56e47e-57ae-4e15-9d07-57eca8971e14", "address": "fa:16:3e:cc:b6:56", "network": {"id": "04f30281-e256-4d60-82d2-89004740b1b8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-649945802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17fcceabdcb74404971adda76fd4e48d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde56e47e-57", "ovs_interfaceid": "de56e47e-57ae-4e15-9d07-57eca8971e14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Converting VIF {"id": "de56e47e-57ae-4e15-9d07-57eca8971e14", "address": "fa:16:3e:cc:b6:56", "network": {"id": "04f30281-e256-4d60-82d2-89004740b1b8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-649945802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17fcceabdcb74404971adda76fd4e48d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde56e47e-57", "ovs_interfaceid": "de56e47e-57ae-4e15-9d07-57eca8971e14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:b6:56,bridge_name='br-int',has_traffic_filtering=True,id=de56e47e-57ae-4e15-9d07-57eca8971e14,network=Network(04f30281-e256-4d60-82d2-89004740b1b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde56e47e-57') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG os_vif [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:b6:56,bridge_name='br-int',has_traffic_filtering=True,id=de56e47e-57ae-4e15-9d07-57eca8971e14,network=Network(04f30281-e256-4d60-82d2-89004740b1b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde56e47e-57') {{(pid=75245) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Created schema index Interface.name {{(pid=75245) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Created schema index Port.name {{(pid=75245) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Created schema index Bridge.name {{(pid=75245) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] [POLLOUT] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '39f2fc67-fedc-5542-9d61-7287cfa33447', '_type': 'linux-noop'}}, row=False) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG nova.network.neutron [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] [instance: 738c0d7a-af77-41f7-9206-0e6b1f18a154] Updating instance_info_cache with network_info: [{"id": "6868c459-7c16-48e4-8806-577f44063ef2", "address": "fa:16:3e:0f:8f:e0", "network": {"id": "04c28abb-e8e0-4147-aa0d-a9d58efbb016", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-93900798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f499a0ff13e421b88e2712a21784fe0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6868c459-7c", "ovs_interfaceid": "6868c459-7c16-48e4-8806-577f44063ef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:10:05 user nova-compute[75245]: INFO oslo.privsep.daemon [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpo_40twd0/privsep.sock']
Nov 29 16:10:05 user sudo[84583]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpo_40twd0/privsep.sock
Nov 29 16:10:05 user sudo[84583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 29 16:10:05 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Releasing lock "refresh_cache-738c0d7a-af77-41f7-9206-0e6b1f18a154" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG nova.compute.manager [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] [instance: 738c0d7a-af77-41f7-9206-0e6b1f18a154] Instance network_info: |[{"id": "6868c459-7c16-48e4-8806-577f44063ef2", "address": "fa:16:3e:0f:8f:e0", "network": {"id": "04c28abb-e8e0-4147-aa0d-a9d58efbb016", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-93900798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f499a0ff13e421b88e2712a21784fe0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6868c459-7c", "ovs_interfaceid": "6868c459-7c16-48e4-8806-577f44063ef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-e57808cb-dab0-4c75-acad-98798a19abda req-295c3293-49d1-4445-a3e8-7bf3b3aadf26 service nova] Acquired lock "refresh_cache-738c0d7a-af77-41f7-9206-0e6b1f18a154" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG nova.network.neutron [req-e57808cb-dab0-4c75-acad-98798a19abda req-295c3293-49d1-4445-a3e8-7bf3b3aadf26 service nova] [instance: 738c0d7a-af77-41f7-9206-0e6b1f18a154] Refreshing network info cache for port 6868c459-7c16-48e4-8806-577f44063ef2 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] [instance: 738c0d7a-af77-41f7-9206-0e6b1f18a154] Start _get_guest_xml network_info=[{"id": "6868c459-7c16-48e4-8806-577f44063ef2", "address": "fa:16:3e:0f:8f:e0", "network": {"id": "04c28abb-e8e0-4147-aa0d-a9d58efbb016", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-93900798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f499a0ff13e421b88e2712a21784fe0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6868c459-7c", "ovs_interfaceid": "6868c459-7c16-48e4-8806-577f44063ef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'a291d9c3-be02-4c6c-9649-4b45c5b7f487'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 16:10:05 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:10:05 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:10:05 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] CPU controller missing on host. {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] CPU controller found on host. {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75245) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T16:06:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Flavor limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Image limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Flavor pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Image pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Got 1 possible topologies {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:09:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-288100051',display_name='tempest-DeleteServersTestJSON-server-288100051',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-288100051',id=1,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f499a0ff13e421b88e2712a21784fe0',ramdisk_id='',reservation_id='r-ikzi9196',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1443860988',owner_user_name='tempest-DeleteServersTestJSON-1443860988-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:10:01Z,user_data=None,user_id='cde8c21d201447c09429d4e043050086',uuid=738c0d7a-af77-41f7-9206-0e6b1f18a154,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6868c459-7c16-48e4-8806-577f44063ef2", "address": "fa:16:3e:0f:8f:e0", "network": {"id": "04c28abb-e8e0-4147-aa0d-a9d58efbb016", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-93900798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f499a0ff13e421b88e2712a21784fe0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6868c459-7c", "ovs_interfaceid": "6868c459-7c16-48e4-8806-577f44063ef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Converting VIF {"id": "6868c459-7c16-48e4-8806-577f44063ef2", "address": "fa:16:3e:0f:8f:e0", "network": {"id": "04c28abb-e8e0-4147-aa0d-a9d58efbb016", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-93900798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f499a0ff13e421b88e2712a21784fe0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6868c459-7c", "ovs_interfaceid": "6868c459-7c16-48e4-8806-577f44063ef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:8f:e0,bridge_name='br-int',has_traffic_filtering=True,id=6868c459-7c16-48e4-8806-577f44063ef2,network=Network(04c28abb-e8e0-4147-aa0d-a9d58efbb016),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6868c459-7c') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG nova.objects.instance [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Lazy-loading 'pci_devices' on Instance uuid 738c0d7a-af77-41f7-9206-0e6b1f18a154 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.634s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG nova.compute.manager [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] Start building networks asynchronously for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.624s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] [instance: 738c0d7a-af77-41f7-9206-0e6b1f18a154] End _get_guest_xml xml=<domain type="kvm">
Nov 29 16:10:05 user nova-compute[75245]:   <uuid>738c0d7a-af77-41f7-9206-0e6b1f18a154</uuid>
Nov 29 16:10:05 user nova-compute[75245]:   <name>instance-00000001</name>
Nov 29 16:10:05 user nova-compute[75245]:   <memory>524288</memory>
Nov 29 16:10:05 user nova-compute[75245]:   <vcpu>1</vcpu>
Nov 29 16:10:05 user nova-compute[75245]:   <metadata>
Nov 29 16:10:05 user nova-compute[75245]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 16:10:05 user nova-compute[75245]:       <nova:package version="0.0.0"/>
Nov 29 16:10:05 user nova-compute[75245]:       <nova:name>tempest-DeleteServersTestJSON-server-288100051</nova:name>
Nov 29 16:10:05 user nova-compute[75245]:       <nova:creationTime>2023-11-29 16:10:05</nova:creationTime>
Nov 29 16:10:05 user nova-compute[75245]:       <nova:flavor name="m1.tiny">
Nov 29 16:10:05 user nova-compute[75245]:         <nova:memory>512</nova:memory>
Nov 29 16:10:05 user nova-compute[75245]:         <nova:disk>1</nova:disk>
Nov 29 16:10:05 user nova-compute[75245]:         <nova:swap>0</nova:swap>
Nov 29 16:10:05 user nova-compute[75245]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 16:10:05 user nova-compute[75245]:         <nova:vcpus>1</nova:vcpus>
Nov 29 16:10:05 user nova-compute[75245]:       </nova:flavor>
Nov 29 16:10:05 user nova-compute[75245]:       <nova:owner>
Nov 29 16:10:05 user nova-compute[75245]:         <nova:user uuid="cde8c21d201447c09429d4e043050086">tempest-DeleteServersTestJSON-1443860988-project-member</nova:user>
Nov 29 16:10:05 user nova-compute[75245]:         <nova:project uuid="6f499a0ff13e421b88e2712a21784fe0">tempest-DeleteServersTestJSON-1443860988</nova:project>
Nov 29 16:10:05 user nova-compute[75245]:       </nova:owner>
Nov 29 16:10:05 user nova-compute[75245]:       <nova:root type="image" uuid="a291d9c3-be02-4c6c-9649-4b45c5b7f487"/>
Nov 29 16:10:05 user nova-compute[75245]:       <nova:ports>
Nov 29 16:10:05 user nova-compute[75245]:         <nova:port uuid="6868c459-7c16-48e4-8806-577f44063ef2">
Nov 29 16:10:05 user nova-compute[75245]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 29 16:10:05 user nova-compute[75245]:         </nova:port>
Nov 29 16:10:05 user nova-compute[75245]:       </nova:ports>
Nov 29 16:10:05 user nova-compute[75245]:     </nova:instance>
Nov 29 16:10:05 user nova-compute[75245]:   </metadata>
Nov 29 16:10:05 user nova-compute[75245]:   <sysinfo type="smbios">
Nov 29 16:10:05 user nova-compute[75245]:     <system>
Nov 29 16:10:05 user nova-compute[75245]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 16:10:05 user nova-compute[75245]:       <entry name="product">OpenStack Nova</entry>
Nov 29 16:10:05 user nova-compute[75245]:       <entry name="version">0.0.0</entry>
Nov 29 16:10:05 user nova-compute[75245]:       <entry name="serial">738c0d7a-af77-41f7-9206-0e6b1f18a154</entry>
Nov 29 16:10:05 user nova-compute[75245]:       <entry name="uuid">738c0d7a-af77-41f7-9206-0e6b1f18a154</entry>
Nov 29 16:10:05 user nova-compute[75245]:       <entry name="family">Virtual Machine</entry>
Nov 29 16:10:05 user nova-compute[75245]:     </system>
Nov 29 16:10:05 user nova-compute[75245]:   </sysinfo>
Nov 29 16:10:05 user nova-compute[75245]:   <os>
Nov 29 16:10:05 user nova-compute[75245]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 16:10:05 user nova-compute[75245]:     <boot dev="hd"/>
Nov 29 16:10:05 user nova-compute[75245]:     <smbios mode="sysinfo"/>
Nov 29 16:10:05 user nova-compute[75245]:   </os>
Nov 29 16:10:05 user nova-compute[75245]:   <features>
Nov 29 16:10:05 user nova-compute[75245]:     <acpi/>
Nov 29 16:10:05 user nova-compute[75245]:     <apic/>
Nov 29 16:10:05 user nova-compute[75245]:     <vmcoreinfo/>
Nov 29 16:10:05 user nova-compute[75245]:   </features>
Nov 29 16:10:05 user nova-compute[75245]:   <clock offset="utc">
Nov 29 16:10:05 user nova-compute[75245]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 16:10:05 user nova-compute[75245]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 16:10:05 user nova-compute[75245]:     <timer name="hpet" present="no"/>
Nov 29 16:10:05 user nova-compute[75245]:   </clock>
Nov 29 16:10:05 user nova-compute[75245]:   <cpu mode="custom" match="exact">
Nov 29 16:10:05 user nova-compute[75245]:     <model>Nehalem</model>
Nov 29 16:10:05 user nova-compute[75245]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 16:10:05 user nova-compute[75245]:   </cpu>
Nov 29 16:10:05 user nova-compute[75245]:   <devices>
Nov 29 16:10:05 user nova-compute[75245]:     <disk type="file" device="disk">
Nov 29 16:10:05 user nova-compute[75245]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 16:10:05 user nova-compute[75245]:       <source file="/opt/stack/data/nova/instances/738c0d7a-af77-41f7-9206-0e6b1f18a154/disk"/>
Nov 29 16:10:05 user nova-compute[75245]:       <target dev="vda" bus="virtio"/>
Nov 29 16:10:05 user nova-compute[75245]:     </disk>
Nov 29 16:10:05 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 16:10:05 user nova-compute[75245]:       <mac address="fa:16:3e:0f:8f:e0"/>
Nov 29 16:10:05 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:10:05 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 16:10:05 user nova-compute[75245]:       <target dev="tap6868c459-7c"/>
Nov 29 16:10:05 user nova-compute[75245]:     </interface>
Nov 29 16:10:05 user nova-compute[75245]:     <serial type="pty">
Nov 29 16:10:05 user nova-compute[75245]:       <log file="/opt/stack/data/nova/instances/738c0d7a-af77-41f7-9206-0e6b1f18a154/console.log" append="off"/>
Nov 29 16:10:05 user nova-compute[75245]:     </serial>
Nov 29 16:10:05 user nova-compute[75245]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 16:10:05 user nova-compute[75245]:     <video>
Nov 29 16:10:05 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:10:05 user nova-compute[75245]:     </video>
Nov 29 16:10:05 user nova-compute[75245]:     <rng model="virtio">
Nov 29 16:10:05 user nova-compute[75245]:       <backend model="random">/dev/urandom</backend>
Nov 29 16:10:05 user nova-compute[75245]:     </rng>
Nov 29 16:10:05 user nova-compute[75245]:     <controller type="usb" index="0" model="none"/>
Nov 29 16:10:05 user nova-compute[75245]:     <memballoon model="virtio">
Nov 29 16:10:05 user nova-compute[75245]:       <stats period="10"/>
Nov 29 16:10:05 user nova-compute[75245]:     </memballoon>
Nov 29 16:10:05 user nova-compute[75245]:   </devices>
Nov 29 16:10:05 user nova-compute[75245]: </domain>
Nov 29 16:10:05 user nova-compute[75245]:  {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:09:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-288100051',display_name='tempest-DeleteServersTestJSON-server-288100051',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-288100051',id=1,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f499a0ff13e421b88e2712a21784fe0',ramdisk_id='',reservation_id='r-ikzi9196',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1443860988',owner_user_name='tempest-DeleteServersTestJSON-1443860988-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:10:01Z,user_data=None,user_id='cde8c21d201447c09429d4e043050086',uuid=738c0d7a-af77-41f7-9206-0e6b1f18a154,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6868c459-7c16-48e4-8806-577f44063ef2", "address": "fa:16:3e:0f:8f:e0", "network": {"id": "04c28abb-e8e0-4147-aa0d-a9d58efbb016", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-93900798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f499a0ff13e421b88e2712a21784fe0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6868c459-7c", "ovs_interfaceid": "6868c459-7c16-48e4-8806-577f44063ef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Converting VIF {"id": "6868c459-7c16-48e4-8806-577f44063ef2", "address": "fa:16:3e:0f:8f:e0", "network": {"id": "04c28abb-e8e0-4147-aa0d-a9d58efbb016", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-93900798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f499a0ff13e421b88e2712a21784fe0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6868c459-7c", "ovs_interfaceid": "6868c459-7c16-48e4-8806-577f44063ef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:8f:e0,bridge_name='br-int',has_traffic_filtering=True,id=6868c459-7c16-48e4-8806-577f44063ef2,network=Network(04c28abb-e8e0-4147-aa0d-a9d58efbb016),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6868c459-7c') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG os_vif [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:8f:e0,bridge_name='br-int',has_traffic_filtering=True,id=6868c459-7c16-48e4-8806-577f44063ef2,network=Network(04c28abb-e8e0-4147-aa0d-a9d58efbb016),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6868c459-7c') {{(pid=75245) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '22d75789-4cc6-5e95-a521-8a4fe83722c4', '_type': 'linux-noop'}}, row=False) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75245) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 16:10:05 user nova-compute[75245]: INFO nova.compute.claims [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Claim successful on node user
Nov 29 16:10:05 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG nova.compute.manager [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] Allocating IP information in the background. {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG nova.network.neutron [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] allocate_for_instance() {{(pid=75245) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 16:10:05 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 16:10:05 user nova-compute[75245]: DEBUG nova.compute.manager [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] Start building block device mappings for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG nova.compute.manager [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] Start spawning the instance on the hypervisor. {{(pid=75245) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] Creating instance directory {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 16:10:05 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] Creating image(s)
Nov 29 16:10:05 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Acquiring lock "/opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "/opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "/opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG nova.policy [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'be595c3f7084413180f2ab86e9c56a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6b87e18ef1f48d19a6907b28cb54f04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75245) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.453s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG nova.compute.manager [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Start building networks asynchronously for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.163s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Acquiring lock "d654f7206043e05d3525550b0fc885556eb999f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG nova.compute.manager [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Allocating IP information in the background. {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG nova.network.neutron [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] allocate_for_instance() {{(pid=75245) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 16:10:05 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 16:10:05 user nova-compute[75245]: DEBUG nova.compute.manager [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Start building block device mappings for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG nova.network.neutron [req-944dd9a8-7fff-4577-a5ee-66e8285bf11d req-eb439240-e501-4edb-bc23-16901218a3f9 service nova] [instance: 6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7] Updated VIF entry in instance network info cache for port de56e47e-57ae-4e15-9d07-57eca8971e14. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG nova.network.neutron [req-944dd9a8-7fff-4577-a5ee-66e8285bf11d req-eb439240-e501-4edb-bc23-16901218a3f9 service nova] [instance: 6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7] Updating instance_info_cache with network_info: [{"id": "de56e47e-57ae-4e15-9d07-57eca8971e14", "address": "fa:16:3e:cc:b6:56", "network": {"id": "04f30281-e256-4d60-82d2-89004740b1b8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-649945802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17fcceabdcb74404971adda76fd4e48d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde56e47e-57", "ovs_interfaceid": "de56e47e-57ae-4e15-9d07-57eca8971e14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.202s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk 1073741824 {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG nova.policy [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7c4942f948584702a8c8b93248694a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd22948fbd074a7c94d8ad7614fbc220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75245) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-944dd9a8-7fff-4577-a5ee-66e8285bf11d req-eb439240-e501-4edb-bc23-16901218a3f9 service nova] Releasing lock "refresh_cache-6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk 1073741824" returned: 0 in 0.070s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.277s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:10:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:10:06 user nova-compute[75245]: DEBUG nova.compute.manager [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Start spawning the instance on the hypervisor. {{(pid=75245) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 16:10:06 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Creating instance directory {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 16:10:06 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Creating image(s)
Nov 29 16:10:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Acquiring lock "/opt/stack/data/nova/instances/3ab9d7cd-79cd-4c9b-8608-c1ef0f333305/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:10:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lock "/opt/stack/data/nova/instances/3ab9d7cd-79cd-4c9b-8608-c1ef0f333305/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:10:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lock "/opt/stack/data/nova/instances/3ab9d7cd-79cd-4c9b-8608-c1ef0f333305/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:10:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:10:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.185s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:10:06 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk. size=1073741824 {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 16:10:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:10:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.192s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:10:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Acquiring lock "d654f7206043e05d3525550b0fc885556eb999f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:10:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:10:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:10:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:10:06 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Cannot resize image /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk to a smaller size. {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 16:10:06 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] Created local disks {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 16:10:06 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] Ensure instance console log exists: /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/console.log {{(pid=75245) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 16:10:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:10:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:10:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:10:06 user nova-compute[75245]: DEBUG nova.network.neutron [req-e57808cb-dab0-4c75-acad-98798a19abda req-295c3293-49d1-4445-a3e8-7bf3b3aadf26 service nova] [instance: 738c0d7a-af77-41f7-9206-0e6b1f18a154] Updated VIF entry in instance network info cache for port 6868c459-7c16-48e4-8806-577f44063ef2. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:10:06 user nova-compute[75245]: DEBUG nova.network.neutron [req-e57808cb-dab0-4c75-acad-98798a19abda req-295c3293-49d1-4445-a3e8-7bf3b3aadf26 service nova] [instance: 738c0d7a-af77-41f7-9206-0e6b1f18a154] Updating instance_info_cache with network_info: [{"id": "6868c459-7c16-48e4-8806-577f44063ef2", "address": "fa:16:3e:0f:8f:e0", "network": {"id": "04c28abb-e8e0-4147-aa0d-a9d58efbb016", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-93900798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f499a0ff13e421b88e2712a21784fe0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6868c459-7c", "ovs_interfaceid": "6868c459-7c16-48e4-8806-577f44063ef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:10:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.221s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:10:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/3ab9d7cd-79cd-4c9b-8608-c1ef0f333305/disk 1073741824 {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:10:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-e57808cb-dab0-4c75-acad-98798a19abda req-295c3293-49d1-4445-a3e8-7bf3b3aadf26 service nova] Releasing lock "refresh_cache-738c0d7a-af77-41f7-9206-0e6b1f18a154" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:10:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/3ab9d7cd-79cd-4c9b-8608-c1ef0f333305/disk 1073741824" returned: 0 in 0.070s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:10:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.296s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:10:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:10:06 user sudo[84583]: pam_unix(sudo:session): session closed for user root
Nov 29 16:10:06 user nova-compute[75245]: INFO oslo.privsep.daemon [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Spawned new privsep daemon via rootwrap
Nov 29 16:10:06 user nova-compute[75245]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 29 16:10:06 user nova-compute[75245]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 29 16:10:06 user nova-compute[75245]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 29 16:10:06 user nova-compute[75245]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84608
Nov 29 16:10:06 user nova-compute[75245]: WARNING oslo_privsep.priv_context [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] privsep daemon already running
Nov 29 16:10:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.187s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:10:06 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3ab9d7cd-79cd-4c9b-8608-c1ef0f333305/disk. size=1073741824 {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 16:10:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ab9d7cd-79cd-4c9b-8608-c1ef0f333305/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:10:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ab9d7cd-79cd-4c9b-8608-c1ef0f333305/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:10:06 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Cannot resize image /opt/stack/data/nova/instances/3ab9d7cd-79cd-4c9b-8608-c1ef0f333305/disk to a smaller size. {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 16:10:06 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Created local disks {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 16:10:06 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Ensure instance console log exists: /opt/stack/data/nova/instances/3ab9d7cd-79cd-4c9b-8608-c1ef0f333305/console.log {{(pid=75245) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 16:10:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:10:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:10:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:10:07 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:07 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapde56e47e-57, may_exist=True, interface_attrs={}) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:10:07 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapde56e47e-57, col_values=(('qos', UUID('dae1e128-df4e-4693-ac27-db848fb4a53d')),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:10:07 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapde56e47e-57, col_values=(('external_ids', {'iface-id': 'de56e47e-57ae-4e15-9d07-57eca8971e14', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:b6:56', 'vm-uuid': '6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7'}),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:10:07 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:07 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:10:07 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:07 user nova-compute[75245]: INFO os_vif [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:b6:56,bridge_name='br-int',has_traffic_filtering=True,id=de56e47e-57ae-4e15-9d07-57eca8971e14,network=Network(04f30281-e256-4d60-82d2-89004740b1b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde56e47e-57')
Nov 29 16:10:07 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:07 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6868c459-7c, may_exist=True, interface_attrs={}) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:10:07 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6868c459-7c, col_values=(('qos', UUID('568bb8c5-52cf-46a0-bee2-ae4392481b83')),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:10:07 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6868c459-7c, col_values=(('external_ids', {'iface-id': '6868c459-7c16-48e4-8806-577f44063ef2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:8f:e0', 'vm-uuid': '738c0d7a-af77-41f7-9206-0e6b1f18a154'}),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:10:07 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:07 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:10:07 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:07 user nova-compute[75245]: INFO os_vif [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:8f:e0,bridge_name='br-int',has_traffic_filtering=True,id=6868c459-7c16-48e4-8806-577f44063ef2,network=Network(04c28abb-e8e0-4147-aa0d-a9d58efbb016),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6868c459-7c')
Nov 29 16:10:07 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:10:07 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] No VIF found with MAC fa:16:3e:cc:b6:56, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:10:07 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:10:07 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] No VIF found with MAC fa:16:3e:0f:8f:e0, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:10:07 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:08 user nova-compute[75245]: DEBUG nova.network.neutron [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] Successfully created port: c72edead-bad2-45c4-9ac8-90dd2a4f8ed5 {{(pid=75245) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 16:10:08 user nova-compute[75245]: DEBUG nova.network.neutron [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Successfully created port: 0b3a82cf-e1cb-455a-9f59-853505903560 {{(pid=75245) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 16:10:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:10 user nova-compute[75245]: DEBUG nova.network.neutron [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] Successfully updated port: c72edead-bad2-45c4-9ac8-90dd2a4f8ed5 {{(pid=75245) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 16:10:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Acquiring lock "refresh_cache-ed9a6a4e-2e7d-443c-82ef-f14f11d32c81" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:10:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Acquired lock "refresh_cache-ed9a6a4e-2e7d-443c-82ef-f14f11d32c81" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:10:11 user nova-compute[75245]: DEBUG nova.network.neutron [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 16:10:11 user nova-compute[75245]: DEBUG nova.compute.manager [req-929b881c-f069-4773-9ced-8e2254204c30 req-38f771b0-9305-4c63-bb82-e24c22581d93 service nova] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] Received event network-changed-c72edead-bad2-45c4-9ac8-90dd2a4f8ed5 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:10:11 user nova-compute[75245]: DEBUG nova.compute.manager [req-929b881c-f069-4773-9ced-8e2254204c30 req-38f771b0-9305-4c63-bb82-e24c22581d93 service nova] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] Refreshing instance network info cache due to event network-changed-c72edead-bad2-45c4-9ac8-90dd2a4f8ed5. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:10:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-929b881c-f069-4773-9ced-8e2254204c30 req-38f771b0-9305-4c63-bb82-e24c22581d93 service nova] Acquiring lock "refresh_cache-ed9a6a4e-2e7d-443c-82ef-f14f11d32c81" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:10:11 user nova-compute[75245]: DEBUG nova.network.neutron [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Successfully updated port: 0b3a82cf-e1cb-455a-9f59-853505903560 {{(pid=75245) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 16:10:11 user nova-compute[75245]: DEBUG nova.network.neutron [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] Instance cache missing network info. {{(pid=75245) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 16:10:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Acquiring lock "refresh_cache-3ab9d7cd-79cd-4c9b-8608-c1ef0f333305" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:10:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Acquired lock "refresh_cache-3ab9d7cd-79cd-4c9b-8608-c1ef0f333305" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:10:11 user nova-compute[75245]: DEBUG nova.network.neutron [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 16:10:11 user nova-compute[75245]: DEBUG nova.network.neutron [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Instance cache missing network info. {{(pid=75245) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG nova.network.neutron [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] Updating instance_info_cache with network_info: [{"id": "c72edead-bad2-45c4-9ac8-90dd2a4f8ed5", "address": "fa:16:3e:bb:74:67", "network": {"id": "f1fac2f4-e789-443e-b6a5-1a3f829bc302", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1199431077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6b87e18ef1f48d19a6907b28cb54f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc72edead-ba", "ovs_interfaceid": "c72edead-bad2-45c4-9ac8-90dd2a4f8ed5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Releasing lock "refresh_cache-ed9a6a4e-2e7d-443c-82ef-f14f11d32c81" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG nova.compute.manager [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] Instance network_info: |[{"id": "c72edead-bad2-45c4-9ac8-90dd2a4f8ed5", "address": "fa:16:3e:bb:74:67", "network": {"id": "f1fac2f4-e789-443e-b6a5-1a3f829bc302", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1199431077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6b87e18ef1f48d19a6907b28cb54f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc72edead-ba", "ovs_interfaceid": "c72edead-bad2-45c4-9ac8-90dd2a4f8ed5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-929b881c-f069-4773-9ced-8e2254204c30 req-38f771b0-9305-4c63-bb82-e24c22581d93 service nova] Acquired lock "refresh_cache-ed9a6a4e-2e7d-443c-82ef-f14f11d32c81" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG nova.network.neutron [req-929b881c-f069-4773-9ced-8e2254204c30 req-38f771b0-9305-4c63-bb82-e24c22581d93 service nova] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] Refreshing network info cache for port c72edead-bad2-45c4-9ac8-90dd2a4f8ed5 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] Start _get_guest_xml network_info=[{"id": "c72edead-bad2-45c4-9ac8-90dd2a4f8ed5", "address": "fa:16:3e:bb:74:67", "network": {"id": "f1fac2f4-e789-443e-b6a5-1a3f829bc302", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1199431077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6b87e18ef1f48d19a6907b28cb54f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc72edead-ba", "ovs_interfaceid": "c72edead-bad2-45c4-9ac8-90dd2a4f8ed5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'a291d9c3-be02-4c6c-9649-4b45c5b7f487'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 16:10:12 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:10:12 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:10:12 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] CPU controller missing on host. {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] CPU controller found on host. {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75245) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T16:06:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Flavor limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Image limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Flavor pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Image pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Got 1 possible topologies {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:10:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-770743428',display_name='tempest-ServerActionsTestOtherA-server-770743428',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-770743428',id=3,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBlv185nmJa9KBQWtd25ahGt24w8RxLoAajuGL7vBUTHaz3jTQraFsqx3MIOXaCnGwG9vPuUxlhI7TdDBUzC5IxITSYROv0nohB5+qOZUd0Imt2qi6DOpY2ZQc/HDcV0+g==',key_name='tempest-keypair-7729748',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6b87e18ef1f48d19a6907b28cb54f04',ramdisk_id='',reservation_id='r-ltass5rn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1840344781',owner_user_name='tempest-ServerActionsTestOtherA-1840344781-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:10:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be595c3f7084413180f2ab86e9c56a64',uuid=ed9a6a4e-2e7d-443c-82ef-f14f11d32c81,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c72edead-bad2-45c4-9ac8-90dd2a4f8ed5", "address": "fa:16:3e:bb:74:67", "network": {"id": "f1fac2f4-e789-443e-b6a5-1a3f829bc302", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1199431077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6b87e18ef1f48d19a6907b28cb54f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc72edead-ba", "ovs_interfaceid": "c72edead-bad2-45c4-9ac8-90dd2a4f8ed5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Converting VIF {"id": "c72edead-bad2-45c4-9ac8-90dd2a4f8ed5", "address": "fa:16:3e:bb:74:67", "network": {"id": "f1fac2f4-e789-443e-b6a5-1a3f829bc302", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1199431077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6b87e18ef1f48d19a6907b28cb54f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc72edead-ba", "ovs_interfaceid": "c72edead-bad2-45c4-9ac8-90dd2a4f8ed5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:74:67,bridge_name='br-int',has_traffic_filtering=True,id=c72edead-bad2-45c4-9ac8-90dd2a4f8ed5,network=Network(f1fac2f4-e789-443e-b6a5-1a3f829bc302),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc72edead-ba') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG nova.objects.instance [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lazy-loading 'pci_devices' on Instance uuid ed9a6a4e-2e7d-443c-82ef-f14f11d32c81 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG nova.compute.manager [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] [instance: 6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7] Instance event wait completed in 0 seconds for  {{(pid=75245) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] [instance: 6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7] Guest created on hypervisor {{(pid=75245) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG nova.compute.manager [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] [instance: 738c0d7a-af77-41f7-9206-0e6b1f18a154] Instance event wait completed in 0 seconds for  {{(pid=75245) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] [instance: 738c0d7a-af77-41f7-9206-0e6b1f18a154] Guest created on hypervisor {{(pid=75245) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] End _get_guest_xml xml=<domain type="kvm">
Nov 29 16:10:12 user nova-compute[75245]:   <uuid>ed9a6a4e-2e7d-443c-82ef-f14f11d32c81</uuid>
Nov 29 16:10:12 user nova-compute[75245]:   <name>instance-00000003</name>
Nov 29 16:10:12 user nova-compute[75245]:   <memory>524288</memory>
Nov 29 16:10:12 user nova-compute[75245]:   <vcpu>1</vcpu>
Nov 29 16:10:12 user nova-compute[75245]:   <metadata>
Nov 29 16:10:12 user nova-compute[75245]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 16:10:12 user nova-compute[75245]:       <nova:package version="0.0.0"/>
Nov 29 16:10:12 user nova-compute[75245]:       <nova:name>tempest-ServerActionsTestOtherA-server-770743428</nova:name>
Nov 29 16:10:12 user nova-compute[75245]:       <nova:creationTime>2023-11-29 16:10:12</nova:creationTime>
Nov 29 16:10:12 user nova-compute[75245]:       <nova:flavor name="m1.tiny">
Nov 29 16:10:12 user nova-compute[75245]:         <nova:memory>512</nova:memory>
Nov 29 16:10:12 user nova-compute[75245]:         <nova:disk>1</nova:disk>
Nov 29 16:10:12 user nova-compute[75245]:         <nova:swap>0</nova:swap>
Nov 29 16:10:12 user nova-compute[75245]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 16:10:12 user nova-compute[75245]:         <nova:vcpus>1</nova:vcpus>
Nov 29 16:10:12 user nova-compute[75245]:       </nova:flavor>
Nov 29 16:10:12 user nova-compute[75245]:       <nova:owner>
Nov 29 16:10:12 user nova-compute[75245]:         <nova:user uuid="be595c3f7084413180f2ab86e9c56a64">tempest-ServerActionsTestOtherA-1840344781-project-member</nova:user>
Nov 29 16:10:12 user nova-compute[75245]:         <nova:project uuid="c6b87e18ef1f48d19a6907b28cb54f04">tempest-ServerActionsTestOtherA-1840344781</nova:project>
Nov 29 16:10:12 user nova-compute[75245]:       </nova:owner>
Nov 29 16:10:12 user nova-compute[75245]:       <nova:root type="image" uuid="a291d9c3-be02-4c6c-9649-4b45c5b7f487"/>
Nov 29 16:10:12 user nova-compute[75245]:       <nova:ports>
Nov 29 16:10:12 user nova-compute[75245]:         <nova:port uuid="c72edead-bad2-45c4-9ac8-90dd2a4f8ed5">
Nov 29 16:10:12 user nova-compute[75245]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 29 16:10:12 user nova-compute[75245]:         </nova:port>
Nov 29 16:10:12 user nova-compute[75245]:       </nova:ports>
Nov 29 16:10:12 user nova-compute[75245]:     </nova:instance>
Nov 29 16:10:12 user nova-compute[75245]:   </metadata>
Nov 29 16:10:12 user nova-compute[75245]:   <sysinfo type="smbios">
Nov 29 16:10:12 user nova-compute[75245]:     <system>
Nov 29 16:10:12 user nova-compute[75245]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 16:10:12 user nova-compute[75245]:       <entry name="product">OpenStack Nova</entry>
Nov 29 16:10:12 user nova-compute[75245]:       <entry name="version">0.0.0</entry>
Nov 29 16:10:12 user nova-compute[75245]:       <entry name="serial">ed9a6a4e-2e7d-443c-82ef-f14f11d32c81</entry>
Nov 29 16:10:12 user nova-compute[75245]:       <entry name="uuid">ed9a6a4e-2e7d-443c-82ef-f14f11d32c81</entry>
Nov 29 16:10:12 user nova-compute[75245]:       <entry name="family">Virtual Machine</entry>
Nov 29 16:10:12 user nova-compute[75245]:     </system>
Nov 29 16:10:12 user nova-compute[75245]:   </sysinfo>
Nov 29 16:10:12 user nova-compute[75245]:   <os>
Nov 29 16:10:12 user nova-compute[75245]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 16:10:12 user nova-compute[75245]:     <boot dev="hd"/>
Nov 29 16:10:12 user nova-compute[75245]:     <smbios mode="sysinfo"/>
Nov 29 16:10:12 user nova-compute[75245]:   </os>
Nov 29 16:10:12 user nova-compute[75245]:   <features>
Nov 29 16:10:12 user nova-compute[75245]:     <acpi/>
Nov 29 16:10:12 user nova-compute[75245]:     <apic/>
Nov 29 16:10:12 user nova-compute[75245]:     <vmcoreinfo/>
Nov 29 16:10:12 user nova-compute[75245]:   </features>
Nov 29 16:10:12 user nova-compute[75245]:   <clock offset="utc">
Nov 29 16:10:12 user nova-compute[75245]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 16:10:12 user nova-compute[75245]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 16:10:12 user nova-compute[75245]:     <timer name="hpet" present="no"/>
Nov 29 16:10:12 user nova-compute[75245]:   </clock>
Nov 29 16:10:12 user nova-compute[75245]:   <cpu mode="custom" match="exact">
Nov 29 16:10:12 user nova-compute[75245]:     <model>Nehalem</model>
Nov 29 16:10:12 user nova-compute[75245]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 16:10:12 user nova-compute[75245]:   </cpu>
Nov 29 16:10:12 user nova-compute[75245]:   <devices>
Nov 29 16:10:12 user nova-compute[75245]:     <disk type="file" device="disk">
Nov 29 16:10:12 user nova-compute[75245]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 16:10:12 user nova-compute[75245]:       <source file="/opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk"/>
Nov 29 16:10:12 user nova-compute[75245]:       <target dev="vda" bus="virtio"/>
Nov 29 16:10:12 user nova-compute[75245]:     </disk>
Nov 29 16:10:12 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 16:10:12 user nova-compute[75245]:       <mac address="fa:16:3e:bb:74:67"/>
Nov 29 16:10:12 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:10:12 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 16:10:12 user nova-compute[75245]:       <target dev="tapc72edead-ba"/>
Nov 29 16:10:12 user nova-compute[75245]:     </interface>
Nov 29 16:10:12 user nova-compute[75245]:     <serial type="pty">
Nov 29 16:10:12 user nova-compute[75245]:       <log file="/opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/console.log" append="off"/>
Nov 29 16:10:12 user nova-compute[75245]:     </serial>
Nov 29 16:10:12 user nova-compute[75245]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 16:10:12 user nova-compute[75245]:     <video>
Nov 29 16:10:12 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:10:12 user nova-compute[75245]:     </video>
Nov 29 16:10:12 user nova-compute[75245]:     <rng model="virtio">
Nov 29 16:10:12 user nova-compute[75245]:       <backend model="random">/dev/urandom</backend>
Nov 29 16:10:12 user nova-compute[75245]:     </rng>
Nov 29 16:10:12 user nova-compute[75245]:     <controller type="usb" index="0" model="none"/>
Nov 29 16:10:12 user nova-compute[75245]:     <memballoon model="virtio">
Nov 29 16:10:12 user nova-compute[75245]:       <stats period="10"/>
Nov 29 16:10:12 user nova-compute[75245]:     </memballoon>
Nov 29 16:10:12 user nova-compute[75245]:   </devices>
Nov 29 16:10:12 user nova-compute[75245]: </domain>
Nov 29 16:10:12 user nova-compute[75245]:  {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:10:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-770743428',display_name='tempest-ServerActionsTestOtherA-server-770743428',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-770743428',id=3,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBlv185nmJa9KBQWtd25ahGt24w8RxLoAajuGL7vBUTHaz3jTQraFsqx3MIOXaCnGwG9vPuUxlhI7TdDBUzC5IxITSYROv0nohB5+qOZUd0Imt2qi6DOpY2ZQc/HDcV0+g==',key_name='tempest-keypair-7729748',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6b87e18ef1f48d19a6907b28cb54f04',ramdisk_id='',reservation_id='r-ltass5rn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1840344781',owner_user_name='tempest-ServerActionsTestOtherA-1840344781-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:10:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be595c3f7084413180f2ab86e9c56a64',uuid=ed9a6a4e-2e7d-443c-82ef-f14f11d32c81,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c72edead-bad2-45c4-9ac8-90dd2a4f8ed5", "address": "fa:16:3e:bb:74:67", "network": {"id": "f1fac2f4-e789-443e-b6a5-1a3f829bc302", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1199431077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6b87e18ef1f48d19a6907b28cb54f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc72edead-ba", "ovs_interfaceid": "c72edead-bad2-45c4-9ac8-90dd2a4f8ed5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Converting VIF {"id": "c72edead-bad2-45c4-9ac8-90dd2a4f8ed5", "address": "fa:16:3e:bb:74:67", "network": {"id": "f1fac2f4-e789-443e-b6a5-1a3f829bc302", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1199431077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6b87e18ef1f48d19a6907b28cb54f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc72edead-ba", "ovs_interfaceid": "c72edead-bad2-45c4-9ac8-90dd2a4f8ed5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:74:67,bridge_name='br-int',has_traffic_filtering=True,id=c72edead-bad2-45c4-9ac8-90dd2a4f8ed5,network=Network(f1fac2f4-e789-443e-b6a5-1a3f829bc302),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc72edead-ba') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG os_vif [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:74:67,bridge_name='br-int',has_traffic_filtering=True,id=c72edead-bad2-45c4-9ac8-90dd2a4f8ed5,network=Network(f1fac2f4-e789-443e-b6a5-1a3f829bc302),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc72edead-ba') {{(pid=75245) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG nova.network.neutron [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Updating instance_info_cache with network_info: [{"id": "0b3a82cf-e1cb-455a-9f59-853505903560", "address": "fa:16:3e:72:f8:5e", "network": {"id": "7f978dee-8a5e-4218-b6fc-2d550c0d7b5d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-53637364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd22948fbd074a7c94d8ad7614fbc220", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b3a82cf-e1", "ovs_interfaceid": "0b3a82cf-e1cb-455a-9f59-853505903560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9e72f231-125e-553e-ab82-d6920fe5d289', '_type': 'linux-noop'}}, row=False) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:10:12 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7] Instance spawned successfully.
Nov 29 16:10:12 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] [instance: 6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 16:10:12 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 738c0d7a-af77-41f7-9206-0e6b1f18a154] Instance spawned successfully.
Nov 29 16:10:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Releasing lock "refresh_cache-3ab9d7cd-79cd-4c9b-8608-c1ef0f333305" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG nova.compute.manager [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Instance network_info: |[{"id": "0b3a82cf-e1cb-455a-9f59-853505903560", "address": "fa:16:3e:72:f8:5e", "network": {"id": "7f978dee-8a5e-4218-b6fc-2d550c0d7b5d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-53637364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd22948fbd074a7c94d8ad7614fbc220", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b3a82cf-e1", "ovs_interfaceid": "0b3a82cf-e1cb-455a-9f59-853505903560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc72edead-ba, may_exist=True, interface_attrs={}) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc72edead-ba, col_values=(('qos', UUID('496146bb-a85c-4d23-a6ee-bd8912c8a899')),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc72edead-ba, col_values=(('external_ids', {'iface-id': 'c72edead-bad2-45c4-9ac8-90dd2a4f8ed5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:74:67', 'vm-uuid': 'ed9a6a4e-2e7d-443c-82ef-f14f11d32c81'}),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] [instance: 738c0d7a-af77-41f7-9206-0e6b1f18a154] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Start _get_guest_xml network_info=[{"id": "0b3a82cf-e1cb-455a-9f59-853505903560", "address": "fa:16:3e:72:f8:5e", "network": {"id": "7f978dee-8a5e-4218-b6fc-2d550c0d7b5d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-53637364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd22948fbd074a7c94d8ad7614fbc220", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b3a82cf-e1", "ovs_interfaceid": "0b3a82cf-e1cb-455a-9f59-853505903560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'a291d9c3-be02-4c6c-9649-4b45c5b7f487'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:10:12 user nova-compute[75245]: INFO os_vif [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:74:67,bridge_name='br-int',has_traffic_filtering=True,id=c72edead-bad2-45c4-9ac8-90dd2a4f8ed5,network=Network(f1fac2f4-e789-443e-b6a5-1a3f829bc302),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc72edead-ba')
Nov 29 16:10:12 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] [instance: 6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7] Found default for hw_cdrom_bus of ide {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] [instance: 6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7] Found default for hw_disk_bus of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] [instance: 6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7] Found default for hw_input_bus of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] [instance: 6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7] Found default for hw_pointer_model of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] [instance: 6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7] Found default for hw_video_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] [instance: 6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7] Found default for hw_vif_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:10:12 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:10:12 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:10:12 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] [instance: 738c0d7a-af77-41f7-9206-0e6b1f18a154] Found default for hw_cdrom_bus of ide {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] [instance: 738c0d7a-af77-41f7-9206-0e6b1f18a154] Found default for hw_disk_bus of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] [instance: 738c0d7a-af77-41f7-9206-0e6b1f18a154] Found default for hw_input_bus of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] [instance: 738c0d7a-af77-41f7-9206-0e6b1f18a154] Found default for hw_pointer_model of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] [instance: 738c0d7a-af77-41f7-9206-0e6b1f18a154] Found default for hw_video_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] [instance: 738c0d7a-af77-41f7-9206-0e6b1f18a154] Found default for hw_vif_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] CPU controller missing on host. {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] CPU controller found on host. {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75245) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T16:06:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Flavor limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Image limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Flavor pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Image pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Got 1 possible topologies {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:10:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-723691220',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-723691220',id=4,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEoMJZt+VqMN0mavu3vY5Kvut5aAyigJQLII/9twNBGC/SlV5jkUl2w3ylxxIBa5TyZWx/7AEPJj5EkYaLXE+xUAT6uZbyatxvBvA6jxLyD3SeE/POApEcydBOMofkwZ3w==',key_name='tempest-keypair-353472592',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd22948fbd074a7c94d8ad7614fbc220',ramdisk_id='',reservation_id='r-k0lo301j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1524245296',owner_user_name='tempest-AttachVolumeShelveTestJSON-1524245296-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:10:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c4942f948584702a8c8b93248694a65',uuid=3ab9d7cd-79cd-4c9b-8608-c1ef0f333305,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b3a82cf-e1cb-455a-9f59-853505903560", "address": "fa:16:3e:72:f8:5e", "network": {"id": "7f978dee-8a5e-4218-b6fc-2d550c0d7b5d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-53637364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd22948fbd074a7c94d8ad7614fbc220", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b3a82cf-e1", "ovs_interfaceid": "0b3a82cf-e1cb-455a-9f59-853505903560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Converting VIF {"id": "0b3a82cf-e1cb-455a-9f59-853505903560", "address": "fa:16:3e:72:f8:5e", "network": {"id": "7f978dee-8a5e-4218-b6fc-2d550c0d7b5d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-53637364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd22948fbd074a7c94d8ad7614fbc220", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b3a82cf-e1", "ovs_interfaceid": "0b3a82cf-e1cb-455a-9f59-853505903560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:f8:5e,bridge_name='br-int',has_traffic_filtering=True,id=0b3a82cf-e1cb-455a-9f59-853505903560,network=Network(7f978dee-8a5e-4218-b6fc-2d550c0d7b5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b3a82cf-e1') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG nova.objects.instance [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lazy-loading 'pci_devices' on Instance uuid 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:10:12 user nova-compute[75245]: INFO nova.compute.manager [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] [instance: 6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7] Took 13.06 seconds to spawn the instance on the hypervisor.
Nov 29 16:10:12 user nova-compute[75245]: DEBUG nova.compute.manager [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] [instance: 6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] End _get_guest_xml xml=<domain type="kvm">
Nov 29 16:10:12 user nova-compute[75245]:   <uuid>3ab9d7cd-79cd-4c9b-8608-c1ef0f333305</uuid>
Nov 29 16:10:12 user nova-compute[75245]:   <name>instance-00000004</name>
Nov 29 16:10:12 user nova-compute[75245]:   <memory>524288</memory>
Nov 29 16:10:12 user nova-compute[75245]:   <vcpu>1</vcpu>
Nov 29 16:10:12 user nova-compute[75245]:   <metadata>
Nov 29 16:10:12 user nova-compute[75245]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 16:10:12 user nova-compute[75245]:       <nova:package version="0.0.0"/>
Nov 29 16:10:12 user nova-compute[75245]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-723691220</nova:name>
Nov 29 16:10:12 user nova-compute[75245]:       <nova:creationTime>2023-11-29 16:10:12</nova:creationTime>
Nov 29 16:10:12 user nova-compute[75245]:       <nova:flavor name="m1.tiny">
Nov 29 16:10:12 user nova-compute[75245]:         <nova:memory>512</nova:memory>
Nov 29 16:10:12 user nova-compute[75245]:         <nova:disk>1</nova:disk>
Nov 29 16:10:12 user nova-compute[75245]:         <nova:swap>0</nova:swap>
Nov 29 16:10:12 user nova-compute[75245]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 16:10:12 user nova-compute[75245]:         <nova:vcpus>1</nova:vcpus>
Nov 29 16:10:12 user nova-compute[75245]:       </nova:flavor>
Nov 29 16:10:12 user nova-compute[75245]:       <nova:owner>
Nov 29 16:10:12 user nova-compute[75245]:         <nova:user uuid="7c4942f948584702a8c8b93248694a65">tempest-AttachVolumeShelveTestJSON-1524245296-project-member</nova:user>
Nov 29 16:10:12 user nova-compute[75245]:         <nova:project uuid="fd22948fbd074a7c94d8ad7614fbc220">tempest-AttachVolumeShelveTestJSON-1524245296</nova:project>
Nov 29 16:10:12 user nova-compute[75245]:       </nova:owner>
Nov 29 16:10:12 user nova-compute[75245]:       <nova:root type="image" uuid="a291d9c3-be02-4c6c-9649-4b45c5b7f487"/>
Nov 29 16:10:12 user nova-compute[75245]:       <nova:ports>
Nov 29 16:10:12 user nova-compute[75245]:         <nova:port uuid="0b3a82cf-e1cb-455a-9f59-853505903560">
Nov 29 16:10:12 user nova-compute[75245]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 29 16:10:12 user nova-compute[75245]:         </nova:port>
Nov 29 16:10:12 user nova-compute[75245]:       </nova:ports>
Nov 29 16:10:12 user nova-compute[75245]:     </nova:instance>
Nov 29 16:10:12 user nova-compute[75245]:   </metadata>
Nov 29 16:10:12 user nova-compute[75245]:   <sysinfo type="smbios">
Nov 29 16:10:12 user nova-compute[75245]:     <system>
Nov 29 16:10:12 user nova-compute[75245]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 16:10:12 user nova-compute[75245]:       <entry name="product">OpenStack Nova</entry>
Nov 29 16:10:12 user nova-compute[75245]:       <entry name="version">0.0.0</entry>
Nov 29 16:10:12 user nova-compute[75245]:       <entry name="serial">3ab9d7cd-79cd-4c9b-8608-c1ef0f333305</entry>
Nov 29 16:10:12 user nova-compute[75245]:       <entry name="uuid">3ab9d7cd-79cd-4c9b-8608-c1ef0f333305</entry>
Nov 29 16:10:12 user nova-compute[75245]:       <entry name="family">Virtual Machine</entry>
Nov 29 16:10:12 user nova-compute[75245]:     </system>
Nov 29 16:10:12 user nova-compute[75245]:   </sysinfo>
Nov 29 16:10:12 user nova-compute[75245]:   <os>
Nov 29 16:10:12 user nova-compute[75245]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 16:10:12 user nova-compute[75245]:     <boot dev="hd"/>
Nov 29 16:10:12 user nova-compute[75245]:     <smbios mode="sysinfo"/>
Nov 29 16:10:12 user nova-compute[75245]:   </os>
Nov 29 16:10:12 user nova-compute[75245]:   <features>
Nov 29 16:10:12 user nova-compute[75245]:     <acpi/>
Nov 29 16:10:12 user nova-compute[75245]:     <apic/>
Nov 29 16:10:12 user nova-compute[75245]:     <vmcoreinfo/>
Nov 29 16:10:12 user nova-compute[75245]:   </features>
Nov 29 16:10:12 user nova-compute[75245]:   <clock offset="utc">
Nov 29 16:10:12 user nova-compute[75245]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 16:10:12 user nova-compute[75245]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 16:10:12 user nova-compute[75245]:     <timer name="hpet" present="no"/>
Nov 29 16:10:12 user nova-compute[75245]:   </clock>
Nov 29 16:10:12 user nova-compute[75245]:   <cpu mode="custom" match="exact">
Nov 29 16:10:12 user nova-compute[75245]:     <model>Nehalem</model>
Nov 29 16:10:12 user nova-compute[75245]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 16:10:12 user nova-compute[75245]:   </cpu>
Nov 29 16:10:12 user nova-compute[75245]:   <devices>
Nov 29 16:10:12 user nova-compute[75245]:     <disk type="file" device="disk">
Nov 29 16:10:12 user nova-compute[75245]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 16:10:12 user nova-compute[75245]:       <source file="/opt/stack/data/nova/instances/3ab9d7cd-79cd-4c9b-8608-c1ef0f333305/disk"/>
Nov 29 16:10:12 user nova-compute[75245]:       <target dev="vda" bus="virtio"/>
Nov 29 16:10:12 user nova-compute[75245]:     </disk>
Nov 29 16:10:12 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 16:10:12 user nova-compute[75245]:       <mac address="fa:16:3e:72:f8:5e"/>
Nov 29 16:10:12 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:10:12 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 16:10:12 user nova-compute[75245]:       <target dev="tap0b3a82cf-e1"/>
Nov 29 16:10:12 user nova-compute[75245]:     </interface>
Nov 29 16:10:12 user nova-compute[75245]:     <serial type="pty">
Nov 29 16:10:12 user nova-compute[75245]:       <log file="/opt/stack/data/nova/instances/3ab9d7cd-79cd-4c9b-8608-c1ef0f333305/console.log" append="off"/>
Nov 29 16:10:12 user nova-compute[75245]:     </serial>
Nov 29 16:10:12 user nova-compute[75245]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 16:10:12 user nova-compute[75245]:     <video>
Nov 29 16:10:12 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:10:12 user nova-compute[75245]:     </video>
Nov 29 16:10:12 user nova-compute[75245]:     <rng model="virtio">
Nov 29 16:10:12 user nova-compute[75245]:       <backend model="random">/dev/urandom</backend>
Nov 29 16:10:12 user nova-compute[75245]:     </rng>
Nov 29 16:10:12 user nova-compute[75245]:     <controller type="usb" index="0" model="none"/>
Nov 29 16:10:12 user nova-compute[75245]:     <memballoon model="virtio">
Nov 29 16:10:12 user nova-compute[75245]:       <stats period="10"/>
Nov 29 16:10:12 user nova-compute[75245]:     </memballoon>
Nov 29 16:10:12 user nova-compute[75245]:   </devices>
Nov 29 16:10:12 user nova-compute[75245]: </domain>
Nov 29 16:10:12 user nova-compute[75245]:  {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:10:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-723691220',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-723691220',id=4,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEoMJZt+VqMN0mavu3vY5Kvut5aAyigJQLII/9twNBGC/SlV5jkUl2w3ylxxIBa5TyZWx/7AEPJj5EkYaLXE+xUAT6uZbyatxvBvA6jxLyD3SeE/POApEcydBOMofkwZ3w==',key_name='tempest-keypair-353472592',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd22948fbd074a7c94d8ad7614fbc220',ramdisk_id='',reservation_id='r-k0lo301j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1524245296',owner_user_name='tempest-AttachVolumeShelveTestJSON-1524245296-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:10:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c4942f948584702a8c8b93248694a65',uuid=3ab9d7cd-79cd-4c9b-8608-c1ef0f333305,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b3a82cf-e1cb-455a-9f59-853505903560", "address": "fa:16:3e:72:f8:5e", "network": {"id": "7f978dee-8a5e-4218-b6fc-2d550c0d7b5d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-53637364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd22948fbd074a7c94d8ad7614fbc220", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b3a82cf-e1", "ovs_interfaceid": "0b3a82cf-e1cb-455a-9f59-853505903560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Converting VIF {"id": "0b3a82cf-e1cb-455a-9f59-853505903560", "address": "fa:16:3e:72:f8:5e", "network": {"id": "7f978dee-8a5e-4218-b6fc-2d550c0d7b5d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-53637364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd22948fbd074a7c94d8ad7614fbc220", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b3a82cf-e1", "ovs_interfaceid": "0b3a82cf-e1cb-455a-9f59-853505903560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:f8:5e,bridge_name='br-int',has_traffic_filtering=True,id=0b3a82cf-e1cb-455a-9f59-853505903560,network=Network(7f978dee-8a5e-4218-b6fc-2d550c0d7b5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b3a82cf-e1') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG os_vif [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:f8:5e,bridge_name='br-int',has_traffic_filtering=True,id=0b3a82cf-e1cb-455a-9f59-853505903560,network=Network(7f978dee-8a5e-4218-b6fc-2d550c0d7b5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b3a82cf-e1') {{(pid=75245) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a0fcfafe-9b8b-57af-92a3-3ceb5d8de72a', '_type': 'linux-noop'}}, row=False) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:12 user nova-compute[75245]: INFO nova.compute.manager [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] [instance: 738c0d7a-af77-41f7-9206-0e6b1f18a154] Took 12.01 seconds to spawn the instance on the hypervisor.
Nov 29 16:10:12 user nova-compute[75245]: DEBUG nova.compute.manager [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] [instance: 738c0d7a-af77-41f7-9206-0e6b1f18a154] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0b3a82cf-e1, may_exist=True, interface_attrs={}) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0b3a82cf-e1, col_values=(('qos', UUID('b0a771b4-81ec-415c-9921-b589e7c2cf8a')),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0b3a82cf-e1, col_values=(('external_ids', {'iface-id': '0b3a82cf-e1cb-455a-9f59-853505903560', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:f8:5e', 'vm-uuid': '3ab9d7cd-79cd-4c9b-8608-c1ef0f333305'}),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] No VIF found with MAC fa:16:3e:bb:74:67, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:10:12 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:12 user nova-compute[75245]: INFO os_vif [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:f8:5e,bridge_name='br-int',has_traffic_filtering=True,id=0b3a82cf-e1cb-455a-9f59-853505903560,network=Network(7f978dee-8a5e-4218-b6fc-2d550c0d7b5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b3a82cf-e1')
Nov 29 16:10:12 user nova-compute[75245]: INFO nova.compute.manager [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] [instance: 6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7] Took 14.08 seconds to build instance.
Nov 29 16:10:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-e061e8d4-c802-4836-930c-2e433a9c9acd tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Lock "6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.468s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:10:13 user nova-compute[75245]: INFO nova.compute.manager [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] [instance: 738c0d7a-af77-41f7-9206-0e6b1f18a154] Took 14.14 seconds to build instance.
Nov 29 16:10:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:10:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] No VIF found with MAC fa:16:3e:72:f8:5e, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:10:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-77dc3813-f9ad-40a4-b015-92c42ca5fc23 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Lock "738c0d7a-af77-41f7-9206-0e6b1f18a154" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.636s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:10:13 user nova-compute[75245]: DEBUG nova.compute.manager [req-977525d7-97e8-40ea-83d4-963e969bc168 req-47023e24-4b3c-4da3-bc19-e2ece831384a service nova] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Received event network-changed-0b3a82cf-e1cb-455a-9f59-853505903560 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:10:13 user nova-compute[75245]: DEBUG nova.compute.manager [req-977525d7-97e8-40ea-83d4-963e969bc168 req-47023e24-4b3c-4da3-bc19-e2ece831384a service nova] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Refreshing instance network info cache due to event network-changed-0b3a82cf-e1cb-455a-9f59-853505903560. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:10:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-977525d7-97e8-40ea-83d4-963e969bc168 req-47023e24-4b3c-4da3-bc19-e2ece831384a service nova] Acquiring lock "refresh_cache-3ab9d7cd-79cd-4c9b-8608-c1ef0f333305" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:10:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-977525d7-97e8-40ea-83d4-963e969bc168 req-47023e24-4b3c-4da3-bc19-e2ece831384a service nova] Acquired lock "refresh_cache-3ab9d7cd-79cd-4c9b-8608-c1ef0f333305" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:10:13 user nova-compute[75245]: DEBUG nova.network.neutron [req-977525d7-97e8-40ea-83d4-963e969bc168 req-47023e24-4b3c-4da3-bc19-e2ece831384a service nova] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Refreshing network info cache for port 0b3a82cf-e1cb-455a-9f59-853505903560 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:10:13 user nova-compute[75245]: DEBUG nova.network.neutron [req-929b881c-f069-4773-9ced-8e2254204c30 req-38f771b0-9305-4c63-bb82-e24c22581d93 service nova] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] Updated VIF entry in instance network info cache for port c72edead-bad2-45c4-9ac8-90dd2a4f8ed5. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:10:13 user nova-compute[75245]: DEBUG nova.network.neutron [req-929b881c-f069-4773-9ced-8e2254204c30 req-38f771b0-9305-4c63-bb82-e24c22581d93 service nova] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] Updating instance_info_cache with network_info: [{"id": "c72edead-bad2-45c4-9ac8-90dd2a4f8ed5", "address": "fa:16:3e:bb:74:67", "network": {"id": "f1fac2f4-e789-443e-b6a5-1a3f829bc302", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1199431077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6b87e18ef1f48d19a6907b28cb54f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc72edead-ba", "ovs_interfaceid": "c72edead-bad2-45c4-9ac8-90dd2a4f8ed5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:10:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-929b881c-f069-4773-9ced-8e2254204c30 req-38f771b0-9305-4c63-bb82-e24c22581d93 service nova] Releasing lock "refresh_cache-ed9a6a4e-2e7d-443c-82ef-f14f11d32c81" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:10:13 user nova-compute[75245]: DEBUG nova.network.neutron [req-977525d7-97e8-40ea-83d4-963e969bc168 req-47023e24-4b3c-4da3-bc19-e2ece831384a service nova] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Updated VIF entry in instance network info cache for port 0b3a82cf-e1cb-455a-9f59-853505903560. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:10:13 user nova-compute[75245]: DEBUG nova.network.neutron [req-977525d7-97e8-40ea-83d4-963e969bc168 req-47023e24-4b3c-4da3-bc19-e2ece831384a service nova] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Updating instance_info_cache with network_info: [{"id": "0b3a82cf-e1cb-455a-9f59-853505903560", "address": "fa:16:3e:72:f8:5e", "network": {"id": "7f978dee-8a5e-4218-b6fc-2d550c0d7b5d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-53637364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd22948fbd074a7c94d8ad7614fbc220", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b3a82cf-e1", "ovs_interfaceid": "0b3a82cf-e1cb-455a-9f59-853505903560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:10:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-977525d7-97e8-40ea-83d4-963e969bc168 req-47023e24-4b3c-4da3-bc19-e2ece831384a service nova] Releasing lock "refresh_cache-3ab9d7cd-79cd-4c9b-8608-c1ef0f333305" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:10:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:16 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:16 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:16 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:16 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Acquiring lock "36728d4f-925b-46a3-b4b5-17f14b9c99c3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:10:16 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Lock "36728d4f-925b-46a3-b4b5-17f14b9c99c3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:10:16 user nova-compute[75245]: DEBUG nova.compute.manager [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] Starting instance... {{(pid=75245) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 16:10:16 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:16 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:16 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:16 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:17 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:10:17 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:10:17 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75245) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 16:10:17 user nova-compute[75245]: INFO nova.compute.claims [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] Claim successful on node user
Nov 29 16:10:17 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:17 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:10:17 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:10:17 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:18 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:10:18 user nova-compute[75245]: DEBUG nova.compute.manager [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] Start building networks asynchronously for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 16:10:18 user nova-compute[75245]: DEBUG nova.compute.manager [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] Allocating IP information in the background. {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 16:10:18 user nova-compute[75245]: DEBUG nova.network.neutron [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] allocate_for_instance() {{(pid=75245) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 16:10:18 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 16:10:18 user nova-compute[75245]: DEBUG nova.compute.manager [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] Start building block device mappings for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 16:10:18 user nova-compute[75245]: DEBUG nova.policy [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '39676e279e7f4fea9383dacfb0ea7875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a08c8f9089c4291b552c567e010b0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75245) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 16:10:18 user nova-compute[75245]: DEBUG nova.compute.manager [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] Start spawning the instance on the hypervisor. {{(pid=75245) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 16:10:18 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] Creating instance directory {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 16:10:18 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] Creating image(s)
Nov 29 16:10:18 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Acquiring lock "/opt/stack/data/nova/instances/36728d4f-925b-46a3-b4b5-17f14b9c99c3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:10:18 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Lock "/opt/stack/data/nova/instances/36728d4f-925b-46a3-b4b5-17f14b9c99c3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:10:18 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Lock "/opt/stack/data/nova/instances/36728d4f-925b-46a3-b4b5-17f14b9c99c3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:10:18 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:10:18 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:18 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:18 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:18 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:18 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.277s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:10:18 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Acquiring lock "d654f7206043e05d3525550b0fc885556eb999f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:10:18 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:10:18 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:10:18 user nova-compute[75245]: DEBUG nova.compute.manager [req-273f63e1-fd67-41fa-998d-3e23b2b3bbe2 req-8085ba2c-b357-46f5-892a-9ad67d5c2088 service nova] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] Received event network-vif-plugged-c72edead-bad2-45c4-9ac8-90dd2a4f8ed5 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:10:18 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-273f63e1-fd67-41fa-998d-3e23b2b3bbe2 req-8085ba2c-b357-46f5-892a-9ad67d5c2088 service nova] Acquiring lock "ed9a6a4e-2e7d-443c-82ef-f14f11d32c81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:10:18 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-273f63e1-fd67-41fa-998d-3e23b2b3bbe2 req-8085ba2c-b357-46f5-892a-9ad67d5c2088 service nova] Lock "ed9a6a4e-2e7d-443c-82ef-f14f11d32c81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.018s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:10:18 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-273f63e1-fd67-41fa-998d-3e23b2b3bbe2 req-8085ba2c-b357-46f5-892a-9ad67d5c2088 service nova] Lock "ed9a6a4e-2e7d-443c-82ef-f14f11d32c81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:10:18 user nova-compute[75245]: DEBUG nova.compute.manager [req-273f63e1-fd67-41fa-998d-3e23b2b3bbe2 req-8085ba2c-b357-46f5-892a-9ad67d5c2088 service nova] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] No waiting events found dispatching network-vif-plugged-c72edead-bad2-45c4-9ac8-90dd2a4f8ed5 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:10:18 user nova-compute[75245]: WARNING nova.compute.manager [req-273f63e1-fd67-41fa-998d-3e23b2b3bbe2 req-8085ba2c-b357-46f5-892a-9ad67d5c2088 service nova] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] Received unexpected event network-vif-plugged-c72edead-bad2-45c4-9ac8-90dd2a4f8ed5 for instance with vm_state building and task_state spawning.
Nov 29 16:10:19 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.304s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:10:19 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/36728d4f-925b-46a3-b4b5-17f14b9c99c3/disk 1073741824 {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:10:19 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/36728d4f-925b-46a3-b4b5-17f14b9c99c3/disk 1073741824" returned: 0 in 0.241s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:10:19 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.556s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:10:19 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:10:19 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.333s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:10:19 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Checking if we can resize image /opt/stack/data/nova/instances/36728d4f-925b-46a3-b4b5-17f14b9c99c3/disk. size=1073741824 {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 16:10:19 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36728d4f-925b-46a3-b4b5-17f14b9c99c3/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:10:19 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:20 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:20 user nova-compute[75245]: DEBUG nova.network.neutron [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] Successfully created port: 507c0cd2-dea3-4352-b2ff-60000cc32053 {{(pid=75245) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 16:10:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36728d4f-925b-46a3-b4b5-17f14b9c99c3/disk --force-share --output=json" returned: 0 in 0.322s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:10:20 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Cannot resize image /opt/stack/data/nova/instances/36728d4f-925b-46a3-b4b5-17f14b9c99c3/disk to a smaller size. {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 16:10:20 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] Created local disks {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 16:10:20 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] Ensure instance console log exists: /opt/stack/data/nova/instances/36728d4f-925b-46a3-b4b5-17f14b9c99c3/console.log {{(pid=75245) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 16:10:20 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:10:20 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:10:20 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:10:20 user nova-compute[75245]: DEBUG nova.compute.manager [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] Instance event wait completed in 0 seconds for  {{(pid=75245) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 16:10:20 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] Guest created on hypervisor {{(pid=75245) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 16:10:20 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] Instance spawned successfully.
Nov 29 16:10:20 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 16:10:20 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] Found default for hw_cdrom_bus of ide {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:10:20 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] Found default for hw_disk_bus of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:10:20 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] Found default for hw_input_bus of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:10:20 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] Found default for hw_pointer_model of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:10:20 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] Found default for hw_video_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:10:20 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] Found default for hw_vif_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:10:20 user nova-compute[75245]: INFO nova.compute.manager [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] Took 14.91 seconds to spawn the instance on the hypervisor.
Nov 29 16:10:20 user nova-compute[75245]: DEBUG nova.compute.manager [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:10:20 user nova-compute[75245]: DEBUG nova.compute.manager [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Instance event wait completed in 0 seconds for  {{(pid=75245) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 16:10:20 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Guest created on hypervisor {{(pid=75245) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 16:10:20 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Instance spawned successfully.
Nov 29 16:10:20 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 16:10:20 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Found default for hw_cdrom_bus of ide {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:10:20 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Found default for hw_disk_bus of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:10:20 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Found default for hw_input_bus of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:10:20 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Found default for hw_pointer_model of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:10:20 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Found default for hw_video_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:10:20 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Found default for hw_vif_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:10:20 user nova-compute[75245]: INFO nova.compute.manager [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] Took 16.20 seconds to build instance.
Nov 29 16:10:20 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-a5b73f2a-bf5f-41aa-9758-d644ccbb0341 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "ed9a6a4e-2e7d-443c-82ef-f14f11d32c81" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.392s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:10:20 user nova-compute[75245]: INFO nova.compute.manager [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Took 14.82 seconds to spawn the instance on the hypervisor.
Nov 29 16:10:20 user nova-compute[75245]: DEBUG nova.compute.manager [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:10:21 user nova-compute[75245]: DEBUG nova.network.neutron [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] Successfully updated port: 507c0cd2-dea3-4352-b2ff-60000cc32053 {{(pid=75245) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 16:10:21 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:21 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Acquiring lock "refresh_cache-36728d4f-925b-46a3-b4b5-17f14b9c99c3" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:10:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Acquired lock "refresh_cache-36728d4f-925b-46a3-b4b5-17f14b9c99c3" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:10:21 user nova-compute[75245]: DEBUG nova.network.neutron [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 16:10:21 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:21 user nova-compute[75245]: INFO nova.compute.manager [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Took 16.74 seconds to build instance.
Nov 29 16:10:21 user nova-compute[75245]: DEBUG nova.compute.manager [req-57b2aecd-e4f0-4d3d-b605-39aa4d90ee6a req-3373b6cc-1e50-4a25-9b4d-3f54f7fa1b95 service nova] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] Received event network-changed-507c0cd2-dea3-4352-b2ff-60000cc32053 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:10:21 user nova-compute[75245]: DEBUG nova.compute.manager [req-57b2aecd-e4f0-4d3d-b605-39aa4d90ee6a req-3373b6cc-1e50-4a25-9b4d-3f54f7fa1b95 service nova] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] Refreshing instance network info cache due to event network-changed-507c0cd2-dea3-4352-b2ff-60000cc32053. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:10:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-57b2aecd-e4f0-4d3d-b605-39aa4d90ee6a req-3373b6cc-1e50-4a25-9b4d-3f54f7fa1b95 service nova] Acquiring lock "refresh_cache-36728d4f-925b-46a3-b4b5-17f14b9c99c3" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:10:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-5fb2b87a-24f7-467c-9304-65b2c32890fa tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lock "3ab9d7cd-79cd-4c9b-8608-c1ef0f333305" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.903s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:10:21 user nova-compute[75245]: DEBUG nova.compute.manager [req-854d38a2-feef-414a-a3c9-eeba82450a2d req-f70e5973-1184-4583-a7ed-4714bf6aa5ba service nova] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] Received event network-vif-plugged-c72edead-bad2-45c4-9ac8-90dd2a4f8ed5 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:10:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-854d38a2-feef-414a-a3c9-eeba82450a2d req-f70e5973-1184-4583-a7ed-4714bf6aa5ba service nova] Acquiring lock "ed9a6a4e-2e7d-443c-82ef-f14f11d32c81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:10:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-854d38a2-feef-414a-a3c9-eeba82450a2d req-f70e5973-1184-4583-a7ed-4714bf6aa5ba service nova] Lock "ed9a6a4e-2e7d-443c-82ef-f14f11d32c81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:10:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-854d38a2-feef-414a-a3c9-eeba82450a2d req-f70e5973-1184-4583-a7ed-4714bf6aa5ba service nova] Lock "ed9a6a4e-2e7d-443c-82ef-f14f11d32c81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:10:21 user nova-compute[75245]: DEBUG nova.compute.manager [req-854d38a2-feef-414a-a3c9-eeba82450a2d req-f70e5973-1184-4583-a7ed-4714bf6aa5ba service nova] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] No waiting events found dispatching network-vif-plugged-c72edead-bad2-45c4-9ac8-90dd2a4f8ed5 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:10:21 user nova-compute[75245]: WARNING nova.compute.manager [req-854d38a2-feef-414a-a3c9-eeba82450a2d req-f70e5973-1184-4583-a7ed-4714bf6aa5ba service nova] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] Received unexpected event network-vif-plugged-c72edead-bad2-45c4-9ac8-90dd2a4f8ed5 for instance with vm_state active and task_state None.
Nov 29 16:10:21 user nova-compute[75245]: DEBUG nova.compute.manager [req-854d38a2-feef-414a-a3c9-eeba82450a2d req-f70e5973-1184-4583-a7ed-4714bf6aa5ba service nova] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Received event network-vif-plugged-0b3a82cf-e1cb-455a-9f59-853505903560 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:10:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-854d38a2-feef-414a-a3c9-eeba82450a2d req-f70e5973-1184-4583-a7ed-4714bf6aa5ba service nova] Acquiring lock "3ab9d7cd-79cd-4c9b-8608-c1ef0f333305-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:10:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-854d38a2-feef-414a-a3c9-eeba82450a2d req-f70e5973-1184-4583-a7ed-4714bf6aa5ba service nova] Lock "3ab9d7cd-79cd-4c9b-8608-c1ef0f333305-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:10:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-854d38a2-feef-414a-a3c9-eeba82450a2d req-f70e5973-1184-4583-a7ed-4714bf6aa5ba service nova] Lock "3ab9d7cd-79cd-4c9b-8608-c1ef0f333305-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:10:21 user nova-compute[75245]: DEBUG nova.compute.manager [req-854d38a2-feef-414a-a3c9-eeba82450a2d req-f70e5973-1184-4583-a7ed-4714bf6aa5ba service nova] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] No waiting events found dispatching network-vif-plugged-0b3a82cf-e1cb-455a-9f59-853505903560 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:10:21 user nova-compute[75245]: WARNING nova.compute.manager [req-854d38a2-feef-414a-a3c9-eeba82450a2d req-f70e5973-1184-4583-a7ed-4714bf6aa5ba service nova] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Received unexpected event network-vif-plugged-0b3a82cf-e1cb-455a-9f59-853505903560 for instance with vm_state active and task_state None.
Nov 29 16:10:21 user nova-compute[75245]: DEBUG nova.network.neutron [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] Instance cache missing network info. {{(pid=75245) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 16:10:21 user nova-compute[75245]: DEBUG nova.network.neutron [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] Updating instance_info_cache with network_info: [{"id": "507c0cd2-dea3-4352-b2ff-60000cc32053", "address": "fa:16:3e:38:db:1f", "network": {"id": "ae7be65e-9c9f-4836-aee2-9d465d5d28f6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-521099242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a08c8f9089c4291b552c567e010b0c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap507c0cd2-de", "ovs_interfaceid": "507c0cd2-dea3-4352-b2ff-60000cc32053", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:10:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Releasing lock "refresh_cache-36728d4f-925b-46a3-b4b5-17f14b9c99c3" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:10:21 user nova-compute[75245]: DEBUG nova.compute.manager [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] Instance network_info: |[{"id": "507c0cd2-dea3-4352-b2ff-60000cc32053", "address": "fa:16:3e:38:db:1f", "network": {"id": "ae7be65e-9c9f-4836-aee2-9d465d5d28f6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-521099242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a08c8f9089c4291b552c567e010b0c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap507c0cd2-de", "ovs_interfaceid": "507c0cd2-dea3-4352-b2ff-60000cc32053", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 16:10:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-57b2aecd-e4f0-4d3d-b605-39aa4d90ee6a req-3373b6cc-1e50-4a25-9b4d-3f54f7fa1b95 service nova] Acquired lock "refresh_cache-36728d4f-925b-46a3-b4b5-17f14b9c99c3" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:10:21 user nova-compute[75245]: DEBUG nova.network.neutron [req-57b2aecd-e4f0-4d3d-b605-39aa4d90ee6a req-3373b6cc-1e50-4a25-9b4d-3f54f7fa1b95 service nova] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] Refreshing network info cache for port 507c0cd2-dea3-4352-b2ff-60000cc32053 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:10:21 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] Start _get_guest_xml network_info=[{"id": "507c0cd2-dea3-4352-b2ff-60000cc32053", "address": "fa:16:3e:38:db:1f", "network": {"id": "ae7be65e-9c9f-4836-aee2-9d465d5d28f6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-521099242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a08c8f9089c4291b552c567e010b0c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap507c0cd2-de", "ovs_interfaceid": "507c0cd2-dea3-4352-b2ff-60000cc32053", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'a291d9c3-be02-4c6c-9649-4b45c5b7f487'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 16:10:22 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:10:22 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:10:22 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 16:10:22 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] CPU controller missing on host. {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 16:10:22 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 16:10:22 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] CPU controller found on host. {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 16:10:22 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75245) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 16:10:22 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T16:06:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 16:10:22 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Flavor limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 16:10:22 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Image limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 16:10:22 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Flavor pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 16:10:22 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Image pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 16:10:22 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 16:10:22 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 16:10:22 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 16:10:22 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Got 1 possible topologies {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 16:10:22 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 16:10:22 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 16:10:22 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:10:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-818220928',display_name='tempest-VolumesAdminNegativeTest-server-818220928',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-818220928',id=5,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMsoqDWltj7rvgiBX8ECAYks2BcP4PLhpyN5x750ZqkhEcfFwh31RewYo0OLNrTg37grVSv5Xt4BkyPjIznL8iWLBiyEX80bNiks13LwL4vdsTtHfE2hr/JOJlqEqGDvOQ==',key_name='tempest-keypair-610425310',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a08c8f9089c4291b552c567e010b0c5',ramdisk_id='',reservation_id='r-0tspe1kf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-193480502',owner_user_name='tempest-VolumesAdminNegativeTest-193480502-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:10:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39676e279e7f4fea9383dacfb0ea7875',uuid=36728d4f-925b-46a3-b4b5-17f14b9c99c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "507c0cd2-dea3-4352-b2ff-60000cc32053", "address": "fa:16:3e:38:db:1f", "network": {"id": "ae7be65e-9c9f-4836-aee2-9d465d5d28f6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-521099242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a08c8f9089c4291b552c567e010b0c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap507c0cd2-de", "ovs_interfaceid": "507c0cd2-dea3-4352-b2ff-60000cc32053", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:10:22 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Converting VIF {"id": "507c0cd2-dea3-4352-b2ff-60000cc32053", "address": "fa:16:3e:38:db:1f", "network": {"id": "ae7be65e-9c9f-4836-aee2-9d465d5d28f6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-521099242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a08c8f9089c4291b552c567e010b0c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap507c0cd2-de", "ovs_interfaceid": "507c0cd2-dea3-4352-b2ff-60000cc32053", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:10:22 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:db:1f,bridge_name='br-int',has_traffic_filtering=True,id=507c0cd2-dea3-4352-b2ff-60000cc32053,network=Network(ae7be65e-9c9f-4836-aee2-9d465d5d28f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap507c0cd2-de') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:10:22 user nova-compute[75245]: DEBUG nova.objects.instance [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Lazy-loading 'pci_devices' on Instance uuid 36728d4f-925b-46a3-b4b5-17f14b9c99c3 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:10:22 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] End _get_guest_xml xml=<domain type="kvm">
Nov 29 16:10:22 user nova-compute[75245]:   <uuid>36728d4f-925b-46a3-b4b5-17f14b9c99c3</uuid>
Nov 29 16:10:22 user nova-compute[75245]:   <name>instance-00000005</name>
Nov 29 16:10:22 user nova-compute[75245]:   <memory>524288</memory>
Nov 29 16:10:22 user nova-compute[75245]:   <vcpu>1</vcpu>
Nov 29 16:10:22 user nova-compute[75245]:   <metadata>
Nov 29 16:10:22 user nova-compute[75245]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 16:10:22 user nova-compute[75245]:       <nova:package version="0.0.0"/>
Nov 29 16:10:22 user nova-compute[75245]:       <nova:name>tempest-VolumesAdminNegativeTest-server-818220928</nova:name>
Nov 29 16:10:22 user nova-compute[75245]:       <nova:creationTime>2023-11-29 16:10:22</nova:creationTime>
Nov 29 16:10:22 user nova-compute[75245]:       <nova:flavor name="m1.tiny">
Nov 29 16:10:22 user nova-compute[75245]:         <nova:memory>512</nova:memory>
Nov 29 16:10:22 user nova-compute[75245]:         <nova:disk>1</nova:disk>
Nov 29 16:10:22 user nova-compute[75245]:         <nova:swap>0</nova:swap>
Nov 29 16:10:22 user nova-compute[75245]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 16:10:22 user nova-compute[75245]:         <nova:vcpus>1</nova:vcpus>
Nov 29 16:10:22 user nova-compute[75245]:       </nova:flavor>
Nov 29 16:10:22 user nova-compute[75245]:       <nova:owner>
Nov 29 16:10:22 user nova-compute[75245]:         <nova:user uuid="39676e279e7f4fea9383dacfb0ea7875">tempest-VolumesAdminNegativeTest-193480502-project-member</nova:user>
Nov 29 16:10:22 user nova-compute[75245]:         <nova:project uuid="2a08c8f9089c4291b552c567e010b0c5">tempest-VolumesAdminNegativeTest-193480502</nova:project>
Nov 29 16:10:22 user nova-compute[75245]:       </nova:owner>
Nov 29 16:10:22 user nova-compute[75245]:       <nova:root type="image" uuid="a291d9c3-be02-4c6c-9649-4b45c5b7f487"/>
Nov 29 16:10:22 user nova-compute[75245]:       <nova:ports>
Nov 29 16:10:22 user nova-compute[75245]:         <nova:port uuid="507c0cd2-dea3-4352-b2ff-60000cc32053">
Nov 29 16:10:22 user nova-compute[75245]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 29 16:10:22 user nova-compute[75245]:         </nova:port>
Nov 29 16:10:22 user nova-compute[75245]:       </nova:ports>
Nov 29 16:10:22 user nova-compute[75245]:     </nova:instance>
Nov 29 16:10:22 user nova-compute[75245]:   </metadata>
Nov 29 16:10:22 user nova-compute[75245]:   <sysinfo type="smbios">
Nov 29 16:10:22 user nova-compute[75245]:     <system>
Nov 29 16:10:22 user nova-compute[75245]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 16:10:22 user nova-compute[75245]:       <entry name="product">OpenStack Nova</entry>
Nov 29 16:10:22 user nova-compute[75245]:       <entry name="version">0.0.0</entry>
Nov 29 16:10:22 user nova-compute[75245]:       <entry name="serial">36728d4f-925b-46a3-b4b5-17f14b9c99c3</entry>
Nov 29 16:10:22 user nova-compute[75245]:       <entry name="uuid">36728d4f-925b-46a3-b4b5-17f14b9c99c3</entry>
Nov 29 16:10:22 user nova-compute[75245]:       <entry name="family">Virtual Machine</entry>
Nov 29 16:10:22 user nova-compute[75245]:     </system>
Nov 29 16:10:22 user nova-compute[75245]:   </sysinfo>
Nov 29 16:10:22 user nova-compute[75245]:   <os>
Nov 29 16:10:22 user nova-compute[75245]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 16:10:22 user nova-compute[75245]:     <boot dev="hd"/>
Nov 29 16:10:22 user nova-compute[75245]:     <smbios mode="sysinfo"/>
Nov 29 16:10:22 user nova-compute[75245]:   </os>
Nov 29 16:10:22 user nova-compute[75245]:   <features>
Nov 29 16:10:22 user nova-compute[75245]:     <acpi/>
Nov 29 16:10:22 user nova-compute[75245]:     <apic/>
Nov 29 16:10:22 user nova-compute[75245]:     <vmcoreinfo/>
Nov 29 16:10:22 user nova-compute[75245]:   </features>
Nov 29 16:10:22 user nova-compute[75245]:   <clock offset="utc">
Nov 29 16:10:22 user nova-compute[75245]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 16:10:22 user nova-compute[75245]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 16:10:22 user nova-compute[75245]:     <timer name="hpet" present="no"/>
Nov 29 16:10:22 user nova-compute[75245]:   </clock>
Nov 29 16:10:22 user nova-compute[75245]:   <cpu mode="custom" match="exact">
Nov 29 16:10:22 user nova-compute[75245]:     <model>Nehalem</model>
Nov 29 16:10:22 user nova-compute[75245]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 16:10:22 user nova-compute[75245]:   </cpu>
Nov 29 16:10:22 user nova-compute[75245]:   <devices>
Nov 29 16:10:22 user nova-compute[75245]:     <disk type="file" device="disk">
Nov 29 16:10:22 user nova-compute[75245]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 16:10:22 user nova-compute[75245]:       <source file="/opt/stack/data/nova/instances/36728d4f-925b-46a3-b4b5-17f14b9c99c3/disk"/>
Nov 29 16:10:22 user nova-compute[75245]:       <target dev="vda" bus="virtio"/>
Nov 29 16:10:22 user nova-compute[75245]:     </disk>
Nov 29 16:10:22 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 16:10:22 user nova-compute[75245]:       <mac address="fa:16:3e:38:db:1f"/>
Nov 29 16:10:22 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:10:22 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 16:10:22 user nova-compute[75245]:       <target dev="tap507c0cd2-de"/>
Nov 29 16:10:22 user nova-compute[75245]:     </interface>
Nov 29 16:10:22 user nova-compute[75245]:     <serial type="pty">
Nov 29 16:10:22 user nova-compute[75245]:       <log file="/opt/stack/data/nova/instances/36728d4f-925b-46a3-b4b5-17f14b9c99c3/console.log" append="off"/>
Nov 29 16:10:22 user nova-compute[75245]:     </serial>
Nov 29 16:10:22 user nova-compute[75245]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 16:10:22 user nova-compute[75245]:     <video>
Nov 29 16:10:22 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:10:22 user nova-compute[75245]:     </video>
Nov 29 16:10:22 user nova-compute[75245]:     <rng model="virtio">
Nov 29 16:10:22 user nova-compute[75245]:       <backend model="random">/dev/urandom</backend>
Nov 29 16:10:22 user nova-compute[75245]:     </rng>
Nov 29 16:10:22 user nova-compute[75245]:     <controller type="usb" index="0" model="none"/>
Nov 29 16:10:22 user nova-compute[75245]:     <memballoon model="virtio">
Nov 29 16:10:22 user nova-compute[75245]:       <stats period="10"/>
Nov 29 16:10:22 user nova-compute[75245]:     </memballoon>
Nov 29 16:10:22 user nova-compute[75245]:   </devices>
Nov 29 16:10:22 user nova-compute[75245]: </domain>
Nov 29 16:10:22 user nova-compute[75245]:  {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 16:10:22 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:10:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-818220928',display_name='tempest-VolumesAdminNegativeTest-server-818220928',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-818220928',id=5,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMsoqDWltj7rvgiBX8ECAYks2BcP4PLhpyN5x750ZqkhEcfFwh31RewYo0OLNrTg37grVSv5Xt4BkyPjIznL8iWLBiyEX80bNiks13LwL4vdsTtHfE2hr/JOJlqEqGDvOQ==',key_name='tempest-keypair-610425310',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a08c8f9089c4291b552c567e010b0c5',ramdisk_id='',reservation_id='r-0tspe1kf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-193480502',owner_user_name='tempest-VolumesAdminNegativeTest-193480502-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:10:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39676e279e7f4fea9383dacfb0ea7875',uuid=36728d4f-925b-46a3-b4b5-17f14b9c99c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "507c0cd2-dea3-4352-b2ff-60000cc32053", "address": "fa:16:3e:38:db:1f", "network": {"id": "ae7be65e-9c9f-4836-aee2-9d465d5d28f6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-521099242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a08c8f9089c4291b552c567e010b0c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap507c0cd2-de", "ovs_interfaceid": "507c0cd2-dea3-4352-b2ff-60000cc32053", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 16:10:22 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Converting VIF {"id": "507c0cd2-dea3-4352-b2ff-60000cc32053", "address": "fa:16:3e:38:db:1f", "network": {"id": "ae7be65e-9c9f-4836-aee2-9d465d5d28f6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-521099242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a08c8f9089c4291b552c567e010b0c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap507c0cd2-de", "ovs_interfaceid": "507c0cd2-dea3-4352-b2ff-60000cc32053", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:10:22 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:db:1f,bridge_name='br-int',has_traffic_filtering=True,id=507c0cd2-dea3-4352-b2ff-60000cc32053,network=Network(ae7be65e-9c9f-4836-aee2-9d465d5d28f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap507c0cd2-de') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:10:22 user nova-compute[75245]: DEBUG os_vif [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:db:1f,bridge_name='br-int',has_traffic_filtering=True,id=507c0cd2-dea3-4352-b2ff-60000cc32053,network=Network(ae7be65e-9c9f-4836-aee2-9d465d5d28f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap507c0cd2-de') {{(pid=75245) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 16:10:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:10:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 16:10:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '375a94db-58f9-5c85-91e3-d086e174358a', '_type': 'linux-noop'}}, row=False) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:10:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:10:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap507c0cd2-de, may_exist=True, interface_attrs={}) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:10:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap507c0cd2-de, col_values=(('qos', UUID('c9c7a39e-93dc-44f1-9a5e-ff021a8882c6')),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:10:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap507c0cd2-de, col_values=(('external_ids', {'iface-id': '507c0cd2-dea3-4352-b2ff-60000cc32053', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:db:1f', 'vm-uuid': '36728d4f-925b-46a3-b4b5-17f14b9c99c3'}),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:10:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:10:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:22 user nova-compute[75245]: INFO os_vif [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:db:1f,bridge_name='br-int',has_traffic_filtering=True,id=507c0cd2-dea3-4352-b2ff-60000cc32053,network=Network(ae7be65e-9c9f-4836-aee2-9d465d5d28f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap507c0cd2-de')
Nov 29 16:10:22 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:10:22 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] No VIF found with MAC fa:16:3e:38:db:1f, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:10:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:22 user nova-compute[75245]: DEBUG nova.network.neutron [req-57b2aecd-e4f0-4d3d-b605-39aa4d90ee6a req-3373b6cc-1e50-4a25-9b4d-3f54f7fa1b95 service nova] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] Updated VIF entry in instance network info cache for port 507c0cd2-dea3-4352-b2ff-60000cc32053. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:10:22 user nova-compute[75245]: DEBUG nova.network.neutron [req-57b2aecd-e4f0-4d3d-b605-39aa4d90ee6a req-3373b6cc-1e50-4a25-9b4d-3f54f7fa1b95 service nova] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] Updating instance_info_cache with network_info: [{"id": "507c0cd2-dea3-4352-b2ff-60000cc32053", "address": "fa:16:3e:38:db:1f", "network": {"id": "ae7be65e-9c9f-4836-aee2-9d465d5d28f6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-521099242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a08c8f9089c4291b552c567e010b0c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap507c0cd2-de", "ovs_interfaceid": "507c0cd2-dea3-4352-b2ff-60000cc32053", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:10:22 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-57b2aecd-e4f0-4d3d-b605-39aa4d90ee6a req-3373b6cc-1e50-4a25-9b4d-3f54f7fa1b95 service nova] Releasing lock "refresh_cache-36728d4f-925b-46a3-b4b5-17f14b9c99c3" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:10:23 user nova-compute[75245]: DEBUG nova.compute.manager [req-831afb6a-86b2-4dd4-9309-96b3261f96f4 req-75bd3b03-4ae2-4b0c-86c8-6b6b35f1282b service nova] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Received event network-vif-plugged-0b3a82cf-e1cb-455a-9f59-853505903560 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:10:23 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-831afb6a-86b2-4dd4-9309-96b3261f96f4 req-75bd3b03-4ae2-4b0c-86c8-6b6b35f1282b service nova] Acquiring lock "3ab9d7cd-79cd-4c9b-8608-c1ef0f333305-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:10:23 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-831afb6a-86b2-4dd4-9309-96b3261f96f4 req-75bd3b03-4ae2-4b0c-86c8-6b6b35f1282b service nova] Lock "3ab9d7cd-79cd-4c9b-8608-c1ef0f333305-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:10:23 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-831afb6a-86b2-4dd4-9309-96b3261f96f4 req-75bd3b03-4ae2-4b0c-86c8-6b6b35f1282b service nova] Lock "3ab9d7cd-79cd-4c9b-8608-c1ef0f333305-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:10:23 user nova-compute[75245]: DEBUG nova.compute.manager [req-831afb6a-86b2-4dd4-9309-96b3261f96f4 req-75bd3b03-4ae2-4b0c-86c8-6b6b35f1282b service nova] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] No waiting events found dispatching network-vif-plugged-0b3a82cf-e1cb-455a-9f59-853505903560 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:10:23 user nova-compute[75245]: WARNING nova.compute.manager [req-831afb6a-86b2-4dd4-9309-96b3261f96f4 req-75bd3b03-4ae2-4b0c-86c8-6b6b35f1282b service nova] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Received unexpected event network-vif-plugged-0b3a82cf-e1cb-455a-9f59-853505903560 for instance with vm_state active and task_state None.
Nov 29 16:10:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:25 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Acquiring lock "e3fea3d2-6db1-4766-ad5b-9ad1e728ea10" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:10:25 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Lock "e3fea3d2-6db1-4766-ad5b-9ad1e728ea10" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:10:25 user nova-compute[75245]: DEBUG nova.compute.manager [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] Starting instance... {{(pid=75245) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 16:10:25 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:10:25 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:10:25 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:25 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75245) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 16:10:25 user nova-compute[75245]: INFO nova.compute.claims [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] Claim successful on node user
Nov 29 16:10:25 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:26 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:10:26 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:10:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.725s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:10:26 user nova-compute[75245]: DEBUG nova.compute.manager [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] Start building networks asynchronously for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 16:10:26 user nova-compute[75245]: DEBUG nova.compute.manager [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] Allocating IP information in the background. {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 16:10:26 user nova-compute[75245]: DEBUG nova.network.neutron [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] allocate_for_instance() {{(pid=75245) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 16:10:26 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 16:10:26 user nova-compute[75245]: DEBUG nova.compute.manager [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] Start building block device mappings for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 16:10:26 user nova-compute[75245]: DEBUG nova.policy [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '388b611697054b0498a3687400168a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6dc8fad291d4894a0906964a18a2ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75245) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 16:10:26 user nova-compute[75245]: DEBUG nova.compute.manager [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] Start spawning the instance on the hypervisor. {{(pid=75245) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 16:10:26 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] Creating instance directory {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 16:10:26 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] Creating image(s)
Nov 29 16:10:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Acquiring lock "/opt/stack/data/nova/instances/e3fea3d2-6db1-4766-ad5b-9ad1e728ea10/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:10:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Lock "/opt/stack/data/nova/instances/e3fea3d2-6db1-4766-ad5b-9ad1e728ea10/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:10:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Lock "/opt/stack/data/nova/instances/e3fea3d2-6db1-4766-ad5b-9ad1e728ea10/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:10:26 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:10:26 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.319s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:10:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Acquiring lock "d654f7206043e05d3525550b0fc885556eb999f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:10:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:10:26 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:10:27 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:27 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:27 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.456s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:10:27 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/e3fea3d2-6db1-4766-ad5b-9ad1e728ea10/disk 1073741824 {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:10:27 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/e3fea3d2-6db1-4766-ad5b-9ad1e728ea10/disk 1073741824" returned: 0 in 0.077s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:10:27 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.542s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:10:27 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:10:27 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:27 user nova-compute[75245]: DEBUG nova.compute.manager [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] Instance event wait completed in 0 seconds for  {{(pid=75245) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 16:10:27 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] Guest created on hypervisor {{(pid=75245) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 16:10:27 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.236s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:10:27 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e3fea3d2-6db1-4766-ad5b-9ad1e728ea10/disk. size=1073741824 {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 16:10:27 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fea3d2-6db1-4766-ad5b-9ad1e728ea10/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:10:27 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] Instance spawned successfully.
Nov 29 16:10:27 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 16:10:27 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] Found default for hw_cdrom_bus of ide {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:10:27 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] Found default for hw_disk_bus of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:10:27 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] Found default for hw_input_bus of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:10:27 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] Found default for hw_pointer_model of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:10:27 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] Found default for hw_video_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:10:27 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] Found default for hw_vif_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:10:27 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fea3d2-6db1-4766-ad5b-9ad1e728ea10/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:10:27 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Cannot resize image /opt/stack/data/nova/instances/e3fea3d2-6db1-4766-ad5b-9ad1e728ea10/disk to a smaller size. {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 16:10:27 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] Created local disks {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 16:10:27 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] Ensure instance console log exists: /opt/stack/data/nova/instances/e3fea3d2-6db1-4766-ad5b-9ad1e728ea10/console.log {{(pid=75245) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 16:10:27 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:10:27 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:10:27 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:10:28 user nova-compute[75245]: INFO nova.compute.manager [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] Took 9.46 seconds to spawn the instance on the hypervisor.
Nov 29 16:10:28 user nova-compute[75245]: DEBUG nova.compute.manager [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:10:28 user nova-compute[75245]: INFO nova.compute.manager [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] Took 11.22 seconds to build instance.
Nov 29 16:10:28 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-044fe397-f79f-4d55-9a57-ed8f0113ef70 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Lock "36728d4f-925b-46a3-b4b5-17f14b9c99c3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.364s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:10:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:28 user nova-compute[75245]: DEBUG nova.network.neutron [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] Successfully created port: f4303524-45ab-49e7-bdac-5522f5c4b8f5 {{(pid=75245) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 16:10:30 user nova-compute[75245]: DEBUG nova.compute.manager [req-2f4d5370-a1b7-4d46-af70-a885515c87e6 req-a3edac0b-a886-474d-a181-4426cd1585b9 service nova] [instance: 738c0d7a-af77-41f7-9206-0e6b1f18a154] Received event network-vif-plugged-6868c459-7c16-48e4-8806-577f44063ef2 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:10:30 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-2f4d5370-a1b7-4d46-af70-a885515c87e6 req-a3edac0b-a886-474d-a181-4426cd1585b9 service nova] Acquiring lock "738c0d7a-af77-41f7-9206-0e6b1f18a154-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:10:30 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-2f4d5370-a1b7-4d46-af70-a885515c87e6 req-a3edac0b-a886-474d-a181-4426cd1585b9 service nova] Lock "738c0d7a-af77-41f7-9206-0e6b1f18a154-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:10:30 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-2f4d5370-a1b7-4d46-af70-a885515c87e6 req-a3edac0b-a886-474d-a181-4426cd1585b9 service nova] Lock "738c0d7a-af77-41f7-9206-0e6b1f18a154-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:10:30 user nova-compute[75245]: DEBUG nova.compute.manager [req-2f4d5370-a1b7-4d46-af70-a885515c87e6 req-a3edac0b-a886-474d-a181-4426cd1585b9 service nova] [instance: 738c0d7a-af77-41f7-9206-0e6b1f18a154] No waiting events found dispatching network-vif-plugged-6868c459-7c16-48e4-8806-577f44063ef2 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:10:30 user nova-compute[75245]: WARNING nova.compute.manager [req-2f4d5370-a1b7-4d46-af70-a885515c87e6 req-a3edac0b-a886-474d-a181-4426cd1585b9 service nova] [instance: 738c0d7a-af77-41f7-9206-0e6b1f18a154] Received unexpected event network-vif-plugged-6868c459-7c16-48e4-8806-577f44063ef2 for instance with vm_state active and task_state None.
Nov 29 16:10:31 user nova-compute[75245]: DEBUG nova.network.neutron [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] Successfully updated port: f4303524-45ab-49e7-bdac-5522f5c4b8f5 {{(pid=75245) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 16:10:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Acquiring lock "refresh_cache-e3fea3d2-6db1-4766-ad5b-9ad1e728ea10" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:10:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Acquired lock "refresh_cache-e3fea3d2-6db1-4766-ad5b-9ad1e728ea10" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:10:31 user nova-compute[75245]: DEBUG nova.network.neutron [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 16:10:31 user nova-compute[75245]: DEBUG nova.compute.manager [req-f2c8a263-a457-40e2-9a6f-99444f7092e8 req-3942e911-c124-42b0-806f-27ebc0c3f035 service nova] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] Received event network-changed-f4303524-45ab-49e7-bdac-5522f5c4b8f5 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:10:31 user nova-compute[75245]: DEBUG nova.compute.manager [req-f2c8a263-a457-40e2-9a6f-99444f7092e8 req-3942e911-c124-42b0-806f-27ebc0c3f035 service nova] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] Refreshing instance network info cache due to event network-changed-f4303524-45ab-49e7-bdac-5522f5c4b8f5. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:10:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-f2c8a263-a457-40e2-9a6f-99444f7092e8 req-3942e911-c124-42b0-806f-27ebc0c3f035 service nova] Acquiring lock "refresh_cache-e3fea3d2-6db1-4766-ad5b-9ad1e728ea10" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:10:31 user nova-compute[75245]: DEBUG nova.network.neutron [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] Instance cache missing network info. {{(pid=75245) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 16:10:31 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:32 user nova-compute[75245]: DEBUG nova.network.neutron [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] Updating instance_info_cache with network_info: [{"id": "f4303524-45ab-49e7-bdac-5522f5c4b8f5", "address": "fa:16:3e:11:8d:50", "network": {"id": "b1ced6f5-b3ca-45c7-b841-353498cf4f5a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-812097196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6dc8fad291d4894a0906964a18a2ee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4303524-45", "ovs_interfaceid": "f4303524-45ab-49e7-bdac-5522f5c4b8f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:10:32 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Releasing lock "refresh_cache-e3fea3d2-6db1-4766-ad5b-9ad1e728ea10" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:10:32 user nova-compute[75245]: DEBUG nova.compute.manager [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] Instance network_info: |[{"id": "f4303524-45ab-49e7-bdac-5522f5c4b8f5", "address": "fa:16:3e:11:8d:50", "network": {"id": "b1ced6f5-b3ca-45c7-b841-353498cf4f5a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-812097196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6dc8fad291d4894a0906964a18a2ee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4303524-45", "ovs_interfaceid": "f4303524-45ab-49e7-bdac-5522f5c4b8f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 16:10:32 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-f2c8a263-a457-40e2-9a6f-99444f7092e8 req-3942e911-c124-42b0-806f-27ebc0c3f035 service nova] Acquired lock "refresh_cache-e3fea3d2-6db1-4766-ad5b-9ad1e728ea10" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:10:32 user nova-compute[75245]: DEBUG nova.network.neutron [req-f2c8a263-a457-40e2-9a6f-99444f7092e8 req-3942e911-c124-42b0-806f-27ebc0c3f035 service nova] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] Refreshing network info cache for port f4303524-45ab-49e7-bdac-5522f5c4b8f5 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:10:32 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] Start _get_guest_xml network_info=[{"id": "f4303524-45ab-49e7-bdac-5522f5c4b8f5", "address": "fa:16:3e:11:8d:50", "network": {"id": "b1ced6f5-b3ca-45c7-b841-353498cf4f5a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-812097196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6dc8fad291d4894a0906964a18a2ee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4303524-45", "ovs_interfaceid": "f4303524-45ab-49e7-bdac-5522f5c4b8f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'a291d9c3-be02-4c6c-9649-4b45c5b7f487'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 16:10:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:32 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:10:32 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:10:32 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 16:10:32 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] CPU controller missing on host. {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 16:10:32 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 16:10:32 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] CPU controller found on host. {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 16:10:32 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75245) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 16:10:32 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T16:06:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 16:10:32 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Flavor limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 16:10:32 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Image limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 16:10:32 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Flavor pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 16:10:32 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Image pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 16:10:32 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 16:10:32 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 16:10:32 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 16:10:32 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Got 1 possible topologies {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 16:10:32 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 16:10:32 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 16:10:32 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:10:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2050055971',display_name='tempest-TestVolumeSwap-server-2050055971',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2050055971',id=6,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8NjzG2hsM8G/ri2ftW+HwYTQZ7smSmyh2wLSlCdQnBBsBAyDRFp3AWgVEdhFC65rO5Z9Dt1ULFcfBlhouuM/QedXcROMn894uH16YytoHwQjKSvXvUJbS23vQJm3A/zA==',key_name='tempest-keypair-998706326',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6dc8fad291d4894a0906964a18a2ee4',ramdisk_id='',reservation_id='r-f5tgod2r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1406149224',owner_user_name='tempest-TestVolumeSwap-1406149224-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:10:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='388b611697054b0498a3687400168a71',uuid=e3fea3d2-6db1-4766-ad5b-9ad1e728ea10,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4303524-45ab-49e7-bdac-5522f5c4b8f5", "address": "fa:16:3e:11:8d:50", "network": {"id": "b1ced6f5-b3ca-45c7-b841-353498cf4f5a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-812097196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6dc8fad291d4894a0906964a18a2ee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4303524-45", "ovs_interfaceid": "f4303524-45ab-49e7-bdac-5522f5c4b8f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:10:32 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Converting VIF {"id": "f4303524-45ab-49e7-bdac-5522f5c4b8f5", "address": "fa:16:3e:11:8d:50", "network": {"id": "b1ced6f5-b3ca-45c7-b841-353498cf4f5a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-812097196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6dc8fad291d4894a0906964a18a2ee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4303524-45", "ovs_interfaceid": "f4303524-45ab-49e7-bdac-5522f5c4b8f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:10:32 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:8d:50,bridge_name='br-int',has_traffic_filtering=True,id=f4303524-45ab-49e7-bdac-5522f5c4b8f5,network=Network(b1ced6f5-b3ca-45c7-b841-353498cf4f5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4303524-45') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:10:32 user nova-compute[75245]: DEBUG nova.objects.instance [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Lazy-loading 'pci_devices' on Instance uuid e3fea3d2-6db1-4766-ad5b-9ad1e728ea10 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:10:32 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] End _get_guest_xml xml=<domain type="kvm">
Nov 29 16:10:32 user nova-compute[75245]:   <uuid>e3fea3d2-6db1-4766-ad5b-9ad1e728ea10</uuid>
Nov 29 16:10:32 user nova-compute[75245]:   <name>instance-00000006</name>
Nov 29 16:10:32 user nova-compute[75245]:   <memory>524288</memory>
Nov 29 16:10:32 user nova-compute[75245]:   <vcpu>1</vcpu>
Nov 29 16:10:32 user nova-compute[75245]:   <metadata>
Nov 29 16:10:32 user nova-compute[75245]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 16:10:32 user nova-compute[75245]:       <nova:package version="0.0.0"/>
Nov 29 16:10:32 user nova-compute[75245]:       <nova:name>tempest-TestVolumeSwap-server-2050055971</nova:name>
Nov 29 16:10:32 user nova-compute[75245]:       <nova:creationTime>2023-11-29 16:10:32</nova:creationTime>
Nov 29 16:10:32 user nova-compute[75245]:       <nova:flavor name="m1.tiny">
Nov 29 16:10:32 user nova-compute[75245]:         <nova:memory>512</nova:memory>
Nov 29 16:10:32 user nova-compute[75245]:         <nova:disk>1</nova:disk>
Nov 29 16:10:32 user nova-compute[75245]:         <nova:swap>0</nova:swap>
Nov 29 16:10:32 user nova-compute[75245]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 16:10:32 user nova-compute[75245]:         <nova:vcpus>1</nova:vcpus>
Nov 29 16:10:32 user nova-compute[75245]:       </nova:flavor>
Nov 29 16:10:32 user nova-compute[75245]:       <nova:owner>
Nov 29 16:10:32 user nova-compute[75245]:         <nova:user uuid="388b611697054b0498a3687400168a71">tempest-TestVolumeSwap-1406149224-project-member</nova:user>
Nov 29 16:10:32 user nova-compute[75245]:         <nova:project uuid="b6dc8fad291d4894a0906964a18a2ee4">tempest-TestVolumeSwap-1406149224</nova:project>
Nov 29 16:10:32 user nova-compute[75245]:       </nova:owner>
Nov 29 16:10:32 user nova-compute[75245]:       <nova:root type="image" uuid="a291d9c3-be02-4c6c-9649-4b45c5b7f487"/>
Nov 29 16:10:32 user nova-compute[75245]:       <nova:ports>
Nov 29 16:10:32 user nova-compute[75245]:         <nova:port uuid="f4303524-45ab-49e7-bdac-5522f5c4b8f5">
Nov 29 16:10:32 user nova-compute[75245]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 29 16:10:32 user nova-compute[75245]:         </nova:port>
Nov 29 16:10:32 user nova-compute[75245]:       </nova:ports>
Nov 29 16:10:32 user nova-compute[75245]:     </nova:instance>
Nov 29 16:10:32 user nova-compute[75245]:   </metadata>
Nov 29 16:10:32 user nova-compute[75245]:   <sysinfo type="smbios">
Nov 29 16:10:32 user nova-compute[75245]:     <system>
Nov 29 16:10:32 user nova-compute[75245]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 16:10:32 user nova-compute[75245]:       <entry name="product">OpenStack Nova</entry>
Nov 29 16:10:32 user nova-compute[75245]:       <entry name="version">0.0.0</entry>
Nov 29 16:10:32 user nova-compute[75245]:       <entry name="serial">e3fea3d2-6db1-4766-ad5b-9ad1e728ea10</entry>
Nov 29 16:10:32 user nova-compute[75245]:       <entry name="uuid">e3fea3d2-6db1-4766-ad5b-9ad1e728ea10</entry>
Nov 29 16:10:32 user nova-compute[75245]:       <entry name="family">Virtual Machine</entry>
Nov 29 16:10:32 user nova-compute[75245]:     </system>
Nov 29 16:10:32 user nova-compute[75245]:   </sysinfo>
Nov 29 16:10:32 user nova-compute[75245]:   <os>
Nov 29 16:10:32 user nova-compute[75245]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 16:10:32 user nova-compute[75245]:     <boot dev="hd"/>
Nov 29 16:10:32 user nova-compute[75245]:     <smbios mode="sysinfo"/>
Nov 29 16:10:32 user nova-compute[75245]:   </os>
Nov 29 16:10:32 user nova-compute[75245]:   <features>
Nov 29 16:10:32 user nova-compute[75245]:     <acpi/>
Nov 29 16:10:32 user nova-compute[75245]:     <apic/>
Nov 29 16:10:32 user nova-compute[75245]:     <vmcoreinfo/>
Nov 29 16:10:32 user nova-compute[75245]:   </features>
Nov 29 16:10:32 user nova-compute[75245]:   <clock offset="utc">
Nov 29 16:10:32 user nova-compute[75245]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 16:10:32 user nova-compute[75245]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 16:10:32 user nova-compute[75245]:     <timer name="hpet" present="no"/>
Nov 29 16:10:32 user nova-compute[75245]:   </clock>
Nov 29 16:10:32 user nova-compute[75245]:   <cpu mode="custom" match="exact">
Nov 29 16:10:32 user nova-compute[75245]:     <model>Nehalem</model>
Nov 29 16:10:32 user nova-compute[75245]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 16:10:32 user nova-compute[75245]:   </cpu>
Nov 29 16:10:32 user nova-compute[75245]:   <devices>
Nov 29 16:10:32 user nova-compute[75245]:     <disk type="file" device="disk">
Nov 29 16:10:32 user nova-compute[75245]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 16:10:32 user nova-compute[75245]:       <source file="/opt/stack/data/nova/instances/e3fea3d2-6db1-4766-ad5b-9ad1e728ea10/disk"/>
Nov 29 16:10:32 user nova-compute[75245]:       <target dev="vda" bus="virtio"/>
Nov 29 16:10:32 user nova-compute[75245]:     </disk>
Nov 29 16:10:32 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 16:10:32 user nova-compute[75245]:       <mac address="fa:16:3e:11:8d:50"/>
Nov 29 16:10:32 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:10:32 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 16:10:32 user nova-compute[75245]:       <target dev="tapf4303524-45"/>
Nov 29 16:10:32 user nova-compute[75245]:     </interface>
Nov 29 16:10:32 user nova-compute[75245]:     <serial type="pty">
Nov 29 16:10:32 user nova-compute[75245]:       <log file="/opt/stack/data/nova/instances/e3fea3d2-6db1-4766-ad5b-9ad1e728ea10/console.log" append="off"/>
Nov 29 16:10:32 user nova-compute[75245]:     </serial>
Nov 29 16:10:32 user nova-compute[75245]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 16:10:32 user nova-compute[75245]:     <video>
Nov 29 16:10:32 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:10:32 user nova-compute[75245]:     </video>
Nov 29 16:10:32 user nova-compute[75245]:     <rng model="virtio">
Nov 29 16:10:32 user nova-compute[75245]:       <backend model="random">/dev/urandom</backend>
Nov 29 16:10:32 user nova-compute[75245]:     </rng>
Nov 29 16:10:32 user nova-compute[75245]:     <controller type="usb" index="0" model="none"/>
Nov 29 16:10:32 user nova-compute[75245]:     <memballoon model="virtio">
Nov 29 16:10:32 user nova-compute[75245]:       <stats period="10"/>
Nov 29 16:10:32 user nova-compute[75245]:     </memballoon>
Nov 29 16:10:32 user nova-compute[75245]:   </devices>
Nov 29 16:10:32 user nova-compute[75245]: </domain>
Nov 29 16:10:32 user nova-compute[75245]:  {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 16:10:32 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:10:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2050055971',display_name='tempest-TestVolumeSwap-server-2050055971',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2050055971',id=6,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8NjzG2hsM8G/ri2ftW+HwYTQZ7smSmyh2wLSlCdQnBBsBAyDRFp3AWgVEdhFC65rO5Z9Dt1ULFcfBlhouuM/QedXcROMn894uH16YytoHwQjKSvXvUJbS23vQJm3A/zA==',key_name='tempest-keypair-998706326',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6dc8fad291d4894a0906964a18a2ee4',ramdisk_id='',reservation_id='r-f5tgod2r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1406149224',owner_user_name='tempest-TestVolumeSwap-1406149224-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:10:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='388b611697054b0498a3687400168a71',uuid=e3fea3d2-6db1-4766-ad5b-9ad1e728ea10,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4303524-45ab-49e7-bdac-5522f5c4b8f5", "address": "fa:16:3e:11:8d:50", "network": {"id": "b1ced6f5-b3ca-45c7-b841-353498cf4f5a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-812097196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6dc8fad291d4894a0906964a18a2ee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4303524-45", "ovs_interfaceid": "f4303524-45ab-49e7-bdac-5522f5c4b8f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 16:10:32 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Converting VIF {"id": "f4303524-45ab-49e7-bdac-5522f5c4b8f5", "address": "fa:16:3e:11:8d:50", "network": {"id": "b1ced6f5-b3ca-45c7-b841-353498cf4f5a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-812097196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6dc8fad291d4894a0906964a18a2ee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4303524-45", "ovs_interfaceid": "f4303524-45ab-49e7-bdac-5522f5c4b8f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:10:32 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:8d:50,bridge_name='br-int',has_traffic_filtering=True,id=f4303524-45ab-49e7-bdac-5522f5c4b8f5,network=Network(b1ced6f5-b3ca-45c7-b841-353498cf4f5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4303524-45') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:10:32 user nova-compute[75245]: DEBUG os_vif [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:8d:50,bridge_name='br-int',has_traffic_filtering=True,id=f4303524-45ab-49e7-bdac-5522f5c4b8f5,network=Network(b1ced6f5-b3ca-45c7-b841-353498cf4f5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4303524-45') {{(pid=75245) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 16:10:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:10:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 16:10:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '27e838ee-0302-5f5f-85e3-2a16d23a3f2d', '_type': 'linux-noop'}}, row=False) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:10:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:10:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf4303524-45, may_exist=True, interface_attrs={}) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:10:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf4303524-45, col_values=(('qos', UUID('1a5f6c06-e504-4a00-8920-54d6387280c1')),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:10:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf4303524-45, col_values=(('external_ids', {'iface-id': 'f4303524-45ab-49e7-bdac-5522f5c4b8f5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:8d:50', 'vm-uuid': 'e3fea3d2-6db1-4766-ad5b-9ad1e728ea10'}),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:10:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:10:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:32 user nova-compute[75245]: INFO os_vif [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:8d:50,bridge_name='br-int',has_traffic_filtering=True,id=f4303524-45ab-49e7-bdac-5522f5c4b8f5,network=Network(b1ced6f5-b3ca-45c7-b841-353498cf4f5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4303524-45')
Nov 29 16:10:32 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:10:32 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] No VIF found with MAC fa:16:3e:11:8d:50, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:10:32 user nova-compute[75245]: DEBUG nova.compute.manager [req-2f0fd11b-ab37-49da-bcea-137265496139 req-60830bcd-1ec0-4940-bce3-165e3b67f4e8 service nova] [instance: 738c0d7a-af77-41f7-9206-0e6b1f18a154] Received event network-vif-plugged-6868c459-7c16-48e4-8806-577f44063ef2 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:10:32 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-2f0fd11b-ab37-49da-bcea-137265496139 req-60830bcd-1ec0-4940-bce3-165e3b67f4e8 service nova] Acquiring lock "738c0d7a-af77-41f7-9206-0e6b1f18a154-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:10:32 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-2f0fd11b-ab37-49da-bcea-137265496139 req-60830bcd-1ec0-4940-bce3-165e3b67f4e8 service nova] Lock "738c0d7a-af77-41f7-9206-0e6b1f18a154-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:10:32 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-2f0fd11b-ab37-49da-bcea-137265496139 req-60830bcd-1ec0-4940-bce3-165e3b67f4e8 service nova] Lock "738c0d7a-af77-41f7-9206-0e6b1f18a154-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:10:32 user nova-compute[75245]: DEBUG nova.compute.manager [req-2f0fd11b-ab37-49da-bcea-137265496139 req-60830bcd-1ec0-4940-bce3-165e3b67f4e8 service nova] [instance: 738c0d7a-af77-41f7-9206-0e6b1f18a154] No waiting events found dispatching network-vif-plugged-6868c459-7c16-48e4-8806-577f44063ef2 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:10:32 user nova-compute[75245]: WARNING nova.compute.manager [req-2f0fd11b-ab37-49da-bcea-137265496139 req-60830bcd-1ec0-4940-bce3-165e3b67f4e8 service nova] [instance: 738c0d7a-af77-41f7-9206-0e6b1f18a154] Received unexpected event network-vif-plugged-6868c459-7c16-48e4-8806-577f44063ef2 for instance with vm_state active and task_state None.
Nov 29 16:10:32 user nova-compute[75245]: DEBUG nova.compute.manager [req-2f0fd11b-ab37-49da-bcea-137265496139 req-60830bcd-1ec0-4940-bce3-165e3b67f4e8 service nova] [instance: 6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7] Received event network-vif-plugged-de56e47e-57ae-4e15-9d07-57eca8971e14 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:10:32 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-2f0fd11b-ab37-49da-bcea-137265496139 req-60830bcd-1ec0-4940-bce3-165e3b67f4e8 service nova] Acquiring lock "6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:10:32 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-2f0fd11b-ab37-49da-bcea-137265496139 req-60830bcd-1ec0-4940-bce3-165e3b67f4e8 service nova] Lock "6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:10:32 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-2f0fd11b-ab37-49da-bcea-137265496139 req-60830bcd-1ec0-4940-bce3-165e3b67f4e8 service nova] Lock "6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:10:32 user nova-compute[75245]: DEBUG nova.compute.manager [req-2f0fd11b-ab37-49da-bcea-137265496139 req-60830bcd-1ec0-4940-bce3-165e3b67f4e8 service nova] [instance: 6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7] No waiting events found dispatching network-vif-plugged-de56e47e-57ae-4e15-9d07-57eca8971e14 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:10:32 user nova-compute[75245]: WARNING nova.compute.manager [req-2f0fd11b-ab37-49da-bcea-137265496139 req-60830bcd-1ec0-4940-bce3-165e3b67f4e8 service nova] [instance: 6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7] Received unexpected event network-vif-plugged-de56e47e-57ae-4e15-9d07-57eca8971e14 for instance with vm_state active and task_state None.
Nov 29 16:10:32 user nova-compute[75245]: DEBUG nova.compute.manager [req-2f0fd11b-ab37-49da-bcea-137265496139 req-60830bcd-1ec0-4940-bce3-165e3b67f4e8 service nova] [instance: 6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7] Received event network-vif-plugged-de56e47e-57ae-4e15-9d07-57eca8971e14 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:10:32 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-2f0fd11b-ab37-49da-bcea-137265496139 req-60830bcd-1ec0-4940-bce3-165e3b67f4e8 service nova] Acquiring lock "6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:10:32 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-2f0fd11b-ab37-49da-bcea-137265496139 req-60830bcd-1ec0-4940-bce3-165e3b67f4e8 service nova] Lock "6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:10:32 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-2f0fd11b-ab37-49da-bcea-137265496139 req-60830bcd-1ec0-4940-bce3-165e3b67f4e8 service nova] Lock "6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:10:32 user nova-compute[75245]: DEBUG nova.compute.manager [req-2f0fd11b-ab37-49da-bcea-137265496139 req-60830bcd-1ec0-4940-bce3-165e3b67f4e8 service nova] [instance: 6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7] No waiting events found dispatching network-vif-plugged-de56e47e-57ae-4e15-9d07-57eca8971e14 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:10:32 user nova-compute[75245]: WARNING nova.compute.manager [req-2f0fd11b-ab37-49da-bcea-137265496139 req-60830bcd-1ec0-4940-bce3-165e3b67f4e8 service nova] [instance: 6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7] Received unexpected event network-vif-plugged-de56e47e-57ae-4e15-9d07-57eca8971e14 for instance with vm_state active and task_state None.
Nov 29 16:10:33 user nova-compute[75245]: DEBUG nova.network.neutron [req-f2c8a263-a457-40e2-9a6f-99444f7092e8 req-3942e911-c124-42b0-806f-27ebc0c3f035 service nova] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] Updated VIF entry in instance network info cache for port f4303524-45ab-49e7-bdac-5522f5c4b8f5. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:10:33 user nova-compute[75245]: DEBUG nova.network.neutron [req-f2c8a263-a457-40e2-9a6f-99444f7092e8 req-3942e911-c124-42b0-806f-27ebc0c3f035 service nova] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] Updating instance_info_cache with network_info: [{"id": "f4303524-45ab-49e7-bdac-5522f5c4b8f5", "address": "fa:16:3e:11:8d:50", "network": {"id": "b1ced6f5-b3ca-45c7-b841-353498cf4f5a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-812097196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6dc8fad291d4894a0906964a18a2ee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4303524-45", "ovs_interfaceid": "f4303524-45ab-49e7-bdac-5522f5c4b8f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:10:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-f2c8a263-a457-40e2-9a6f-99444f7092e8 req-3942e911-c124-42b0-806f-27ebc0c3f035 service nova] Releasing lock "refresh_cache-e3fea3d2-6db1-4766-ad5b-9ad1e728ea10" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:10:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] Acquiring lock "41ce739e-9d85-4d8c-980b-b6845d39e31c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:10:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] Lock "41ce739e-9d85-4d8c-980b-b6845d39e31c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:10:33 user nova-compute[75245]: DEBUG nova.compute.manager [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] [instance: 41ce739e-9d85-4d8c-980b-b6845d39e31c] Starting instance... {{(pid=75245) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 16:10:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:10:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:10:33 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75245) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 16:10:33 user nova-compute[75245]: INFO nova.compute.claims [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] [instance: 41ce739e-9d85-4d8c-980b-b6845d39e31c] Claim successful on node user
Nov 29 16:10:34 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:10:34 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:10:34 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.830s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:10:34 user nova-compute[75245]: DEBUG nova.compute.manager [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] [instance: 41ce739e-9d85-4d8c-980b-b6845d39e31c] Start building networks asynchronously for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 16:10:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:34 user nova-compute[75245]: DEBUG nova.compute.manager [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] [instance: 41ce739e-9d85-4d8c-980b-b6845d39e31c] Allocating IP information in the background. {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 16:10:34 user nova-compute[75245]: DEBUG nova.network.neutron [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] [instance: 41ce739e-9d85-4d8c-980b-b6845d39e31c] allocate_for_instance() {{(pid=75245) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 16:10:34 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] [instance: 41ce739e-9d85-4d8c-980b-b6845d39e31c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 16:10:34 user nova-compute[75245]: DEBUG nova.compute.manager [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] [instance: 41ce739e-9d85-4d8c-980b-b6845d39e31c] Start building block device mappings for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 16:10:34 user nova-compute[75245]: DEBUG nova.policy [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f4cfa738baa54b359dbb2a62fc1664c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55afa28bc1b4b91bcbbdcf595cdf496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75245) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 16:10:35 user nova-compute[75245]: DEBUG nova.compute.manager [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] [instance: 41ce739e-9d85-4d8c-980b-b6845d39e31c] Start spawning the instance on the hypervisor. {{(pid=75245) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 16:10:35 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] [instance: 41ce739e-9d85-4d8c-980b-b6845d39e31c] Creating instance directory {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 16:10:35 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] [instance: 41ce739e-9d85-4d8c-980b-b6845d39e31c] Creating image(s)
Nov 29 16:10:35 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] Acquiring lock "/opt/stack/data/nova/instances/41ce739e-9d85-4d8c-980b-b6845d39e31c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:10:35 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] Lock "/opt/stack/data/nova/instances/41ce739e-9d85-4d8c-980b-b6845d39e31c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:10:35 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] Lock "/opt/stack/data/nova/instances/41ce739e-9d85-4d8c-980b-b6845d39e31c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:10:35 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:10:35 user nova-compute[75245]: DEBUG nova.compute.manager [req-a2f48825-1e9d-4392-b621-ffd73fa7d179 req-45e84c84-add1-4ee4-91b2-bf519437ddf2 service nova] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] Received event network-vif-plugged-f4303524-45ab-49e7-bdac-5522f5c4b8f5 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:10:35 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a2f48825-1e9d-4392-b621-ffd73fa7d179 req-45e84c84-add1-4ee4-91b2-bf519437ddf2 service nova] Acquiring lock "e3fea3d2-6db1-4766-ad5b-9ad1e728ea10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:10:35 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a2f48825-1e9d-4392-b621-ffd73fa7d179 req-45e84c84-add1-4ee4-91b2-bf519437ddf2 service nova] Lock "e3fea3d2-6db1-4766-ad5b-9ad1e728ea10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:10:35 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a2f48825-1e9d-4392-b621-ffd73fa7d179 req-45e84c84-add1-4ee4-91b2-bf519437ddf2 service nova] Lock "e3fea3d2-6db1-4766-ad5b-9ad1e728ea10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:10:35 user nova-compute[75245]: DEBUG nova.compute.manager [req-a2f48825-1e9d-4392-b621-ffd73fa7d179 req-45e84c84-add1-4ee4-91b2-bf519437ddf2 service nova] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] No waiting events found dispatching network-vif-plugged-f4303524-45ab-49e7-bdac-5522f5c4b8f5 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:10:35 user nova-compute[75245]: WARNING nova.compute.manager [req-a2f48825-1e9d-4392-b621-ffd73fa7d179 req-45e84c84-add1-4ee4-91b2-bf519437ddf2 service nova] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] Received unexpected event network-vif-plugged-f4303524-45ab-49e7-bdac-5522f5c4b8f5 for instance with vm_state building and task_state spawning.
Nov 29 16:10:35 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.599s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:10:35 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] Acquiring lock "d654f7206043e05d3525550b0fc885556eb999f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:10:35 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:10:35 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:10:36 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:36 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.677s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:10:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/41ce739e-9d85-4d8c-980b-b6845d39e31c/disk 1073741824 {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:10:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/41ce739e-9d85-4d8c-980b-b6845d39e31c/disk 1073741824" returned: 0 in 0.209s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:10:36 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.892s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:10:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:10:36 user nova-compute[75245]: DEBUG nova.network.neutron [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] [instance: 41ce739e-9d85-4d8c-980b-b6845d39e31c] Successfully created port: e63be854-02c3-4ae4-af88-5d7466611d32 {{(pid=75245) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 16:10:37 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.341s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:10:37 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] Checking if we can resize image /opt/stack/data/nova/instances/41ce739e-9d85-4d8c-980b-b6845d39e31c/disk. size=1073741824 {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 16:10:37 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41ce739e-9d85-4d8c-980b-b6845d39e31c/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:10:37 user nova-compute[75245]: DEBUG nova.compute.manager [req-5a665157-3e3c-4da2-ae91-8437a1822283 req-031bb36c-ec3a-4509-ad11-fd656071bacf service nova] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] Received event network-vif-plugged-507c0cd2-dea3-4352-b2ff-60000cc32053 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:10:37 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-5a665157-3e3c-4da2-ae91-8437a1822283 req-031bb36c-ec3a-4509-ad11-fd656071bacf service nova] Acquiring lock "36728d4f-925b-46a3-b4b5-17f14b9c99c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:10:37 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-5a665157-3e3c-4da2-ae91-8437a1822283 req-031bb36c-ec3a-4509-ad11-fd656071bacf service nova] Lock "36728d4f-925b-46a3-b4b5-17f14b9c99c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:10:37 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-5a665157-3e3c-4da2-ae91-8437a1822283 req-031bb36c-ec3a-4509-ad11-fd656071bacf service nova] Lock "36728d4f-925b-46a3-b4b5-17f14b9c99c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:10:37 user nova-compute[75245]: DEBUG nova.compute.manager [req-5a665157-3e3c-4da2-ae91-8437a1822283 req-031bb36c-ec3a-4509-ad11-fd656071bacf service nova] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] No waiting events found dispatching network-vif-plugged-507c0cd2-dea3-4352-b2ff-60000cc32053 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:10:37 user nova-compute[75245]: WARNING nova.compute.manager [req-5a665157-3e3c-4da2-ae91-8437a1822283 req-031bb36c-ec3a-4509-ad11-fd656071bacf service nova] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] Received unexpected event network-vif-plugged-507c0cd2-dea3-4352-b2ff-60000cc32053 for instance with vm_state active and task_state None.
Nov 29 16:10:37 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41ce739e-9d85-4d8c-980b-b6845d39e31c/disk --force-share --output=json" returned: 0 in 0.284s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:10:37 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] Cannot resize image /opt/stack/data/nova/instances/41ce739e-9d85-4d8c-980b-b6845d39e31c/disk to a smaller size. {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 16:10:37 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] [instance: 41ce739e-9d85-4d8c-980b-b6845d39e31c] Created local disks {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 16:10:37 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] [instance: 41ce739e-9d85-4d8c-980b-b6845d39e31c] Ensure instance console log exists: /opt/stack/data/nova/instances/41ce739e-9d85-4d8c-980b-b6845d39e31c/console.log {{(pid=75245) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 16:10:37 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:10:37 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:10:37 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.003s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:10:37 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:37 user nova-compute[75245]: DEBUG nova.compute.manager [req-b57496dc-31f5-4786-819c-fe581d3096da req-5dc1750b-619f-4035-871d-557911d2afee service nova] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] Received event network-vif-plugged-f4303524-45ab-49e7-bdac-5522f5c4b8f5 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:10:37 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b57496dc-31f5-4786-819c-fe581d3096da req-5dc1750b-619f-4035-871d-557911d2afee service nova] Acquiring lock "e3fea3d2-6db1-4766-ad5b-9ad1e728ea10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:10:37 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b57496dc-31f5-4786-819c-fe581d3096da req-5dc1750b-619f-4035-871d-557911d2afee service nova] Lock "e3fea3d2-6db1-4766-ad5b-9ad1e728ea10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:10:37 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b57496dc-31f5-4786-819c-fe581d3096da req-5dc1750b-619f-4035-871d-557911d2afee service nova] Lock "e3fea3d2-6db1-4766-ad5b-9ad1e728ea10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:10:37 user nova-compute[75245]: DEBUG nova.compute.manager [req-b57496dc-31f5-4786-819c-fe581d3096da req-5dc1750b-619f-4035-871d-557911d2afee service nova] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] No waiting events found dispatching network-vif-plugged-f4303524-45ab-49e7-bdac-5522f5c4b8f5 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:10:37 user nova-compute[75245]: WARNING nova.compute.manager [req-b57496dc-31f5-4786-819c-fe581d3096da req-5dc1750b-619f-4035-871d-557911d2afee service nova] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] Received unexpected event network-vif-plugged-f4303524-45ab-49e7-bdac-5522f5c4b8f5 for instance with vm_state building and task_state spawning.
Nov 29 16:10:37 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:38 user nova-compute[75245]: DEBUG nova.network.neutron [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] [instance: 41ce739e-9d85-4d8c-980b-b6845d39e31c] Successfully updated port: e63be854-02c3-4ae4-af88-5d7466611d32 {{(pid=75245) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 16:10:38 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] Acquiring lock "refresh_cache-41ce739e-9d85-4d8c-980b-b6845d39e31c" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:10:38 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] Acquired lock "refresh_cache-41ce739e-9d85-4d8c-980b-b6845d39e31c" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:10:38 user nova-compute[75245]: DEBUG nova.network.neutron [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] [instance: 41ce739e-9d85-4d8c-980b-b6845d39e31c] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 16:10:38 user nova-compute[75245]: DEBUG nova.compute.manager [req-e53afadd-4681-482b-ad9c-42e2c13f8a85 req-29024874-8434-4bd5-8058-bbdaf5d10a92 service nova] [instance: 41ce739e-9d85-4d8c-980b-b6845d39e31c] Received event network-changed-e63be854-02c3-4ae4-af88-5d7466611d32 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:10:38 user nova-compute[75245]: DEBUG nova.compute.manager [req-e53afadd-4681-482b-ad9c-42e2c13f8a85 req-29024874-8434-4bd5-8058-bbdaf5d10a92 service nova] [instance: 41ce739e-9d85-4d8c-980b-b6845d39e31c] Refreshing instance network info cache due to event network-changed-e63be854-02c3-4ae4-af88-5d7466611d32. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:10:38 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-e53afadd-4681-482b-ad9c-42e2c13f8a85 req-29024874-8434-4bd5-8058-bbdaf5d10a92 service nova] Acquiring lock "refresh_cache-41ce739e-9d85-4d8c-980b-b6845d39e31c" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:10:38 user nova-compute[75245]: DEBUG nova.network.neutron [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] [instance: 41ce739e-9d85-4d8c-980b-b6845d39e31c] Instance cache missing network info. {{(pid=75245) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 16:10:39 user nova-compute[75245]: DEBUG nova.compute.manager [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] Instance event wait completed in 0 seconds for  {{(pid=75245) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 16:10:39 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] Guest created on hypervisor {{(pid=75245) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 16:10:39 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] Instance spawned successfully.
Nov 29 16:10:39 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 16:10:39 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] Found default for hw_cdrom_bus of ide {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:10:39 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] Found default for hw_disk_bus of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:10:39 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] Found default for hw_input_bus of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:10:39 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] Found default for hw_pointer_model of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:10:39 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] Found default for hw_video_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:10:39 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] Found default for hw_vif_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:10:39 user nova-compute[75245]: DEBUG nova.network.neutron [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] [instance: 41ce739e-9d85-4d8c-980b-b6845d39e31c] Updating instance_info_cache with network_info: [{"id": "e63be854-02c3-4ae4-af88-5d7466611d32", "address": "fa:16:3e:b3:dc:9f", "network": {"id": "cc4c136b-246d-4996-ad6c-49779f146780", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1274060241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a55afa28bc1b4b91bcbbdcf595cdf496", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape63be854-02", "ovs_interfaceid": "e63be854-02c3-4ae4-af88-5d7466611d32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:10:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] Releasing lock "refresh_cache-41ce739e-9d85-4d8c-980b-b6845d39e31c" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:10:39 user nova-compute[75245]: DEBUG nova.compute.manager [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] [instance: 41ce739e-9d85-4d8c-980b-b6845d39e31c] Instance network_info: |[{"id": "e63be854-02c3-4ae4-af88-5d7466611d32", "address": "fa:16:3e:b3:dc:9f", "network": {"id": "cc4c136b-246d-4996-ad6c-49779f146780", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1274060241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a55afa28bc1b4b91bcbbdcf595cdf496", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape63be854-02", "ovs_interfaceid": "e63be854-02c3-4ae4-af88-5d7466611d32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 16:10:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-e53afadd-4681-482b-ad9c-42e2c13f8a85 req-29024874-8434-4bd5-8058-bbdaf5d10a92 service nova] Acquired lock "refresh_cache-41ce739e-9d85-4d8c-980b-b6845d39e31c" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:10:39 user nova-compute[75245]: DEBUG nova.network.neutron [req-e53afadd-4681-482b-ad9c-42e2c13f8a85 req-29024874-8434-4bd5-8058-bbdaf5d10a92 service nova] [instance: 41ce739e-9d85-4d8c-980b-b6845d39e31c] Refreshing network info cache for port e63be854-02c3-4ae4-af88-5d7466611d32 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:10:39 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] [instance: 41ce739e-9d85-4d8c-980b-b6845d39e31c] Start _get_guest_xml network_info=[{"id": "e63be854-02c3-4ae4-af88-5d7466611d32", "address": "fa:16:3e:b3:dc:9f", "network": {"id": "cc4c136b-246d-4996-ad6c-49779f146780", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1274060241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a55afa28bc1b4b91bcbbdcf595cdf496", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape63be854-02", "ovs_interfaceid": "e63be854-02c3-4ae4-af88-5d7466611d32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'a291d9c3-be02-4c6c-9649-4b45c5b7f487'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 16:10:39 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:10:39 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:10:39 user nova-compute[75245]: INFO nova.compute.manager [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] Took 12.82 seconds to spawn the instance on the hypervisor.
Nov 29 16:10:39 user nova-compute[75245]: DEBUG nova.compute.manager [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:10:39 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 16:10:39 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] CPU controller missing on host. {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 16:10:39 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 16:10:39 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] CPU controller found on host. {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 16:10:39 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75245) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 16:10:39 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T16:06:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 16:10:39 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] Flavor limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 16:10:39 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] Image limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 16:10:39 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] Flavor pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 16:10:39 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] Image pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 16:10:39 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 16:10:39 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 16:10:39 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 16:10:39 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] Got 1 possible topologies {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 16:10:39 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 16:10:39 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 16:10:39 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:10:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1766655900',display_name='tempest-VolumesActionsTest-instance-1766655900',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1766655900',id=7,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a55afa28bc1b4b91bcbbdcf595cdf496',ramdisk_id='',reservation_id='r-lf88awj1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1821015742',owner_user_name='tempest-VolumesActionsTest-1821015742-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:10:35Z,user_data=None,user_id='f4cfa738baa54b359dbb2a62fc1664c6',uuid=41ce739e-9d85-4d8c-980b-b6845d39e31c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e63be854-02c3-4ae4-af88-5d7466611d32", "address": "fa:16:3e:b3:dc:9f", "network": {"id": "cc4c136b-246d-4996-ad6c-49779f146780", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1274060241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a55afa28bc1b4b91bcbbdcf595cdf496", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape63be854-02", "ovs_interfaceid": "e63be854-02c3-4ae4-af88-5d7466611d32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:10:39 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] Converting VIF {"id": "e63be854-02c3-4ae4-af88-5d7466611d32", "address": "fa:16:3e:b3:dc:9f", "network": {"id": "cc4c136b-246d-4996-ad6c-49779f146780", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1274060241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a55afa28bc1b4b91bcbbdcf595cdf496", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape63be854-02", "ovs_interfaceid": "e63be854-02c3-4ae4-af88-5d7466611d32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:10:39 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:dc:9f,bridge_name='br-int',has_traffic_filtering=True,id=e63be854-02c3-4ae4-af88-5d7466611d32,network=Network(cc4c136b-246d-4996-ad6c-49779f146780),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape63be854-02') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:10:39 user nova-compute[75245]: DEBUG nova.objects.instance [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] Lazy-loading 'pci_devices' on Instance uuid 41ce739e-9d85-4d8c-980b-b6845d39e31c {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:10:39 user nova-compute[75245]: DEBUG nova.compute.manager [req-b3c614af-ca8b-48b4-b224-6cc854a88e59 req-dc0edf15-571d-425a-9e9e-4ae53a5cb660 service nova] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] Received event network-vif-plugged-507c0cd2-dea3-4352-b2ff-60000cc32053 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:10:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b3c614af-ca8b-48b4-b224-6cc854a88e59 req-dc0edf15-571d-425a-9e9e-4ae53a5cb660 service nova] Acquiring lock "36728d4f-925b-46a3-b4b5-17f14b9c99c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:10:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b3c614af-ca8b-48b4-b224-6cc854a88e59 req-dc0edf15-571d-425a-9e9e-4ae53a5cb660 service nova] Lock "36728d4f-925b-46a3-b4b5-17f14b9c99c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:10:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b3c614af-ca8b-48b4-b224-6cc854a88e59 req-dc0edf15-571d-425a-9e9e-4ae53a5cb660 service nova] Lock "36728d4f-925b-46a3-b4b5-17f14b9c99c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:10:39 user nova-compute[75245]: DEBUG nova.compute.manager [req-b3c614af-ca8b-48b4-b224-6cc854a88e59 req-dc0edf15-571d-425a-9e9e-4ae53a5cb660 service nova] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] No waiting events found dispatching network-vif-plugged-507c0cd2-dea3-4352-b2ff-60000cc32053 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:10:39 user nova-compute[75245]: WARNING nova.compute.manager [req-b3c614af-ca8b-48b4-b224-6cc854a88e59 req-dc0edf15-571d-425a-9e9e-4ae53a5cb660 service nova] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] Received unexpected event network-vif-plugged-507c0cd2-dea3-4352-b2ff-60000cc32053 for instance with vm_state active and task_state None.
Nov 29 16:10:39 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] [instance: 41ce739e-9d85-4d8c-980b-b6845d39e31c] End _get_guest_xml xml=<domain type="kvm">
Nov 29 16:10:39 user nova-compute[75245]:   <uuid>41ce739e-9d85-4d8c-980b-b6845d39e31c</uuid>
Nov 29 16:10:39 user nova-compute[75245]:   <name>instance-00000007</name>
Nov 29 16:10:39 user nova-compute[75245]:   <memory>524288</memory>
Nov 29 16:10:39 user nova-compute[75245]:   <vcpu>1</vcpu>
Nov 29 16:10:39 user nova-compute[75245]:   <metadata>
Nov 29 16:10:39 user nova-compute[75245]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 16:10:39 user nova-compute[75245]:       <nova:package version="0.0.0"/>
Nov 29 16:10:39 user nova-compute[75245]:       <nova:name>tempest-VolumesActionsTest-instance-1766655900</nova:name>
Nov 29 16:10:39 user nova-compute[75245]:       <nova:creationTime>2023-11-29 16:10:39</nova:creationTime>
Nov 29 16:10:39 user nova-compute[75245]:       <nova:flavor name="m1.tiny">
Nov 29 16:10:39 user nova-compute[75245]:         <nova:memory>512</nova:memory>
Nov 29 16:10:39 user nova-compute[75245]:         <nova:disk>1</nova:disk>
Nov 29 16:10:39 user nova-compute[75245]:         <nova:swap>0</nova:swap>
Nov 29 16:10:39 user nova-compute[75245]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 16:10:39 user nova-compute[75245]:         <nova:vcpus>1</nova:vcpus>
Nov 29 16:10:39 user nova-compute[75245]:       </nova:flavor>
Nov 29 16:10:39 user nova-compute[75245]:       <nova:owner>
Nov 29 16:10:39 user nova-compute[75245]:         <nova:user uuid="f4cfa738baa54b359dbb2a62fc1664c6">tempest-VolumesActionsTest-1821015742-project-member</nova:user>
Nov 29 16:10:39 user nova-compute[75245]:         <nova:project uuid="a55afa28bc1b4b91bcbbdcf595cdf496">tempest-VolumesActionsTest-1821015742</nova:project>
Nov 29 16:10:39 user nova-compute[75245]:       </nova:owner>
Nov 29 16:10:39 user nova-compute[75245]:       <nova:root type="image" uuid="a291d9c3-be02-4c6c-9649-4b45c5b7f487"/>
Nov 29 16:10:39 user nova-compute[75245]:       <nova:ports>
Nov 29 16:10:39 user nova-compute[75245]:         <nova:port uuid="e63be854-02c3-4ae4-af88-5d7466611d32">
Nov 29 16:10:39 user nova-compute[75245]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 29 16:10:39 user nova-compute[75245]:         </nova:port>
Nov 29 16:10:39 user nova-compute[75245]:       </nova:ports>
Nov 29 16:10:39 user nova-compute[75245]:     </nova:instance>
Nov 29 16:10:39 user nova-compute[75245]:   </metadata>
Nov 29 16:10:39 user nova-compute[75245]:   <sysinfo type="smbios">
Nov 29 16:10:39 user nova-compute[75245]:     <system>
Nov 29 16:10:39 user nova-compute[75245]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 16:10:39 user nova-compute[75245]:       <entry name="product">OpenStack Nova</entry>
Nov 29 16:10:39 user nova-compute[75245]:       <entry name="version">0.0.0</entry>
Nov 29 16:10:39 user nova-compute[75245]:       <entry name="serial">41ce739e-9d85-4d8c-980b-b6845d39e31c</entry>
Nov 29 16:10:39 user nova-compute[75245]:       <entry name="uuid">41ce739e-9d85-4d8c-980b-b6845d39e31c</entry>
Nov 29 16:10:39 user nova-compute[75245]:       <entry name="family">Virtual Machine</entry>
Nov 29 16:10:39 user nova-compute[75245]:     </system>
Nov 29 16:10:39 user nova-compute[75245]:   </sysinfo>
Nov 29 16:10:39 user nova-compute[75245]:   <os>
Nov 29 16:10:39 user nova-compute[75245]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 16:10:39 user nova-compute[75245]:     <boot dev="hd"/>
Nov 29 16:10:39 user nova-compute[75245]:     <smbios mode="sysinfo"/>
Nov 29 16:10:39 user nova-compute[75245]:   </os>
Nov 29 16:10:39 user nova-compute[75245]:   <features>
Nov 29 16:10:39 user nova-compute[75245]:     <acpi/>
Nov 29 16:10:39 user nova-compute[75245]:     <apic/>
Nov 29 16:10:39 user nova-compute[75245]:     <vmcoreinfo/>
Nov 29 16:10:39 user nova-compute[75245]:   </features>
Nov 29 16:10:39 user nova-compute[75245]:   <clock offset="utc">
Nov 29 16:10:39 user nova-compute[75245]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 16:10:39 user nova-compute[75245]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 16:10:39 user nova-compute[75245]:     <timer name="hpet" present="no"/>
Nov 29 16:10:39 user nova-compute[75245]:   </clock>
Nov 29 16:10:39 user nova-compute[75245]:   <cpu mode="custom" match="exact">
Nov 29 16:10:39 user nova-compute[75245]:     <model>Nehalem</model>
Nov 29 16:10:39 user nova-compute[75245]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 16:10:39 user nova-compute[75245]:   </cpu>
Nov 29 16:10:39 user nova-compute[75245]:   <devices>
Nov 29 16:10:39 user nova-compute[75245]:     <disk type="file" device="disk">
Nov 29 16:10:39 user nova-compute[75245]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 16:10:39 user nova-compute[75245]:       <source file="/opt/stack/data/nova/instances/41ce739e-9d85-4d8c-980b-b6845d39e31c/disk"/>
Nov 29 16:10:39 user nova-compute[75245]:       <target dev="vda" bus="virtio"/>
Nov 29 16:10:39 user nova-compute[75245]:     </disk>
Nov 29 16:10:39 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 16:10:39 user nova-compute[75245]:       <mac address="fa:16:3e:b3:dc:9f"/>
Nov 29 16:10:39 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:10:39 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 16:10:39 user nova-compute[75245]:       <target dev="tape63be854-02"/>
Nov 29 16:10:39 user nova-compute[75245]:     </interface>
Nov 29 16:10:39 user nova-compute[75245]:     <serial type="pty">
Nov 29 16:10:39 user nova-compute[75245]:       <log file="/opt/stack/data/nova/instances/41ce739e-9d85-4d8c-980b-b6845d39e31c/console.log" append="off"/>
Nov 29 16:10:39 user nova-compute[75245]:     </serial>
Nov 29 16:10:39 user nova-compute[75245]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 16:10:39 user nova-compute[75245]:     <video>
Nov 29 16:10:39 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:10:39 user nova-compute[75245]:     </video>
Nov 29 16:10:39 user nova-compute[75245]:     <rng model="virtio">
Nov 29 16:10:39 user nova-compute[75245]:       <backend model="random">/dev/urandom</backend>
Nov 29 16:10:39 user nova-compute[75245]:     </rng>
Nov 29 16:10:39 user nova-compute[75245]:     <controller type="usb" index="0" model="none"/>
Nov 29 16:10:39 user nova-compute[75245]:     <memballoon model="virtio">
Nov 29 16:10:39 user nova-compute[75245]:       <stats period="10"/>
Nov 29 16:10:39 user nova-compute[75245]:     </memballoon>
Nov 29 16:10:39 user nova-compute[75245]:   </devices>
Nov 29 16:10:39 user nova-compute[75245]: </domain>
Nov 29 16:10:39 user nova-compute[75245]:  {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 16:10:39 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:10:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1766655900',display_name='tempest-VolumesActionsTest-instance-1766655900',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1766655900',id=7,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a55afa28bc1b4b91bcbbdcf595cdf496',ramdisk_id='',reservation_id='r-lf88awj1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1821015742',owner_user_name='tempest-VolumesActionsTest-1821015742-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:10:35Z,user_data=None,user_id='f4cfa738baa54b359dbb2a62fc1664c6',uuid=41ce739e-9d85-4d8c-980b-b6845d39e31c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e63be854-02c3-4ae4-af88-5d7466611d32", "address": "fa:16:3e:b3:dc:9f", "network": {"id": "cc4c136b-246d-4996-ad6c-49779f146780", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1274060241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a55afa28bc1b4b91bcbbdcf595cdf496", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape63be854-02", "ovs_interfaceid": "e63be854-02c3-4ae4-af88-5d7466611d32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 16:10:39 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] Converting VIF {"id": "e63be854-02c3-4ae4-af88-5d7466611d32", "address": "fa:16:3e:b3:dc:9f", "network": {"id": "cc4c136b-246d-4996-ad6c-49779f146780", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1274060241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a55afa28bc1b4b91bcbbdcf595cdf496", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape63be854-02", "ovs_interfaceid": "e63be854-02c3-4ae4-af88-5d7466611d32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:10:39 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:dc:9f,bridge_name='br-int',has_traffic_filtering=True,id=e63be854-02c3-4ae4-af88-5d7466611d32,network=Network(cc4c136b-246d-4996-ad6c-49779f146780),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape63be854-02') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:10:39 user nova-compute[75245]: DEBUG os_vif [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:dc:9f,bridge_name='br-int',has_traffic_filtering=True,id=e63be854-02c3-4ae4-af88-5d7466611d32,network=Network(cc4c136b-246d-4996-ad6c-49779f146780),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape63be854-02') {{(pid=75245) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 16:10:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:10:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 16:10:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cc755ffa-039b-52eb-abff-8de52f658b8d', '_type': 'linux-noop'}}, row=False) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:10:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:10:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape63be854-02, may_exist=True, interface_attrs={}) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:10:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape63be854-02, col_values=(('qos', UUID('5b8c5eb0-ca15-4306-af69-b2484016dfe9')),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:10:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape63be854-02, col_values=(('external_ids', {'iface-id': 'e63be854-02c3-4ae4-af88-5d7466611d32', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:dc:9f', 'vm-uuid': '41ce739e-9d85-4d8c-980b-b6845d39e31c'}),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:10:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:10:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:39 user nova-compute[75245]: INFO os_vif [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:dc:9f,bridge_name='br-int',has_traffic_filtering=True,id=e63be854-02c3-4ae4-af88-5d7466611d32,network=Network(cc4c136b-246d-4996-ad6c-49779f146780),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape63be854-02')
Nov 29 16:10:39 user nova-compute[75245]: INFO nova.compute.manager [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] Took 14.16 seconds to build instance.
Nov 29 16:10:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-a57228a8-a153-4c2c-9099-557d5caff7d0 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Lock "e3fea3d2-6db1-4766-ad5b-9ad1e728ea10" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.387s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:10:39 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:10:39 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] No VIF found with MAC fa:16:3e:b3:dc:9f, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:10:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:40 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] Acquiring lock "55f5b252-468d-4064-99b3-49bdcdf98db8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:10:40 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] Lock "55f5b252-468d-4064-99b3-49bdcdf98db8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:10:40 user nova-compute[75245]: DEBUG nova.compute.manager [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] Starting instance... {{(pid=75245) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 16:10:40 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:10:40 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:10:40 user nova-compute[75245]: DEBUG nova.network.neutron [req-e53afadd-4681-482b-ad9c-42e2c13f8a85 req-29024874-8434-4bd5-8058-bbdaf5d10a92 service nova] [instance: 41ce739e-9d85-4d8c-980b-b6845d39e31c] Updated VIF entry in instance network info cache for port e63be854-02c3-4ae4-af88-5d7466611d32. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:10:40 user nova-compute[75245]: DEBUG nova.network.neutron [req-e53afadd-4681-482b-ad9c-42e2c13f8a85 req-29024874-8434-4bd5-8058-bbdaf5d10a92 service nova] [instance: 41ce739e-9d85-4d8c-980b-b6845d39e31c] Updating instance_info_cache with network_info: [{"id": "e63be854-02c3-4ae4-af88-5d7466611d32", "address": "fa:16:3e:b3:dc:9f", "network": {"id": "cc4c136b-246d-4996-ad6c-49779f146780", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1274060241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a55afa28bc1b4b91bcbbdcf595cdf496", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape63be854-02", "ovs_interfaceid": "e63be854-02c3-4ae4-af88-5d7466611d32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:10:40 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75245) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 16:10:40 user nova-compute[75245]: INFO nova.compute.claims [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] Claim successful on node user
Nov 29 16:10:40 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-e53afadd-4681-482b-ad9c-42e2c13f8a85 req-29024874-8434-4bd5-8058-bbdaf5d10a92 service nova] Releasing lock "refresh_cache-41ce739e-9d85-4d8c-980b-b6845d39e31c" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:10:41 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:41 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:41 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:41 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:10:41 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:10:41 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.891s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:10:41 user nova-compute[75245]: DEBUG nova.compute.manager [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] Start building networks asynchronously for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 16:10:41 user nova-compute[75245]: DEBUG nova.compute.manager [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] Allocating IP information in the background. {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 16:10:41 user nova-compute[75245]: DEBUG nova.network.neutron [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] allocate_for_instance() {{(pid=75245) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 16:10:41 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 16:10:41 user nova-compute[75245]: DEBUG nova.compute.manager [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] Start building block device mappings for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 16:10:42 user nova-compute[75245]: DEBUG nova.policy [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '64e190ebe1954fd6b7db1eeb3b96c7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631a4252b40c45a7a192d0fefabec0d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75245) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 16:10:42 user nova-compute[75245]: DEBUG nova.compute.manager [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] Start spawning the instance on the hypervisor. {{(pid=75245) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 16:10:42 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] Creating instance directory {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 16:10:42 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] Creating image(s)
Nov 29 16:10:42 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] Acquiring lock "/opt/stack/data/nova/instances/55f5b252-468d-4064-99b3-49bdcdf98db8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:10:42 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] Lock "/opt/stack/data/nova/instances/55f5b252-468d-4064-99b3-49bdcdf98db8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:10:42 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] Lock "/opt/stack/data/nova/instances/55f5b252-468d-4064-99b3-49bdcdf98db8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:10:42 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:10:42 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:42 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:42 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:42 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.249s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:10:42 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] Acquiring lock "d654f7206043e05d3525550b0fc885556eb999f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:10:42 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:10:42 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:10:42 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:42 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.264s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:10:42 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/55f5b252-468d-4064-99b3-49bdcdf98db8/disk 1073741824 {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:10:42 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/55f5b252-468d-4064-99b3-49bdcdf98db8/disk 1073741824" returned: 0 in 0.058s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:10:42 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.327s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:10:42 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:10:42 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.286s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:10:42 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] Checking if we can resize image /opt/stack/data/nova/instances/55f5b252-468d-4064-99b3-49bdcdf98db8/disk. size=1073741824 {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 16:10:42 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55f5b252-468d-4064-99b3-49bdcdf98db8/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:10:43 user nova-compute[75245]: DEBUG nova.network.neutron [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] Successfully created port: eb8171a1-ecbc-43ba-86b5-c4d81f0231b4 {{(pid=75245) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 16:10:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55f5b252-468d-4064-99b3-49bdcdf98db8/disk --force-share --output=json" returned: 0 in 0.307s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:10:43 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] Cannot resize image /opt/stack/data/nova/instances/55f5b252-468d-4064-99b3-49bdcdf98db8/disk to a smaller size. {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 16:10:43 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] Created local disks {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 16:10:43 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] Ensure instance console log exists: /opt/stack/data/nova/instances/55f5b252-468d-4064-99b3-49bdcdf98db8/console.log {{(pid=75245) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 16:10:43 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:10:43 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:10:43 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:10:43 user nova-compute[75245]: DEBUG nova.compute.manager [req-422f83fa-934c-442c-8a91-1fd2466c092b req-5a293457-9881-4f57-afc9-de2288e75a62 service nova] [instance: 41ce739e-9d85-4d8c-980b-b6845d39e31c] Received event network-vif-plugged-e63be854-02c3-4ae4-af88-5d7466611d32 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:10:43 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-422f83fa-934c-442c-8a91-1fd2466c092b req-5a293457-9881-4f57-afc9-de2288e75a62 service nova] Acquiring lock "41ce739e-9d85-4d8c-980b-b6845d39e31c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:10:43 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-422f83fa-934c-442c-8a91-1fd2466c092b req-5a293457-9881-4f57-afc9-de2288e75a62 service nova] Lock "41ce739e-9d85-4d8c-980b-b6845d39e31c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:10:43 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-422f83fa-934c-442c-8a91-1fd2466c092b req-5a293457-9881-4f57-afc9-de2288e75a62 service nova] Lock "41ce739e-9d85-4d8c-980b-b6845d39e31c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:10:43 user nova-compute[75245]: DEBUG nova.compute.manager [req-422f83fa-934c-442c-8a91-1fd2466c092b req-5a293457-9881-4f57-afc9-de2288e75a62 service nova] [instance: 41ce739e-9d85-4d8c-980b-b6845d39e31c] No waiting events found dispatching network-vif-plugged-e63be854-02c3-4ae4-af88-5d7466611d32 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:10:43 user nova-compute[75245]: WARNING nova.compute.manager [req-422f83fa-934c-442c-8a91-1fd2466c092b req-5a293457-9881-4f57-afc9-de2288e75a62 service nova] [instance: 41ce739e-9d85-4d8c-980b-b6845d39e31c] Received unexpected event network-vif-plugged-e63be854-02c3-4ae4-af88-5d7466611d32 for instance with vm_state building and task_state spawning.
Nov 29 16:10:44 user nova-compute[75245]: DEBUG nova.network.neutron [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] Successfully updated port: eb8171a1-ecbc-43ba-86b5-c4d81f0231b4 {{(pid=75245) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 16:10:44 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] Acquiring lock "refresh_cache-55f5b252-468d-4064-99b3-49bdcdf98db8" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:10:44 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] Acquired lock "refresh_cache-55f5b252-468d-4064-99b3-49bdcdf98db8" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:10:44 user nova-compute[75245]: DEBUG nova.network.neutron [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 16:10:44 user nova-compute[75245]: DEBUG nova.network.neutron [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] Instance cache missing network info. {{(pid=75245) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 16:10:44 user nova-compute[75245]: DEBUG nova.compute.manager [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] [instance: 41ce739e-9d85-4d8c-980b-b6845d39e31c] Instance event wait completed in 0 seconds for  {{(pid=75245) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 16:10:44 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] [instance: 41ce739e-9d85-4d8c-980b-b6845d39e31c] Guest created on hypervisor {{(pid=75245) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 16:10:44 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 41ce739e-9d85-4d8c-980b-b6845d39e31c] Instance spawned successfully.
Nov 29 16:10:44 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] [instance: 41ce739e-9d85-4d8c-980b-b6845d39e31c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 16:10:44 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] [instance: 41ce739e-9d85-4d8c-980b-b6845d39e31c] Found default for hw_cdrom_bus of ide {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:10:44 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] [instance: 41ce739e-9d85-4d8c-980b-b6845d39e31c] Found default for hw_disk_bus of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:10:44 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] [instance: 41ce739e-9d85-4d8c-980b-b6845d39e31c] Found default for hw_input_bus of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:10:44 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] [instance: 41ce739e-9d85-4d8c-980b-b6845d39e31c] Found default for hw_pointer_model of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:10:44 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] [instance: 41ce739e-9d85-4d8c-980b-b6845d39e31c] Found default for hw_video_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:10:44 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] [instance: 41ce739e-9d85-4d8c-980b-b6845d39e31c] Found default for hw_vif_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:10:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:44 user nova-compute[75245]: INFO nova.compute.manager [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] [instance: 41ce739e-9d85-4d8c-980b-b6845d39e31c] Took 9.41 seconds to spawn the instance on the hypervisor.
Nov 29 16:10:44 user nova-compute[75245]: DEBUG nova.compute.manager [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] [instance: 41ce739e-9d85-4d8c-980b-b6845d39e31c] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:10:44 user nova-compute[75245]: DEBUG nova.network.neutron [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] Updating instance_info_cache with network_info: [{"id": "eb8171a1-ecbc-43ba-86b5-c4d81f0231b4", "address": "fa:16:3e:ec:7c:03", "network": {"id": "675752ef-e4b8-410c-a508-00abae320208", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1370872233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "631a4252b40c45a7a192d0fefabec0d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb8171a1-ec", "ovs_interfaceid": "eb8171a1-ecbc-43ba-86b5-c4d81f0231b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:10:44 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] Releasing lock "refresh_cache-55f5b252-468d-4064-99b3-49bdcdf98db8" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:10:44 user nova-compute[75245]: DEBUG nova.compute.manager [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] Instance network_info: |[{"id": "eb8171a1-ecbc-43ba-86b5-c4d81f0231b4", "address": "fa:16:3e:ec:7c:03", "network": {"id": "675752ef-e4b8-410c-a508-00abae320208", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1370872233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "631a4252b40c45a7a192d0fefabec0d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb8171a1-ec", "ovs_interfaceid": "eb8171a1-ecbc-43ba-86b5-c4d81f0231b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 16:10:44 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] Start _get_guest_xml network_info=[{"id": "eb8171a1-ecbc-43ba-86b5-c4d81f0231b4", "address": "fa:16:3e:ec:7c:03", "network": {"id": "675752ef-e4b8-410c-a508-00abae320208", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1370872233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "631a4252b40c45a7a192d0fefabec0d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb8171a1-ec", "ovs_interfaceid": "eb8171a1-ecbc-43ba-86b5-c4d81f0231b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'a291d9c3-be02-4c6c-9649-4b45c5b7f487'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 16:10:44 user nova-compute[75245]: DEBUG nova.compute.manager [req-f687170b-5d75-4359-9522-4ca074ca9482 req-cd244514-cd0a-4516-a897-688f9763011b service nova] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] Received event network-changed-eb8171a1-ecbc-43ba-86b5-c4d81f0231b4 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:10:44 user nova-compute[75245]: DEBUG nova.compute.manager [req-f687170b-5d75-4359-9522-4ca074ca9482 req-cd244514-cd0a-4516-a897-688f9763011b service nova] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] Refreshing instance network info cache due to event network-changed-eb8171a1-ecbc-43ba-86b5-c4d81f0231b4. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:10:44 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-f687170b-5d75-4359-9522-4ca074ca9482 req-cd244514-cd0a-4516-a897-688f9763011b service nova] Acquiring lock "refresh_cache-55f5b252-468d-4064-99b3-49bdcdf98db8" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:10:44 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-f687170b-5d75-4359-9522-4ca074ca9482 req-cd244514-cd0a-4516-a897-688f9763011b service nova] Acquired lock "refresh_cache-55f5b252-468d-4064-99b3-49bdcdf98db8" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:10:44 user nova-compute[75245]: DEBUG nova.network.neutron [req-f687170b-5d75-4359-9522-4ca074ca9482 req-cd244514-cd0a-4516-a897-688f9763011b service nova] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] Refreshing network info cache for port eb8171a1-ecbc-43ba-86b5-c4d81f0231b4 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:10:44 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:10:44 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:10:44 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 16:10:44 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] CPU controller missing on host. {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 16:10:44 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 16:10:44 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] CPU controller found on host. {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 16:10:44 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75245) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 16:10:44 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T16:06:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 16:10:44 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] Flavor limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 16:10:44 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] Image limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 16:10:44 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] Flavor pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 16:10:44 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] Image pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 16:10:44 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 16:10:44 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 16:10:44 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 16:10:44 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] Got 1 possible topologies {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 16:10:44 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 16:10:44 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 16:10:44 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:10:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-2039927274',display_name='tempest-VolumesAssistedSnapshotsTest-server-2039927274',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-2039927274',id=8,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIlDZJSu5j7dU2EIWtn3rkn43PtYiKLciomrgOwP2Fg5AB4HbaKLm7AtTLVa2LMXb4hEXOVjnMhJq3LbqcLb39Web1zncwTZqYeK4/jz3ZLSncdM+cp8q7f4ljCgRK0hUA==',key_name='tempest-keypair-752852639',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='631a4252b40c45a7a192d0fefabec0d5',ramdisk_id='',reservation_id='r-s6z0usbp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-818874217',owner_user_name='tempest-VolumesAssistedSnapshotsTest-818874217-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:10:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64e190ebe1954fd6b7db1eeb3b96c7b0',uuid=55f5b252-468d-4064-99b3-49bdcdf98db8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb8171a1-ecbc-43ba-86b5-c4d81f0231b4", "address": "fa:16:3e:ec:7c:03", "network": {"id": "675752ef-e4b8-410c-a508-00abae320208", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1370872233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "631a4252b40c45a7a192d0fefabec0d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb8171a1-ec", "ovs_interfaceid": "eb8171a1-ecbc-43ba-86b5-c4d81f0231b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:10:44 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] Converting VIF {"id": "eb8171a1-ecbc-43ba-86b5-c4d81f0231b4", "address": "fa:16:3e:ec:7c:03", "network": {"id": "675752ef-e4b8-410c-a508-00abae320208", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1370872233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "631a4252b40c45a7a192d0fefabec0d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb8171a1-ec", "ovs_interfaceid": "eb8171a1-ecbc-43ba-86b5-c4d81f0231b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:10:44 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:7c:03,bridge_name='br-int',has_traffic_filtering=True,id=eb8171a1-ecbc-43ba-86b5-c4d81f0231b4,network=Network(675752ef-e4b8-410c-a508-00abae320208),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb8171a1-ec') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:10:44 user nova-compute[75245]: DEBUG nova.objects.instance [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] Lazy-loading 'pci_devices' on Instance uuid 55f5b252-468d-4064-99b3-49bdcdf98db8 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:10:44 user nova-compute[75245]: INFO nova.compute.manager [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] [instance: 41ce739e-9d85-4d8c-980b-b6845d39e31c] Took 11.12 seconds to build instance.
Nov 29 16:10:44 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] End _get_guest_xml xml=<domain type="kvm">
Nov 29 16:10:44 user nova-compute[75245]:   <uuid>55f5b252-468d-4064-99b3-49bdcdf98db8</uuid>
Nov 29 16:10:44 user nova-compute[75245]:   <name>instance-00000008</name>
Nov 29 16:10:44 user nova-compute[75245]:   <memory>524288</memory>
Nov 29 16:10:44 user nova-compute[75245]:   <vcpu>1</vcpu>
Nov 29 16:10:44 user nova-compute[75245]:   <metadata>
Nov 29 16:10:44 user nova-compute[75245]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 16:10:44 user nova-compute[75245]:       <nova:package version="0.0.0"/>
Nov 29 16:10:44 user nova-compute[75245]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-2039927274</nova:name>
Nov 29 16:10:44 user nova-compute[75245]:       <nova:creationTime>2023-11-29 16:10:44</nova:creationTime>
Nov 29 16:10:44 user nova-compute[75245]:       <nova:flavor name="m1.tiny">
Nov 29 16:10:44 user nova-compute[75245]:         <nova:memory>512</nova:memory>
Nov 29 16:10:44 user nova-compute[75245]:         <nova:disk>1</nova:disk>
Nov 29 16:10:44 user nova-compute[75245]:         <nova:swap>0</nova:swap>
Nov 29 16:10:44 user nova-compute[75245]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 16:10:44 user nova-compute[75245]:         <nova:vcpus>1</nova:vcpus>
Nov 29 16:10:44 user nova-compute[75245]:       </nova:flavor>
Nov 29 16:10:44 user nova-compute[75245]:       <nova:owner>
Nov 29 16:10:44 user nova-compute[75245]:         <nova:user uuid="64e190ebe1954fd6b7db1eeb3b96c7b0">tempest-VolumesAssistedSnapshotsTest-818874217-project-member</nova:user>
Nov 29 16:10:44 user nova-compute[75245]:         <nova:project uuid="631a4252b40c45a7a192d0fefabec0d5">tempest-VolumesAssistedSnapshotsTest-818874217</nova:project>
Nov 29 16:10:44 user nova-compute[75245]:       </nova:owner>
Nov 29 16:10:44 user nova-compute[75245]:       <nova:root type="image" uuid="a291d9c3-be02-4c6c-9649-4b45c5b7f487"/>
Nov 29 16:10:44 user nova-compute[75245]:       <nova:ports>
Nov 29 16:10:44 user nova-compute[75245]:         <nova:port uuid="eb8171a1-ecbc-43ba-86b5-c4d81f0231b4">
Nov 29 16:10:44 user nova-compute[75245]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 29 16:10:44 user nova-compute[75245]:         </nova:port>
Nov 29 16:10:44 user nova-compute[75245]:       </nova:ports>
Nov 29 16:10:44 user nova-compute[75245]:     </nova:instance>
Nov 29 16:10:44 user nova-compute[75245]:   </metadata>
Nov 29 16:10:44 user nova-compute[75245]:   <sysinfo type="smbios">
Nov 29 16:10:44 user nova-compute[75245]:     <system>
Nov 29 16:10:44 user nova-compute[75245]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 16:10:44 user nova-compute[75245]:       <entry name="product">OpenStack Nova</entry>
Nov 29 16:10:44 user nova-compute[75245]:       <entry name="version">0.0.0</entry>
Nov 29 16:10:44 user nova-compute[75245]:       <entry name="serial">55f5b252-468d-4064-99b3-49bdcdf98db8</entry>
Nov 29 16:10:44 user nova-compute[75245]:       <entry name="uuid">55f5b252-468d-4064-99b3-49bdcdf98db8</entry>
Nov 29 16:10:44 user nova-compute[75245]:       <entry name="family">Virtual Machine</entry>
Nov 29 16:10:44 user nova-compute[75245]:     </system>
Nov 29 16:10:44 user nova-compute[75245]:   </sysinfo>
Nov 29 16:10:44 user nova-compute[75245]:   <os>
Nov 29 16:10:44 user nova-compute[75245]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 16:10:44 user nova-compute[75245]:     <boot dev="hd"/>
Nov 29 16:10:44 user nova-compute[75245]:     <smbios mode="sysinfo"/>
Nov 29 16:10:44 user nova-compute[75245]:   </os>
Nov 29 16:10:44 user nova-compute[75245]:   <features>
Nov 29 16:10:44 user nova-compute[75245]:     <acpi/>
Nov 29 16:10:44 user nova-compute[75245]:     <apic/>
Nov 29 16:10:44 user nova-compute[75245]:     <vmcoreinfo/>
Nov 29 16:10:44 user nova-compute[75245]:   </features>
Nov 29 16:10:44 user nova-compute[75245]:   <clock offset="utc">
Nov 29 16:10:44 user nova-compute[75245]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 16:10:44 user nova-compute[75245]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 16:10:44 user nova-compute[75245]:     <timer name="hpet" present="no"/>
Nov 29 16:10:44 user nova-compute[75245]:   </clock>
Nov 29 16:10:44 user nova-compute[75245]:   <cpu mode="custom" match="exact">
Nov 29 16:10:44 user nova-compute[75245]:     <model>Nehalem</model>
Nov 29 16:10:44 user nova-compute[75245]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 16:10:44 user nova-compute[75245]:   </cpu>
Nov 29 16:10:44 user nova-compute[75245]:   <devices>
Nov 29 16:10:44 user nova-compute[75245]:     <disk type="file" device="disk">
Nov 29 16:10:44 user nova-compute[75245]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 16:10:44 user nova-compute[75245]:       <source file="/opt/stack/data/nova/instances/55f5b252-468d-4064-99b3-49bdcdf98db8/disk"/>
Nov 29 16:10:44 user nova-compute[75245]:       <target dev="vda" bus="virtio"/>
Nov 29 16:10:44 user nova-compute[75245]:     </disk>
Nov 29 16:10:44 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 16:10:44 user nova-compute[75245]:       <mac address="fa:16:3e:ec:7c:03"/>
Nov 29 16:10:44 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:10:44 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 16:10:44 user nova-compute[75245]:       <target dev="tapeb8171a1-ec"/>
Nov 29 16:10:44 user nova-compute[75245]:     </interface>
Nov 29 16:10:44 user nova-compute[75245]:     <serial type="pty">
Nov 29 16:10:44 user nova-compute[75245]:       <log file="/opt/stack/data/nova/instances/55f5b252-468d-4064-99b3-49bdcdf98db8/console.log" append="off"/>
Nov 29 16:10:44 user nova-compute[75245]:     </serial>
Nov 29 16:10:44 user nova-compute[75245]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 16:10:44 user nova-compute[75245]:     <video>
Nov 29 16:10:44 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:10:44 user nova-compute[75245]:     </video>
Nov 29 16:10:44 user nova-compute[75245]:     <rng model="virtio">
Nov 29 16:10:44 user nova-compute[75245]:       <backend model="random">/dev/urandom</backend>
Nov 29 16:10:44 user nova-compute[75245]:     </rng>
Nov 29 16:10:44 user nova-compute[75245]:     <controller type="usb" index="0" model="none"/>
Nov 29 16:10:44 user nova-compute[75245]:     <memballoon model="virtio">
Nov 29 16:10:44 user nova-compute[75245]:       <stats period="10"/>
Nov 29 16:10:44 user nova-compute[75245]:     </memballoon>
Nov 29 16:10:44 user nova-compute[75245]:   </devices>
Nov 29 16:10:44 user nova-compute[75245]: </domain>
Nov 29 16:10:44 user nova-compute[75245]:  {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 16:10:44 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:10:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-2039927274',display_name='tempest-VolumesAssistedSnapshotsTest-server-2039927274',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-2039927274',id=8,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIlDZJSu5j7dU2EIWtn3rkn43PtYiKLciomrgOwP2Fg5AB4HbaKLm7AtTLVa2LMXb4hEXOVjnMhJq3LbqcLb39Web1zncwTZqYeK4/jz3ZLSncdM+cp8q7f4ljCgRK0hUA==',key_name='tempest-keypair-752852639',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='631a4252b40c45a7a192d0fefabec0d5',ramdisk_id='',reservation_id='r-s6z0usbp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-818874217',owner_user_name='tempest-VolumesAssistedSnapshotsTest-818874217-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:10:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64e190ebe1954fd6b7db1eeb3b96c7b0',uuid=55f5b252-468d-4064-99b3-49bdcdf98db8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb8171a1-ecbc-43ba-86b5-c4d81f0231b4", "address": "fa:16:3e:ec:7c:03", "network": {"id": "675752ef-e4b8-410c-a508-00abae320208", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1370872233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "631a4252b40c45a7a192d0fefabec0d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb8171a1-ec", "ovs_interfaceid": "eb8171a1-ecbc-43ba-86b5-c4d81f0231b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 16:10:44 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] Converting VIF {"id": "eb8171a1-ecbc-43ba-86b5-c4d81f0231b4", "address": "fa:16:3e:ec:7c:03", "network": {"id": "675752ef-e4b8-410c-a508-00abae320208", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1370872233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "631a4252b40c45a7a192d0fefabec0d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb8171a1-ec", "ovs_interfaceid": "eb8171a1-ecbc-43ba-86b5-c4d81f0231b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:10:44 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:7c:03,bridge_name='br-int',has_traffic_filtering=True,id=eb8171a1-ecbc-43ba-86b5-c4d81f0231b4,network=Network(675752ef-e4b8-410c-a508-00abae320208),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb8171a1-ec') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:10:44 user nova-compute[75245]: DEBUG os_vif [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:7c:03,bridge_name='br-int',has_traffic_filtering=True,id=eb8171a1-ecbc-43ba-86b5-c4d81f0231b4,network=Network(675752ef-e4b8-410c-a508-00abae320208),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb8171a1-ec') {{(pid=75245) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 16:10:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:10:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 16:10:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd5cf82ae-6426-5547-a99f-1507739355c9', '_type': 'linux-noop'}}, row=False) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:10:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:10:44 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-11f95a5f-9a90-4154-ae2c-c9ebeeb54b7d tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] Lock "41ce739e-9d85-4d8c-980b-b6845d39e31c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.279s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:10:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeb8171a1-ec, may_exist=True, interface_attrs={}) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:10:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeb8171a1-ec, col_values=(('qos', UUID('b366209b-97d8-4eef-8f76-fca1670c097b')),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:10:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeb8171a1-ec, col_values=(('external_ids', {'iface-id': 'eb8171a1-ecbc-43ba-86b5-c4d81f0231b4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:7c:03', 'vm-uuid': '55f5b252-468d-4064-99b3-49bdcdf98db8'}),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:10:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:10:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:44 user nova-compute[75245]: INFO os_vif [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:7c:03,bridge_name='br-int',has_traffic_filtering=True,id=eb8171a1-ecbc-43ba-86b5-c4d81f0231b4,network=Network(675752ef-e4b8-410c-a508-00abae320208),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb8171a1-ec')
Nov 29 16:10:45 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:10:45 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] No VIF found with MAC fa:16:3e:ec:7c:03, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:10:45 user nova-compute[75245]: DEBUG nova.network.neutron [req-f687170b-5d75-4359-9522-4ca074ca9482 req-cd244514-cd0a-4516-a897-688f9763011b service nova] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] Updated VIF entry in instance network info cache for port eb8171a1-ecbc-43ba-86b5-c4d81f0231b4. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:10:45 user nova-compute[75245]: DEBUG nova.network.neutron [req-f687170b-5d75-4359-9522-4ca074ca9482 req-cd244514-cd0a-4516-a897-688f9763011b service nova] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] Updating instance_info_cache with network_info: [{"id": "eb8171a1-ecbc-43ba-86b5-c4d81f0231b4", "address": "fa:16:3e:ec:7c:03", "network": {"id": "675752ef-e4b8-410c-a508-00abae320208", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1370872233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "631a4252b40c45a7a192d0fefabec0d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb8171a1-ec", "ovs_interfaceid": "eb8171a1-ecbc-43ba-86b5-c4d81f0231b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:10:45 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-f687170b-5d75-4359-9522-4ca074ca9482 req-cd244514-cd0a-4516-a897-688f9763011b service nova] Releasing lock "refresh_cache-55f5b252-468d-4064-99b3-49bdcdf98db8" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:10:46 user nova-compute[75245]: DEBUG nova.compute.manager [req-8981ad26-9c81-445c-a913-c7e69c4568d9 req-f23372ac-eb78-45e9-8121-d7077e784b51 service nova] [instance: 41ce739e-9d85-4d8c-980b-b6845d39e31c] Received event network-vif-plugged-e63be854-02c3-4ae4-af88-5d7466611d32 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:10:46 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-8981ad26-9c81-445c-a913-c7e69c4568d9 req-f23372ac-eb78-45e9-8121-d7077e784b51 service nova] Acquiring lock "41ce739e-9d85-4d8c-980b-b6845d39e31c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:10:46 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-8981ad26-9c81-445c-a913-c7e69c4568d9 req-f23372ac-eb78-45e9-8121-d7077e784b51 service nova] Lock "41ce739e-9d85-4d8c-980b-b6845d39e31c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:10:46 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-8981ad26-9c81-445c-a913-c7e69c4568d9 req-f23372ac-eb78-45e9-8121-d7077e784b51 service nova] Lock "41ce739e-9d85-4d8c-980b-b6845d39e31c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:10:46 user nova-compute[75245]: DEBUG nova.compute.manager [req-8981ad26-9c81-445c-a913-c7e69c4568d9 req-f23372ac-eb78-45e9-8121-d7077e784b51 service nova] [instance: 41ce739e-9d85-4d8c-980b-b6845d39e31c] No waiting events found dispatching network-vif-plugged-e63be854-02c3-4ae4-af88-5d7466611d32 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:10:46 user nova-compute[75245]: WARNING nova.compute.manager [req-8981ad26-9c81-445c-a913-c7e69c4568d9 req-f23372ac-eb78-45e9-8121-d7077e784b51 service nova] [instance: 41ce739e-9d85-4d8c-980b-b6845d39e31c] Received unexpected event network-vif-plugged-e63be854-02c3-4ae4-af88-5d7466611d32 for instance with vm_state active and task_state None.
Nov 29 16:10:46 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:46 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:46 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:47 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:47 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:47 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:47 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:47 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:47 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:48 user nova-compute[75245]: DEBUG nova.compute.manager [req-194eef65-4509-42fc-9bae-44b676a32da1 req-9a3debbc-423d-4202-896a-6fd9ea2b3446 service nova] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] Received event network-vif-plugged-eb8171a1-ecbc-43ba-86b5-c4d81f0231b4 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:10:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-194eef65-4509-42fc-9bae-44b676a32da1 req-9a3debbc-423d-4202-896a-6fd9ea2b3446 service nova] Acquiring lock "55f5b252-468d-4064-99b3-49bdcdf98db8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:10:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-194eef65-4509-42fc-9bae-44b676a32da1 req-9a3debbc-423d-4202-896a-6fd9ea2b3446 service nova] Lock "55f5b252-468d-4064-99b3-49bdcdf98db8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:10:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-194eef65-4509-42fc-9bae-44b676a32da1 req-9a3debbc-423d-4202-896a-6fd9ea2b3446 service nova] Lock "55f5b252-468d-4064-99b3-49bdcdf98db8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:10:48 user nova-compute[75245]: DEBUG nova.compute.manager [req-194eef65-4509-42fc-9bae-44b676a32da1 req-9a3debbc-423d-4202-896a-6fd9ea2b3446 service nova] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] No waiting events found dispatching network-vif-plugged-eb8171a1-ecbc-43ba-86b5-c4d81f0231b4 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:10:48 user nova-compute[75245]: WARNING nova.compute.manager [req-194eef65-4509-42fc-9bae-44b676a32da1 req-9a3debbc-423d-4202-896a-6fd9ea2b3446 service nova] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] Received unexpected event network-vif-plugged-eb8171a1-ecbc-43ba-86b5-c4d81f0231b4 for instance with vm_state building and task_state spawning.
Nov 29 16:10:48 user nova-compute[75245]: DEBUG nova.compute.manager [req-194eef65-4509-42fc-9bae-44b676a32da1 req-9a3debbc-423d-4202-896a-6fd9ea2b3446 service nova] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] Received event network-vif-plugged-eb8171a1-ecbc-43ba-86b5-c4d81f0231b4 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:10:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-194eef65-4509-42fc-9bae-44b676a32da1 req-9a3debbc-423d-4202-896a-6fd9ea2b3446 service nova] Acquiring lock "55f5b252-468d-4064-99b3-49bdcdf98db8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:10:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-194eef65-4509-42fc-9bae-44b676a32da1 req-9a3debbc-423d-4202-896a-6fd9ea2b3446 service nova] Lock "55f5b252-468d-4064-99b3-49bdcdf98db8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:10:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-194eef65-4509-42fc-9bae-44b676a32da1 req-9a3debbc-423d-4202-896a-6fd9ea2b3446 service nova] Lock "55f5b252-468d-4064-99b3-49bdcdf98db8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:10:48 user nova-compute[75245]: DEBUG nova.compute.manager [req-194eef65-4509-42fc-9bae-44b676a32da1 req-9a3debbc-423d-4202-896a-6fd9ea2b3446 service nova] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] No waiting events found dispatching network-vif-plugged-eb8171a1-ecbc-43ba-86b5-c4d81f0231b4 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:10:48 user nova-compute[75245]: WARNING nova.compute.manager [req-194eef65-4509-42fc-9bae-44b676a32da1 req-9a3debbc-423d-4202-896a-6fd9ea2b3446 service nova] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] Received unexpected event network-vif-plugged-eb8171a1-ecbc-43ba-86b5-c4d81f0231b4 for instance with vm_state building and task_state spawning.
Nov 29 16:10:48 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:10:48 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Cleaning up deleted instances {{(pid=75245) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 16:10:48 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] There are 0 instances to clean {{(pid=75245) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 16:10:48 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:10:48 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75245) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 16:10:48 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:10:49 user nova-compute[75245]: DEBUG nova.compute.manager [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] Instance event wait completed in 0 seconds for  {{(pid=75245) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 16:10:49 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] Guest created on hypervisor {{(pid=75245) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 16:10:49 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] Instance spawned successfully.
Nov 29 16:10:49 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 16:10:49 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] Found default for hw_cdrom_bus of ide {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:10:49 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] Found default for hw_disk_bus of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:10:49 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] Found default for hw_input_bus of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:10:49 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] Found default for hw_pointer_model of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:10:49 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] Found default for hw_video_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:10:49 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] Found default for hw_vif_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:10:49 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] Acquiring lock "06ccc13b-8769-4c8b-9f9c-b9c26c8f7778" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:10:49 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] Lock "06ccc13b-8769-4c8b-9f9c-b9c26c8f7778" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:10:49 user nova-compute[75245]: DEBUG nova.compute.manager [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] [instance: 06ccc13b-8769-4c8b-9f9c-b9c26c8f7778] Starting instance... {{(pid=75245) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 16:10:49 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:10:49 user nova-compute[75245]: INFO nova.compute.manager [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] Took 7.56 seconds to spawn the instance on the hypervisor.
Nov 29 16:10:49 user nova-compute[75245]: DEBUG nova.compute.manager [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:10:49 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:10:49 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:10:49 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75245) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 16:10:49 user nova-compute[75245]: INFO nova.compute.claims [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] [instance: 06ccc13b-8769-4c8b-9f9c-b9c26c8f7778] Claim successful on node user
Nov 29 16:10:49 user nova-compute[75245]: INFO nova.compute.manager [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] Took 8.95 seconds to build instance.
Nov 29 16:10:49 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-70d9c6d8-96d0-4f28-8ae8-68f8c0c1ff17 tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] Lock "55f5b252-468d-4064-99b3-49bdcdf98db8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.190s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:10:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:50 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:10:50 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:10:50 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.637s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:10:50 user nova-compute[75245]: DEBUG nova.compute.manager [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] [instance: 06ccc13b-8769-4c8b-9f9c-b9c26c8f7778] Start building networks asynchronously for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 16:10:50 user nova-compute[75245]: DEBUG nova.compute.manager [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] [instance: 06ccc13b-8769-4c8b-9f9c-b9c26c8f7778] Allocating IP information in the background. {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 16:10:50 user nova-compute[75245]: DEBUG nova.network.neutron [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] [instance: 06ccc13b-8769-4c8b-9f9c-b9c26c8f7778] allocate_for_instance() {{(pid=75245) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 16:10:50 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:10:50 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Starting heal instance info cache {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 16:10:50 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Rebuilding the list of instances to heal {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 16:10:50 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] [instance: 06ccc13b-8769-4c8b-9f9c-b9c26c8f7778] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 16:10:50 user nova-compute[75245]: DEBUG nova.compute.manager [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] [instance: 06ccc13b-8769-4c8b-9f9c-b9c26c8f7778] Start building block device mappings for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 16:10:50 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 06ccc13b-8769-4c8b-9f9c-b9c26c8f7778] Skipping network cache update for instance because it is Building. {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 29 16:10:50 user nova-compute[75245]: DEBUG nova.compute.manager [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] [instance: 06ccc13b-8769-4c8b-9f9c-b9c26c8f7778] Start spawning the instance on the hypervisor. {{(pid=75245) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 16:10:50 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] [instance: 06ccc13b-8769-4c8b-9f9c-b9c26c8f7778] Creating instance directory {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 16:10:50 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] [instance: 06ccc13b-8769-4c8b-9f9c-b9c26c8f7778] Creating image(s)
Nov 29 16:10:50 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] Acquiring lock "/opt/stack/data/nova/instances/06ccc13b-8769-4c8b-9f9c-b9c26c8f7778/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:10:50 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] Lock "/opt/stack/data/nova/instances/06ccc13b-8769-4c8b-9f9c-b9c26c8f7778/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:10:50 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] Lock "/opt/stack/data/nova/instances/06ccc13b-8769-4c8b-9f9c-b9c26c8f7778/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:10:50 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "refresh_cache-738c0d7a-af77-41f7-9206-0e6b1f18a154" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:10:50 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquired lock "refresh_cache-738c0d7a-af77-41f7-9206-0e6b1f18a154" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:10:50 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 738c0d7a-af77-41f7-9206-0e6b1f18a154] Forcefully refreshing network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 16:10:50 user nova-compute[75245]: DEBUG nova.objects.instance [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lazy-loading 'info_cache' on Instance uuid 738c0d7a-af77-41f7-9206-0e6b1f18a154 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:10:50 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:10:50 user nova-compute[75245]: DEBUG nova.policy [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd8e392186cf44341b3f7491662dc6b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a1fecac724d6f8baaa28f253bcc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75245) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 16:10:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.242s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:10:51 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] Acquiring lock "d654f7206043e05d3525550b0fc885556eb999f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:10:51 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:10:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:10:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.265s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:10:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/06ccc13b-8769-4c8b-9f9c-b9c26c8f7778/disk 1073741824 {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:10:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/06ccc13b-8769-4c8b-9f9c-b9c26c8f7778/disk 1073741824" returned: 0 in 0.066s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:10:51 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.337s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:10:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:10:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.203s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:10:51 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] Checking if we can resize image /opt/stack/data/nova/instances/06ccc13b-8769-4c8b-9f9c-b9c26c8f7778/disk. size=1073741824 {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 16:10:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ccc13b-8769-4c8b-9f9c-b9c26c8f7778/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:10:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ccc13b-8769-4c8b-9f9c-b9c26c8f7778/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:10:51 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] Cannot resize image /opt/stack/data/nova/instances/06ccc13b-8769-4c8b-9f9c-b9c26c8f7778/disk to a smaller size. {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 16:10:51 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] [instance: 06ccc13b-8769-4c8b-9f9c-b9c26c8f7778] Created local disks {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 16:10:51 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] [instance: 06ccc13b-8769-4c8b-9f9c-b9c26c8f7778] Ensure instance console log exists: /opt/stack/data/nova/instances/06ccc13b-8769-4c8b-9f9c-b9c26c8f7778/console.log {{(pid=75245) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 16:10:51 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:10:51 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:10:51 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:10:51 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 738c0d7a-af77-41f7-9206-0e6b1f18a154] Updating instance_info_cache with network_info: [{"id": "6868c459-7c16-48e4-8806-577f44063ef2", "address": "fa:16:3e:0f:8f:e0", "network": {"id": "04c28abb-e8e0-4147-aa0d-a9d58efbb016", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-93900798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f499a0ff13e421b88e2712a21784fe0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6868c459-7c", "ovs_interfaceid": "6868c459-7c16-48e4-8806-577f44063ef2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:10:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Releasing lock "refresh_cache-738c0d7a-af77-41f7-9206-0e6b1f18a154" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:10:52 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 738c0d7a-af77-41f7-9206-0e6b1f18a154] Updated the network info_cache for instance {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 16:10:52 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:10:52 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:10:52 user nova-compute[75245]: DEBUG nova.network.neutron [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] [instance: 06ccc13b-8769-4c8b-9f9c-b9c26c8f7778] Successfully created port: d21b7d48-b9e1-40d9-9dd9-3f04e172d8b6 {{(pid=75245) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 16:10:52 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:10:52 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:10:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:10:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:10:52 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75245) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 16:10:52 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/738c0d7a-af77-41f7-9206-0e6b1f18a154/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:10:52 user nova-compute[75245]: DEBUG nova.network.neutron [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] [instance: 06ccc13b-8769-4c8b-9f9c-b9c26c8f7778] Successfully updated port: d21b7d48-b9e1-40d9-9dd9-3f04e172d8b6 {{(pid=75245) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 16:10:52 user nova-compute[75245]: DEBUG nova.compute.manager [req-fbd9a64c-8f0f-4a5a-822c-5c209aca3c56 req-9cfcb215-3afe-44ae-ad12-7b7a1f9274e9 service nova] [instance: 06ccc13b-8769-4c8b-9f9c-b9c26c8f7778] Received event network-changed-d21b7d48-b9e1-40d9-9dd9-3f04e172d8b6 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:10:52 user nova-compute[75245]: DEBUG nova.compute.manager [req-fbd9a64c-8f0f-4a5a-822c-5c209aca3c56 req-9cfcb215-3afe-44ae-ad12-7b7a1f9274e9 service nova] [instance: 06ccc13b-8769-4c8b-9f9c-b9c26c8f7778] Refreshing instance network info cache due to event network-changed-d21b7d48-b9e1-40d9-9dd9-3f04e172d8b6. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:10:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-fbd9a64c-8f0f-4a5a-822c-5c209aca3c56 req-9cfcb215-3afe-44ae-ad12-7b7a1f9274e9 service nova] Acquiring lock "refresh_cache-06ccc13b-8769-4c8b-9f9c-b9c26c8f7778" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:10:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-fbd9a64c-8f0f-4a5a-822c-5c209aca3c56 req-9cfcb215-3afe-44ae-ad12-7b7a1f9274e9 service nova] Acquired lock "refresh_cache-06ccc13b-8769-4c8b-9f9c-b9c26c8f7778" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:10:52 user nova-compute[75245]: DEBUG nova.network.neutron [req-fbd9a64c-8f0f-4a5a-822c-5c209aca3c56 req-9cfcb215-3afe-44ae-ad12-7b7a1f9274e9 service nova] [instance: 06ccc13b-8769-4c8b-9f9c-b9c26c8f7778] Refreshing network info cache for port d21b7d48-b9e1-40d9-9dd9-3f04e172d8b6 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:10:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] Acquiring lock "refresh_cache-06ccc13b-8769-4c8b-9f9c-b9c26c8f7778" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:10:53 user nova-compute[75245]: DEBUG nova.network.neutron [req-fbd9a64c-8f0f-4a5a-822c-5c209aca3c56 req-9cfcb215-3afe-44ae-ad12-7b7a1f9274e9 service nova] [instance: 06ccc13b-8769-4c8b-9f9c-b9c26c8f7778] Instance cache missing network info. {{(pid=75245) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 16:10:53 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/738c0d7a-af77-41f7-9206-0e6b1f18a154/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:10:53 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/738c0d7a-af77-41f7-9206-0e6b1f18a154/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:10:53 user nova-compute[75245]: DEBUG nova.network.neutron [req-fbd9a64c-8f0f-4a5a-822c-5c209aca3c56 req-9cfcb215-3afe-44ae-ad12-7b7a1f9274e9 service nova] [instance: 06ccc13b-8769-4c8b-9f9c-b9c26c8f7778] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:10:53 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/738c0d7a-af77-41f7-9206-0e6b1f18a154/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:10:53 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41ce739e-9d85-4d8c-980b-b6845d39e31c/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:10:53 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-fbd9a64c-8f0f-4a5a-822c-5c209aca3c56 req-9cfcb215-3afe-44ae-ad12-7b7a1f9274e9 service nova] Releasing lock "refresh_cache-06ccc13b-8769-4c8b-9f9c-b9c26c8f7778" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:10:53 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] Acquired lock "refresh_cache-06ccc13b-8769-4c8b-9f9c-b9c26c8f7778" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:10:53 user nova-compute[75245]: DEBUG nova.network.neutron [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] [instance: 06ccc13b-8769-4c8b-9f9c-b9c26c8f7778] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 16:10:53 user nova-compute[75245]: DEBUG nova.network.neutron [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] [instance: 06ccc13b-8769-4c8b-9f9c-b9c26c8f7778] Instance cache missing network info. {{(pid=75245) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 16:10:53 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41ce739e-9d85-4d8c-980b-b6845d39e31c/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:10:53 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41ce739e-9d85-4d8c-980b-b6845d39e31c/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:10:53 user nova-compute[75245]: DEBUG nova.network.neutron [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] [instance: 06ccc13b-8769-4c8b-9f9c-b9c26c8f7778] Updating instance_info_cache with network_info: [{"id": "d21b7d48-b9e1-40d9-9dd9-3f04e172d8b6", "address": "fa:16:3e:91:06:a7", "network": {"id": "6de7b493-9ee2-479f-8e5b-7624f9fffc60", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ffdbebd41351498089cb0fadd3b40e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd21b7d48-b9", "ovs_interfaceid": "d21b7d48-b9e1-40d9-9dd9-3f04e172d8b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:10:53 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] Releasing lock "refresh_cache-06ccc13b-8769-4c8b-9f9c-b9c26c8f7778" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:10:53 user nova-compute[75245]: DEBUG nova.compute.manager [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] [instance: 06ccc13b-8769-4c8b-9f9c-b9c26c8f7778] Instance network_info: |[{"id": "d21b7d48-b9e1-40d9-9dd9-3f04e172d8b6", "address": "fa:16:3e:91:06:a7", "network": {"id": "6de7b493-9ee2-479f-8e5b-7624f9fffc60", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ffdbebd41351498089cb0fadd3b40e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd21b7d48-b9", "ovs_interfaceid": "d21b7d48-b9e1-40d9-9dd9-3f04e172d8b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 16:10:53 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] [instance: 06ccc13b-8769-4c8b-9f9c-b9c26c8f7778] Start _get_guest_xml network_info=[{"id": "d21b7d48-b9e1-40d9-9dd9-3f04e172d8b6", "address": "fa:16:3e:91:06:a7", "network": {"id": "6de7b493-9ee2-479f-8e5b-7624f9fffc60", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ffdbebd41351498089cb0fadd3b40e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd21b7d48-b9", "ovs_interfaceid": "d21b7d48-b9e1-40d9-9dd9-3f04e172d8b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'a291d9c3-be02-4c6c-9649-4b45c5b7f487'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 16:10:53 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41ce739e-9d85-4d8c-980b-b6845d39e31c/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:10:53 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:10:53 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:10:53 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55f5b252-468d-4064-99b3-49bdcdf98db8/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:10:53 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 16:10:53 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] CPU controller missing on host. {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 16:10:53 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 16:10:53 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] CPU controller found on host. {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 16:10:53 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75245) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 16:10:53 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T16:06:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 16:10:53 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] Flavor limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 16:10:53 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] Image limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 16:10:53 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] Flavor pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 16:10:53 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] Image pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 16:10:53 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 16:10:53 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 16:10:53 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 16:10:53 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] Got 1 possible topologies {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 16:10:53 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 16:10:53 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 16:10:53 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:10:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-805162112',display_name='tempest-VolumesNegativeTest-instance-805162112',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-805162112',id=9,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a33a1fecac724d6f8baaa28f253bcc5f',ramdisk_id='',reservation_id='r-wtm3qtb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-591560084',owner_user_name='tempest-VolumesNegativeTest-591560084-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:10:51Z,user_data=None,user_id='d8e392186cf44341b3f7491662dc6b2a',uuid=06ccc13b-8769-4c8b-9f9c-b9c26c8f7778,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d21b7d48-b9e1-40d9-9dd9-3f04e172d8b6", "address": "fa:16:3e:91:06:a7", "network": {"id": "6de7b493-9ee2-479f-8e5b-7624f9fffc60", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ffdbebd41351498089cb0fadd3b40e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd21b7d48-b9", "ovs_interfaceid": "d21b7d48-b9e1-40d9-9dd9-3f04e172d8b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:10:53 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] Converting VIF {"id": "d21b7d48-b9e1-40d9-9dd9-3f04e172d8b6", "address": "fa:16:3e:91:06:a7", "network": {"id": "6de7b493-9ee2-479f-8e5b-7624f9fffc60", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ffdbebd41351498089cb0fadd3b40e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd21b7d48-b9", "ovs_interfaceid": "d21b7d48-b9e1-40d9-9dd9-3f04e172d8b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:10:53 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:06:a7,bridge_name='br-int',has_traffic_filtering=True,id=d21b7d48-b9e1-40d9-9dd9-3f04e172d8b6,network=Network(6de7b493-9ee2-479f-8e5b-7624f9fffc60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd21b7d48-b9') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:10:53 user nova-compute[75245]: DEBUG nova.objects.instance [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] Lazy-loading 'pci_devices' on Instance uuid 06ccc13b-8769-4c8b-9f9c-b9c26c8f7778 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:10:53 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] [instance: 06ccc13b-8769-4c8b-9f9c-b9c26c8f7778] End _get_guest_xml xml=<domain type="kvm">
Nov 29 16:10:53 user nova-compute[75245]:   <uuid>06ccc13b-8769-4c8b-9f9c-b9c26c8f7778</uuid>
Nov 29 16:10:53 user nova-compute[75245]:   <name>instance-00000009</name>
Nov 29 16:10:53 user nova-compute[75245]:   <memory>524288</memory>
Nov 29 16:10:53 user nova-compute[75245]:   <vcpu>1</vcpu>
Nov 29 16:10:53 user nova-compute[75245]:   <metadata>
Nov 29 16:10:53 user nova-compute[75245]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 16:10:53 user nova-compute[75245]:       <nova:package version="0.0.0"/>
Nov 29 16:10:53 user nova-compute[75245]:       <nova:name>tempest-VolumesNegativeTest-instance-805162112</nova:name>
Nov 29 16:10:53 user nova-compute[75245]:       <nova:creationTime>2023-11-29 16:10:53</nova:creationTime>
Nov 29 16:10:53 user nova-compute[75245]:       <nova:flavor name="m1.tiny">
Nov 29 16:10:53 user nova-compute[75245]:         <nova:memory>512</nova:memory>
Nov 29 16:10:53 user nova-compute[75245]:         <nova:disk>1</nova:disk>
Nov 29 16:10:53 user nova-compute[75245]:         <nova:swap>0</nova:swap>
Nov 29 16:10:53 user nova-compute[75245]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 16:10:53 user nova-compute[75245]:         <nova:vcpus>1</nova:vcpus>
Nov 29 16:10:53 user nova-compute[75245]:       </nova:flavor>
Nov 29 16:10:53 user nova-compute[75245]:       <nova:owner>
Nov 29 16:10:53 user nova-compute[75245]:         <nova:user uuid="d8e392186cf44341b3f7491662dc6b2a">tempest-VolumesNegativeTest-591560084-project-member</nova:user>
Nov 29 16:10:53 user nova-compute[75245]:         <nova:project uuid="a33a1fecac724d6f8baaa28f253bcc5f">tempest-VolumesNegativeTest-591560084</nova:project>
Nov 29 16:10:53 user nova-compute[75245]:       </nova:owner>
Nov 29 16:10:53 user nova-compute[75245]:       <nova:root type="image" uuid="a291d9c3-be02-4c6c-9649-4b45c5b7f487"/>
Nov 29 16:10:53 user nova-compute[75245]:       <nova:ports>
Nov 29 16:10:53 user nova-compute[75245]:         <nova:port uuid="d21b7d48-b9e1-40d9-9dd9-3f04e172d8b6">
Nov 29 16:10:53 user nova-compute[75245]:           <nova:ip type="fixed" address="192.168.233.112" ipVersion="4"/>
Nov 29 16:10:53 user nova-compute[75245]:         </nova:port>
Nov 29 16:10:53 user nova-compute[75245]:       </nova:ports>
Nov 29 16:10:53 user nova-compute[75245]:     </nova:instance>
Nov 29 16:10:53 user nova-compute[75245]:   </metadata>
Nov 29 16:10:53 user nova-compute[75245]:   <sysinfo type="smbios">
Nov 29 16:10:53 user nova-compute[75245]:     <system>
Nov 29 16:10:53 user nova-compute[75245]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 16:10:53 user nova-compute[75245]:       <entry name="product">OpenStack Nova</entry>
Nov 29 16:10:53 user nova-compute[75245]:       <entry name="version">0.0.0</entry>
Nov 29 16:10:53 user nova-compute[75245]:       <entry name="serial">06ccc13b-8769-4c8b-9f9c-b9c26c8f7778</entry>
Nov 29 16:10:53 user nova-compute[75245]:       <entry name="uuid">06ccc13b-8769-4c8b-9f9c-b9c26c8f7778</entry>
Nov 29 16:10:53 user nova-compute[75245]:       <entry name="family">Virtual Machine</entry>
Nov 29 16:10:53 user nova-compute[75245]:     </system>
Nov 29 16:10:53 user nova-compute[75245]:   </sysinfo>
Nov 29 16:10:53 user nova-compute[75245]:   <os>
Nov 29 16:10:53 user nova-compute[75245]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 16:10:53 user nova-compute[75245]:     <boot dev="hd"/>
Nov 29 16:10:53 user nova-compute[75245]:     <smbios mode="sysinfo"/>
Nov 29 16:10:53 user nova-compute[75245]:   </os>
Nov 29 16:10:53 user nova-compute[75245]:   <features>
Nov 29 16:10:53 user nova-compute[75245]:     <acpi/>
Nov 29 16:10:53 user nova-compute[75245]:     <apic/>
Nov 29 16:10:53 user nova-compute[75245]:     <vmcoreinfo/>
Nov 29 16:10:53 user nova-compute[75245]:   </features>
Nov 29 16:10:53 user nova-compute[75245]:   <clock offset="utc">
Nov 29 16:10:53 user nova-compute[75245]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 16:10:53 user nova-compute[75245]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 16:10:53 user nova-compute[75245]:     <timer name="hpet" present="no"/>
Nov 29 16:10:53 user nova-compute[75245]:   </clock>
Nov 29 16:10:53 user nova-compute[75245]:   <cpu mode="custom" match="exact">
Nov 29 16:10:53 user nova-compute[75245]:     <model>Nehalem</model>
Nov 29 16:10:53 user nova-compute[75245]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 16:10:53 user nova-compute[75245]:   </cpu>
Nov 29 16:10:53 user nova-compute[75245]:   <devices>
Nov 29 16:10:53 user nova-compute[75245]:     <disk type="file" device="disk">
Nov 29 16:10:53 user nova-compute[75245]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 16:10:53 user nova-compute[75245]:       <source file="/opt/stack/data/nova/instances/06ccc13b-8769-4c8b-9f9c-b9c26c8f7778/disk"/>
Nov 29 16:10:53 user nova-compute[75245]:       <target dev="vda" bus="virtio"/>
Nov 29 16:10:53 user nova-compute[75245]:     </disk>
Nov 29 16:10:53 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 16:10:53 user nova-compute[75245]:       <mac address="fa:16:3e:91:06:a7"/>
Nov 29 16:10:53 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:10:53 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 16:10:53 user nova-compute[75245]:       <target dev="tapd21b7d48-b9"/>
Nov 29 16:10:53 user nova-compute[75245]:     </interface>
Nov 29 16:10:53 user nova-compute[75245]:     <serial type="pty">
Nov 29 16:10:53 user nova-compute[75245]:       <log file="/opt/stack/data/nova/instances/06ccc13b-8769-4c8b-9f9c-b9c26c8f7778/console.log" append="off"/>
Nov 29 16:10:53 user nova-compute[75245]:     </serial>
Nov 29 16:10:53 user nova-compute[75245]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 16:10:53 user nova-compute[75245]:     <video>
Nov 29 16:10:53 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:10:53 user nova-compute[75245]:     </video>
Nov 29 16:10:53 user nova-compute[75245]:     <rng model="virtio">
Nov 29 16:10:53 user nova-compute[75245]:       <backend model="random">/dev/urandom</backend>
Nov 29 16:10:53 user nova-compute[75245]:     </rng>
Nov 29 16:10:53 user nova-compute[75245]:     <controller type="usb" index="0" model="none"/>
Nov 29 16:10:53 user nova-compute[75245]:     <memballoon model="virtio">
Nov 29 16:10:53 user nova-compute[75245]:       <stats period="10"/>
Nov 29 16:10:53 user nova-compute[75245]:     </memballoon>
Nov 29 16:10:53 user nova-compute[75245]:   </devices>
Nov 29 16:10:53 user nova-compute[75245]: </domain>
Nov 29 16:10:53 user nova-compute[75245]:  {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 16:10:53 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:10:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-805162112',display_name='tempest-VolumesNegativeTest-instance-805162112',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-805162112',id=9,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a33a1fecac724d6f8baaa28f253bcc5f',ramdisk_id='',reservation_id='r-wtm3qtb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-591560084',owner_user_name='tempest-VolumesNegativeTest-591560084-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:10:51Z,user_data=None,user_id='d8e392186cf44341b3f7491662dc6b2a',uuid=06ccc13b-8769-4c8b-9f9c-b9c26c8f7778,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d21b7d48-b9e1-40d9-9dd9-3f04e172d8b6", "address": "fa:16:3e:91:06:a7", "network": {"id": "6de7b493-9ee2-479f-8e5b-7624f9fffc60", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ffdbebd41351498089cb0fadd3b40e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd21b7d48-b9", "ovs_interfaceid": "d21b7d48-b9e1-40d9-9dd9-3f04e172d8b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 16:10:53 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] Converting VIF {"id": "d21b7d48-b9e1-40d9-9dd9-3f04e172d8b6", "address": "fa:16:3e:91:06:a7", "network": {"id": "6de7b493-9ee2-479f-8e5b-7624f9fffc60", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ffdbebd41351498089cb0fadd3b40e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd21b7d48-b9", "ovs_interfaceid": "d21b7d48-b9e1-40d9-9dd9-3f04e172d8b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:10:53 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:06:a7,bridge_name='br-int',has_traffic_filtering=True,id=d21b7d48-b9e1-40d9-9dd9-3f04e172d8b6,network=Network(6de7b493-9ee2-479f-8e5b-7624f9fffc60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd21b7d48-b9') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:10:53 user nova-compute[75245]: DEBUG os_vif [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:06:a7,bridge_name='br-int',has_traffic_filtering=True,id=d21b7d48-b9e1-40d9-9dd9-3f04e172d8b6,network=Network(6de7b493-9ee2-479f-8e5b-7624f9fffc60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd21b7d48-b9') {{(pid=75245) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 16:10:53 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:53 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:10:53 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 16:10:53 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:53 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bae33a8e-c2dc-56ff-ac39-c11f610f79f0', '_type': 'linux-noop'}}, row=False) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:10:53 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:53 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:10:53 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:53 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:53 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd21b7d48-b9, may_exist=True, interface_attrs={}) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:10:53 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd21b7d48-b9, col_values=(('qos', UUID('9539e7cd-6b45-4b93-a9bb-c21ad5dfcae2')),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:10:53 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd21b7d48-b9, col_values=(('external_ids', {'iface-id': 'd21b7d48-b9e1-40d9-9dd9-3f04e172d8b6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:06:a7', 'vm-uuid': '06ccc13b-8769-4c8b-9f9c-b9c26c8f7778'}),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:10:53 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:53 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:10:53 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:53 user nova-compute[75245]: INFO os_vif [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:06:a7,bridge_name='br-int',has_traffic_filtering=True,id=d21b7d48-b9e1-40d9-9dd9-3f04e172d8b6,network=Network(6de7b493-9ee2-479f-8e5b-7624f9fffc60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd21b7d48-b9')
Nov 29 16:10:53 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55f5b252-468d-4064-99b3-49bdcdf98db8/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:10:53 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55f5b252-468d-4064-99b3-49bdcdf98db8/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:10:53 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:10:53 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] No VIF found with MAC fa:16:3e:91:06:a7, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:10:54 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55f5b252-468d-4064-99b3-49bdcdf98db8/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:10:54 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ab9d7cd-79cd-4c9b-8608-c1ef0f333305/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:10:54 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ab9d7cd-79cd-4c9b-8608-c1ef0f333305/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:10:54 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ab9d7cd-79cd-4c9b-8608-c1ef0f333305/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:10:54 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ab9d7cd-79cd-4c9b-8608-c1ef0f333305/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:10:54 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:10:54 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Acquiring lock "696417e7-8eff-46f3-a6f1-11a9f5191627" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:10:54 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Lock "696417e7-8eff-46f3-a6f1-11a9f5191627" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:10:54 user nova-compute[75245]: DEBUG nova.compute.manager [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Starting instance... {{(pid=75245) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 16:10:54 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:10:54 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:10:54 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:10:54 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:10:54 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75245) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 16:10:54 user nova-compute[75245]: INFO nova.compute.claims [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Claim successful on node user
Nov 29 16:10:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:10:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fea3d2-6db1-4766-ad5b-9ad1e728ea10/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:10:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fea3d2-6db1-4766-ad5b-9ad1e728ea10/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:10:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fea3d2-6db1-4766-ad5b-9ad1e728ea10/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:10:55 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:10:55 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:55 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:10:55 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.677s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:10:55 user nova-compute[75245]: DEBUG nova.compute.manager [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Start building networks asynchronously for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 16:10:55 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:55 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fea3d2-6db1-4766-ad5b-9ad1e728ea10/disk --force-share --output=json" returned: 0 in 0.294s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:10:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:10:55 user nova-compute[75245]: DEBUG nova.compute.manager [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Allocating IP information in the background. {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 16:10:55 user nova-compute[75245]: DEBUG nova.network.neutron [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] allocate_for_instance() {{(pid=75245) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 16:10:55 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 16:10:56 user nova-compute[75245]: DEBUG nova.compute.manager [req-e2f5f6ae-dc1d-41d6-8464-4feaf1be9610 req-a7acbc42-e680-4f0e-a009-f203e473b66e service nova] [instance: 06ccc13b-8769-4c8b-9f9c-b9c26c8f7778] Received event network-vif-plugged-d21b7d48-b9e1-40d9-9dd9-3f04e172d8b6 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:10:56 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-e2f5f6ae-dc1d-41d6-8464-4feaf1be9610 req-a7acbc42-e680-4f0e-a009-f203e473b66e service nova] Acquiring lock "06ccc13b-8769-4c8b-9f9c-b9c26c8f7778-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:10:56 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-e2f5f6ae-dc1d-41d6-8464-4feaf1be9610 req-a7acbc42-e680-4f0e-a009-f203e473b66e service nova] Lock "06ccc13b-8769-4c8b-9f9c-b9c26c8f7778-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:10:56 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-e2f5f6ae-dc1d-41d6-8464-4feaf1be9610 req-a7acbc42-e680-4f0e-a009-f203e473b66e service nova] Lock "06ccc13b-8769-4c8b-9f9c-b9c26c8f7778-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:10:56 user nova-compute[75245]: DEBUG nova.compute.manager [req-e2f5f6ae-dc1d-41d6-8464-4feaf1be9610 req-a7acbc42-e680-4f0e-a009-f203e473b66e service nova] [instance: 06ccc13b-8769-4c8b-9f9c-b9c26c8f7778] No waiting events found dispatching network-vif-plugged-d21b7d48-b9e1-40d9-9dd9-3f04e172d8b6 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:10:56 user nova-compute[75245]: WARNING nova.compute.manager [req-e2f5f6ae-dc1d-41d6-8464-4feaf1be9610 req-a7acbc42-e680-4f0e-a009-f203e473b66e service nova] [instance: 06ccc13b-8769-4c8b-9f9c-b9c26c8f7778] Received unexpected event network-vif-plugged-d21b7d48-b9e1-40d9-9dd9-3f04e172d8b6 for instance with vm_state building and task_state spawning.
Nov 29 16:10:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk --force-share --output=json" returned: 0 in 0.334s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:10:56 user nova-compute[75245]: DEBUG nova.compute.manager [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Start building block device mappings for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 16:10:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:10:56 user nova-compute[75245]: INFO nova.virt.block_device [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Booting with volume 86bd6476-7e72-486f-8c34-0dea88db3678 at /dev/vda
Nov 29 16:10:56 user nova-compute[75245]: DEBUG nova.policy [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1fc59a8c008f4270a8643280e6649e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e751c778a804388a05afe573a7b7828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75245) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 16:10:56 user nova-compute[75245]: DEBUG os_brick.utils [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:10:56 user nova-compute[75245]: INFO oslo.privsep.daemon [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmprvf1vk83/privsep.sock']
Nov 29 16:10:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:10:56 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:56 user sudo[86145]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmprvf1vk83/privsep.sock
Nov 29 16:10:56 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:56 user sudo[86145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 29 16:10:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36728d4f-925b-46a3-b4b5-17f14b9c99c3/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:10:56 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36728d4f-925b-46a3-b4b5-17f14b9c99c3/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:10:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36728d4f-925b-46a3-b4b5-17f14b9c99c3/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:10:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36728d4f-925b-46a3-b4b5-17f14b9c99c3/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:10:58 user sudo[86145]: pam_unix(sudo:session): session closed for user root
Nov 29 16:10:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:58 user nova-compute[75245]: DEBUG nova.network.neutron [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Successfully created port: d116100d-dfd6-4666-86cd-659d5539871a {{(pid=75245) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 16:10:58 user nova-compute[75245]: INFO oslo.privsep.daemon [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Spawned new privsep daemon via rootwrap
Nov 29 16:10:58 user nova-compute[75245]: DEBUG nova.compute.manager [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] [instance: 06ccc13b-8769-4c8b-9f9c-b9c26c8f7778] Instance event wait completed in 0 seconds for  {{(pid=75245) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 16:10:58 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] [instance: 06ccc13b-8769-4c8b-9f9c-b9c26c8f7778] Guest created on hypervisor {{(pid=75245) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 16:10:58 user nova-compute[75245]: DEBUG nova.compute.manager [req-7969fe0c-75c2-4833-b258-7fe5b187a084 req-c567a178-67d3-4526-b700-d6aa02b06302 service nova] [instance: 06ccc13b-8769-4c8b-9f9c-b9c26c8f7778] Received event network-vif-plugged-d21b7d48-b9e1-40d9-9dd9-3f04e172d8b6 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:10:58 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-7969fe0c-75c2-4833-b258-7fe5b187a084 req-c567a178-67d3-4526-b700-d6aa02b06302 service nova] Acquiring lock "06ccc13b-8769-4c8b-9f9c-b9c26c8f7778-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:10:58 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-7969fe0c-75c2-4833-b258-7fe5b187a084 req-c567a178-67d3-4526-b700-d6aa02b06302 service nova] Lock "06ccc13b-8769-4c8b-9f9c-b9c26c8f7778-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:10:58 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-7969fe0c-75c2-4833-b258-7fe5b187a084 req-c567a178-67d3-4526-b700-d6aa02b06302 service nova] Lock "06ccc13b-8769-4c8b-9f9c-b9c26c8f7778-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:10:58 user nova-compute[75245]: DEBUG nova.compute.manager [req-7969fe0c-75c2-4833-b258-7fe5b187a084 req-c567a178-67d3-4526-b700-d6aa02b06302 service nova] [instance: 06ccc13b-8769-4c8b-9f9c-b9c26c8f7778] No waiting events found dispatching network-vif-plugged-d21b7d48-b9e1-40d9-9dd9-3f04e172d8b6 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:10:58 user nova-compute[75245]: WARNING nova.compute.manager [req-7969fe0c-75c2-4833-b258-7fe5b187a084 req-c567a178-67d3-4526-b700-d6aa02b06302 service nova] [instance: 06ccc13b-8769-4c8b-9f9c-b9c26c8f7778] Received unexpected event network-vif-plugged-d21b7d48-b9e1-40d9-9dd9-3f04e172d8b6 for instance with vm_state building and task_state spawning.
Nov 29 16:10:58 user nova-compute[75245]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 29 16:10:58 user nova-compute[75245]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 29 16:10:58 user nova-compute[75245]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 29 16:10:58 user nova-compute[75245]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86166
Nov 29 16:10:58 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:10:58 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:10:58 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Hypervisor/Node resource view: name=user free_ram=7691MB free_disk=25.71269989013672GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75245) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 16:10:58 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:10:58 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:10:58 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 06ccc13b-8769-4c8b-9f9c-b9c26c8f7778] Instance spawned successfully.
Nov 29 16:10:58 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] [instance: 06ccc13b-8769-4c8b-9f9c-b9c26c8f7778] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 16:10:58 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] [instance: 06ccc13b-8769-4c8b-9f9c-b9c26c8f7778] Found default for hw_cdrom_bus of ide {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:10:58 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] [instance: 06ccc13b-8769-4c8b-9f9c-b9c26c8f7778] Found default for hw_disk_bus of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:10:58 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] [instance: 06ccc13b-8769-4c8b-9f9c-b9c26c8f7778] Found default for hw_input_bus of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:10:58 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] [instance: 06ccc13b-8769-4c8b-9f9c-b9c26c8f7778] Found default for hw_pointer_model of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:10:58 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] [instance: 06ccc13b-8769-4c8b-9f9c-b9c26c8f7778] Found default for hw_video_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:10:58 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] [instance: 06ccc13b-8769-4c8b-9f9c-b9c26c8f7778] Found default for hw_vif_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:10:58 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[c743a1c6-bbe1-4faf-aa18-89929af17659]: (2,) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:10:58 user nova-compute[75245]: INFO nova.compute.manager [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] [instance: 06ccc13b-8769-4c8b-9f9c-b9c26c8f7778] Took 7.91 seconds to spawn the instance on the hypervisor.
Nov 29 16:10:58 user nova-compute[75245]: DEBUG nova.compute.manager [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] [instance: 06ccc13b-8769-4c8b-9f9c-b9c26c8f7778] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:10:58 user nova-compute[75245]: INFO nova.compute.manager [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] [instance: 06ccc13b-8769-4c8b-9f9c-b9c26c8f7778] Took 9.09 seconds to build instance.
Nov 29 16:10:58 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-16f644ce-8201-4ec7-908a-ac079dbcf275 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] Lock "06ccc13b-8769-4c8b-9f9c-b9c26c8f7778" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.248s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:10:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:10:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:10:58 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f56132e-162b-4021-949f-7d8f2227a853]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:69ed8ed87091\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:10:58 user nova-compute[75245]: WARNING os_brick.initiator.connectors.nvmeof [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 29 16:10:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:10:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.026s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:10:58 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46013a0-21a0-424d-80e9-034d200d73c7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:10:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:10:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:10:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:10:58 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[c831b7e6-f599-46f5-bcb1-0fb86ae46805]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:10:58 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[491ef24a-5022-470e-bb6d-8668b9684005]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:10:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Running cmd (subprocess): nvme version {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:10:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] 'nvme version' failed. Not Retrying. {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:10:58 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.nvmeof [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] nvme not present on system {{(pid=75245) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 16:10:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:10:58 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 738c0d7a-af77-41f7-9206-0e6b1f18a154 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:10:58 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:10:58 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance ed9a6a4e-2e7d-443c-82ef-f14f11d32c81 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:10:58 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:10:58 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 36728d4f-925b-46a3-b4b5-17f14b9c99c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:10:58 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance e3fea3d2-6db1-4766-ad5b-9ad1e728ea10 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:10:58 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 41ce739e-9d85-4d8c-980b-b6845d39e31c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:10:58 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 55f5b252-468d-4064-99b3-49bdcdf98db8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:10:58 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 06ccc13b-8769-4c8b-9f9c-b9c26c8f7778 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:10:58 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 696417e7-8eff-46f3-a6f1-11a9f5191627 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:10:58 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 16:10:58 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 16:10:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:10:58 user nova-compute[75245]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 16:10:58 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f3a26f-2f88-4a26-88a3-65de70371ee0]: (4, '') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:10:58 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75245) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 16:10:58 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 16:10:58 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] LIGHTOS: no hostnqn found. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 16:10:58 user nova-compute[75245]: DEBUG os_brick.utils [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] <== get_connector_properties: return (2569ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:69ed8ed87091', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:10:58 user nova-compute[75245]: DEBUG nova.virt.block_device [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Updating existing volume attachment record: f7ad6649-bbcc-4b1b-b788-718c989c7ccc {{(pid=75245) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 16:10:58 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Refreshing inventories for resource provider dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 16:10:59 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Updating ProviderTree inventory for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 16:10:59 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Updating inventory in ProviderTree for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 16:10:59 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Refreshing aggregate associations for resource provider dcc0ed27-167e-4f3a-a0de-183bb144a50c, aggregates: None {{(pid=75245) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 16:10:59 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Refreshing trait associations for resource provider dcc0ed27-167e-4f3a-a0de-183bb144a50c, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG {{(pid=75245) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 16:10:59 user nova-compute[75245]: DEBUG nova.network.neutron [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Successfully created port: 1bcb8f7b-abf5-4fe1-8ad9-a1d0316f951a {{(pid=75245) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 16:10:59 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:10:59 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:10:59 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Compute_service record updated for user:user {{(pid=75245) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 16:10:59 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.173s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:10:59 user nova-compute[75245]: DEBUG nova.network.neutron [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Successfully created port: f91c7d1f-43fd-4e3e-9748-dd25010699bd {{(pid=75245) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 16:11:00 user nova-compute[75245]: DEBUG nova.network.neutron [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Successfully created port: 56b28d7b-1c3c-4e60-bbd6-7fd01f07fc6c {{(pid=75245) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 16:11:00 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:11:00 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:11:00 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:11:00 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:11:00 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75245) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 16:11:01 user nova-compute[75245]: DEBUG nova.network.neutron [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Successfully created port: d6c559e9-afbf-473d-b4b0-f3cdff6938bc {{(pid=75245) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 16:11:02 user nova-compute[75245]: DEBUG nova.network.neutron [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Successfully updated port: d116100d-dfd6-4666-86cd-659d5539871a {{(pid=75245) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 16:11:02 user nova-compute[75245]: DEBUG nova.compute.manager [req-c905bda3-bcc6-40d1-991e-290b406d8d01 req-5c3c574b-e6a9-41de-8a27-701143a37b9a service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Received event network-changed-d116100d-dfd6-4666-86cd-659d5539871a {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:11:02 user nova-compute[75245]: DEBUG nova.compute.manager [req-c905bda3-bcc6-40d1-991e-290b406d8d01 req-5c3c574b-e6a9-41de-8a27-701143a37b9a service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Refreshing instance network info cache due to event network-changed-d116100d-dfd6-4666-86cd-659d5539871a. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:11:02 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-c905bda3-bcc6-40d1-991e-290b406d8d01 req-5c3c574b-e6a9-41de-8a27-701143a37b9a service nova] Acquiring lock "refresh_cache-696417e7-8eff-46f3-a6f1-11a9f5191627" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:11:02 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-c905bda3-bcc6-40d1-991e-290b406d8d01 req-5c3c574b-e6a9-41de-8a27-701143a37b9a service nova] Acquired lock "refresh_cache-696417e7-8eff-46f3-a6f1-11a9f5191627" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:11:02 user nova-compute[75245]: DEBUG nova.network.neutron [req-c905bda3-bcc6-40d1-991e-290b406d8d01 req-5c3c574b-e6a9-41de-8a27-701143a37b9a service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Refreshing network info cache for port d116100d-dfd6-4666-86cd-659d5539871a {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:11:02 user nova-compute[75245]: DEBUG nova.network.neutron [req-c905bda3-bcc6-40d1-991e-290b406d8d01 req-5c3c574b-e6a9-41de-8a27-701143a37b9a service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Instance cache missing network info. {{(pid=75245) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 16:11:02 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:02 user nova-compute[75245]: DEBUG nova.network.neutron [req-c905bda3-bcc6-40d1-991e-290b406d8d01 req-5c3c574b-e6a9-41de-8a27-701143a37b9a service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:11:02 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-c905bda3-bcc6-40d1-991e-290b406d8d01 req-5c3c574b-e6a9-41de-8a27-701143a37b9a service nova] Releasing lock "refresh_cache-696417e7-8eff-46f3-a6f1-11a9f5191627" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:11:03 user nova-compute[75245]: DEBUG nova.network.neutron [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Successfully updated port: e2cbf31f-6cf8-4a30-9d9b-3bbb3645a660 {{(pid=75245) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 16:11:03 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:04 user nova-compute[75245]: DEBUG nova.network.neutron [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Successfully updated port: 6a5d2bae-9b9d-4331-b080-badfed69c6b1 {{(pid=75245) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 16:11:04 user nova-compute[75245]: DEBUG nova.compute.manager [req-a8f33bae-c53b-4603-b625-6b02fb5c114e req-f45fe582-ef32-498e-9a52-9ca9ef4296ee service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Received event network-changed-e2cbf31f-6cf8-4a30-9d9b-3bbb3645a660 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:11:04 user nova-compute[75245]: DEBUG nova.compute.manager [req-a8f33bae-c53b-4603-b625-6b02fb5c114e req-f45fe582-ef32-498e-9a52-9ca9ef4296ee service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Refreshing instance network info cache due to event network-changed-e2cbf31f-6cf8-4a30-9d9b-3bbb3645a660. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:11:04 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a8f33bae-c53b-4603-b625-6b02fb5c114e req-f45fe582-ef32-498e-9a52-9ca9ef4296ee service nova] Acquiring lock "refresh_cache-696417e7-8eff-46f3-a6f1-11a9f5191627" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:11:04 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a8f33bae-c53b-4603-b625-6b02fb5c114e req-f45fe582-ef32-498e-9a52-9ca9ef4296ee service nova] Acquired lock "refresh_cache-696417e7-8eff-46f3-a6f1-11a9f5191627" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:11:04 user nova-compute[75245]: DEBUG nova.network.neutron [req-a8f33bae-c53b-4603-b625-6b02fb5c114e req-f45fe582-ef32-498e-9a52-9ca9ef4296ee service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Refreshing network info cache for port e2cbf31f-6cf8-4a30-9d9b-3bbb3645a660 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:11:04 user nova-compute[75245]: DEBUG nova.network.neutron [req-a8f33bae-c53b-4603-b625-6b02fb5c114e req-f45fe582-ef32-498e-9a52-9ca9ef4296ee service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Instance cache missing network info. {{(pid=75245) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 16:11:04 user nova-compute[75245]: DEBUG nova.network.neutron [req-a8f33bae-c53b-4603-b625-6b02fb5c114e req-f45fe582-ef32-498e-9a52-9ca9ef4296ee service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:11:04 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a8f33bae-c53b-4603-b625-6b02fb5c114e req-f45fe582-ef32-498e-9a52-9ca9ef4296ee service nova] Releasing lock "refresh_cache-696417e7-8eff-46f3-a6f1-11a9f5191627" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:11:04 user nova-compute[75245]: DEBUG nova.compute.manager [req-a8f33bae-c53b-4603-b625-6b02fb5c114e req-f45fe582-ef32-498e-9a52-9ca9ef4296ee service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Received event network-changed-6a5d2bae-9b9d-4331-b080-badfed69c6b1 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:11:04 user nova-compute[75245]: DEBUG nova.compute.manager [req-a8f33bae-c53b-4603-b625-6b02fb5c114e req-f45fe582-ef32-498e-9a52-9ca9ef4296ee service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Refreshing instance network info cache due to event network-changed-6a5d2bae-9b9d-4331-b080-badfed69c6b1. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:11:04 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a8f33bae-c53b-4603-b625-6b02fb5c114e req-f45fe582-ef32-498e-9a52-9ca9ef4296ee service nova] Acquiring lock "refresh_cache-696417e7-8eff-46f3-a6f1-11a9f5191627" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:11:04 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a8f33bae-c53b-4603-b625-6b02fb5c114e req-f45fe582-ef32-498e-9a52-9ca9ef4296ee service nova] Acquired lock "refresh_cache-696417e7-8eff-46f3-a6f1-11a9f5191627" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:11:04 user nova-compute[75245]: DEBUG nova.network.neutron [req-a8f33bae-c53b-4603-b625-6b02fb5c114e req-f45fe582-ef32-498e-9a52-9ca9ef4296ee service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Refreshing network info cache for port 6a5d2bae-9b9d-4331-b080-badfed69c6b1 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:11:04 user nova-compute[75245]: DEBUG nova.network.neutron [req-a8f33bae-c53b-4603-b625-6b02fb5c114e req-f45fe582-ef32-498e-9a52-9ca9ef4296ee service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Instance cache missing network info. {{(pid=75245) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 16:11:04 user nova-compute[75245]: DEBUG nova.network.neutron [req-a8f33bae-c53b-4603-b625-6b02fb5c114e req-f45fe582-ef32-498e-9a52-9ca9ef4296ee service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:11:05 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a8f33bae-c53b-4603-b625-6b02fb5c114e req-f45fe582-ef32-498e-9a52-9ca9ef4296ee service nova] Releasing lock "refresh_cache-696417e7-8eff-46f3-a6f1-11a9f5191627" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:11:05 user nova-compute[75245]: DEBUG nova.network.neutron [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Successfully updated port: 1bcb8f7b-abf5-4fe1-8ad9-a1d0316f951a {{(pid=75245) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 16:11:06 user nova-compute[75245]: DEBUG nova.network.neutron [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Successfully updated port: f91c7d1f-43fd-4e3e-9748-dd25010699bd {{(pid=75245) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 16:11:06 user nova-compute[75245]: DEBUG nova.compute.manager [req-f925417b-ed1c-4063-a1e9-9edcffc08f56 req-4a361a8b-e284-490a-921d-e140410e0197 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Received event network-changed-1bcb8f7b-abf5-4fe1-8ad9-a1d0316f951a {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:11:06 user nova-compute[75245]: DEBUG nova.compute.manager [req-f925417b-ed1c-4063-a1e9-9edcffc08f56 req-4a361a8b-e284-490a-921d-e140410e0197 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Refreshing instance network info cache due to event network-changed-1bcb8f7b-abf5-4fe1-8ad9-a1d0316f951a. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:11:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-f925417b-ed1c-4063-a1e9-9edcffc08f56 req-4a361a8b-e284-490a-921d-e140410e0197 service nova] Acquiring lock "refresh_cache-696417e7-8eff-46f3-a6f1-11a9f5191627" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:11:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-f925417b-ed1c-4063-a1e9-9edcffc08f56 req-4a361a8b-e284-490a-921d-e140410e0197 service nova] Acquired lock "refresh_cache-696417e7-8eff-46f3-a6f1-11a9f5191627" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:11:06 user nova-compute[75245]: DEBUG nova.network.neutron [req-f925417b-ed1c-4063-a1e9-9edcffc08f56 req-4a361a8b-e284-490a-921d-e140410e0197 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Refreshing network info cache for port 1bcb8f7b-abf5-4fe1-8ad9-a1d0316f951a {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:11:06 user nova-compute[75245]: DEBUG nova.network.neutron [req-f925417b-ed1c-4063-a1e9-9edcffc08f56 req-4a361a8b-e284-490a-921d-e140410e0197 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Instance cache missing network info. {{(pid=75245) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 16:11:06 user nova-compute[75245]: DEBUG nova.network.neutron [req-f925417b-ed1c-4063-a1e9-9edcffc08f56 req-4a361a8b-e284-490a-921d-e140410e0197 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:11:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-f925417b-ed1c-4063-a1e9-9edcffc08f56 req-4a361a8b-e284-490a-921d-e140410e0197 service nova] Releasing lock "refresh_cache-696417e7-8eff-46f3-a6f1-11a9f5191627" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:11:06 user nova-compute[75245]: DEBUG nova.compute.manager [req-f925417b-ed1c-4063-a1e9-9edcffc08f56 req-4a361a8b-e284-490a-921d-e140410e0197 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Received event network-changed-f91c7d1f-43fd-4e3e-9748-dd25010699bd {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:11:06 user nova-compute[75245]: DEBUG nova.compute.manager [req-f925417b-ed1c-4063-a1e9-9edcffc08f56 req-4a361a8b-e284-490a-921d-e140410e0197 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Refreshing instance network info cache due to event network-changed-f91c7d1f-43fd-4e3e-9748-dd25010699bd. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:11:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-f925417b-ed1c-4063-a1e9-9edcffc08f56 req-4a361a8b-e284-490a-921d-e140410e0197 service nova] Acquiring lock "refresh_cache-696417e7-8eff-46f3-a6f1-11a9f5191627" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:11:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-f925417b-ed1c-4063-a1e9-9edcffc08f56 req-4a361a8b-e284-490a-921d-e140410e0197 service nova] Acquired lock "refresh_cache-696417e7-8eff-46f3-a6f1-11a9f5191627" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:11:06 user nova-compute[75245]: DEBUG nova.network.neutron [req-f925417b-ed1c-4063-a1e9-9edcffc08f56 req-4a361a8b-e284-490a-921d-e140410e0197 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Refreshing network info cache for port f91c7d1f-43fd-4e3e-9748-dd25010699bd {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:11:06 user nova-compute[75245]: DEBUG nova.network.neutron [req-f925417b-ed1c-4063-a1e9-9edcffc08f56 req-4a361a8b-e284-490a-921d-e140410e0197 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Instance cache missing network info. {{(pid=75245) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 16:11:07 user nova-compute[75245]: DEBUG nova.network.neutron [req-f925417b-ed1c-4063-a1e9-9edcffc08f56 req-4a361a8b-e284-490a-921d-e140410e0197 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:11:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-f925417b-ed1c-4063-a1e9-9edcffc08f56 req-4a361a8b-e284-490a-921d-e140410e0197 service nova] Releasing lock "refresh_cache-696417e7-8eff-46f3-a6f1-11a9f5191627" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:11:07 user nova-compute[75245]: DEBUG nova.network.neutron [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Successfully updated port: 56b28d7b-1c3c-4e60-bbd6-7fd01f07fc6c {{(pid=75245) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 16:11:07 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:07 user nova-compute[75245]: INFO nova.virt.block_device [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Booting with volume 0a923d37-4d88-41bf-a160-1e163236f311 at /dev/vdb
Nov 29 16:11:07 user nova-compute[75245]: DEBUG os_brick.utils [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:11:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:11:07 user nova-compute[75245]: DEBUG nova.network.neutron [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Successfully updated port: d6c559e9-afbf-473d-b4b0-f3cdff6938bc {{(pid=75245) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 16:11:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:11:07 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c72bdf-45ea-4da9-8013-d98b818988db]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:69ed8ed87091\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:11:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:11:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Acquiring lock "refresh_cache-696417e7-8eff-46f3-a6f1-11a9f5191627" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:11:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Acquired lock "refresh_cache-696417e7-8eff-46f3-a6f1-11a9f5191627" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:11:07 user nova-compute[75245]: DEBUG nova.network.neutron [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 16:11:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:11:07 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[991d5ef1-8347-49f0-a442-a1092d326179]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:11:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:11:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:11:07 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b25139f-5eb8-4a19-8e0a-a80fb17004b4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:11:07 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e3c38fe-2840-4a40-9948-ef286a886420]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:11:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Running cmd (subprocess): nvme version {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:11:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] 'nvme version' failed. Not Retrying. {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:11:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.nvmeof [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] nvme not present on system {{(pid=75245) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 16:11:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:11:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:11:08 user nova-compute[75245]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 16:11:08 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e673fc-1f65-407e-8954-4ff56f75848e]: (4, '') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:11:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75245) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 16:11:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 16:11:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] LIGHTOS: no hostnqn found. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 16:11:08 user nova-compute[75245]: DEBUG os_brick.utils [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:69ed8ed87091', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:11:08 user nova-compute[75245]: DEBUG nova.virt.block_device [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Updating existing volume attachment record: 73ebf34e-48b6-4079-a1bb-842489bf34c5 {{(pid=75245) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 16:11:08 user nova-compute[75245]: DEBUG nova.network.neutron [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Instance cache missing network info. {{(pid=75245) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 16:11:08 user nova-compute[75245]: DEBUG nova.compute.manager [req-9d8fac6c-0572-4553-9947-1fb40b06b18b req-3b6e5282-af21-4c1f-b93c-dfc0142b9b47 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Received event network-changed-56b28d7b-1c3c-4e60-bbd6-7fd01f07fc6c {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:11:08 user nova-compute[75245]: DEBUG nova.compute.manager [req-9d8fac6c-0572-4553-9947-1fb40b06b18b req-3b6e5282-af21-4c1f-b93c-dfc0142b9b47 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Refreshing instance network info cache due to event network-changed-56b28d7b-1c3c-4e60-bbd6-7fd01f07fc6c. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:11:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-9d8fac6c-0572-4553-9947-1fb40b06b18b req-3b6e5282-af21-4c1f-b93c-dfc0142b9b47 service nova] Acquiring lock "refresh_cache-696417e7-8eff-46f3-a6f1-11a9f5191627" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:11:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:09 user nova-compute[75245]: DEBUG nova.network.neutron [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Updating instance_info_cache with network_info: [{"id": "d116100d-dfd6-4666-86cd-659d5539871a", "address": "fa:16:3e:aa:b6:e1", "network": {"id": "8a90347e-c47f-450a-8b31-4bf8d24e9aee", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-923062507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd116100d-df", "ovs_interfaceid": "d116100d-dfd6-4666-86cd-659d5539871a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e2cbf31f-6cf8-4a30-9d9b-3bbb3645a660", "address": "fa:16:3e:0e:64:29", "network": {"id": "891dd2c7-8a6d-4a31-b5d4-6edcd5e2f9ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-214436945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2cbf31f-6c", "ovs_interfaceid": "e2cbf31f-6cf8-4a30-9d9b-3bbb3645a660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6a5d2bae-9b9d-4331-b080-badfed69c6b1", "address": "fa:16:3e:cb:f8:53", "network": {"id": "891dd2c7-8a6d-4a31-b5d4-6edcd5e2f9ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-214436945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a5d2bae-9b", "ovs_interfaceid": "6a5d2bae-9b9d-4331-b080-badfed69c6b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1bcb8f7b-abf5-4fe1-8ad9-a1d0316f951a", "address": "fa:16:3e:4e:09:93", "network": {"id": "891dd2c7-8a6d-4a31-b5d4-6edcd5e2f9ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-214436945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bcb8f7b-ab", "ovs_interfaceid": "1bcb8f7b-abf5-4fe1-8ad9-a1d0316f951a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f91c7d1f-43fd-4e3e-9748-dd25010699bd", "address": "fa:16:3e:3f:11:4e", "network": {"id": "891dd2c7-8a6d-4a31-b5d4-6edcd5e2f9ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-214436945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91c7d1f-43", "ovs_interfaceid": "f91c7d1f-43fd-4e3e-9748-dd25010699bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "56b28d7b-1c3c-4e60-bbd6-7fd01f07fc6c", "address": "fa:16:3e:83:2f:60", "network": {"id": "e6c7f35e-5af2-440d-8433-00e0c0f5e62c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1457199759", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56b28d7b-1c", "ovs_interfaceid": "56b28d7b-1c3c-4e60-bbd6-7fd01f07fc6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d6c559e9-afbf-473d-b4b0-f3cdff6938bc", "address": "fa:16:3e:21:9f:17", "network": {"id": "e6c7f35e-5af2-440d-8433-00e0c0f5e62c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1457199759", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c559e9-af", "ovs_interfaceid": "d6c559e9-afbf-473d-b4b0-f3cdff6938bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:11:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Releasing lock "refresh_cache-696417e7-8eff-46f3-a6f1-11a9f5191627" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:11:09 user nova-compute[75245]: DEBUG nova.compute.manager [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Instance network_info: |[{"id": "d116100d-dfd6-4666-86cd-659d5539871a", "address": "fa:16:3e:aa:b6:e1", "network": {"id": "8a90347e-c47f-450a-8b31-4bf8d24e9aee", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-923062507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd116100d-df", "ovs_interfaceid": "d116100d-dfd6-4666-86cd-659d5539871a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e2cbf31f-6cf8-4a30-9d9b-3bbb3645a660", "address": "fa:16:3e:0e:64:29", "network": {"id": "891dd2c7-8a6d-4a31-b5d4-6edcd5e2f9ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-214436945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2cbf31f-6c", "ovs_interfaceid": "e2cbf31f-6cf8-4a30-9d9b-3bbb3645a660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6a5d2bae-9b9d-4331-b080-badfed69c6b1", "address": "fa:16:3e:cb:f8:53", "network": {"id": "891dd2c7-8a6d-4a31-b5d4-6edcd5e2f9ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-214436945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a5d2bae-9b", "ovs_interfaceid": "6a5d2bae-9b9d-4331-b080-badfed69c6b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1bcb8f7b-abf5-4fe1-8ad9-a1d0316f951a", "address": "fa:16:3e:4e:09:93", "network": {"id": "891dd2c7-8a6d-4a31-b5d4-6edcd5e2f9ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-214436945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bcb8f7b-ab", "ovs_interfaceid": "1bcb8f7b-abf5-4fe1-8ad9-a1d0316f951a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f91c7d1f-43fd-4e3e-9748-dd25010699bd", "address": "fa:16:3e:3f:11:4e", "network": {"id": "891dd2c7-8a6d-4a31-b5d4-6edcd5e2f9ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-214436945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91c7d1f-43", "ovs_interfaceid": "f91c7d1f-43fd-4e3e-9748-dd25010699bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "56b28d7b-1c3c-4e60-bbd6-7fd01f07fc6c", "address": "fa:16:3e:83:2f:60", "network": {"id": "e6c7f35e-5af2-440d-8433-00e0c0f5e62c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1457199759", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56b28d7b-1c", "ovs_interfaceid": "56b28d7b-1c3c-4e60-bbd6-7fd01f07fc6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d6c559e9-afbf-473d-b4b0-f3cdff6938bc", "address": "fa:16:3e:21:9f:17", "network": {"id": "e6c7f35e-5af2-440d-8433-00e0c0f5e62c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1457199759", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c559e9-af", "ovs_interfaceid": "d6c559e9-afbf-473d-b4b0-f3cdff6938bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 16:11:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-9d8fac6c-0572-4553-9947-1fb40b06b18b req-3b6e5282-af21-4c1f-b93c-dfc0142b9b47 service nova] Acquired lock "refresh_cache-696417e7-8eff-46f3-a6f1-11a9f5191627" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:11:09 user nova-compute[75245]: DEBUG nova.network.neutron [req-9d8fac6c-0572-4553-9947-1fb40b06b18b req-3b6e5282-af21-4c1f-b93c-dfc0142b9b47 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Refreshing network info cache for port 56b28d7b-1c3c-4e60-bbd6-7fd01f07fc6c {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:11:10 user nova-compute[75245]: DEBUG nova.network.neutron [req-9d8fac6c-0572-4553-9947-1fb40b06b18b req-3b6e5282-af21-4c1f-b93c-dfc0142b9b47 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Updated VIF entry in instance network info cache for port 56b28d7b-1c3c-4e60-bbd6-7fd01f07fc6c. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:11:10 user nova-compute[75245]: DEBUG nova.network.neutron [req-9d8fac6c-0572-4553-9947-1fb40b06b18b req-3b6e5282-af21-4c1f-b93c-dfc0142b9b47 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Updating instance_info_cache with network_info: [{"id": "d116100d-dfd6-4666-86cd-659d5539871a", "address": "fa:16:3e:aa:b6:e1", "network": {"id": "8a90347e-c47f-450a-8b31-4bf8d24e9aee", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-923062507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd116100d-df", "ovs_interfaceid": "d116100d-dfd6-4666-86cd-659d5539871a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e2cbf31f-6cf8-4a30-9d9b-3bbb3645a660", "address": "fa:16:3e:0e:64:29", "network": {"id": "891dd2c7-8a6d-4a31-b5d4-6edcd5e2f9ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-214436945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2cbf31f-6c", "ovs_interfaceid": "e2cbf31f-6cf8-4a30-9d9b-3bbb3645a660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6a5d2bae-9b9d-4331-b080-badfed69c6b1", "address": "fa:16:3e:cb:f8:53", "network": {"id": "891dd2c7-8a6d-4a31-b5d4-6edcd5e2f9ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-214436945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a5d2bae-9b", "ovs_interfaceid": "6a5d2bae-9b9d-4331-b080-badfed69c6b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1bcb8f7b-abf5-4fe1-8ad9-a1d0316f951a", "address": "fa:16:3e:4e:09:93", "network": {"id": "891dd2c7-8a6d-4a31-b5d4-6edcd5e2f9ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-214436945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bcb8f7b-ab", "ovs_interfaceid": "1bcb8f7b-abf5-4fe1-8ad9-a1d0316f951a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f91c7d1f-43fd-4e3e-9748-dd25010699bd", "address": "fa:16:3e:3f:11:4e", "network": {"id": "891dd2c7-8a6d-4a31-b5d4-6edcd5e2f9ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-214436945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91c7d1f-43", "ovs_interfaceid": "f91c7d1f-43fd-4e3e-9748-dd25010699bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "56b28d7b-1c3c-4e60-bbd6-7fd01f07fc6c", "address": "fa:16:3e:83:2f:60", "network": {"id": "e6c7f35e-5af2-440d-8433-00e0c0f5e62c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1457199759", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56b28d7b-1c", "ovs_interfaceid": "56b28d7b-1c3c-4e60-bbd6-7fd01f07fc6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d6c559e9-afbf-473d-b4b0-f3cdff6938bc", "address": "fa:16:3e:21:9f:17", "network": {"id": "e6c7f35e-5af2-440d-8433-00e0c0f5e62c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1457199759", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c559e9-af", "ovs_interfaceid": "d6c559e9-afbf-473d-b4b0-f3cdff6938bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:11:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-9d8fac6c-0572-4553-9947-1fb40b06b18b req-3b6e5282-af21-4c1f-b93c-dfc0142b9b47 service nova] Releasing lock "refresh_cache-696417e7-8eff-46f3-a6f1-11a9f5191627" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:11:10 user nova-compute[75245]: DEBUG nova.compute.manager [req-9d8fac6c-0572-4553-9947-1fb40b06b18b req-3b6e5282-af21-4c1f-b93c-dfc0142b9b47 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Received event network-changed-d6c559e9-afbf-473d-b4b0-f3cdff6938bc {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:11:10 user nova-compute[75245]: DEBUG nova.compute.manager [req-9d8fac6c-0572-4553-9947-1fb40b06b18b req-3b6e5282-af21-4c1f-b93c-dfc0142b9b47 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Refreshing instance network info cache due to event network-changed-d6c559e9-afbf-473d-b4b0-f3cdff6938bc. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:11:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-9d8fac6c-0572-4553-9947-1fb40b06b18b req-3b6e5282-af21-4c1f-b93c-dfc0142b9b47 service nova] Acquiring lock "refresh_cache-696417e7-8eff-46f3-a6f1-11a9f5191627" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:11:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-9d8fac6c-0572-4553-9947-1fb40b06b18b req-3b6e5282-af21-4c1f-b93c-dfc0142b9b47 service nova] Acquired lock "refresh_cache-696417e7-8eff-46f3-a6f1-11a9f5191627" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:11:10 user nova-compute[75245]: DEBUG nova.network.neutron [req-9d8fac6c-0572-4553-9947-1fb40b06b18b req-3b6e5282-af21-4c1f-b93c-dfc0142b9b47 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Refreshing network info cache for port d6c559e9-afbf-473d-b4b0-f3cdff6938bc {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:11:10 user nova-compute[75245]: DEBUG nova.network.neutron [req-9d8fac6c-0572-4553-9947-1fb40b06b18b req-3b6e5282-af21-4c1f-b93c-dfc0142b9b47 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Updated VIF entry in instance network info cache for port d6c559e9-afbf-473d-b4b0-f3cdff6938bc. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:11:10 user nova-compute[75245]: DEBUG nova.network.neutron [req-9d8fac6c-0572-4553-9947-1fb40b06b18b req-3b6e5282-af21-4c1f-b93c-dfc0142b9b47 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Updating instance_info_cache with network_info: [{"id": "d116100d-dfd6-4666-86cd-659d5539871a", "address": "fa:16:3e:aa:b6:e1", "network": {"id": "8a90347e-c47f-450a-8b31-4bf8d24e9aee", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-923062507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd116100d-df", "ovs_interfaceid": "d116100d-dfd6-4666-86cd-659d5539871a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e2cbf31f-6cf8-4a30-9d9b-3bbb3645a660", "address": "fa:16:3e:0e:64:29", "network": {"id": "891dd2c7-8a6d-4a31-b5d4-6edcd5e2f9ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-214436945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2cbf31f-6c", "ovs_interfaceid": "e2cbf31f-6cf8-4a30-9d9b-3bbb3645a660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6a5d2bae-9b9d-4331-b080-badfed69c6b1", "address": "fa:16:3e:cb:f8:53", "network": {"id": "891dd2c7-8a6d-4a31-b5d4-6edcd5e2f9ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-214436945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a5d2bae-9b", "ovs_interfaceid": "6a5d2bae-9b9d-4331-b080-badfed69c6b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1bcb8f7b-abf5-4fe1-8ad9-a1d0316f951a", "address": "fa:16:3e:4e:09:93", "network": {"id": "891dd2c7-8a6d-4a31-b5d4-6edcd5e2f9ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-214436945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bcb8f7b-ab", "ovs_interfaceid": "1bcb8f7b-abf5-4fe1-8ad9-a1d0316f951a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f91c7d1f-43fd-4e3e-9748-dd25010699bd", "address": "fa:16:3e:3f:11:4e", "network": {"id": "891dd2c7-8a6d-4a31-b5d4-6edcd5e2f9ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-214436945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91c7d1f-43", "ovs_interfaceid": "f91c7d1f-43fd-4e3e-9748-dd25010699bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "56b28d7b-1c3c-4e60-bbd6-7fd01f07fc6c", "address": "fa:16:3e:83:2f:60", "network": {"id": "e6c7f35e-5af2-440d-8433-00e0c0f5e62c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1457199759", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56b28d7b-1c", "ovs_interfaceid": "56b28d7b-1c3c-4e60-bbd6-7fd01f07fc6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d6c559e9-afbf-473d-b4b0-f3cdff6938bc", "address": "fa:16:3e:21:9f:17", "network": {"id": "e6c7f35e-5af2-440d-8433-00e0c0f5e62c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1457199759", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c559e9-af", "ovs_interfaceid": "d6c559e9-afbf-473d-b4b0-f3cdff6938bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:11:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-9d8fac6c-0572-4553-9947-1fb40b06b18b req-3b6e5282-af21-4c1f-b93c-dfc0142b9b47 service nova] Releasing lock "refresh_cache-696417e7-8eff-46f3-a6f1-11a9f5191627" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:11:12 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:15 user nova-compute[75245]: INFO nova.virt.block_device [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Booting with volume 51c84145-9618-45af-ad49-4fd8c925bb63 at /dev/vdc
Nov 29 16:11:15 user nova-compute[75245]: DEBUG os_brick.utils [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:11:15 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:11:16 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:11:16 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a87020-acfc-49ad-9512-dd2514d1800d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:69ed8ed87091\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:11:16 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:11:16 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:11:16 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d0313c-a973-4b25-abdd-98157438836e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:11:16 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:11:16 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:11:16 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f00f1e1-8b10-4bf1-b4d1-95bbcf53aedd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:11:16 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[bacded4c-ec68-4886-9c83-1ab2d4a4ee58]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:11:16 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Running cmd (subprocess): nvme version {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:11:16 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] 'nvme version' failed. Not Retrying. {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:11:16 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.nvmeof [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] nvme not present on system {{(pid=75245) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 16:11:16 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:11:16 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:11:16 user nova-compute[75245]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 16:11:16 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[c757b80e-9d74-4adb-a3cd-1afb11437bc3]: (4, '') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:11:16 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75245) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 16:11:16 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 16:11:16 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] LIGHTOS: no hostnqn found. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 16:11:16 user nova-compute[75245]: DEBUG os_brick.utils [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:69ed8ed87091', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:11:16 user nova-compute[75245]: DEBUG nova.virt.block_device [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Updating existing volume attachment record: 26cd195f-183b-43b9-b1e2-fecdfbf5508e {{(pid=75245) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 16:11:17 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:18 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:23 user nova-compute[75245]: DEBUG nova.compute.manager [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Start spawning the instance on the hypervisor. {{(pid=75245) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 16:11:23 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Creating instance directory {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 16:11:23 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Creating image(s)
Nov 29 16:11:23 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Did not create local disks {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 16:11:23 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Ensure instance console log exists: /opt/stack/data/nova/instances/696417e7-8eff-46f3-a6f1-11a9f5191627/console.log {{(pid=75245) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 16:11:23 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:11:23 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:11:23 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:11:23 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Start _get_guest_xml network_info=[{"id": "d116100d-dfd6-4666-86cd-659d5539871a", "address": "fa:16:3e:aa:b6:e1", "network": {"id": "8a90347e-c47f-450a-8b31-4bf8d24e9aee", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-923062507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd116100d-df", "ovs_interfaceid": "d116100d-dfd6-4666-86cd-659d5539871a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e2cbf31f-6cf8-4a30-9d9b-3bbb3645a660", "address": "fa:16:3e:0e:64:29", "network": {"id": "891dd2c7-8a6d-4a31-b5d4-6edcd5e2f9ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-214436945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2cbf31f-6c", "ovs_interfaceid": "e2cbf31f-6cf8-4a30-9d9b-3bbb3645a660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6a5d2bae-9b9d-4331-b080-badfed69c6b1", "address": "fa:16:3e:cb:f8:53", "network": {"id": "891dd2c7-8a6d-4a31-b5d4-6edcd5e2f9ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-214436945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a5d2bae-9b", "ovs_interfaceid": "6a5d2bae-9b9d-4331-b080-badfed69c6b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1bcb8f7b-abf5-4fe1-8ad9-a1d0316f951a", "address": "fa:16:3e:4e:09:93", "network": {"id": "891dd2c7-8a6d-4a31-b5d4-6edcd5e2f9ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-214436945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bcb8f7b-ab", "ovs_interfaceid": "1bcb8f7b-abf5-4fe1-8ad9-a1d0316f951a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f91c7d1f-43fd-4e3e-9748-dd25010699bd", "address": "fa:16:3e:3f:11:4e", "network": {"id": "891dd2c7-8a6d-4a31-b5d4-6edcd5e2f9ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-214436945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91c7d1f-43", "ovs_interfaceid": "f91c7d1f-43fd-4e3e-9748-dd25010699bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "56b28d7b-1c3c-4e60-bbd6-7fd01f07fc6c", "address": "fa:16:3e:83:2f:60", "network": {"id": "e6c7f35e-5af2-440d-8433-00e0c0f5e62c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1457199759", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56b28d7b-1c", "ovs_interfaceid": "56b28d7b-1c3c-4e60-bbd6-7fd01f07fc6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d6c559e9-afbf-473d-b4b0-f3cdff6938bc", "address": "fa:16:3e:21:9f:17", "network": {"id": "e6c7f35e-5af2-440d-8433-00e0c0f5e62c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1457199759", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c559e9-af", "ovs_interfaceid": "d6c559e9-afbf-473d-b4b0-f3cdff6938bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': 'f7ad6649-bbcc-4b1b-b788-718c989c7ccc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yYxhBraG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '696417e7-8eff-46f3-a6f1-11a9f5191627', 'attached_at': '', 'detached_at': '', 'volume_id': '86bd6476-7e72-486f-8c34-0dea88db3678', 'serial': '86bd6476-7e72-486f-8c34-0dea88db3678'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'guest_format': None, 'volume_type': None}, {'boot_index': 1, 'attachment_id': '73ebf34e-48b6-4079-a1bb-842489bf34c5', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qkfYeGDa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '696417e7-8eff-46f3-a6f1-11a9f5191627', 'attached_at': '', 'detached_at': '', 'volume_id': '0a923d37-4d88-41bf-a160-1e163236f311', 'serial': '0a923d37-4d88-41bf-a160-1e163236f311'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'guest_format': None, 'volume_type': None}, {'boot_index': 2, 'attachment_id': '26cd195f-183b-43b9-b1e2-fecdfbf5508e', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qwDRiYpW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '696417e7-8eff-46f3-a6f1-11a9f5191627', 'attached_at': '', 'detached_at': '', 'volume_id': '51c84145-9618-45af-ad49-4fd8c925bb63', 'serial': '51c84145-9618-45af-ad49-4fd8c925bb63'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'guest_format': None, 'volume_type': None} {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 16:11:23 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:11:23 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:11:23 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 16:11:23 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] CPU controller missing on host. {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 16:11:23 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 16:11:23 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] CPU controller found on host. {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 16:11:23 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75245) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 16:11:23 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T16:06:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 16:11:23 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Flavor limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 16:11:23 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Image limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 16:11:23 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Flavor pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 16:11:23 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Image pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 16:11:23 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 16:11:23 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 16:11:23 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 16:11:23 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Got 1 possible topologies {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 16:11:23 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 16:11:23 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 16:11:23 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:11:23 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:11:23 user nova-compute[75245]: DEBUG os_brick.initiator.connector [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Factory for ISCSI on None {{(pid=75245) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 29 16:11:23 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:11:23 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Calling os-brick to attach iSCSI Volume {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 16:11:23 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yYxhBraG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:11:23 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:11:23 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:11:23 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:11:23 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:11:23 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:11:24 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:11:24 user nova-compute[75245]: INFO os_brick.initiator.connectors.iscsi [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 16:11:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 -p 172.16.0.220:3260 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:11:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:11:24 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ee9a1d-6913-4810-8986-d7ee231502bd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:11:24 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 16:11:24 user nova-compute[75245]:  {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:11:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 -p 172.16.0.220:3260 --interface default --op new {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:11:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:11:24 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[6267cb82-0ac1-4aa8-a296-0f24a2d5e1fe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678] added\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:11:24 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678] added
Nov 29 16:11:24 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:11:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:11:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:11:24 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77a1f37-277f-4b8f-b304-b436d628c203]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:11:24 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:11:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:11:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:11:24 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd406cf2-7b21-4b3e-bc0e-34083519c20c]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:11:24 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:11:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yYxhBraG {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:11:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yYxhBraG" returned: 0 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:11:24 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[338ac558-510a-4ec9-8335-60727c97f90a]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:11:24 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yYxhBraG'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:11:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:11:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:11:24 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[75263745-963c-4c65-b456-dde204d47f2f]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:11:24 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:11:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:11:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:11:24 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd599a5-8489-4d73-bdf4-6a2cae391026]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:11:24 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 16:11:24 user nova-compute[75245]:  {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:11:24 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 16:11:24 user nova-compute[75245]:  {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:11:24 user nova-compute[75245]: WARNING os_brick.initiator.connectors.iscsi [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 16:11:24 user nova-compute[75245]: 
Nov 29 16:11:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 -p 172.16.0.220:3260 --login {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:11:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:11:24 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf21268-b83f-4bf8-ba5c-2113fb211f1f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:11:24 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678, portal: 172.16.0.220,3260]
Nov 29 16:11:24 user nova-compute[75245]: Login to [iface: default, target: iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678, portal: 172.16.0.220,3260] successful.
Nov 29 16:11:24 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:11:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:11:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:11:24 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf19e37-c810-4b40-af3c-06ae3c7149a3]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:11:24 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:11:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:11:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:11:24 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[882584ed-4cdc-499d-ab35-2a16bce00fd4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:11:24 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 (non-flash)
Nov 29 16:11:24 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:11:24 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 (non-flash)
Nov 29 16:11:24 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:11:24 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:11:24 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Connected to 172.16.0.220:3260 {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 16:11:24 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=75245) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 16:11:24 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75245) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 16:11:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:11:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:11:24 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b285b4-3c96-4ac3-bc00-0a1588b89fdf]: (4, ('- - 0', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:11:24 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75245) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 16:11:24 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yYxhBraG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 16:11:25 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:11:25 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '23430323735336661', 'path': '/dev/sdb'} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:11:25 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23430323735336661', 'path': '/dev/sdb'} {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 16:11:25 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Calling os-brick to attach iSCSI Volume {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 16:11:25 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qkfYeGDa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:11:25 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:11:25 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:11:25 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:11:25 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:11:25 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:11:25 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:11:25 user nova-compute[75245]: INFO os_brick.initiator.connectors.iscsi [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 16:11:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311 -p 172.16.0.220:3260 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:11:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:11:25 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a553c9e-205c-482b-a93b-eea001f581bc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:11:25 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 16:11:25 user nova-compute[75245]:  {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:11:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311 -p 172.16.0.220:3260 --interface default --op new {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:11:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:11:25 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aad99ba-709c-4667-ba55-aaa697608cc9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311] added\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:11:25 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311] added
Nov 29 16:11:25 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:11:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:11:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:11:25 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[f59a38df-771e-420f-a50c-f2527d21e4d6]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:11:25 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:11:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:11:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:11:25 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7cd52e6-3293-4983-9265-108c2ec0c1ff]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:11:25 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:11:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qkfYeGDa {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:11:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qkfYeGDa" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:11:25 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[a01a767a-f7bb-4a23-a8e8-7f8aa8d62204]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:11:25 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qkfYeGDa'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:11:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:11:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:11:25 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[5403ed26-0cc2-4ab7-9965-9dc00f03bbb7]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:11:25 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:11:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:11:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:11:25 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2506ca-0a4c-424d-8946-e403924063a2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:11:25 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 (non-flash)
Nov 29 16:11:25 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:11:25 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 (non-flash)
Nov 29 16:11:25 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:11:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311 -p 172.16.0.220:3260 --login {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:11:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:11:25 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aeec6e6-c2e8-42cf-9a7f-c3375ff297d7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:11:25 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311, portal: 172.16.0.220,3260]
Nov 29 16:11:25 user nova-compute[75245]: Login to [iface: default, target: iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311, portal: 172.16.0.220,3260] successful.
Nov 29 16:11:25 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:11:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:11:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:11:25 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee594119-2057-4fd6-9e98-120d074577c9]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:11:25 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:11:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:11:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:11:25 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[3025f6a3-116c-48da-8ad5-0c4083c73a0a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:11:25 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 (non-flash)
Nov 29 16:11:25 user nova-compute[75245]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311 (non-flash)
Nov 29 16:11:25 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:11:25 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 (non-flash)
Nov 29 16:11:25 user nova-compute[75245]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311 (non-flash)
Nov 29 16:11:25 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:11:25 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:11:25 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Connected to 172.16.0.220:3260 {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 16:11:25 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=75245) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 16:11:25 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75245) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 16:11:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:11:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:11:25 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7bb5b7b-eb26-4555-8679-a56c17cce61b]: (4, ('- - 0', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:11:25 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: None {{(pid=75245) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 16:11:26 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75245) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 16:11:26 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qkfYeGDa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 16:11:26 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:11:26 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '23861633530396239', 'path': '/dev/sdc'} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:11:26 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23861633530396239', 'path': '/dev/sdc'} {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 16:11:26 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Calling os-brick to attach iSCSI Volume {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 16:11:26 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qwDRiYpW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:11:26 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:11:26 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:11:26 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:11:26 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:11:26 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:11:26 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:11:26 user nova-compute[75245]: INFO os_brick.initiator.connectors.iscsi [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 16:11:26 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63 -p 172.16.0.220:3260 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:11:26 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:11:26 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53f67da-167e-4a3b-ae98-1b704c1b1e93]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:11:26 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 16:11:26 user nova-compute[75245]:  {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:11:26 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63 -p 172.16.0.220:3260 --interface default --op new {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:11:26 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:11:26 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[177f0504-7494-4b04-ae3e-9d685681e43f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63] added\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:11:26 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63] added
Nov 29 16:11:26 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:11:26 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:11:26 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:11:26 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[729a9445-4696-454b-8a1b-16103f002ff5]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:11:26 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:11:26 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:11:26 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:11:26 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9deef8a-4557-4b94-b774-d97afed13760]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:11:26 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:11:26 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qwDRiYpW {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:11:26 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qwDRiYpW" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:11:26 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[6916d7e2-27cd-4e1f-b389-c65593cf5b74]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:11:26 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qwDRiYpW'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:11:26 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:11:26 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:11:26 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d7f2ec9-de0a-4d5f-bb08-c8f8f3080ee7]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:11:26 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:11:26 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:11:26 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:11:26 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28b0163-3cf8-4647-8c6b-a1237a227f93]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:11:26 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 (non-flash)
Nov 29 16:11:26 user nova-compute[75245]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311 (non-flash)
Nov 29 16:11:26 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:11:26 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 (non-flash)
Nov 29 16:11:26 user nova-compute[75245]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311 (non-flash)
Nov 29 16:11:26 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:11:26 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63 -p 172.16.0.220:3260 --login {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:11:26 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:11:26 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d0ae29-585f-4d67-8ca1-d081f32f5075]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:11:26 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63, portal: 172.16.0.220,3260]
Nov 29 16:11:26 user nova-compute[75245]: Login to [iface: default, target: iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63, portal: 172.16.0.220,3260] successful.
Nov 29 16:11:26 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:11:26 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:11:26 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:11:26 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[77208b47-f9ad-4332-a00b-b56c0fd6d970]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:11:26 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:11:26 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:11:26 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:11:26 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[c76ee90a-e8bf-4b6f-a3da-de3ec6333f10]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:11:26 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 (non-flash)
Nov 29 16:11:26 user nova-compute[75245]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311 (non-flash)
Nov 29 16:11:26 user nova-compute[75245]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63 (non-flash)
Nov 29 16:11:26 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:11:26 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 (non-flash)
Nov 29 16:11:26 user nova-compute[75245]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311 (non-flash)
Nov 29 16:11:26 user nova-compute[75245]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63 (non-flash)
Nov 29 16:11:26 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:11:26 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:11:26 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Connected to 172.16.0.220:3260 {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 16:11:26 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=75245) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 16:11:26 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75245) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 16:11:26 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:11:26 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:11:26 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[27de90fe-3bf9-44f4-9492-a57fdf7df0e3]: (4, ('- - 0', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:11:26 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: None {{(pid=75245) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 16:11:27 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:27 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75245) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 16:11:27 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qwDRiYpW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 16:11:27 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:11:27 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '26339623435353964', 'path': '/dev/sdd'} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:11:27 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26339623435353964', 'path': '/dev/sdd'} {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T16:10:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1163488234',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1163488234',id=10,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOw/5U9h5ccex2qnP/5hOTP78ppDsOgRNSxy0KA0i1xSCXR5NDTKu7hvcsmkDcFw/WanqDVtSpFbkkBVHht7EsYDS15+PaPoF0OH31h4AuA0XHHkSzaU9hrZMTJL7pI2Mg==',key_name='tempest-keypair-1884616232',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e751c778a804388a05afe573a7b7828',ramdisk_id='',reservation_id='r-6eckmld2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1192969410',owner_user_name='tempest-TaggedBootDevicesTest-1192969410-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:10:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fc59a8c008f4270a8643280e6649e94',uuid=696417e7-8eff-46f3-a6f1-11a9f5191627,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d116100d-dfd6-4666-86cd-659d5539871a", "address": "fa:16:3e:aa:b6:e1", "network": {"id": "8a90347e-c47f-450a-8b31-4bf8d24e9aee", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-923062507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd116100d-df", "ovs_interfaceid": "d116100d-dfd6-4666-86cd-659d5539871a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Converting VIF {"id": "d116100d-dfd6-4666-86cd-659d5539871a", "address": "fa:16:3e:aa:b6:e1", "network": {"id": "8a90347e-c47f-450a-8b31-4bf8d24e9aee", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-923062507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd116100d-df", "ovs_interfaceid": "d116100d-dfd6-4666-86cd-659d5539871a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:b6:e1,bridge_name='br-int',has_traffic_filtering=True,id=d116100d-dfd6-4666-86cd-659d5539871a,network=Network(8a90347e-c47f-450a-8b31-4bf8d24e9aee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd116100d-df') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T16:10:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1163488234',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1163488234',id=10,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOw/5U9h5ccex2qnP/5hOTP78ppDsOgRNSxy0KA0i1xSCXR5NDTKu7hvcsmkDcFw/WanqDVtSpFbkkBVHht7EsYDS15+PaPoF0OH31h4AuA0XHHkSzaU9hrZMTJL7pI2Mg==',key_name='tempest-keypair-1884616232',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e751c778a804388a05afe573a7b7828',ramdisk_id='',reservation_id='r-6eckmld2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1192969410',owner_user_name='tempest-TaggedBootDevicesTest-1192969410-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:10:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fc59a8c008f4270a8643280e6649e94',uuid=696417e7-8eff-46f3-a6f1-11a9f5191627,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2cbf31f-6cf8-4a30-9d9b-3bbb3645a660", "address": "fa:16:3e:0e:64:29", "network": {"id": "891dd2c7-8a6d-4a31-b5d4-6edcd5e2f9ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-214436945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2cbf31f-6c", "ovs_interfaceid": "e2cbf31f-6cf8-4a30-9d9b-3bbb3645a660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Converting VIF {"id": "e2cbf31f-6cf8-4a30-9d9b-3bbb3645a660", "address": "fa:16:3e:0e:64:29", "network": {"id": "891dd2c7-8a6d-4a31-b5d4-6edcd5e2f9ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-214436945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2cbf31f-6c", "ovs_interfaceid": "e2cbf31f-6cf8-4a30-9d9b-3bbb3645a660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:64:29,bridge_name='br-int',has_traffic_filtering=True,id=e2cbf31f-6cf8-4a30-9d9b-3bbb3645a660,network=Network(891dd2c7-8a6d-4a31-b5d4-6edcd5e2f9ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape2cbf31f-6c') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T16:10:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1163488234',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1163488234',id=10,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOw/5U9h5ccex2qnP/5hOTP78ppDsOgRNSxy0KA0i1xSCXR5NDTKu7hvcsmkDcFw/WanqDVtSpFbkkBVHht7EsYDS15+PaPoF0OH31h4AuA0XHHkSzaU9hrZMTJL7pI2Mg==',key_name='tempest-keypair-1884616232',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e751c778a804388a05afe573a7b7828',ramdisk_id='',reservation_id='r-6eckmld2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1192969410',owner_user_name='tempest-TaggedBootDevicesTest-1192969410-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:10:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fc59a8c008f4270a8643280e6649e94',uuid=696417e7-8eff-46f3-a6f1-11a9f5191627,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a5d2bae-9b9d-4331-b080-badfed69c6b1", "address": "fa:16:3e:cb:f8:53", "network": {"id": "891dd2c7-8a6d-4a31-b5d4-6edcd5e2f9ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-214436945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a5d2bae-9b", "ovs_interfaceid": "6a5d2bae-9b9d-4331-b080-badfed69c6b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Converting VIF {"id": "6a5d2bae-9b9d-4331-b080-badfed69c6b1", "address": "fa:16:3e:cb:f8:53", "network": {"id": "891dd2c7-8a6d-4a31-b5d4-6edcd5e2f9ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-214436945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a5d2bae-9b", "ovs_interfaceid": "6a5d2bae-9b9d-4331-b080-badfed69c6b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:f8:53,bridge_name='br-int',has_traffic_filtering=True,id=6a5d2bae-9b9d-4331-b080-badfed69c6b1,network=Network(891dd2c7-8a6d-4a31-b5d4-6edcd5e2f9ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6a5d2bae-9b') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T16:10:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1163488234',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1163488234',id=10,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOw/5U9h5ccex2qnP/5hOTP78ppDsOgRNSxy0KA0i1xSCXR5NDTKu7hvcsmkDcFw/WanqDVtSpFbkkBVHht7EsYDS15+PaPoF0OH31h4AuA0XHHkSzaU9hrZMTJL7pI2Mg==',key_name='tempest-keypair-1884616232',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e751c778a804388a05afe573a7b7828',ramdisk_id='',reservation_id='r-6eckmld2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1192969410',owner_user_name='tempest-TaggedBootDevicesTest-1192969410-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:10:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fc59a8c008f4270a8643280e6649e94',uuid=696417e7-8eff-46f3-a6f1-11a9f5191627,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1bcb8f7b-abf5-4fe1-8ad9-a1d0316f951a", "address": "fa:16:3e:4e:09:93", "network": {"id": "891dd2c7-8a6d-4a31-b5d4-6edcd5e2f9ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-214436945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bcb8f7b-ab", "ovs_interfaceid": "1bcb8f7b-abf5-4fe1-8ad9-a1d0316f951a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Converting VIF {"id": "1bcb8f7b-abf5-4fe1-8ad9-a1d0316f951a", "address": "fa:16:3e:4e:09:93", "network": {"id": "891dd2c7-8a6d-4a31-b5d4-6edcd5e2f9ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-214436945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bcb8f7b-ab", "ovs_interfaceid": "1bcb8f7b-abf5-4fe1-8ad9-a1d0316f951a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:09:93,bridge_name='br-int',has_traffic_filtering=True,id=1bcb8f7b-abf5-4fe1-8ad9-a1d0316f951a,network=Network(891dd2c7-8a6d-4a31-b5d4-6edcd5e2f9ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bcb8f7b-ab') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T16:10:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1163488234',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1163488234',id=10,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOw/5U9h5ccex2qnP/5hOTP78ppDsOgRNSxy0KA0i1xSCXR5NDTKu7hvcsmkDcFw/WanqDVtSpFbkkBVHht7EsYDS15+PaPoF0OH31h4AuA0XHHkSzaU9hrZMTJL7pI2Mg==',key_name='tempest-keypair-1884616232',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e751c778a804388a05afe573a7b7828',ramdisk_id='',reservation_id='r-6eckmld2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1192969410',owner_user_name='tempest-TaggedBootDevicesTest-1192969410-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:10:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fc59a8c008f4270a8643280e6649e94',uuid=696417e7-8eff-46f3-a6f1-11a9f5191627,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f91c7d1f-43fd-4e3e-9748-dd25010699bd", "address": "fa:16:3e:3f:11:4e", "network": {"id": "891dd2c7-8a6d-4a31-b5d4-6edcd5e2f9ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-214436945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91c7d1f-43", "ovs_interfaceid": "f91c7d1f-43fd-4e3e-9748-dd25010699bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Converting VIF {"id": "f91c7d1f-43fd-4e3e-9748-dd25010699bd", "address": "fa:16:3e:3f:11:4e", "network": {"id": "891dd2c7-8a6d-4a31-b5d4-6edcd5e2f9ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-214436945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91c7d1f-43", "ovs_interfaceid": "f91c7d1f-43fd-4e3e-9748-dd25010699bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:11:4e,bridge_name='br-int',has_traffic_filtering=True,id=f91c7d1f-43fd-4e3e-9748-dd25010699bd,network=Network(891dd2c7-8a6d-4a31-b5d4-6edcd5e2f9ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf91c7d1f-43') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T16:10:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1163488234',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1163488234',id=10,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOw/5U9h5ccex2qnP/5hOTP78ppDsOgRNSxy0KA0i1xSCXR5NDTKu7hvcsmkDcFw/WanqDVtSpFbkkBVHht7EsYDS15+PaPoF0OH31h4AuA0XHHkSzaU9hrZMTJL7pI2Mg==',key_name='tempest-keypair-1884616232',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e751c778a804388a05afe573a7b7828',ramdisk_id='',reservation_id='r-6eckmld2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1192969410',owner_user_name='tempest-TaggedBootDevicesTest-1192969410-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:10:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fc59a8c008f4270a8643280e6649e94',uuid=696417e7-8eff-46f3-a6f1-11a9f5191627,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56b28d7b-1c3c-4e60-bbd6-7fd01f07fc6c", "address": "fa:16:3e:83:2f:60", "network": {"id": "e6c7f35e-5af2-440d-8433-00e0c0f5e62c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1457199759", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56b28d7b-1c", "ovs_interfaceid": "56b28d7b-1c3c-4e60-bbd6-7fd01f07fc6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Converting VIF {"id": "56b28d7b-1c3c-4e60-bbd6-7fd01f07fc6c", "address": "fa:16:3e:83:2f:60", "network": {"id": "e6c7f35e-5af2-440d-8433-00e0c0f5e62c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1457199759", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56b28d7b-1c", "ovs_interfaceid": "56b28d7b-1c3c-4e60-bbd6-7fd01f07fc6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:2f:60,bridge_name='br-int',has_traffic_filtering=True,id=56b28d7b-1c3c-4e60-bbd6-7fd01f07fc6c,network=Network(e6c7f35e-5af2-440d-8433-00e0c0f5e62c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56b28d7b-1c') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T16:10:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1163488234',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1163488234',id=10,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOw/5U9h5ccex2qnP/5hOTP78ppDsOgRNSxy0KA0i1xSCXR5NDTKu7hvcsmkDcFw/WanqDVtSpFbkkBVHht7EsYDS15+PaPoF0OH31h4AuA0XHHkSzaU9hrZMTJL7pI2Mg==',key_name='tempest-keypair-1884616232',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e751c778a804388a05afe573a7b7828',ramdisk_id='',reservation_id='r-6eckmld2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1192969410',owner_user_name='tempest-TaggedBootDevicesTest-1192969410-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:10:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fc59a8c008f4270a8643280e6649e94',uuid=696417e7-8eff-46f3-a6f1-11a9f5191627,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6c559e9-afbf-473d-b4b0-f3cdff6938bc", "address": "fa:16:3e:21:9f:17", "network": {"id": "e6c7f35e-5af2-440d-8433-00e0c0f5e62c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1457199759", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c559e9-af", "ovs_interfaceid": "d6c559e9-afbf-473d-b4b0-f3cdff6938bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Converting VIF {"id": "d6c559e9-afbf-473d-b4b0-f3cdff6938bc", "address": "fa:16:3e:21:9f:17", "network": {"id": "e6c7f35e-5af2-440d-8433-00e0c0f5e62c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1457199759", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c559e9-af", "ovs_interfaceid": "d6c559e9-afbf-473d-b4b0-f3cdff6938bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:9f:17,bridge_name='br-int',has_traffic_filtering=True,id=d6c559e9-afbf-473d-b4b0-f3cdff6938bc,network=Network(e6c7f35e-5af2-440d-8433-00e0c0f5e62c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6c559e9-af') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG nova.objects.instance [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Lazy-loading 'pci_devices' on Instance uuid 696417e7-8eff-46f3-a6f1-11a9f5191627 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] End _get_guest_xml xml=<domain type="kvm">
Nov 29 16:11:28 user nova-compute[75245]:   <uuid>696417e7-8eff-46f3-a6f1-11a9f5191627</uuid>
Nov 29 16:11:28 user nova-compute[75245]:   <name>instance-0000000a</name>
Nov 29 16:11:28 user nova-compute[75245]:   <memory>524288</memory>
Nov 29 16:11:28 user nova-compute[75245]:   <vcpu>1</vcpu>
Nov 29 16:11:28 user nova-compute[75245]:   <metadata>
Nov 29 16:11:28 user nova-compute[75245]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 16:11:28 user nova-compute[75245]:       <nova:package version="0.0.0"/>
Nov 29 16:11:28 user nova-compute[75245]:       <nova:name>tempest-device-tagging-server-1163488234</nova:name>
Nov 29 16:11:28 user nova-compute[75245]:       <nova:creationTime>2023-11-29 16:11:23</nova:creationTime>
Nov 29 16:11:28 user nova-compute[75245]:       <nova:flavor name="m1.tiny">
Nov 29 16:11:28 user nova-compute[75245]:         <nova:memory>512</nova:memory>
Nov 29 16:11:28 user nova-compute[75245]:         <nova:disk>1</nova:disk>
Nov 29 16:11:28 user nova-compute[75245]:         <nova:swap>0</nova:swap>
Nov 29 16:11:28 user nova-compute[75245]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 16:11:28 user nova-compute[75245]:         <nova:vcpus>1</nova:vcpus>
Nov 29 16:11:28 user nova-compute[75245]:       </nova:flavor>
Nov 29 16:11:28 user nova-compute[75245]:       <nova:owner>
Nov 29 16:11:28 user nova-compute[75245]:         <nova:user uuid="1fc59a8c008f4270a8643280e6649e94">tempest-TaggedBootDevicesTest-1192969410-project-member</nova:user>
Nov 29 16:11:28 user nova-compute[75245]:         <nova:project uuid="1e751c778a804388a05afe573a7b7828">tempest-TaggedBootDevicesTest-1192969410</nova:project>
Nov 29 16:11:28 user nova-compute[75245]:       </nova:owner>
Nov 29 16:11:28 user nova-compute[75245]:       <nova:root type="image" uuid="a291d9c3-be02-4c6c-9649-4b45c5b7f487"/>
Nov 29 16:11:28 user nova-compute[75245]:       <nova:ports>
Nov 29 16:11:28 user nova-compute[75245]:         <nova:port uuid="d116100d-dfd6-4666-86cd-659d5539871a">
Nov 29 16:11:28 user nova-compute[75245]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 29 16:11:28 user nova-compute[75245]:         </nova:port>
Nov 29 16:11:28 user nova-compute[75245]:         <nova:port uuid="e2cbf31f-6cf8-4a30-9d9b-3bbb3645a660">
Nov 29 16:11:28 user nova-compute[75245]:           <nova:ip type="fixed" address="10.1.1.45" ipVersion="4"/>
Nov 29 16:11:28 user nova-compute[75245]:         </nova:port>
Nov 29 16:11:28 user nova-compute[75245]:         <nova:port uuid="6a5d2bae-9b9d-4331-b080-badfed69c6b1">
Nov 29 16:11:28 user nova-compute[75245]:           <nova:ip type="fixed" address="10.1.1.46" ipVersion="4"/>
Nov 29 16:11:28 user nova-compute[75245]:         </nova:port>
Nov 29 16:11:28 user nova-compute[75245]:         <nova:port uuid="1bcb8f7b-abf5-4fe1-8ad9-a1d0316f951a">
Nov 29 16:11:28 user nova-compute[75245]:           <nova:ip type="fixed" address="10.1.1.129" ipVersion="4"/>
Nov 29 16:11:28 user nova-compute[75245]:         </nova:port>
Nov 29 16:11:28 user nova-compute[75245]:         <nova:port uuid="f91c7d1f-43fd-4e3e-9748-dd25010699bd">
Nov 29 16:11:28 user nova-compute[75245]:           <nova:ip type="fixed" address="10.1.1.173" ipVersion="4"/>
Nov 29 16:11:28 user nova-compute[75245]:         </nova:port>
Nov 29 16:11:28 user nova-compute[75245]:         <nova:port uuid="56b28d7b-1c3c-4e60-bbd6-7fd01f07fc6c">
Nov 29 16:11:28 user nova-compute[75245]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 29 16:11:28 user nova-compute[75245]:         </nova:port>
Nov 29 16:11:28 user nova-compute[75245]:         <nova:port uuid="d6c559e9-afbf-473d-b4b0-f3cdff6938bc">
Nov 29 16:11:28 user nova-compute[75245]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 29 16:11:28 user nova-compute[75245]:         </nova:port>
Nov 29 16:11:28 user nova-compute[75245]:       </nova:ports>
Nov 29 16:11:28 user nova-compute[75245]:     </nova:instance>
Nov 29 16:11:28 user nova-compute[75245]:   </metadata>
Nov 29 16:11:28 user nova-compute[75245]:   <sysinfo type="smbios">
Nov 29 16:11:28 user nova-compute[75245]:     <system>
Nov 29 16:11:28 user nova-compute[75245]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 16:11:28 user nova-compute[75245]:       <entry name="product">OpenStack Nova</entry>
Nov 29 16:11:28 user nova-compute[75245]:       <entry name="version">0.0.0</entry>
Nov 29 16:11:28 user nova-compute[75245]:       <entry name="serial">696417e7-8eff-46f3-a6f1-11a9f5191627</entry>
Nov 29 16:11:28 user nova-compute[75245]:       <entry name="uuid">696417e7-8eff-46f3-a6f1-11a9f5191627</entry>
Nov 29 16:11:28 user nova-compute[75245]:       <entry name="family">Virtual Machine</entry>
Nov 29 16:11:28 user nova-compute[75245]:     </system>
Nov 29 16:11:28 user nova-compute[75245]:   </sysinfo>
Nov 29 16:11:28 user nova-compute[75245]:   <os>
Nov 29 16:11:28 user nova-compute[75245]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 16:11:28 user nova-compute[75245]:     <boot dev="hd"/>
Nov 29 16:11:28 user nova-compute[75245]:     <smbios mode="sysinfo"/>
Nov 29 16:11:28 user nova-compute[75245]:   </os>
Nov 29 16:11:28 user nova-compute[75245]:   <features>
Nov 29 16:11:28 user nova-compute[75245]:     <acpi/>
Nov 29 16:11:28 user nova-compute[75245]:     <apic/>
Nov 29 16:11:28 user nova-compute[75245]:     <vmcoreinfo/>
Nov 29 16:11:28 user nova-compute[75245]:   </features>
Nov 29 16:11:28 user nova-compute[75245]:   <clock offset="utc">
Nov 29 16:11:28 user nova-compute[75245]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 16:11:28 user nova-compute[75245]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 16:11:28 user nova-compute[75245]:     <timer name="hpet" present="no"/>
Nov 29 16:11:28 user nova-compute[75245]:   </clock>
Nov 29 16:11:28 user nova-compute[75245]:   <cpu mode="custom" match="exact">
Nov 29 16:11:28 user nova-compute[75245]:     <model>Nehalem</model>
Nov 29 16:11:28 user nova-compute[75245]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 16:11:28 user nova-compute[75245]:   </cpu>
Nov 29 16:11:28 user nova-compute[75245]:   <devices>
Nov 29 16:11:28 user nova-compute[75245]:     <disk type="file" device="cdrom">
Nov 29 16:11:28 user nova-compute[75245]:       <driver name="qemu" type="raw" cache="none"/>
Nov 29 16:11:28 user nova-compute[75245]:       <source file="/opt/stack/data/nova/instances/696417e7-8eff-46f3-a6f1-11a9f5191627/disk.config"/>
Nov 29 16:11:28 user nova-compute[75245]:       <target dev="hda" bus="ide"/>
Nov 29 16:11:28 user nova-compute[75245]:     </disk>
Nov 29 16:11:28 user nova-compute[75245]:     <disk type="block" device="disk">
Nov 29 16:11:28 user nova-compute[75245]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:11:28 user nova-compute[75245]:       <source dev="/dev/sdb"/>
Nov 29 16:11:28 user nova-compute[75245]:       <target dev="vda" bus="virtio"/>
Nov 29 16:11:28 user nova-compute[75245]:       <serial>86bd6476-7e72-486f-8c34-0dea88db3678</serial>
Nov 29 16:11:28 user nova-compute[75245]:     </disk>
Nov 29 16:11:28 user nova-compute[75245]:     <disk type="block" device="disk">
Nov 29 16:11:28 user nova-compute[75245]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:11:28 user nova-compute[75245]:       <source dev="/dev/sdc"/>
Nov 29 16:11:28 user nova-compute[75245]:       <target dev="vdb" bus="virtio"/>
Nov 29 16:11:28 user nova-compute[75245]:       <serial>0a923d37-4d88-41bf-a160-1e163236f311</serial>
Nov 29 16:11:28 user nova-compute[75245]:     </disk>
Nov 29 16:11:28 user nova-compute[75245]:     <disk type="block" device="disk">
Nov 29 16:11:28 user nova-compute[75245]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:11:28 user nova-compute[75245]:       <source dev="/dev/sdd"/>
Nov 29 16:11:28 user nova-compute[75245]:       <target dev="vdc" bus="virtio"/>
Nov 29 16:11:28 user nova-compute[75245]:       <serial>51c84145-9618-45af-ad49-4fd8c925bb63</serial>
Nov 29 16:11:28 user nova-compute[75245]:     </disk>
Nov 29 16:11:28 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 16:11:28 user nova-compute[75245]:       <mac address="fa:16:3e:aa:b6:e1"/>
Nov 29 16:11:28 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:11:28 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 16:11:28 user nova-compute[75245]:       <target dev="tapd116100d-df"/>
Nov 29 16:11:28 user nova-compute[75245]:     </interface>
Nov 29 16:11:28 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 16:11:28 user nova-compute[75245]:       <mac address="fa:16:3e:0e:64:29"/>
Nov 29 16:11:28 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:11:28 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 16:11:28 user nova-compute[75245]:       <target dev="tape2cbf31f-6c"/>
Nov 29 16:11:28 user nova-compute[75245]:     </interface>
Nov 29 16:11:28 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 16:11:28 user nova-compute[75245]:       <mac address="fa:16:3e:cb:f8:53"/>
Nov 29 16:11:28 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:11:28 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 16:11:28 user nova-compute[75245]:       <target dev="tap6a5d2bae-9b"/>
Nov 29 16:11:28 user nova-compute[75245]:     </interface>
Nov 29 16:11:28 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 16:11:28 user nova-compute[75245]:       <mac address="fa:16:3e:4e:09:93"/>
Nov 29 16:11:28 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:11:28 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 16:11:28 user nova-compute[75245]:       <target dev="tap1bcb8f7b-ab"/>
Nov 29 16:11:28 user nova-compute[75245]:     </interface>
Nov 29 16:11:28 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 16:11:28 user nova-compute[75245]:       <mac address="fa:16:3e:3f:11:4e"/>
Nov 29 16:11:28 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:11:28 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 16:11:28 user nova-compute[75245]:       <target dev="tapf91c7d1f-43"/>
Nov 29 16:11:28 user nova-compute[75245]:     </interface>
Nov 29 16:11:28 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 16:11:28 user nova-compute[75245]:       <mac address="fa:16:3e:83:2f:60"/>
Nov 29 16:11:28 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:11:28 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 16:11:28 user nova-compute[75245]:       <target dev="tap56b28d7b-1c"/>
Nov 29 16:11:28 user nova-compute[75245]:     </interface>
Nov 29 16:11:28 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 16:11:28 user nova-compute[75245]:       <mac address="fa:16:3e:21:9f:17"/>
Nov 29 16:11:28 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:11:28 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 16:11:28 user nova-compute[75245]:       <target dev="tapd6c559e9-af"/>
Nov 29 16:11:28 user nova-compute[75245]:     </interface>
Nov 29 16:11:28 user nova-compute[75245]:     <serial type="pty">
Nov 29 16:11:28 user nova-compute[75245]:       <log file="/opt/stack/data/nova/instances/696417e7-8eff-46f3-a6f1-11a9f5191627/console.log" append="off"/>
Nov 29 16:11:28 user nova-compute[75245]:     </serial>
Nov 29 16:11:28 user nova-compute[75245]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 16:11:28 user nova-compute[75245]:     <video>
Nov 29 16:11:28 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:11:28 user nova-compute[75245]:     </video>
Nov 29 16:11:28 user nova-compute[75245]:     <rng model="virtio">
Nov 29 16:11:28 user nova-compute[75245]:       <backend model="random">/dev/urandom</backend>
Nov 29 16:11:28 user nova-compute[75245]:     </rng>
Nov 29 16:11:28 user nova-compute[75245]:     <controller type="usb" index="0" model="none"/>
Nov 29 16:11:28 user nova-compute[75245]:     <memballoon model="virtio">
Nov 29 16:11:28 user nova-compute[75245]:       <stats period="10"/>
Nov 29 16:11:28 user nova-compute[75245]:     </memballoon>
Nov 29 16:11:28 user nova-compute[75245]:   </devices>
Nov 29 16:11:28 user nova-compute[75245]: </domain>
Nov 29 16:11:28 user nova-compute[75245]:  {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T16:10:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1163488234',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1163488234',id=10,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOw/5U9h5ccex2qnP/5hOTP78ppDsOgRNSxy0KA0i1xSCXR5NDTKu7hvcsmkDcFw/WanqDVtSpFbkkBVHht7EsYDS15+PaPoF0OH31h4AuA0XHHkSzaU9hrZMTJL7pI2Mg==',key_name='tempest-keypair-1884616232',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e751c778a804388a05afe573a7b7828',ramdisk_id='',reservation_id='r-6eckmld2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1192969410',owner_user_name='tempest-TaggedBootDevicesTest-1192969410-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:10:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fc59a8c008f4270a8643280e6649e94',uuid=696417e7-8eff-46f3-a6f1-11a9f5191627,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d116100d-dfd6-4666-86cd-659d5539871a", "address": "fa:16:3e:aa:b6:e1", "network": {"id": "8a90347e-c47f-450a-8b31-4bf8d24e9aee", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-923062507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd116100d-df", "ovs_interfaceid": "d116100d-dfd6-4666-86cd-659d5539871a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Converting VIF {"id": "d116100d-dfd6-4666-86cd-659d5539871a", "address": "fa:16:3e:aa:b6:e1", "network": {"id": "8a90347e-c47f-450a-8b31-4bf8d24e9aee", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-923062507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd116100d-df", "ovs_interfaceid": "d116100d-dfd6-4666-86cd-659d5539871a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:b6:e1,bridge_name='br-int',has_traffic_filtering=True,id=d116100d-dfd6-4666-86cd-659d5539871a,network=Network(8a90347e-c47f-450a-8b31-4bf8d24e9aee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd116100d-df') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG os_vif [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:b6:e1,bridge_name='br-int',has_traffic_filtering=True,id=d116100d-dfd6-4666-86cd-659d5539871a,network=Network(8a90347e-c47f-450a-8b31-4bf8d24e9aee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd116100d-df') {{(pid=75245) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5bc93cbd-dcc9-5134-a3d6-f0b58e4f56cc', '_type': 'linux-noop'}}, row=False) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd116100d-df, may_exist=True, interface_attrs={}) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd116100d-df, col_values=(('qos', UUID('8717fbb9-c10e-4998-8502-0a5b24c74513')),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd116100d-df, col_values=(('external_ids', {'iface-id': 'd116100d-dfd6-4666-86cd-659d5539871a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:b6:e1', 'vm-uuid': '696417e7-8eff-46f3-a6f1-11a9f5191627'}),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:28 user nova-compute[75245]: INFO os_vif [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:b6:e1,bridge_name='br-int',has_traffic_filtering=True,id=d116100d-dfd6-4666-86cd-659d5539871a,network=Network(8a90347e-c47f-450a-8b31-4bf8d24e9aee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd116100d-df')
Nov 29 16:11:28 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T16:10:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1163488234',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1163488234',id=10,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOw/5U9h5ccex2qnP/5hOTP78ppDsOgRNSxy0KA0i1xSCXR5NDTKu7hvcsmkDcFw/WanqDVtSpFbkkBVHht7EsYDS15+PaPoF0OH31h4AuA0XHHkSzaU9hrZMTJL7pI2Mg==',key_name='tempest-keypair-1884616232',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e751c778a804388a05afe573a7b7828',ramdisk_id='',reservation_id='r-6eckmld2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1192969410',owner_user_name='tempest-TaggedBootDevicesTest-1192969410-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:10:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fc59a8c008f4270a8643280e6649e94',uuid=696417e7-8eff-46f3-a6f1-11a9f5191627,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2cbf31f-6cf8-4a30-9d9b-3bbb3645a660", "address": "fa:16:3e:0e:64:29", "network": {"id": "891dd2c7-8a6d-4a31-b5d4-6edcd5e2f9ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-214436945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2cbf31f-6c", "ovs_interfaceid": "e2cbf31f-6cf8-4a30-9d9b-3bbb3645a660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75245) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Converting VIF {"id": "e2cbf31f-6cf8-4a30-9d9b-3bbb3645a660", "address": "fa:16:3e:0e:64:29", "network": {"id": "891dd2c7-8a6d-4a31-b5d4-6edcd5e2f9ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-214436945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2cbf31f-6c", "ovs_interfaceid": "e2cbf31f-6cf8-4a30-9d9b-3bbb3645a660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:64:29,bridge_name='br-int',has_traffic_filtering=True,id=e2cbf31f-6cf8-4a30-9d9b-3bbb3645a660,network=Network(891dd2c7-8a6d-4a31-b5d4-6edcd5e2f9ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape2cbf31f-6c') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG os_vif [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:64:29,bridge_name='br-int',has_traffic_filtering=True,id=e2cbf31f-6cf8-4a30-9d9b-3bbb3645a660,network=Network(891dd2c7-8a6d-4a31-b5d4-6edcd5e2f9ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape2cbf31f-6c') {{(pid=75245) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c0c858fa-2b2a-5b9c-b295-9a4b88e08b4e', '_type': 'linux-noop'}}, row=False) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape2cbf31f-6c, may_exist=True, interface_attrs={}) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape2cbf31f-6c, col_values=(('qos', UUID('69adb4a6-e456-4b54-a7dd-be98c79079f4')),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape2cbf31f-6c, col_values=(('external_ids', {'iface-id': 'e2cbf31f-6cf8-4a30-9d9b-3bbb3645a660', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:64:29', 'vm-uuid': '696417e7-8eff-46f3-a6f1-11a9f5191627'}),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:28 user nova-compute[75245]: INFO os_vif [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:64:29,bridge_name='br-int',has_traffic_filtering=True,id=e2cbf31f-6cf8-4a30-9d9b-3bbb3645a660,network=Network(891dd2c7-8a6d-4a31-b5d4-6edcd5e2f9ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape2cbf31f-6c')
Nov 29 16:11:28 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T16:10:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1163488234',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1163488234',id=10,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOw/5U9h5ccex2qnP/5hOTP78ppDsOgRNSxy0KA0i1xSCXR5NDTKu7hvcsmkDcFw/WanqDVtSpFbkkBVHht7EsYDS15+PaPoF0OH31h4AuA0XHHkSzaU9hrZMTJL7pI2Mg==',key_name='tempest-keypair-1884616232',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e751c778a804388a05afe573a7b7828',ramdisk_id='',reservation_id='r-6eckmld2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1192969410',owner_user_name='tempest-TaggedBootDevicesTest-1192969410-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:10:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fc59a8c008f4270a8643280e6649e94',uuid=696417e7-8eff-46f3-a6f1-11a9f5191627,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a5d2bae-9b9d-4331-b080-badfed69c6b1", "address": "fa:16:3e:cb:f8:53", "network": {"id": "891dd2c7-8a6d-4a31-b5d4-6edcd5e2f9ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-214436945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a5d2bae-9b", "ovs_interfaceid": "6a5d2bae-9b9d-4331-b080-badfed69c6b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75245) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Converting VIF {"id": "6a5d2bae-9b9d-4331-b080-badfed69c6b1", "address": "fa:16:3e:cb:f8:53", "network": {"id": "891dd2c7-8a6d-4a31-b5d4-6edcd5e2f9ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-214436945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a5d2bae-9b", "ovs_interfaceid": "6a5d2bae-9b9d-4331-b080-badfed69c6b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:f8:53,bridge_name='br-int',has_traffic_filtering=True,id=6a5d2bae-9b9d-4331-b080-badfed69c6b1,network=Network(891dd2c7-8a6d-4a31-b5d4-6edcd5e2f9ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6a5d2bae-9b') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG os_vif [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:f8:53,bridge_name='br-int',has_traffic_filtering=True,id=6a5d2bae-9b9d-4331-b080-badfed69c6b1,network=Network(891dd2c7-8a6d-4a31-b5d4-6edcd5e2f9ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6a5d2bae-9b') {{(pid=75245) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '925f738f-8998-551a-b63a-6c4ad3ccf354', '_type': 'linux-noop'}}, row=False) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6a5d2bae-9b, may_exist=True, interface_attrs={}) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6a5d2bae-9b, col_values=(('qos', UUID('faa0f118-5f22-41e5-bb69-55f2245a9752')),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6a5d2bae-9b, col_values=(('external_ids', {'iface-id': '6a5d2bae-9b9d-4331-b080-badfed69c6b1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:f8:53', 'vm-uuid': '696417e7-8eff-46f3-a6f1-11a9f5191627'}),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:28 user nova-compute[75245]: INFO os_vif [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:f8:53,bridge_name='br-int',has_traffic_filtering=True,id=6a5d2bae-9b9d-4331-b080-badfed69c6b1,network=Network(891dd2c7-8a6d-4a31-b5d4-6edcd5e2f9ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6a5d2bae-9b')
Nov 29 16:11:28 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T16:10:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1163488234',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1163488234',id=10,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOw/5U9h5ccex2qnP/5hOTP78ppDsOgRNSxy0KA0i1xSCXR5NDTKu7hvcsmkDcFw/WanqDVtSpFbkkBVHht7EsYDS15+PaPoF0OH31h4AuA0XHHkSzaU9hrZMTJL7pI2Mg==',key_name='tempest-keypair-1884616232',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e751c778a804388a05afe573a7b7828',ramdisk_id='',reservation_id='r-6eckmld2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1192969410',owner_user_name='tempest-TaggedBootDevicesTest-1192969410-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:10:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fc59a8c008f4270a8643280e6649e94',uuid=696417e7-8eff-46f3-a6f1-11a9f5191627,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1bcb8f7b-abf5-4fe1-8ad9-a1d0316f951a", "address": "fa:16:3e:4e:09:93", "network": {"id": "891dd2c7-8a6d-4a31-b5d4-6edcd5e2f9ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-214436945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bcb8f7b-ab", "ovs_interfaceid": "1bcb8f7b-abf5-4fe1-8ad9-a1d0316f951a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Converting VIF {"id": "1bcb8f7b-abf5-4fe1-8ad9-a1d0316f951a", "address": "fa:16:3e:4e:09:93", "network": {"id": "891dd2c7-8a6d-4a31-b5d4-6edcd5e2f9ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-214436945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bcb8f7b-ab", "ovs_interfaceid": "1bcb8f7b-abf5-4fe1-8ad9-a1d0316f951a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:09:93,bridge_name='br-int',has_traffic_filtering=True,id=1bcb8f7b-abf5-4fe1-8ad9-a1d0316f951a,network=Network(891dd2c7-8a6d-4a31-b5d4-6edcd5e2f9ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bcb8f7b-ab') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG os_vif [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:09:93,bridge_name='br-int',has_traffic_filtering=True,id=1bcb8f7b-abf5-4fe1-8ad9-a1d0316f951a,network=Network(891dd2c7-8a6d-4a31-b5d4-6edcd5e2f9ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bcb8f7b-ab') {{(pid=75245) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6b1aaae7-0538-5256-a27d-4521e7aefa53', '_type': 'linux-noop'}}, row=False) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1bcb8f7b-ab, may_exist=True, interface_attrs={}) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1bcb8f7b-ab, col_values=(('qos', UUID('451ae516-3d75-43e9-8666-40a4d6a7a904')),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1bcb8f7b-ab, col_values=(('external_ids', {'iface-id': '1bcb8f7b-abf5-4fe1-8ad9-a1d0316f951a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:09:93', 'vm-uuid': '696417e7-8eff-46f3-a6f1-11a9f5191627'}),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:28 user nova-compute[75245]: INFO os_vif [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:09:93,bridge_name='br-int',has_traffic_filtering=True,id=1bcb8f7b-abf5-4fe1-8ad9-a1d0316f951a,network=Network(891dd2c7-8a6d-4a31-b5d4-6edcd5e2f9ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bcb8f7b-ab')
Nov 29 16:11:28 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T16:10:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1163488234',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1163488234',id=10,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOw/5U9h5ccex2qnP/5hOTP78ppDsOgRNSxy0KA0i1xSCXR5NDTKu7hvcsmkDcFw/WanqDVtSpFbkkBVHht7EsYDS15+PaPoF0OH31h4AuA0XHHkSzaU9hrZMTJL7pI2Mg==',key_name='tempest-keypair-1884616232',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e751c778a804388a05afe573a7b7828',ramdisk_id='',reservation_id='r-6eckmld2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1192969410',owner_user_name='tempest-TaggedBootDevicesTest-1192969410-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:10:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fc59a8c008f4270a8643280e6649e94',uuid=696417e7-8eff-46f3-a6f1-11a9f5191627,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f91c7d1f-43fd-4e3e-9748-dd25010699bd", "address": "fa:16:3e:3f:11:4e", "network": {"id": "891dd2c7-8a6d-4a31-b5d4-6edcd5e2f9ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-214436945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91c7d1f-43", "ovs_interfaceid": "f91c7d1f-43fd-4e3e-9748-dd25010699bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Converting VIF {"id": "f91c7d1f-43fd-4e3e-9748-dd25010699bd", "address": "fa:16:3e:3f:11:4e", "network": {"id": "891dd2c7-8a6d-4a31-b5d4-6edcd5e2f9ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-214436945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91c7d1f-43", "ovs_interfaceid": "f91c7d1f-43fd-4e3e-9748-dd25010699bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:11:4e,bridge_name='br-int',has_traffic_filtering=True,id=f91c7d1f-43fd-4e3e-9748-dd25010699bd,network=Network(891dd2c7-8a6d-4a31-b5d4-6edcd5e2f9ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf91c7d1f-43') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG os_vif [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:11:4e,bridge_name='br-int',has_traffic_filtering=True,id=f91c7d1f-43fd-4e3e-9748-dd25010699bd,network=Network(891dd2c7-8a6d-4a31-b5d4-6edcd5e2f9ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf91c7d1f-43') {{(pid=75245) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a607d907-211e-5f1d-82d7-f253e79aa2f3', '_type': 'linux-noop'}}, row=False) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf91c7d1f-43, may_exist=True, interface_attrs={}) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf91c7d1f-43, col_values=(('qos', UUID('b54c77a9-b47b-4412-a895-8a61c378799e')),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf91c7d1f-43, col_values=(('external_ids', {'iface-id': 'f91c7d1f-43fd-4e3e-9748-dd25010699bd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:11:4e', 'vm-uuid': '696417e7-8eff-46f3-a6f1-11a9f5191627'}),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:28 user nova-compute[75245]: INFO os_vif [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:11:4e,bridge_name='br-int',has_traffic_filtering=True,id=f91c7d1f-43fd-4e3e-9748-dd25010699bd,network=Network(891dd2c7-8a6d-4a31-b5d4-6edcd5e2f9ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf91c7d1f-43')
Nov 29 16:11:28 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T16:10:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1163488234',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1163488234',id=10,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOw/5U9h5ccex2qnP/5hOTP78ppDsOgRNSxy0KA0i1xSCXR5NDTKu7hvcsmkDcFw/WanqDVtSpFbkkBVHht7EsYDS15+PaPoF0OH31h4AuA0XHHkSzaU9hrZMTJL7pI2Mg==',key_name='tempest-keypair-1884616232',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e751c778a804388a05afe573a7b7828',ramdisk_id='',reservation_id='r-6eckmld2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1192969410',owner_user_name='tempest-TaggedBootDevicesTest-1192969410-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:10:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fc59a8c008f4270a8643280e6649e94',uuid=696417e7-8eff-46f3-a6f1-11a9f5191627,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56b28d7b-1c3c-4e60-bbd6-7fd01f07fc6c", "address": "fa:16:3e:83:2f:60", "network": {"id": "e6c7f35e-5af2-440d-8433-00e0c0f5e62c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1457199759", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56b28d7b-1c", "ovs_interfaceid": "56b28d7b-1c3c-4e60-bbd6-7fd01f07fc6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Converting VIF {"id": "56b28d7b-1c3c-4e60-bbd6-7fd01f07fc6c", "address": "fa:16:3e:83:2f:60", "network": {"id": "e6c7f35e-5af2-440d-8433-00e0c0f5e62c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1457199759", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56b28d7b-1c", "ovs_interfaceid": "56b28d7b-1c3c-4e60-bbd6-7fd01f07fc6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:2f:60,bridge_name='br-int',has_traffic_filtering=True,id=56b28d7b-1c3c-4e60-bbd6-7fd01f07fc6c,network=Network(e6c7f35e-5af2-440d-8433-00e0c0f5e62c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56b28d7b-1c') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG os_vif [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:2f:60,bridge_name='br-int',has_traffic_filtering=True,id=56b28d7b-1c3c-4e60-bbd6-7fd01f07fc6c,network=Network(e6c7f35e-5af2-440d-8433-00e0c0f5e62c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56b28d7b-1c') {{(pid=75245) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '52586467-8e64-57c2-bde0-8dcaded0c7b5', '_type': 'linux-noop'}}, row=False) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap56b28d7b-1c, may_exist=True, interface_attrs={}) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap56b28d7b-1c, col_values=(('qos', UUID('f7aacd1f-5268-4e4c-9215-0762c174841d')),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap56b28d7b-1c, col_values=(('external_ids', {'iface-id': '56b28d7b-1c3c-4e60-bbd6-7fd01f07fc6c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:2f:60', 'vm-uuid': '696417e7-8eff-46f3-a6f1-11a9f5191627'}),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:28 user nova-compute[75245]: INFO os_vif [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:2f:60,bridge_name='br-int',has_traffic_filtering=True,id=56b28d7b-1c3c-4e60-bbd6-7fd01f07fc6c,network=Network(e6c7f35e-5af2-440d-8433-00e0c0f5e62c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56b28d7b-1c')
Nov 29 16:11:28 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T16:10:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1163488234',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1163488234',id=10,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOw/5U9h5ccex2qnP/5hOTP78ppDsOgRNSxy0KA0i1xSCXR5NDTKu7hvcsmkDcFw/WanqDVtSpFbkkBVHht7EsYDS15+PaPoF0OH31h4AuA0XHHkSzaU9hrZMTJL7pI2Mg==',key_name='tempest-keypair-1884616232',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e751c778a804388a05afe573a7b7828',ramdisk_id='',reservation_id='r-6eckmld2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1192969410',owner_user_name='tempest-TaggedBootDevicesTest-1192969410-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:10:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fc59a8c008f4270a8643280e6649e94',uuid=696417e7-8eff-46f3-a6f1-11a9f5191627,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6c559e9-afbf-473d-b4b0-f3cdff6938bc", "address": "fa:16:3e:21:9f:17", "network": {"id": "e6c7f35e-5af2-440d-8433-00e0c0f5e62c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1457199759", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c559e9-af", "ovs_interfaceid": "d6c559e9-afbf-473d-b4b0-f3cdff6938bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Converting VIF {"id": "d6c559e9-afbf-473d-b4b0-f3cdff6938bc", "address": "fa:16:3e:21:9f:17", "network": {"id": "e6c7f35e-5af2-440d-8433-00e0c0f5e62c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1457199759", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c559e9-af", "ovs_interfaceid": "d6c559e9-afbf-473d-b4b0-f3cdff6938bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:9f:17,bridge_name='br-int',has_traffic_filtering=True,id=d6c559e9-afbf-473d-b4b0-f3cdff6938bc,network=Network(e6c7f35e-5af2-440d-8433-00e0c0f5e62c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6c559e9-af') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG os_vif [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:9f:17,bridge_name='br-int',has_traffic_filtering=True,id=d6c559e9-afbf-473d-b4b0-f3cdff6938bc,network=Network(e6c7f35e-5af2-440d-8433-00e0c0f5e62c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6c559e9-af') {{(pid=75245) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c50854cf-be2a-5aeb-bea1-6da5930ba119', '_type': 'linux-noop'}}, row=False) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd6c559e9-af, may_exist=True, interface_attrs={}) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd6c559e9-af, col_values=(('qos', UUID('b9613eb5-a003-4c88-88b2-efda983c5187')),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd6c559e9-af, col_values=(('external_ids', {'iface-id': 'd6c559e9-afbf-473d-b4b0-f3cdff6938bc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:9f:17', 'vm-uuid': '696417e7-8eff-46f3-a6f1-11a9f5191627'}),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:28 user nova-compute[75245]: INFO os_vif [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:9f:17,bridge_name='br-int',has_traffic_filtering=True,id=d6c559e9-afbf-473d-b4b0-f3cdff6938bc,network=Network(e6c7f35e-5af2-440d-8433-00e0c0f5e62c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6c559e9-af')
Nov 29 16:11:28 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] No BDM found with device name hda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] No VIF found with MAC fa:16:3e:aa:b6:e1, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:11:28 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] No VIF found with MAC fa:16:3e:3f:11:4e, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:11:28 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Using config drive
Nov 29 16:11:28 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Creating config drive at /opt/stack/data/nova/instances/696417e7-8eff-46f3-a6f1-11a9f5191627/disk.config
Nov 29 16:11:28 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/696417e7-8eff-46f3-a6f1-11a9f5191627/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpj8b0q2te {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:11:29 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/696417e7-8eff-46f3-a6f1-11a9f5191627/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpj8b0q2te" returned: 0 in 0.062s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:11:30 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:30 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:30 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:30 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:30 user nova-compute[75245]: DEBUG nova.compute.manager [req-cfab1b50-e494-491b-90b5-ee8a0f24396c req-9180d3cb-cd8c-42e2-8a52-42eef1c9effe service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Received event network-vif-plugged-d116100d-dfd6-4666-86cd-659d5539871a {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:11:30 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-cfab1b50-e494-491b-90b5-ee8a0f24396c req-9180d3cb-cd8c-42e2-8a52-42eef1c9effe service nova] Acquiring lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:11:30 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-cfab1b50-e494-491b-90b5-ee8a0f24396c req-9180d3cb-cd8c-42e2-8a52-42eef1c9effe service nova] Lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:11:30 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-cfab1b50-e494-491b-90b5-ee8a0f24396c req-9180d3cb-cd8c-42e2-8a52-42eef1c9effe service nova] Lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:11:30 user nova-compute[75245]: DEBUG nova.compute.manager [req-cfab1b50-e494-491b-90b5-ee8a0f24396c req-9180d3cb-cd8c-42e2-8a52-42eef1c9effe service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] No waiting events found dispatching network-vif-plugged-d116100d-dfd6-4666-86cd-659d5539871a {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:11:30 user nova-compute[75245]: WARNING nova.compute.manager [req-cfab1b50-e494-491b-90b5-ee8a0f24396c req-9180d3cb-cd8c-42e2-8a52-42eef1c9effe service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Received unexpected event network-vif-plugged-d116100d-dfd6-4666-86cd-659d5539871a for instance with vm_state building and task_state spawning.
Nov 29 16:11:30 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:30 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:30 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:31 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:31 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:31 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:31 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:31 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:31 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:31 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:31 user nova-compute[75245]: DEBUG nova.compute.manager [req-6019df82-925e-40b0-9e59-4e369c7fcb81 req-a101a100-a2b1-4527-898a-a8eb1732df51 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Received event network-vif-plugged-6a5d2bae-9b9d-4331-b080-badfed69c6b1 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:11:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-6019df82-925e-40b0-9e59-4e369c7fcb81 req-a101a100-a2b1-4527-898a-a8eb1732df51 service nova] Acquiring lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:11:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-6019df82-925e-40b0-9e59-4e369c7fcb81 req-a101a100-a2b1-4527-898a-a8eb1732df51 service nova] Lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:11:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-6019df82-925e-40b0-9e59-4e369c7fcb81 req-a101a100-a2b1-4527-898a-a8eb1732df51 service nova] Lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:11:31 user nova-compute[75245]: DEBUG nova.compute.manager [req-6019df82-925e-40b0-9e59-4e369c7fcb81 req-a101a100-a2b1-4527-898a-a8eb1732df51 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] No waiting events found dispatching network-vif-plugged-6a5d2bae-9b9d-4331-b080-badfed69c6b1 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:11:31 user nova-compute[75245]: WARNING nova.compute.manager [req-6019df82-925e-40b0-9e59-4e369c7fcb81 req-a101a100-a2b1-4527-898a-a8eb1732df51 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Received unexpected event network-vif-plugged-6a5d2bae-9b9d-4331-b080-badfed69c6b1 for instance with vm_state building and task_state spawning.
Nov 29 16:11:31 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:31 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:31 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:31 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:31 user nova-compute[75245]: DEBUG nova.compute.manager [req-dc526427-a3cd-44b1-9dbe-24ea0de4ea3b req-36c20868-8865-4226-af9b-7e1ca590cd05 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Received event network-vif-plugged-1bcb8f7b-abf5-4fe1-8ad9-a1d0316f951a {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:11:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-dc526427-a3cd-44b1-9dbe-24ea0de4ea3b req-36c20868-8865-4226-af9b-7e1ca590cd05 service nova] Acquiring lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:11:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-dc526427-a3cd-44b1-9dbe-24ea0de4ea3b req-36c20868-8865-4226-af9b-7e1ca590cd05 service nova] Lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:11:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-dc526427-a3cd-44b1-9dbe-24ea0de4ea3b req-36c20868-8865-4226-af9b-7e1ca590cd05 service nova] Lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:11:31 user nova-compute[75245]: DEBUG nova.compute.manager [req-dc526427-a3cd-44b1-9dbe-24ea0de4ea3b req-36c20868-8865-4226-af9b-7e1ca590cd05 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] No waiting events found dispatching network-vif-plugged-1bcb8f7b-abf5-4fe1-8ad9-a1d0316f951a {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:11:31 user nova-compute[75245]: WARNING nova.compute.manager [req-dc526427-a3cd-44b1-9dbe-24ea0de4ea3b req-36c20868-8865-4226-af9b-7e1ca590cd05 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Received unexpected event network-vif-plugged-1bcb8f7b-abf5-4fe1-8ad9-a1d0316f951a for instance with vm_state building and task_state spawning.
Nov 29 16:11:31 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:31 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:31 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:31 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:31 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:31 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:32 user nova-compute[75245]: DEBUG nova.compute.manager [req-cc678786-e130-457f-8644-78510ce8c7b6 req-f3e74bba-1952-42c7-bafe-839bded1bbf2 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Received event network-vif-plugged-d116100d-dfd6-4666-86cd-659d5539871a {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:11:32 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-cc678786-e130-457f-8644-78510ce8c7b6 req-f3e74bba-1952-42c7-bafe-839bded1bbf2 service nova] Acquiring lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:11:32 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-cc678786-e130-457f-8644-78510ce8c7b6 req-f3e74bba-1952-42c7-bafe-839bded1bbf2 service nova] Lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:11:32 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-cc678786-e130-457f-8644-78510ce8c7b6 req-f3e74bba-1952-42c7-bafe-839bded1bbf2 service nova] Lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:11:32 user nova-compute[75245]: DEBUG nova.compute.manager [req-cc678786-e130-457f-8644-78510ce8c7b6 req-f3e74bba-1952-42c7-bafe-839bded1bbf2 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] No waiting events found dispatching network-vif-plugged-d116100d-dfd6-4666-86cd-659d5539871a {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:11:32 user nova-compute[75245]: WARNING nova.compute.manager [req-cc678786-e130-457f-8644-78510ce8c7b6 req-f3e74bba-1952-42c7-bafe-839bded1bbf2 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Received unexpected event network-vif-plugged-d116100d-dfd6-4666-86cd-659d5539871a for instance with vm_state building and task_state spawning.
Nov 29 16:11:32 user nova-compute[75245]: DEBUG nova.compute.manager [req-cc678786-e130-457f-8644-78510ce8c7b6 req-f3e74bba-1952-42c7-bafe-839bded1bbf2 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Received event network-vif-plugged-e2cbf31f-6cf8-4a30-9d9b-3bbb3645a660 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:11:32 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-cc678786-e130-457f-8644-78510ce8c7b6 req-f3e74bba-1952-42c7-bafe-839bded1bbf2 service nova] Acquiring lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:11:32 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-cc678786-e130-457f-8644-78510ce8c7b6 req-f3e74bba-1952-42c7-bafe-839bded1bbf2 service nova] Lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:11:32 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-cc678786-e130-457f-8644-78510ce8c7b6 req-f3e74bba-1952-42c7-bafe-839bded1bbf2 service nova] Lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:11:32 user nova-compute[75245]: DEBUG nova.compute.manager [req-cc678786-e130-457f-8644-78510ce8c7b6 req-f3e74bba-1952-42c7-bafe-839bded1bbf2 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] No waiting events found dispatching network-vif-plugged-e2cbf31f-6cf8-4a30-9d9b-3bbb3645a660 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:11:32 user nova-compute[75245]: WARNING nova.compute.manager [req-cc678786-e130-457f-8644-78510ce8c7b6 req-f3e74bba-1952-42c7-bafe-839bded1bbf2 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Received unexpected event network-vif-plugged-e2cbf31f-6cf8-4a30-9d9b-3bbb3645a660 for instance with vm_state building and task_state spawning.
Nov 29 16:11:32 user nova-compute[75245]: DEBUG nova.compute.manager [req-cc678786-e130-457f-8644-78510ce8c7b6 req-f3e74bba-1952-42c7-bafe-839bded1bbf2 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Received event network-vif-plugged-e2cbf31f-6cf8-4a30-9d9b-3bbb3645a660 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:11:32 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-cc678786-e130-457f-8644-78510ce8c7b6 req-f3e74bba-1952-42c7-bafe-839bded1bbf2 service nova] Acquiring lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:11:32 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-cc678786-e130-457f-8644-78510ce8c7b6 req-f3e74bba-1952-42c7-bafe-839bded1bbf2 service nova] Lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:11:32 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-cc678786-e130-457f-8644-78510ce8c7b6 req-f3e74bba-1952-42c7-bafe-839bded1bbf2 service nova] Lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:11:32 user nova-compute[75245]: DEBUG nova.compute.manager [req-cc678786-e130-457f-8644-78510ce8c7b6 req-f3e74bba-1952-42c7-bafe-839bded1bbf2 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] No waiting events found dispatching network-vif-plugged-e2cbf31f-6cf8-4a30-9d9b-3bbb3645a660 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:11:32 user nova-compute[75245]: WARNING nova.compute.manager [req-cc678786-e130-457f-8644-78510ce8c7b6 req-f3e74bba-1952-42c7-bafe-839bded1bbf2 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Received unexpected event network-vif-plugged-e2cbf31f-6cf8-4a30-9d9b-3bbb3645a660 for instance with vm_state building and task_state spawning.
Nov 29 16:11:33 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:33 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:33 user nova-compute[75245]: DEBUG nova.compute.manager [req-859e03e8-20f5-42d3-8525-1128d7cc2d3d req-bdd5c9f9-45fb-4bbd-b7f5-d44785566ce4 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Received event network-vif-plugged-6a5d2bae-9b9d-4331-b080-badfed69c6b1 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:11:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-859e03e8-20f5-42d3-8525-1128d7cc2d3d req-bdd5c9f9-45fb-4bbd-b7f5-d44785566ce4 service nova] Acquiring lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:11:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-859e03e8-20f5-42d3-8525-1128d7cc2d3d req-bdd5c9f9-45fb-4bbd-b7f5-d44785566ce4 service nova] Lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:11:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-859e03e8-20f5-42d3-8525-1128d7cc2d3d req-bdd5c9f9-45fb-4bbd-b7f5-d44785566ce4 service nova] Lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:11:33 user nova-compute[75245]: DEBUG nova.compute.manager [req-859e03e8-20f5-42d3-8525-1128d7cc2d3d req-bdd5c9f9-45fb-4bbd-b7f5-d44785566ce4 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] No waiting events found dispatching network-vif-plugged-6a5d2bae-9b9d-4331-b080-badfed69c6b1 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:11:33 user nova-compute[75245]: WARNING nova.compute.manager [req-859e03e8-20f5-42d3-8525-1128d7cc2d3d req-bdd5c9f9-45fb-4bbd-b7f5-d44785566ce4 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Received unexpected event network-vif-plugged-6a5d2bae-9b9d-4331-b080-badfed69c6b1 for instance with vm_state building and task_state spawning.
Nov 29 16:11:33 user nova-compute[75245]: DEBUG nova.compute.manager [req-859e03e8-20f5-42d3-8525-1128d7cc2d3d req-bdd5c9f9-45fb-4bbd-b7f5-d44785566ce4 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Received event network-vif-plugged-f91c7d1f-43fd-4e3e-9748-dd25010699bd {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:11:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-859e03e8-20f5-42d3-8525-1128d7cc2d3d req-bdd5c9f9-45fb-4bbd-b7f5-d44785566ce4 service nova] Acquiring lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:11:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-859e03e8-20f5-42d3-8525-1128d7cc2d3d req-bdd5c9f9-45fb-4bbd-b7f5-d44785566ce4 service nova] Lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:11:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-859e03e8-20f5-42d3-8525-1128d7cc2d3d req-bdd5c9f9-45fb-4bbd-b7f5-d44785566ce4 service nova] Lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:11:33 user nova-compute[75245]: DEBUG nova.compute.manager [req-859e03e8-20f5-42d3-8525-1128d7cc2d3d req-bdd5c9f9-45fb-4bbd-b7f5-d44785566ce4 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] No waiting events found dispatching network-vif-plugged-f91c7d1f-43fd-4e3e-9748-dd25010699bd {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:11:33 user nova-compute[75245]: WARNING nova.compute.manager [req-859e03e8-20f5-42d3-8525-1128d7cc2d3d req-bdd5c9f9-45fb-4bbd-b7f5-d44785566ce4 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Received unexpected event network-vif-plugged-f91c7d1f-43fd-4e3e-9748-dd25010699bd for instance with vm_state building and task_state spawning.
Nov 29 16:11:33 user nova-compute[75245]: DEBUG nova.compute.manager [req-859e03e8-20f5-42d3-8525-1128d7cc2d3d req-bdd5c9f9-45fb-4bbd-b7f5-d44785566ce4 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Received event network-vif-plugged-f91c7d1f-43fd-4e3e-9748-dd25010699bd {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:11:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-859e03e8-20f5-42d3-8525-1128d7cc2d3d req-bdd5c9f9-45fb-4bbd-b7f5-d44785566ce4 service nova] Acquiring lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:11:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-859e03e8-20f5-42d3-8525-1128d7cc2d3d req-bdd5c9f9-45fb-4bbd-b7f5-d44785566ce4 service nova] Lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:11:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-859e03e8-20f5-42d3-8525-1128d7cc2d3d req-bdd5c9f9-45fb-4bbd-b7f5-d44785566ce4 service nova] Lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:11:33 user nova-compute[75245]: DEBUG nova.compute.manager [req-859e03e8-20f5-42d3-8525-1128d7cc2d3d req-bdd5c9f9-45fb-4bbd-b7f5-d44785566ce4 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] No waiting events found dispatching network-vif-plugged-f91c7d1f-43fd-4e3e-9748-dd25010699bd {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:11:33 user nova-compute[75245]: WARNING nova.compute.manager [req-859e03e8-20f5-42d3-8525-1128d7cc2d3d req-bdd5c9f9-45fb-4bbd-b7f5-d44785566ce4 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Received unexpected event network-vif-plugged-f91c7d1f-43fd-4e3e-9748-dd25010699bd for instance with vm_state building and task_state spawning.
Nov 29 16:11:33 user nova-compute[75245]: DEBUG nova.compute.manager [req-859e03e8-20f5-42d3-8525-1128d7cc2d3d req-bdd5c9f9-45fb-4bbd-b7f5-d44785566ce4 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Received event network-vif-plugged-d6c559e9-afbf-473d-b4b0-f3cdff6938bc {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:11:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-859e03e8-20f5-42d3-8525-1128d7cc2d3d req-bdd5c9f9-45fb-4bbd-b7f5-d44785566ce4 service nova] Acquiring lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:11:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-859e03e8-20f5-42d3-8525-1128d7cc2d3d req-bdd5c9f9-45fb-4bbd-b7f5-d44785566ce4 service nova] Lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:11:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-859e03e8-20f5-42d3-8525-1128d7cc2d3d req-bdd5c9f9-45fb-4bbd-b7f5-d44785566ce4 service nova] Lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:11:33 user nova-compute[75245]: DEBUG nova.compute.manager [req-859e03e8-20f5-42d3-8525-1128d7cc2d3d req-bdd5c9f9-45fb-4bbd-b7f5-d44785566ce4 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] No waiting events found dispatching network-vif-plugged-d6c559e9-afbf-473d-b4b0-f3cdff6938bc {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:11:33 user nova-compute[75245]: WARNING nova.compute.manager [req-859e03e8-20f5-42d3-8525-1128d7cc2d3d req-bdd5c9f9-45fb-4bbd-b7f5-d44785566ce4 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Received unexpected event network-vif-plugged-d6c559e9-afbf-473d-b4b0-f3cdff6938bc for instance with vm_state building and task_state spawning.
Nov 29 16:11:33 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:33 user nova-compute[75245]: DEBUG nova.compute.manager [req-786bec24-fceb-452a-a2ff-d5d6605611b4 req-31276667-da63-4e61-8be5-de9e2b147f20 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Received event network-vif-plugged-1bcb8f7b-abf5-4fe1-8ad9-a1d0316f951a {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:11:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-786bec24-fceb-452a-a2ff-d5d6605611b4 req-31276667-da63-4e61-8be5-de9e2b147f20 service nova] Acquiring lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:11:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-786bec24-fceb-452a-a2ff-d5d6605611b4 req-31276667-da63-4e61-8be5-de9e2b147f20 service nova] Lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:11:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-786bec24-fceb-452a-a2ff-d5d6605611b4 req-31276667-da63-4e61-8be5-de9e2b147f20 service nova] Lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:11:33 user nova-compute[75245]: DEBUG nova.compute.manager [req-786bec24-fceb-452a-a2ff-d5d6605611b4 req-31276667-da63-4e61-8be5-de9e2b147f20 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] No waiting events found dispatching network-vif-plugged-1bcb8f7b-abf5-4fe1-8ad9-a1d0316f951a {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:11:33 user nova-compute[75245]: WARNING nova.compute.manager [req-786bec24-fceb-452a-a2ff-d5d6605611b4 req-31276667-da63-4e61-8be5-de9e2b147f20 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Received unexpected event network-vif-plugged-1bcb8f7b-abf5-4fe1-8ad9-a1d0316f951a for instance with vm_state building and task_state spawning.
Nov 29 16:11:33 user nova-compute[75245]: DEBUG nova.compute.manager [req-786bec24-fceb-452a-a2ff-d5d6605611b4 req-31276667-da63-4e61-8be5-de9e2b147f20 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Received event network-vif-plugged-56b28d7b-1c3c-4e60-bbd6-7fd01f07fc6c {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:11:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-786bec24-fceb-452a-a2ff-d5d6605611b4 req-31276667-da63-4e61-8be5-de9e2b147f20 service nova] Acquiring lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:11:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-786bec24-fceb-452a-a2ff-d5d6605611b4 req-31276667-da63-4e61-8be5-de9e2b147f20 service nova] Lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:11:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-786bec24-fceb-452a-a2ff-d5d6605611b4 req-31276667-da63-4e61-8be5-de9e2b147f20 service nova] Lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:11:33 user nova-compute[75245]: DEBUG nova.compute.manager [req-786bec24-fceb-452a-a2ff-d5d6605611b4 req-31276667-da63-4e61-8be5-de9e2b147f20 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] No waiting events found dispatching network-vif-plugged-56b28d7b-1c3c-4e60-bbd6-7fd01f07fc6c {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:11:33 user nova-compute[75245]: WARNING nova.compute.manager [req-786bec24-fceb-452a-a2ff-d5d6605611b4 req-31276667-da63-4e61-8be5-de9e2b147f20 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Received unexpected event network-vif-plugged-56b28d7b-1c3c-4e60-bbd6-7fd01f07fc6c for instance with vm_state building and task_state spawning.
Nov 29 16:11:33 user nova-compute[75245]: DEBUG nova.compute.manager [req-786bec24-fceb-452a-a2ff-d5d6605611b4 req-31276667-da63-4e61-8be5-de9e2b147f20 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Received event network-vif-plugged-56b28d7b-1c3c-4e60-bbd6-7fd01f07fc6c {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:11:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-786bec24-fceb-452a-a2ff-d5d6605611b4 req-31276667-da63-4e61-8be5-de9e2b147f20 service nova] Acquiring lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:11:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-786bec24-fceb-452a-a2ff-d5d6605611b4 req-31276667-da63-4e61-8be5-de9e2b147f20 service nova] Lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:11:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-786bec24-fceb-452a-a2ff-d5d6605611b4 req-31276667-da63-4e61-8be5-de9e2b147f20 service nova] Lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:11:33 user nova-compute[75245]: DEBUG nova.compute.manager [req-786bec24-fceb-452a-a2ff-d5d6605611b4 req-31276667-da63-4e61-8be5-de9e2b147f20 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] No waiting events found dispatching network-vif-plugged-56b28d7b-1c3c-4e60-bbd6-7fd01f07fc6c {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:11:33 user nova-compute[75245]: WARNING nova.compute.manager [req-786bec24-fceb-452a-a2ff-d5d6605611b4 req-31276667-da63-4e61-8be5-de9e2b147f20 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Received unexpected event network-vif-plugged-56b28d7b-1c3c-4e60-bbd6-7fd01f07fc6c for instance with vm_state building and task_state spawning.
Nov 29 16:11:33 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:33 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:33 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:33 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:34 user nova-compute[75245]: DEBUG nova.compute.manager [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Instance event wait completed in 0 seconds for  {{(pid=75245) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 16:11:34 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Guest created on hypervisor {{(pid=75245) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 16:11:34 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Instance spawned successfully.
Nov 29 16:11:34 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 16:11:34 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Found default for hw_cdrom_bus of ide {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:11:34 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Found default for hw_disk_bus of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:11:34 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Found default for hw_input_bus of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:11:34 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Found default for hw_pointer_model of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:11:34 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Found default for hw_video_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:11:34 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Found default for hw_vif_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:11:34 user nova-compute[75245]: INFO nova.compute.manager [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Took 11.02 seconds to spawn the instance on the hypervisor.
Nov 29 16:11:34 user nova-compute[75245]: DEBUG nova.compute.manager [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:11:35 user nova-compute[75245]: INFO nova.compute.manager [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Took 40.19 seconds to build instance.
Nov 29 16:11:35 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-240df8a8-5a88-46cf-acb1-7d7d6bbb6674 tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Lock "696417e7-8eff-46f3-a6f1-11a9f5191627" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 40.319s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:11:35 user nova-compute[75245]: DEBUG nova.compute.manager [req-b576339b-0ec2-428c-8237-40733cf29f3a req-10dc3385-2d01-402b-ab53-24a281e1fed7 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Received event network-vif-plugged-d6c559e9-afbf-473d-b4b0-f3cdff6938bc {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:11:35 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b576339b-0ec2-428c-8237-40733cf29f3a req-10dc3385-2d01-402b-ab53-24a281e1fed7 service nova] Acquiring lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:11:35 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b576339b-0ec2-428c-8237-40733cf29f3a req-10dc3385-2d01-402b-ab53-24a281e1fed7 service nova] Lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:11:35 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b576339b-0ec2-428c-8237-40733cf29f3a req-10dc3385-2d01-402b-ab53-24a281e1fed7 service nova] Lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:11:35 user nova-compute[75245]: DEBUG nova.compute.manager [req-b576339b-0ec2-428c-8237-40733cf29f3a req-10dc3385-2d01-402b-ab53-24a281e1fed7 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] No waiting events found dispatching network-vif-plugged-d6c559e9-afbf-473d-b4b0-f3cdff6938bc {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:11:35 user nova-compute[75245]: WARNING nova.compute.manager [req-b576339b-0ec2-428c-8237-40733cf29f3a req-10dc3385-2d01-402b-ab53-24a281e1fed7 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Received unexpected event network-vif-plugged-d6c559e9-afbf-473d-b4b0-f3cdff6938bc for instance with vm_state active and task_state None.
Nov 29 16:11:37 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:38 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:43 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:48 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:11:48 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:48 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75245) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 16:11:48 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:11:48 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:11:48 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:11:49 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Acquiring lock "d55e6c2e-9791-4154-85f5-fec852577c2d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:11:49 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Lock "d55e6c2e-9791-4154-85f5-fec852577c2d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:11:49 user nova-compute[75245]: DEBUG nova.compute.manager [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] [instance: d55e6c2e-9791-4154-85f5-fec852577c2d] Starting instance... {{(pid=75245) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 16:11:49 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:11:49 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:11:49 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75245) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 16:11:49 user nova-compute[75245]: INFO nova.compute.claims [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] [instance: d55e6c2e-9791-4154-85f5-fec852577c2d] Claim successful on node user
Nov 29 16:11:50 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:11:50 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:11:50 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.556s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:11:50 user nova-compute[75245]: DEBUG nova.compute.manager [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] [instance: d55e6c2e-9791-4154-85f5-fec852577c2d] Start building networks asynchronously for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 16:11:50 user nova-compute[75245]: DEBUG nova.compute.manager [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] [instance: d55e6c2e-9791-4154-85f5-fec852577c2d] Allocating IP information in the background. {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 16:11:50 user nova-compute[75245]: DEBUG nova.network.neutron [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] [instance: d55e6c2e-9791-4154-85f5-fec852577c2d] allocate_for_instance() {{(pid=75245) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 16:11:50 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] [instance: d55e6c2e-9791-4154-85f5-fec852577c2d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 16:11:50 user nova-compute[75245]: DEBUG nova.compute.manager [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] [instance: d55e6c2e-9791-4154-85f5-fec852577c2d] Start building block device mappings for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 16:11:50 user nova-compute[75245]: DEBUG nova.policy [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '97d9ea0d0a1842649850d631bed11ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17fcceabdcb74404971adda76fd4e48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75245) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 16:11:50 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:11:50 user nova-compute[75245]: DEBUG nova.compute.manager [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] [instance: d55e6c2e-9791-4154-85f5-fec852577c2d] Start spawning the instance on the hypervisor. {{(pid=75245) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 16:11:50 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] [instance: d55e6c2e-9791-4154-85f5-fec852577c2d] Creating instance directory {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 16:11:50 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] [instance: d55e6c2e-9791-4154-85f5-fec852577c2d] Creating image(s)
Nov 29 16:11:50 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Acquiring lock "/opt/stack/data/nova/instances/d55e6c2e-9791-4154-85f5-fec852577c2d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:11:50 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Lock "/opt/stack/data/nova/instances/d55e6c2e-9791-4154-85f5-fec852577c2d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:11:50 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Lock "/opt/stack/data/nova/instances/d55e6c2e-9791-4154-85f5-fec852577c2d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.013s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:11:50 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:11:50 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2d2f1223-d206-4b10-a4b9-b0d129f4543a tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Acquiring lock "738c0d7a-af77-41f7-9206-0e6b1f18a154" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:11:50 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2d2f1223-d206-4b10-a4b9-b0d129f4543a tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Lock "738c0d7a-af77-41f7-9206-0e6b1f18a154" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:11:50 user nova-compute[75245]: DEBUG nova.objects.instance [None req-2d2f1223-d206-4b10-a4b9-b0d129f4543a tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Lazy-loading 'flavor' on Instance uuid 738c0d7a-af77-41f7-9206-0e6b1f18a154 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:11:50 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2d2f1223-d206-4b10-a4b9-b0d129f4543a tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Lock "738c0d7a-af77-41f7-9206-0e6b1f18a154" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.094s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:11:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:50 user nova-compute[75245]: DEBUG nova.network.neutron [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] [instance: d55e6c2e-9791-4154-85f5-fec852577c2d] Successfully created port: 5a304ad9-9181-4384-b792-a8e80af9a86b {{(pid=75245) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 16:11:50 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.358s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:11:50 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Acquiring lock "d654f7206043e05d3525550b0fc885556eb999f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:11:50 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:11:50 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:11:51 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2d2f1223-d206-4b10-a4b9-b0d129f4543a tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Acquiring lock "738c0d7a-af77-41f7-9206-0e6b1f18a154" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:11:51 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2d2f1223-d206-4b10-a4b9-b0d129f4543a tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Lock "738c0d7a-af77-41f7-9206-0e6b1f18a154" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:11:51 user nova-compute[75245]: INFO nova.compute.manager [None req-2d2f1223-d206-4b10-a4b9-b0d129f4543a tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] [instance: 738c0d7a-af77-41f7-9206-0e6b1f18a154] Attaching volume 565529bd-33f8-43ed-a1d7-697afb9491f3 to /dev/vdb
Nov 29 16:11:51 user nova-compute[75245]: DEBUG os_brick.utils [None req-2d2f1223-d206-4b10-a4b9-b0d129f4543a tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:11:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:11:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:11:51 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[d732f55b-07ea-4b1e-8516-00914d914417]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:69ed8ed87091\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:11:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:11:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.182s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:11:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/d55e6c2e-9791-4154-85f5-fec852577c2d/disk 1073741824 {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:11:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:11:51 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac60474-7f9a-4535-a7de-823c5313f43f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:11:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:11:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/d55e6c2e-9791-4154-85f5-fec852577c2d/disk 1073741824" returned: 0 in 0.055s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:11:51 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:11:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:11:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:11:51 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c040d2-4fd2-4530-af92-b39cccc589a8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:11:51 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[233ee962-b67e-4d64-94ac-ba72b8758390]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:11:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-2d2f1223-d206-4b10-a4b9-b0d129f4543a tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Running cmd (subprocess): nvme version {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:11:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-2d2f1223-d206-4b10-a4b9-b0d129f4543a tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] 'nvme version' failed. Not Retrying. {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:11:51 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2d2f1223-d206-4b10-a4b9-b0d129f4543a tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] nvme not present on system {{(pid=75245) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 16:11:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:11:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:11:51 user nova-compute[75245]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 16:11:51 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[095654e5-4fcb-4a3c-be99-5af4e8df1a45]: (4, '') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:11:51 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-2d2f1223-d206-4b10-a4b9-b0d129f4543a tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75245) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 16:11:51 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-2d2f1223-d206-4b10-a4b9-b0d129f4543a tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 16:11:51 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-2d2f1223-d206-4b10-a4b9-b0d129f4543a tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] LIGHTOS: no hostnqn found. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 16:11:51 user nova-compute[75245]: DEBUG os_brick.utils [None req-2d2f1223-d206-4b10-a4b9-b0d129f4543a tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] <== get_connector_properties: return (212ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:69ed8ed87091', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:11:51 user nova-compute[75245]: DEBUG nova.virt.block_device [None req-2d2f1223-d206-4b10-a4b9-b0d129f4543a tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] [instance: 738c0d7a-af77-41f7-9206-0e6b1f18a154] Updating existing volume attachment record: 9cd2188c-d462-4af8-982b-747946c0e054 {{(pid=75245) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 16:11:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.216s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:11:51 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d55e6c2e-9791-4154-85f5-fec852577c2d/disk. size=1073741824 {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 16:11:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d55e6c2e-9791-4154-85f5-fec852577c2d/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:11:51 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:11:51 user nova-compute[75245]: DEBUG nova.network.neutron [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] [instance: d55e6c2e-9791-4154-85f5-fec852577c2d] Successfully updated port: 5a304ad9-9181-4384-b792-a8e80af9a86b {{(pid=75245) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 16:11:51 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Acquiring lock "refresh_cache-d55e6c2e-9791-4154-85f5-fec852577c2d" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:11:51 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Acquired lock "refresh_cache-d55e6c2e-9791-4154-85f5-fec852577c2d" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:11:51 user nova-compute[75245]: DEBUG nova.network.neutron [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] [instance: d55e6c2e-9791-4154-85f5-fec852577c2d] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 16:11:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d55e6c2e-9791-4154-85f5-fec852577c2d/disk --force-share --output=json" returned: 0 in 0.371s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:11:51 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Cannot resize image /opt/stack/data/nova/instances/d55e6c2e-9791-4154-85f5-fec852577c2d/disk to a smaller size. {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 16:11:51 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] [instance: d55e6c2e-9791-4154-85f5-fec852577c2d] Created local disks {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 16:11:51 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] [instance: d55e6c2e-9791-4154-85f5-fec852577c2d] Ensure instance console log exists: /opt/stack/data/nova/instances/d55e6c2e-9791-4154-85f5-fec852577c2d/console.log {{(pid=75245) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 16:11:51 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:11:51 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:11:51 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:11:51 user nova-compute[75245]: DEBUG nova.compute.manager [req-e14c1e1a-be50-4b19-beea-5cd3382fba6d req-bfcdb562-9533-47a4-962b-c008f311ae96 service nova] [instance: d55e6c2e-9791-4154-85f5-fec852577c2d] Received event network-changed-5a304ad9-9181-4384-b792-a8e80af9a86b {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:11:51 user nova-compute[75245]: DEBUG nova.compute.manager [req-e14c1e1a-be50-4b19-beea-5cd3382fba6d req-bfcdb562-9533-47a4-962b-c008f311ae96 service nova] [instance: d55e6c2e-9791-4154-85f5-fec852577c2d] Refreshing instance network info cache due to event network-changed-5a304ad9-9181-4384-b792-a8e80af9a86b. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:11:51 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-e14c1e1a-be50-4b19-beea-5cd3382fba6d req-bfcdb562-9533-47a4-962b-c008f311ae96 service nova] Acquiring lock "refresh_cache-d55e6c2e-9791-4154-85f5-fec852577c2d" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:11:51 user nova-compute[75245]: DEBUG nova.network.neutron [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] [instance: d55e6c2e-9791-4154-85f5-fec852577c2d] Instance cache missing network info. {{(pid=75245) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 16:11:52 user nova-compute[75245]: DEBUG nova.network.neutron [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] [instance: d55e6c2e-9791-4154-85f5-fec852577c2d] Updating instance_info_cache with network_info: [{"id": "5a304ad9-9181-4384-b792-a8e80af9a86b", "address": "fa:16:3e:f4:ca:eb", "network": {"id": "04f30281-e256-4d60-82d2-89004740b1b8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-649945802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17fcceabdcb74404971adda76fd4e48d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a304ad9-91", "ovs_interfaceid": "5a304ad9-9181-4384-b792-a8e80af9a86b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:11:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Releasing lock "refresh_cache-d55e6c2e-9791-4154-85f5-fec852577c2d" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:11:52 user nova-compute[75245]: DEBUG nova.compute.manager [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] [instance: d55e6c2e-9791-4154-85f5-fec852577c2d] Instance network_info: |[{"id": "5a304ad9-9181-4384-b792-a8e80af9a86b", "address": "fa:16:3e:f4:ca:eb", "network": {"id": "04f30281-e256-4d60-82d2-89004740b1b8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-649945802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17fcceabdcb74404971adda76fd4e48d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a304ad9-91", "ovs_interfaceid": "5a304ad9-9181-4384-b792-a8e80af9a86b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 16:11:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-e14c1e1a-be50-4b19-beea-5cd3382fba6d req-bfcdb562-9533-47a4-962b-c008f311ae96 service nova] Acquired lock "refresh_cache-d55e6c2e-9791-4154-85f5-fec852577c2d" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:11:52 user nova-compute[75245]: DEBUG nova.network.neutron [req-e14c1e1a-be50-4b19-beea-5cd3382fba6d req-bfcdb562-9533-47a4-962b-c008f311ae96 service nova] [instance: d55e6c2e-9791-4154-85f5-fec852577c2d] Refreshing network info cache for port 5a304ad9-9181-4384-b792-a8e80af9a86b {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:11:52 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] [instance: d55e6c2e-9791-4154-85f5-fec852577c2d] Start _get_guest_xml network_info=[{"id": "5a304ad9-9181-4384-b792-a8e80af9a86b", "address": "fa:16:3e:f4:ca:eb", "network": {"id": "04f30281-e256-4d60-82d2-89004740b1b8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-649945802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17fcceabdcb74404971adda76fd4e48d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a304ad9-91", "ovs_interfaceid": "5a304ad9-9181-4384-b792-a8e80af9a86b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'a291d9c3-be02-4c6c-9649-4b45c5b7f487'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 16:11:52 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:11:52 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:11:52 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 16:11:52 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] CPU controller missing on host. {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 16:11:52 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 16:11:52 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] CPU controller found on host. {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 16:11:52 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75245) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 16:11:52 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T16:06:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 16:11:52 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Flavor limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 16:11:52 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Image limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 16:11:52 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Flavor pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 16:11:52 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Image pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 16:11:52 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 16:11:52 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 16:11:52 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 16:11:52 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Got 1 possible topologies {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 16:11:52 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 16:11:52 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 16:11:52 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:11:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2029969502',display_name='tempest-ServersNegativeTestJSON-server-2029969502',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2029969502',id=11,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='17fcceabdcb74404971adda76fd4e48d',ramdisk_id='',reservation_id='r-ooowwp2q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1566439864',owner_user_name='tempest-ServersNegativeTestJSON-1566439864-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:11:50Z,user_data=None,user_id='97d9ea0d0a1842649850d631bed11ac1',uuid=d55e6c2e-9791-4154-85f5-fec852577c2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a304ad9-9181-4384-b792-a8e80af9a86b", "address": "fa:16:3e:f4:ca:eb", "network": {"id": "04f30281-e256-4d60-82d2-89004740b1b8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-649945802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17fcceabdcb74404971adda76fd4e48d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a304ad9-91", "ovs_interfaceid": "5a304ad9-9181-4384-b792-a8e80af9a86b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:11:52 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Converting VIF {"id": "5a304ad9-9181-4384-b792-a8e80af9a86b", "address": "fa:16:3e:f4:ca:eb", "network": {"id": "04f30281-e256-4d60-82d2-89004740b1b8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-649945802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17fcceabdcb74404971adda76fd4e48d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a304ad9-91", "ovs_interfaceid": "5a304ad9-9181-4384-b792-a8e80af9a86b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:11:52 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:ca:eb,bridge_name='br-int',has_traffic_filtering=True,id=5a304ad9-9181-4384-b792-a8e80af9a86b,network=Network(04f30281-e256-4d60-82d2-89004740b1b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a304ad9-91') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:11:52 user nova-compute[75245]: DEBUG nova.objects.instance [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Lazy-loading 'pci_devices' on Instance uuid d55e6c2e-9791-4154-85f5-fec852577c2d {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:11:52 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] [instance: d55e6c2e-9791-4154-85f5-fec852577c2d] End _get_guest_xml xml=<domain type="kvm">
Nov 29 16:11:52 user nova-compute[75245]:   <uuid>d55e6c2e-9791-4154-85f5-fec852577c2d</uuid>
Nov 29 16:11:52 user nova-compute[75245]:   <name>instance-0000000b</name>
Nov 29 16:11:52 user nova-compute[75245]:   <memory>524288</memory>
Nov 29 16:11:52 user nova-compute[75245]:   <vcpu>1</vcpu>
Nov 29 16:11:52 user nova-compute[75245]:   <metadata>
Nov 29 16:11:52 user nova-compute[75245]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 16:11:52 user nova-compute[75245]:       <nova:package version="0.0.0"/>
Nov 29 16:11:52 user nova-compute[75245]:       <nova:name>tempest-ServersNegativeTestJSON-server-2029969502</nova:name>
Nov 29 16:11:52 user nova-compute[75245]:       <nova:creationTime>2023-11-29 16:11:52</nova:creationTime>
Nov 29 16:11:52 user nova-compute[75245]:       <nova:flavor name="m1.tiny">
Nov 29 16:11:52 user nova-compute[75245]:         <nova:memory>512</nova:memory>
Nov 29 16:11:52 user nova-compute[75245]:         <nova:disk>1</nova:disk>
Nov 29 16:11:52 user nova-compute[75245]:         <nova:swap>0</nova:swap>
Nov 29 16:11:52 user nova-compute[75245]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 16:11:52 user nova-compute[75245]:         <nova:vcpus>1</nova:vcpus>
Nov 29 16:11:52 user nova-compute[75245]:       </nova:flavor>
Nov 29 16:11:52 user nova-compute[75245]:       <nova:owner>
Nov 29 16:11:52 user nova-compute[75245]:         <nova:user uuid="97d9ea0d0a1842649850d631bed11ac1">tempest-ServersNegativeTestJSON-1566439864-project-member</nova:user>
Nov 29 16:11:52 user nova-compute[75245]:         <nova:project uuid="17fcceabdcb74404971adda76fd4e48d">tempest-ServersNegativeTestJSON-1566439864</nova:project>
Nov 29 16:11:52 user nova-compute[75245]:       </nova:owner>
Nov 29 16:11:52 user nova-compute[75245]:       <nova:root type="image" uuid="a291d9c3-be02-4c6c-9649-4b45c5b7f487"/>
Nov 29 16:11:52 user nova-compute[75245]:       <nova:ports>
Nov 29 16:11:52 user nova-compute[75245]:         <nova:port uuid="5a304ad9-9181-4384-b792-a8e80af9a86b">
Nov 29 16:11:52 user nova-compute[75245]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 29 16:11:52 user nova-compute[75245]:         </nova:port>
Nov 29 16:11:52 user nova-compute[75245]:       </nova:ports>
Nov 29 16:11:52 user nova-compute[75245]:     </nova:instance>
Nov 29 16:11:52 user nova-compute[75245]:   </metadata>
Nov 29 16:11:52 user nova-compute[75245]:   <sysinfo type="smbios">
Nov 29 16:11:52 user nova-compute[75245]:     <system>
Nov 29 16:11:52 user nova-compute[75245]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 16:11:52 user nova-compute[75245]:       <entry name="product">OpenStack Nova</entry>
Nov 29 16:11:52 user nova-compute[75245]:       <entry name="version">0.0.0</entry>
Nov 29 16:11:52 user nova-compute[75245]:       <entry name="serial">d55e6c2e-9791-4154-85f5-fec852577c2d</entry>
Nov 29 16:11:52 user nova-compute[75245]:       <entry name="uuid">d55e6c2e-9791-4154-85f5-fec852577c2d</entry>
Nov 29 16:11:52 user nova-compute[75245]:       <entry name="family">Virtual Machine</entry>
Nov 29 16:11:52 user nova-compute[75245]:     </system>
Nov 29 16:11:52 user nova-compute[75245]:   </sysinfo>
Nov 29 16:11:52 user nova-compute[75245]:   <os>
Nov 29 16:11:52 user nova-compute[75245]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 16:11:52 user nova-compute[75245]:     <boot dev="hd"/>
Nov 29 16:11:52 user nova-compute[75245]:     <smbios mode="sysinfo"/>
Nov 29 16:11:52 user nova-compute[75245]:   </os>
Nov 29 16:11:52 user nova-compute[75245]:   <features>
Nov 29 16:11:52 user nova-compute[75245]:     <acpi/>
Nov 29 16:11:52 user nova-compute[75245]:     <apic/>
Nov 29 16:11:52 user nova-compute[75245]:     <vmcoreinfo/>
Nov 29 16:11:52 user nova-compute[75245]:   </features>
Nov 29 16:11:52 user nova-compute[75245]:   <clock offset="utc">
Nov 29 16:11:52 user nova-compute[75245]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 16:11:52 user nova-compute[75245]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 16:11:52 user nova-compute[75245]:     <timer name="hpet" present="no"/>
Nov 29 16:11:52 user nova-compute[75245]:   </clock>
Nov 29 16:11:52 user nova-compute[75245]:   <cpu mode="custom" match="exact">
Nov 29 16:11:52 user nova-compute[75245]:     <model>Nehalem</model>
Nov 29 16:11:52 user nova-compute[75245]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 16:11:52 user nova-compute[75245]:   </cpu>
Nov 29 16:11:52 user nova-compute[75245]:   <devices>
Nov 29 16:11:52 user nova-compute[75245]:     <disk type="file" device="disk">
Nov 29 16:11:52 user nova-compute[75245]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 16:11:52 user nova-compute[75245]:       <source file="/opt/stack/data/nova/instances/d55e6c2e-9791-4154-85f5-fec852577c2d/disk"/>
Nov 29 16:11:52 user nova-compute[75245]:       <target dev="vda" bus="virtio"/>
Nov 29 16:11:52 user nova-compute[75245]:     </disk>
Nov 29 16:11:52 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 16:11:52 user nova-compute[75245]:       <mac address="fa:16:3e:f4:ca:eb"/>
Nov 29 16:11:52 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:11:52 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 16:11:52 user nova-compute[75245]:       <target dev="tap5a304ad9-91"/>
Nov 29 16:11:52 user nova-compute[75245]:     </interface>
Nov 29 16:11:52 user nova-compute[75245]:     <serial type="pty">
Nov 29 16:11:52 user nova-compute[75245]:       <log file="/opt/stack/data/nova/instances/d55e6c2e-9791-4154-85f5-fec852577c2d/console.log" append="off"/>
Nov 29 16:11:52 user nova-compute[75245]:     </serial>
Nov 29 16:11:52 user nova-compute[75245]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 16:11:52 user nova-compute[75245]:     <video>
Nov 29 16:11:52 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:11:52 user nova-compute[75245]:     </video>
Nov 29 16:11:52 user nova-compute[75245]:     <rng model="virtio">
Nov 29 16:11:52 user nova-compute[75245]:       <backend model="random">/dev/urandom</backend>
Nov 29 16:11:52 user nova-compute[75245]:     </rng>
Nov 29 16:11:52 user nova-compute[75245]:     <controller type="usb" index="0" model="none"/>
Nov 29 16:11:52 user nova-compute[75245]:     <memballoon model="virtio">
Nov 29 16:11:52 user nova-compute[75245]:       <stats period="10"/>
Nov 29 16:11:52 user nova-compute[75245]:     </memballoon>
Nov 29 16:11:52 user nova-compute[75245]:   </devices>
Nov 29 16:11:52 user nova-compute[75245]: </domain>
Nov 29 16:11:52 user nova-compute[75245]:  {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 16:11:52 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:11:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2029969502',display_name='tempest-ServersNegativeTestJSON-server-2029969502',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2029969502',id=11,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='17fcceabdcb74404971adda76fd4e48d',ramdisk_id='',reservation_id='r-ooowwp2q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1566439864',owner_user_name='tempest-ServersNegativeTestJSON-1566439864-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:11:50Z,user_data=None,user_id='97d9ea0d0a1842649850d631bed11ac1',uuid=d55e6c2e-9791-4154-85f5-fec852577c2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a304ad9-9181-4384-b792-a8e80af9a86b", "address": "fa:16:3e:f4:ca:eb", "network": {"id": "04f30281-e256-4d60-82d2-89004740b1b8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-649945802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17fcceabdcb74404971adda76fd4e48d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a304ad9-91", "ovs_interfaceid": "5a304ad9-9181-4384-b792-a8e80af9a86b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 16:11:52 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Converting VIF {"id": "5a304ad9-9181-4384-b792-a8e80af9a86b", "address": "fa:16:3e:f4:ca:eb", "network": {"id": "04f30281-e256-4d60-82d2-89004740b1b8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-649945802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17fcceabdcb74404971adda76fd4e48d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a304ad9-91", "ovs_interfaceid": "5a304ad9-9181-4384-b792-a8e80af9a86b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:11:52 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:ca:eb,bridge_name='br-int',has_traffic_filtering=True,id=5a304ad9-9181-4384-b792-a8e80af9a86b,network=Network(04f30281-e256-4d60-82d2-89004740b1b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a304ad9-91') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:11:52 user nova-compute[75245]: DEBUG os_vif [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:ca:eb,bridge_name='br-int',has_traffic_filtering=True,id=5a304ad9-9181-4384-b792-a8e80af9a86b,network=Network(04f30281-e256-4d60-82d2-89004740b1b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a304ad9-91') {{(pid=75245) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 16:11:52 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:52 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:11:52 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 16:11:52 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:52 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c8cb537e-2876-5d48-9716-79723c2a6fd2', '_type': 'linux-noop'}}, row=False) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:11:52 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:52 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:11:52 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:52 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5a304ad9-91, may_exist=True, interface_attrs={}) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:11:52 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5a304ad9-91, col_values=(('qos', UUID('be901679-ca93-4fa4-ac78-7186ff7a1a29')),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:11:52 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5a304ad9-91, col_values=(('external_ids', {'iface-id': '5a304ad9-9181-4384-b792-a8e80af9a86b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:ca:eb', 'vm-uuid': 'd55e6c2e-9791-4154-85f5-fec852577c2d'}),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:11:52 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:52 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:11:52 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:52 user nova-compute[75245]: INFO os_vif [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:ca:eb,bridge_name='br-int',has_traffic_filtering=True,id=5a304ad9-9181-4384-b792-a8e80af9a86b,network=Network(04f30281-e256-4d60-82d2-89004740b1b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a304ad9-91')
Nov 29 16:11:52 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:11:52 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] No VIF found with MAC fa:16:3e:f4:ca:eb, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:11:52 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:11:52 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Starting heal instance info cache {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 16:11:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "refresh_cache-6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:11:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquired lock "refresh_cache-6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:11:52 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7] Forcefully refreshing network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 16:11:52 user nova-compute[75245]: DEBUG nova.network.neutron [req-e14c1e1a-be50-4b19-beea-5cd3382fba6d req-bfcdb562-9533-47a4-962b-c008f311ae96 service nova] [instance: d55e6c2e-9791-4154-85f5-fec852577c2d] Updated VIF entry in instance network info cache for port 5a304ad9-9181-4384-b792-a8e80af9a86b. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:11:52 user nova-compute[75245]: DEBUG nova.network.neutron [req-e14c1e1a-be50-4b19-beea-5cd3382fba6d req-bfcdb562-9533-47a4-962b-c008f311ae96 service nova] [instance: d55e6c2e-9791-4154-85f5-fec852577c2d] Updating instance_info_cache with network_info: [{"id": "5a304ad9-9181-4384-b792-a8e80af9a86b", "address": "fa:16:3e:f4:ca:eb", "network": {"id": "04f30281-e256-4d60-82d2-89004740b1b8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-649945802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17fcceabdcb74404971adda76fd4e48d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a304ad9-91", "ovs_interfaceid": "5a304ad9-9181-4384-b792-a8e80af9a86b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:11:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-e14c1e1a-be50-4b19-beea-5cd3382fba6d req-bfcdb562-9533-47a4-962b-c008f311ae96 service nova] Releasing lock "refresh_cache-d55e6c2e-9791-4154-85f5-fec852577c2d" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:11:53 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7] Updating instance_info_cache with network_info: [{"id": "de56e47e-57ae-4e15-9d07-57eca8971e14", "address": "fa:16:3e:cc:b6:56", "network": {"id": "04f30281-e256-4d60-82d2-89004740b1b8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-649945802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17fcceabdcb74404971adda76fd4e48d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde56e47e-57", "ovs_interfaceid": "de56e47e-57ae-4e15-9d07-57eca8971e14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:11:53 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Releasing lock "refresh_cache-6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:11:53 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7] Updated the network info_cache for instance {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 16:11:53 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:11:53 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:11:53 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:11:53 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:11:53 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75245) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 16:11:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:55 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:55 user nova-compute[75245]: DEBUG nova.compute.manager [req-5d7e7dd1-ab17-4f49-a6cf-d1cbaaef5c98 req-df93205f-26b4-45c9-8ea9-7b68f5b19483 service nova] [instance: d55e6c2e-9791-4154-85f5-fec852577c2d] Received event network-vif-plugged-5a304ad9-9181-4384-b792-a8e80af9a86b {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:11:55 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-5d7e7dd1-ab17-4f49-a6cf-d1cbaaef5c98 req-df93205f-26b4-45c9-8ea9-7b68f5b19483 service nova] Acquiring lock "d55e6c2e-9791-4154-85f5-fec852577c2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:11:55 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-5d7e7dd1-ab17-4f49-a6cf-d1cbaaef5c98 req-df93205f-26b4-45c9-8ea9-7b68f5b19483 service nova] Lock "d55e6c2e-9791-4154-85f5-fec852577c2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:11:55 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-5d7e7dd1-ab17-4f49-a6cf-d1cbaaef5c98 req-df93205f-26b4-45c9-8ea9-7b68f5b19483 service nova] Lock "d55e6c2e-9791-4154-85f5-fec852577c2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:11:55 user nova-compute[75245]: DEBUG nova.compute.manager [req-5d7e7dd1-ab17-4f49-a6cf-d1cbaaef5c98 req-df93205f-26b4-45c9-8ea9-7b68f5b19483 service nova] [instance: d55e6c2e-9791-4154-85f5-fec852577c2d] No waiting events found dispatching network-vif-plugged-5a304ad9-9181-4384-b792-a8e80af9a86b {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:11:55 user nova-compute[75245]: WARNING nova.compute.manager [req-5d7e7dd1-ab17-4f49-a6cf-d1cbaaef5c98 req-df93205f-26b4-45c9-8ea9-7b68f5b19483 service nova] [instance: d55e6c2e-9791-4154-85f5-fec852577c2d] Received unexpected event network-vif-plugged-5a304ad9-9181-4384-b792-a8e80af9a86b for instance with vm_state building and task_state spawning.
Nov 29 16:11:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/738c0d7a-af77-41f7-9206-0e6b1f18a154/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:11:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/738c0d7a-af77-41f7-9206-0e6b1f18a154/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:11:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/738c0d7a-af77-41f7-9206-0e6b1f18a154/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:11:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/738c0d7a-af77-41f7-9206-0e6b1f18a154/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:11:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41ce739e-9d85-4d8c-980b-b6845d39e31c/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:11:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41ce739e-9d85-4d8c-980b-b6845d39e31c/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:11:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41ce739e-9d85-4d8c-980b-b6845d39e31c/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:11:56 user nova-compute[75245]: DEBUG nova.compute.manager [req-a0df66e6-f22a-4967-815e-e89b864d9b34 req-55aec7e5-bd4e-4096-b37c-5337d4f0e242 service nova] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Received event network-changed-0b3a82cf-e1cb-455a-9f59-853505903560 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:11:56 user nova-compute[75245]: DEBUG nova.compute.manager [req-a0df66e6-f22a-4967-815e-e89b864d9b34 req-55aec7e5-bd4e-4096-b37c-5337d4f0e242 service nova] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Refreshing instance network info cache due to event network-changed-0b3a82cf-e1cb-455a-9f59-853505903560. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:11:56 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a0df66e6-f22a-4967-815e-e89b864d9b34 req-55aec7e5-bd4e-4096-b37c-5337d4f0e242 service nova] Acquiring lock "refresh_cache-3ab9d7cd-79cd-4c9b-8608-c1ef0f333305" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:11:56 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a0df66e6-f22a-4967-815e-e89b864d9b34 req-55aec7e5-bd4e-4096-b37c-5337d4f0e242 service nova] Acquired lock "refresh_cache-3ab9d7cd-79cd-4c9b-8608-c1ef0f333305" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:11:56 user nova-compute[75245]: DEBUG nova.network.neutron [req-a0df66e6-f22a-4967-815e-e89b864d9b34 req-55aec7e5-bd4e-4096-b37c-5337d4f0e242 service nova] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Refreshing network info cache for port 0b3a82cf-e1cb-455a-9f59-853505903560 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:11:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41ce739e-9d85-4d8c-980b-b6845d39e31c/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:11:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55f5b252-468d-4064-99b3-49bdcdf98db8/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:11:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55f5b252-468d-4064-99b3-49bdcdf98db8/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:11:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55f5b252-468d-4064-99b3-49bdcdf98db8/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:11:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55f5b252-468d-4064-99b3-49bdcdf98db8/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:11:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ab9d7cd-79cd-4c9b-8608-c1ef0f333305/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:11:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ab9d7cd-79cd-4c9b-8608-c1ef0f333305/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:11:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ab9d7cd-79cd-4c9b-8608-c1ef0f333305/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:11:56 user nova-compute[75245]: DEBUG nova.network.neutron [req-a0df66e6-f22a-4967-815e-e89b864d9b34 req-55aec7e5-bd4e-4096-b37c-5337d4f0e242 service nova] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Updated VIF entry in instance network info cache for port 0b3a82cf-e1cb-455a-9f59-853505903560. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:11:56 user nova-compute[75245]: DEBUG nova.network.neutron [req-a0df66e6-f22a-4967-815e-e89b864d9b34 req-55aec7e5-bd4e-4096-b37c-5337d4f0e242 service nova] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Updating instance_info_cache with network_info: [{"id": "0b3a82cf-e1cb-455a-9f59-853505903560", "address": "fa:16:3e:72:f8:5e", "network": {"id": "7f978dee-8a5e-4218-b6fc-2d550c0d7b5d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-53637364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd22948fbd074a7c94d8ad7614fbc220", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b3a82cf-e1", "ovs_interfaceid": "0b3a82cf-e1cb-455a-9f59-853505903560", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:11:57 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a0df66e6-f22a-4967-815e-e89b864d9b34 req-55aec7e5-bd4e-4096-b37c-5337d4f0e242 service nova] Releasing lock "refresh_cache-3ab9d7cd-79cd-4c9b-8608-c1ef0f333305" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:11:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ab9d7cd-79cd-4c9b-8608-c1ef0f333305/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:11:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:11:57 user nova-compute[75245]: DEBUG nova.compute.manager [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] [instance: d55e6c2e-9791-4154-85f5-fec852577c2d] Instance event wait completed in 0 seconds for  {{(pid=75245) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 16:11:57 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] [instance: d55e6c2e-9791-4154-85f5-fec852577c2d] Guest created on hypervisor {{(pid=75245) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 16:11:57 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: d55e6c2e-9791-4154-85f5-fec852577c2d] Instance spawned successfully.
Nov 29 16:11:57 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] [instance: d55e6c2e-9791-4154-85f5-fec852577c2d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 16:11:57 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:57 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] [instance: d55e6c2e-9791-4154-85f5-fec852577c2d] Found default for hw_cdrom_bus of ide {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:11:57 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] [instance: d55e6c2e-9791-4154-85f5-fec852577c2d] Found default for hw_disk_bus of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:11:57 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] [instance: d55e6c2e-9791-4154-85f5-fec852577c2d] Found default for hw_input_bus of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:11:57 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] [instance: d55e6c2e-9791-4154-85f5-fec852577c2d] Found default for hw_pointer_model of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:11:57 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] [instance: d55e6c2e-9791-4154-85f5-fec852577c2d] Found default for hw_video_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:11:57 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] [instance: d55e6c2e-9791-4154-85f5-fec852577c2d] Found default for hw_vif_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:11:57 user nova-compute[75245]: DEBUG nova.compute.manager [req-0037547e-902b-42da-9e0d-e51fbe842578 req-730ec7ec-da2a-4115-a9b5-067082614327 service nova] [instance: d55e6c2e-9791-4154-85f5-fec852577c2d] Received event network-vif-plugged-5a304ad9-9181-4384-b792-a8e80af9a86b {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:11:57 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-0037547e-902b-42da-9e0d-e51fbe842578 req-730ec7ec-da2a-4115-a9b5-067082614327 service nova] Acquiring lock "d55e6c2e-9791-4154-85f5-fec852577c2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:11:57 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-0037547e-902b-42da-9e0d-e51fbe842578 req-730ec7ec-da2a-4115-a9b5-067082614327 service nova] Lock "d55e6c2e-9791-4154-85f5-fec852577c2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:11:57 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-0037547e-902b-42da-9e0d-e51fbe842578 req-730ec7ec-da2a-4115-a9b5-067082614327 service nova] Lock "d55e6c2e-9791-4154-85f5-fec852577c2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:11:57 user nova-compute[75245]: DEBUG nova.compute.manager [req-0037547e-902b-42da-9e0d-e51fbe842578 req-730ec7ec-da2a-4115-a9b5-067082614327 service nova] [instance: d55e6c2e-9791-4154-85f5-fec852577c2d] No waiting events found dispatching network-vif-plugged-5a304ad9-9181-4384-b792-a8e80af9a86b {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:11:57 user nova-compute[75245]: WARNING nova.compute.manager [req-0037547e-902b-42da-9e0d-e51fbe842578 req-730ec7ec-da2a-4115-a9b5-067082614327 service nova] [instance: d55e6c2e-9791-4154-85f5-fec852577c2d] Received unexpected event network-vif-plugged-5a304ad9-9181-4384-b792-a8e80af9a86b for instance with vm_state building and task_state spawning.
Nov 29 16:11:57 user nova-compute[75245]: DEBUG nova.compute.manager [req-0037547e-902b-42da-9e0d-e51fbe842578 req-730ec7ec-da2a-4115-a9b5-067082614327 service nova] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] Received event network-changed-c72edead-bad2-45c4-9ac8-90dd2a4f8ed5 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:11:57 user nova-compute[75245]: DEBUG nova.compute.manager [req-0037547e-902b-42da-9e0d-e51fbe842578 req-730ec7ec-da2a-4115-a9b5-067082614327 service nova] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] Refreshing instance network info cache due to event network-changed-c72edead-bad2-45c4-9ac8-90dd2a4f8ed5. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:11:57 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-0037547e-902b-42da-9e0d-e51fbe842578 req-730ec7ec-da2a-4115-a9b5-067082614327 service nova] Acquiring lock "refresh_cache-ed9a6a4e-2e7d-443c-82ef-f14f11d32c81" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:11:57 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-0037547e-902b-42da-9e0d-e51fbe842578 req-730ec7ec-da2a-4115-a9b5-067082614327 service nova] Acquired lock "refresh_cache-ed9a6a4e-2e7d-443c-82ef-f14f11d32c81" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:11:57 user nova-compute[75245]: DEBUG nova.network.neutron [req-0037547e-902b-42da-9e0d-e51fbe842578 req-730ec7ec-da2a-4115-a9b5-067082614327 service nova] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] Refreshing network info cache for port c72edead-bad2-45c4-9ac8-90dd2a4f8ed5 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:11:57 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:11:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7/disk --force-share --output=json" returned: 0 in 0.527s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:11:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:11:57 user nova-compute[75245]: INFO nova.compute.manager [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] [instance: d55e6c2e-9791-4154-85f5-fec852577c2d] Took 7.20 seconds to spawn the instance on the hypervisor.
Nov 29 16:11:57 user nova-compute[75245]: DEBUG nova.compute.manager [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] [instance: d55e6c2e-9791-4154-85f5-fec852577c2d] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:11:57 user nova-compute[75245]: INFO nova.compute.manager [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] [instance: d55e6c2e-9791-4154-85f5-fec852577c2d] Took 8.26 seconds to build instance.
Nov 29 16:11:57 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-de14a154-6a4b-487e-a97e-1fe82ad435c6 tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Lock "d55e6c2e-9791-4154-85f5-fec852577c2d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.372s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:11:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7/disk --force-share --output=json" returned: 0 in 0.292s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:11:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fea3d2-6db1-4766-ad5b-9ad1e728ea10/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:11:58 user nova-compute[75245]: DEBUG nova.network.neutron [req-0037547e-902b-42da-9e0d-e51fbe842578 req-730ec7ec-da2a-4115-a9b5-067082614327 service nova] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] Updated VIF entry in instance network info cache for port c72edead-bad2-45c4-9ac8-90dd2a4f8ed5. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:11:58 user nova-compute[75245]: DEBUG nova.network.neutron [req-0037547e-902b-42da-9e0d-e51fbe842578 req-730ec7ec-da2a-4115-a9b5-067082614327 service nova] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] Updating instance_info_cache with network_info: [{"id": "c72edead-bad2-45c4-9ac8-90dd2a4f8ed5", "address": "fa:16:3e:bb:74:67", "network": {"id": "f1fac2f4-e789-443e-b6a5-1a3f829bc302", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1199431077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6b87e18ef1f48d19a6907b28cb54f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc72edead-ba", "ovs_interfaceid": "c72edead-bad2-45c4-9ac8-90dd2a4f8ed5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:11:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fea3d2-6db1-4766-ad5b-9ad1e728ea10/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:11:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fea3d2-6db1-4766-ad5b-9ad1e728ea10/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:11:58 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-0037547e-902b-42da-9e0d-e51fbe842578 req-730ec7ec-da2a-4115-a9b5-067082614327 service nova] Releasing lock "refresh_cache-ed9a6a4e-2e7d-443c-82ef-f14f11d32c81" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:11:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fea3d2-6db1-4766-ad5b-9ad1e728ea10/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:11:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:11:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:11:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:11:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:11:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ccc13b-8769-4c8b-9f9c-b9c26c8f7778/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:11:59 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ccc13b-8769-4c8b-9f9c-b9c26c8f7778/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:11:59 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ccc13b-8769-4c8b-9f9c-b9c26c8f7778/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:11:59 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ccc13b-8769-4c8b-9f9c-b9c26c8f7778/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:11:59 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36728d4f-925b-46a3-b4b5-17f14b9c99c3/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:11:59 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36728d4f-925b-46a3-b4b5-17f14b9c99c3/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:11:59 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36728d4f-925b-46a3-b4b5-17f14b9c99c3/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:11:59 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36728d4f-925b-46a3-b4b5-17f14b9c99c3/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:11:59 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d55e6c2e-9791-4154-85f5-fec852577c2d/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:11:59 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d55e6c2e-9791-4154-85f5-fec852577c2d/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:11:59 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d55e6c2e-9791-4154-85f5-fec852577c2d/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:00 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d55e6c2e-9791-4154-85f5-fec852577c2d/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:00 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:12:00 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:12:00 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:12:00 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d2f1223-d206-4b10-a4b9-b0d129f4543a tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] [instance: 738c0d7a-af77-41f7-9206-0e6b1f18a154] Calling os-brick to attach iSCSI Volume {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 16:12:00 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2f1223-d206-4b10-a4b9-b0d129f4543a tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:565529bd-33f8-43ed-a1d7-697afb9491f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WMHDCklN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:12:00 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-2d2f1223-d206-4b10-a4b9-b0d129f4543a tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:12:00 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-2d2f1223-d206-4b10-a4b9-b0d129f4543a tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:12:00 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-2d2f1223-d206-4b10-a4b9-b0d129f4543a tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:12:00 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-2d2f1223-d206-4b10-a4b9-b0d129f4543a tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:12:00 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-2d2f1223-d206-4b10-a4b9-b0d129f4543a tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:565529bd-33f8-43ed-a1d7-697afb9491f3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:12:00 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-2d2f1223-d206-4b10-a4b9-b0d129f4543a tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:565529bd-33f8-43ed-a1d7-697afb9491f3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:12:00 user nova-compute[75245]: INFO os_brick.initiator.connectors.iscsi [None req-2d2f1223-d206-4b10-a4b9-b0d129f4543a tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 16:12:00 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:565529bd-33f8-43ed-a1d7-697afb9491f3 -p 172.16.0.220:3260 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:00 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:12:00 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:12:00 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Hypervisor/Node resource view: name=user free_ram=7026MB free_disk=25.5833740234375GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75245) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 16:12:00 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:12:00 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:12:00 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:565529bd-33f8-43ed-a1d7-697afb9491f3 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:00 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ee2e0d-b397-4ba1-8528-848b511c6705]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:00 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2f1223-d206-4b10-a4b9-b0d129f4543a tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 16:12:00 user nova-compute[75245]:  {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:12:00 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:565529bd-33f8-43ed-a1d7-697afb9491f3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:00 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:565529bd-33f8-43ed-a1d7-697afb9491f3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:00 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[449249b1-3e8f-4be3-84d2-1c7ce0006c4f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:565529bd-33f8-43ed-a1d7-697afb9491f3] added\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:00 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2f1223-d206-4b10-a4b9-b0d129f4543a tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:565529bd-33f8-43ed-a1d7-697afb9491f3] added
Nov 29 16:12:00 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:12:00 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:565529bd-33f8-43ed-a1d7-697afb9491f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:00 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:565529bd-33f8-43ed-a1d7-697afb9491f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:00 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d2c407-878f-4aad-bccf-3d4a972c25f9]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:00 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2f1223-d206-4b10-a4b9-b0d129f4543a tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:12:00 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:565529bd-33f8-43ed-a1d7-697afb9491f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:00 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:565529bd-33f8-43ed-a1d7-697afb9491f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:00 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eba7af9-153c-42d4-9cd5-2fcf6b107663]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:00 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2f1223-d206-4b10-a4b9-b0d129f4543a tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:12:00 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:565529bd-33f8-43ed-a1d7-697afb9491f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WMHDCklN {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:00 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:565529bd-33f8-43ed-a1d7-697afb9491f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WMHDCklN" returned: 0 in 0.031s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:00 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d67e6a-c39c-43a3-af33-d65fa533106a]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:00 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2f1223-d206-4b10-a4b9-b0d129f4543a tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WMHDCklN'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:12:00 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:565529bd-33f8-43ed-a1d7-697afb9491f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:00 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:565529bd-33f8-43ed-a1d7-697afb9491f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:00 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff431f8-4e86-403e-9fc3-709c2d543385]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:00 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2f1223-d206-4b10-a4b9-b0d129f4543a tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:12:00 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:00 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 738c0d7a-af77-41f7-9206-0e6b1f18a154 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:12:00 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:12:00 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance ed9a6a4e-2e7d-443c-82ef-f14f11d32c81 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:12:00 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:12:00 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 36728d4f-925b-46a3-b4b5-17f14b9c99c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:12:00 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance e3fea3d2-6db1-4766-ad5b-9ad1e728ea10 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:12:00 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 41ce739e-9d85-4d8c-980b-b6845d39e31c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:12:00 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 55f5b252-468d-4064-99b3-49bdcdf98db8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:12:00 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 06ccc13b-8769-4c8b-9f9c-b9c26c8f7778 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:12:00 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 696417e7-8eff-46f3-a6f1-11a9f5191627 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:12:00 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance d55e6c2e-9791-4154-85f5-fec852577c2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:12:00 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 16:12:00 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 16:12:00 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:00 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a487ebc-bed7-423a-9d59-cc36a35a028c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:00 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2f1223-d206-4b10-a4b9-b0d129f4543a tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 (non-flash)
Nov 29 16:12:00 user nova-compute[75245]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311 (non-flash)
Nov 29 16:12:00 user nova-compute[75245]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63 (non-flash)
Nov 29 16:12:00 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:12:00 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2f1223-d206-4b10-a4b9-b0d129f4543a tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 (non-flash)
Nov 29 16:12:00 user nova-compute[75245]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311 (non-flash)
Nov 29 16:12:00 user nova-compute[75245]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63 (non-flash)
Nov 29 16:12:00 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:12:00 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:565529bd-33f8-43ed-a1d7-697afb9491f3 -p 172.16.0.220:3260 --login {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:01 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:565529bd-33f8-43ed-a1d7-697afb9491f3 -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:01 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc92e07-c1d9-4fe7-b399-4f5b457d5926]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:565529bd-33f8-43ed-a1d7-697afb9491f3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:565529bd-33f8-43ed-a1d7-697afb9491f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:01 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2f1223-d206-4b10-a4b9-b0d129f4543a tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:565529bd-33f8-43ed-a1d7-697afb9491f3, portal: 172.16.0.220,3260]
Nov 29 16:12:01 user nova-compute[75245]: Login to [iface: default, target: iqn.2010-10.org.openstack:565529bd-33f8-43ed-a1d7-697afb9491f3, portal: 172.16.0.220,3260] successful.
Nov 29 16:12:01 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:12:01 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:565529bd-33f8-43ed-a1d7-697afb9491f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:01 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:565529bd-33f8-43ed-a1d7-697afb9491f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:01 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[f90f53d2-45a6-47a3-b175-a4273ec41195]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:01 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2f1223-d206-4b10-a4b9-b0d129f4543a tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:12:01 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:01 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:01 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[af9c476f-5025-4241-9b1d-40811f03acff]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:565529bd-33f8-43ed-a1d7-697afb9491f3 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:01 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2f1223-d206-4b10-a4b9-b0d129f4543a tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 (non-flash)
Nov 29 16:12:01 user nova-compute[75245]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311 (non-flash)
Nov 29 16:12:01 user nova-compute[75245]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63 (non-flash)
Nov 29 16:12:01 user nova-compute[75245]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:565529bd-33f8-43ed-a1d7-697afb9491f3 (non-flash)
Nov 29 16:12:01 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:12:01 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2f1223-d206-4b10-a4b9-b0d129f4543a tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 (non-flash)
Nov 29 16:12:01 user nova-compute[75245]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311 (non-flash)
Nov 29 16:12:01 user nova-compute[75245]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63 (non-flash)
Nov 29 16:12:01 user nova-compute[75245]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:565529bd-33f8-43ed-a1d7-697afb9491f3 (non-flash)
Nov 29 16:12:01 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:12:01 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-2d2f1223-d206-4b10-a4b9-b0d129f4543a tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:565529bd-33f8-43ed-a1d7-697afb9491f3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.381s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:12:01 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2f1223-d206-4b10-a4b9-b0d129f4543a tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Connected to 172.16.0.220:3260 {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 16:12:01 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-2d2f1223-d206-4b10-a4b9-b0d129f4543a tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=75245) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 16:12:01 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-2d2f1223-d206-4b10-a4b9-b0d129f4543a tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75245) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 16:12:01 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:01 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:01 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce2a25f-ef2b-4355-ad31-2624a6c709f7]: (4, ('- - 0', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:01 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-2d2f1223-d206-4b10-a4b9-b0d129f4543a tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75245) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 16:12:01 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2f1223-d206-4b10-a4b9-b0d129f4543a tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:565529bd-33f8-43ed-a1d7-697afb9491f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WMHDCklN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 16:12:01 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:12:01 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:12:01 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Compute_service record updated for user:user {{(pid=75245) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 16:12:01 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.834s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:12:01 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:12:01 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:12:01 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:12:01 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:12:01 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:12:01 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:12:01 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75245) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 16:12:02 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d9385425-7227-4c05-ae40-6fc08d32f34e tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Acquiring lock "3ab9d7cd-79cd-4c9b-8608-c1ef0f333305" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:12:02 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d9385425-7227-4c05-ae40-6fc08d32f34e tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lock "3ab9d7cd-79cd-4c9b-8608-c1ef0f333305" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:12:02 user nova-compute[75245]: INFO nova.compute.manager [None req-d9385425-7227-4c05-ae40-6fc08d32f34e tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Shelving
Nov 29 16:12:02 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:02 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-2d2f1223-d206-4b10-a4b9-b0d129f4543a tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.424s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:12:02 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2f1223-d206-4b10-a4b9-b0d129f4543a tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] <== connect_volume: return (1426ms) {'type': 'block', 'scsi_wwn': '23032323433663732', 'path': '/dev/sde'} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:12:02 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d2f1223-d206-4b10-a4b9-b0d129f4543a tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] [instance: 738c0d7a-af77-41f7-9206-0e6b1f18a154] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23032323433663732', 'path': '/dev/sde'} {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 16:12:02 user nova-compute[75245]: DEBUG nova.objects.instance [None req-2d2f1223-d206-4b10-a4b9-b0d129f4543a tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Lazy-loading 'flavor' on Instance uuid 738c0d7a-af77-41f7-9206-0e6b1f18a154 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:12:02 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:02 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:02 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-2d2f1223-d206-4b10-a4b9-b0d129f4543a tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 16:12:02 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:12:02 user nova-compute[75245]:   <source dev="/dev/sde"/>
Nov 29 16:12:02 user nova-compute[75245]:   <target dev="vdb" bus="virtio"/>
Nov 29 16:12:02 user nova-compute[75245]:   <serial>565529bd-33f8-43ed-a1d7-697afb9491f3</serial>
Nov 29 16:12:02 user nova-compute[75245]: </disk>
Nov 29 16:12:02 user nova-compute[75245]:  {{(pid=75245) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 16:12:02 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:02 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:02 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:02 user nova-compute[75245]: DEBUG nova.compute.manager [req-b243e525-80e5-43dd-a79c-fcb53925de72 req-3c525270-133b-4327-80e0-17a12645cbaf service nova] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Received event network-vif-unplugged-0b3a82cf-e1cb-455a-9f59-853505903560 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:12:02 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b243e525-80e5-43dd-a79c-fcb53925de72 req-3c525270-133b-4327-80e0-17a12645cbaf service nova] Acquiring lock "3ab9d7cd-79cd-4c9b-8608-c1ef0f333305-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:12:02 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b243e525-80e5-43dd-a79c-fcb53925de72 req-3c525270-133b-4327-80e0-17a12645cbaf service nova] Lock "3ab9d7cd-79cd-4c9b-8608-c1ef0f333305-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:12:02 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b243e525-80e5-43dd-a79c-fcb53925de72 req-3c525270-133b-4327-80e0-17a12645cbaf service nova] Lock "3ab9d7cd-79cd-4c9b-8608-c1ef0f333305-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:12:02 user nova-compute[75245]: DEBUG nova.compute.manager [req-b243e525-80e5-43dd-a79c-fcb53925de72 req-3c525270-133b-4327-80e0-17a12645cbaf service nova] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] No waiting events found dispatching network-vif-unplugged-0b3a82cf-e1cb-455a-9f59-853505903560 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:12:02 user nova-compute[75245]: WARNING nova.compute.manager [req-b243e525-80e5-43dd-a79c-fcb53925de72 req-3c525270-133b-4327-80e0-17a12645cbaf service nova] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Received unexpected event network-vif-unplugged-0b3a82cf-e1cb-455a-9f59-853505903560 for instance with vm_state active and task_state shelving.
Nov 29 16:12:02 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:02 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-2d2f1223-d206-4b10-a4b9-b0d129f4543a tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:12:02 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-2d2f1223-d206-4b10-a4b9-b0d129f4543a tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:12:02 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-2d2f1223-d206-4b10-a4b9-b0d129f4543a tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] No VIF found with MAC fa:16:3e:0f:8f:e0, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:12:02 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2d2f1223-d206-4b10-a4b9-b0d129f4543a tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Lock "738c0d7a-af77-41f7-9206-0e6b1f18a154" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.966s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:12:02 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:03 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:03 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:03 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:03 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Instance destroyed successfully.
Nov 29 16:12:03 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-d9385425-7227-4c05-ae40-6fc08d32f34e tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Beginning cold snapshot process
Nov 29 16:12:03 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:03 user nova-compute[75245]: DEBUG nova.privsep.utils [None req-d9385425-7227-4c05-ae40-6fc08d32f34e tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75245) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 16:12:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-d9385425-7227-4c05-ae40-6fc08d32f34e tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/3ab9d7cd-79cd-4c9b-8608-c1ef0f333305/disk /opt/stack/data/nova/instances/snapshots/tmp3ssjuvpt/c7976110ccf24e7aa8e3c6d96a8ac967 {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:03 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:03 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:03 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:03 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:03 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:03 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:03 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-d9385425-7227-4c05-ae40-6fc08d32f34e tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/3ab9d7cd-79cd-4c9b-8608-c1ef0f333305/disk /opt/stack/data/nova/instances/snapshots/tmp3ssjuvpt/c7976110ccf24e7aa8e3c6d96a8ac967" returned: 0 in 0.779s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:04 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-d9385425-7227-4c05-ae40-6fc08d32f34e tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Snapshot extracted, beginning image upload
Nov 29 16:12:04 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d431838b-ba47-4c07-8c51-a50a426b2e33 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Acquiring lock "738c0d7a-af77-41f7-9206-0e6b1f18a154" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:12:04 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d431838b-ba47-4c07-8c51-a50a426b2e33 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Lock "738c0d7a-af77-41f7-9206-0e6b1f18a154" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:12:04 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d431838b-ba47-4c07-8c51-a50a426b2e33 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Acquiring lock "738c0d7a-af77-41f7-9206-0e6b1f18a154-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:12:04 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d431838b-ba47-4c07-8c51-a50a426b2e33 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Lock "738c0d7a-af77-41f7-9206-0e6b1f18a154-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:12:04 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d431838b-ba47-4c07-8c51-a50a426b2e33 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Lock "738c0d7a-af77-41f7-9206-0e6b1f18a154-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:12:04 user nova-compute[75245]: INFO nova.compute.manager [None req-d431838b-ba47-4c07-8c51-a50a426b2e33 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] [instance: 738c0d7a-af77-41f7-9206-0e6b1f18a154] Terminating instance
Nov 29 16:12:04 user nova-compute[75245]: DEBUG nova.compute.manager [None req-d431838b-ba47-4c07-8c51-a50a426b2e33 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] [instance: 738c0d7a-af77-41f7-9206-0e6b1f18a154] Start destroying the instance on the hypervisor. {{(pid=75245) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 16:12:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:04 user nova-compute[75245]: DEBUG nova.compute.manager [req-5b36d003-76ce-4841-99c3-7a6c663f9d0c req-1740fdb8-3aec-4d86-a478-b12046076526 service nova] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Received event network-vif-plugged-0b3a82cf-e1cb-455a-9f59-853505903560 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:12:04 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-5b36d003-76ce-4841-99c3-7a6c663f9d0c req-1740fdb8-3aec-4d86-a478-b12046076526 service nova] Acquiring lock "3ab9d7cd-79cd-4c9b-8608-c1ef0f333305-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:12:04 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-5b36d003-76ce-4841-99c3-7a6c663f9d0c req-1740fdb8-3aec-4d86-a478-b12046076526 service nova] Lock "3ab9d7cd-79cd-4c9b-8608-c1ef0f333305-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:12:04 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-5b36d003-76ce-4841-99c3-7a6c663f9d0c req-1740fdb8-3aec-4d86-a478-b12046076526 service nova] Lock "3ab9d7cd-79cd-4c9b-8608-c1ef0f333305-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:12:04 user nova-compute[75245]: DEBUG nova.compute.manager [req-5b36d003-76ce-4841-99c3-7a6c663f9d0c req-1740fdb8-3aec-4d86-a478-b12046076526 service nova] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] No waiting events found dispatching network-vif-plugged-0b3a82cf-e1cb-455a-9f59-853505903560 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:12:04 user nova-compute[75245]: WARNING nova.compute.manager [req-5b36d003-76ce-4841-99c3-7a6c663f9d0c req-1740fdb8-3aec-4d86-a478-b12046076526 service nova] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Received unexpected event network-vif-plugged-0b3a82cf-e1cb-455a-9f59-853505903560 for instance with vm_state active and task_state shelving_image_uploading.
Nov 29 16:12:04 user nova-compute[75245]: DEBUG nova.compute.manager [req-5b36d003-76ce-4841-99c3-7a6c663f9d0c req-1740fdb8-3aec-4d86-a478-b12046076526 service nova] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Received event network-vif-plugged-0b3a82cf-e1cb-455a-9f59-853505903560 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:12:04 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-5b36d003-76ce-4841-99c3-7a6c663f9d0c req-1740fdb8-3aec-4d86-a478-b12046076526 service nova] Acquiring lock "3ab9d7cd-79cd-4c9b-8608-c1ef0f333305-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:12:04 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-5b36d003-76ce-4841-99c3-7a6c663f9d0c req-1740fdb8-3aec-4d86-a478-b12046076526 service nova] Lock "3ab9d7cd-79cd-4c9b-8608-c1ef0f333305-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:12:04 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-5b36d003-76ce-4841-99c3-7a6c663f9d0c req-1740fdb8-3aec-4d86-a478-b12046076526 service nova] Lock "3ab9d7cd-79cd-4c9b-8608-c1ef0f333305-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:12:04 user nova-compute[75245]: DEBUG nova.compute.manager [req-5b36d003-76ce-4841-99c3-7a6c663f9d0c req-1740fdb8-3aec-4d86-a478-b12046076526 service nova] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] No waiting events found dispatching network-vif-plugged-0b3a82cf-e1cb-455a-9f59-853505903560 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:12:04 user nova-compute[75245]: WARNING nova.compute.manager [req-5b36d003-76ce-4841-99c3-7a6c663f9d0c req-1740fdb8-3aec-4d86-a478-b12046076526 service nova] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Received unexpected event network-vif-plugged-0b3a82cf-e1cb-455a-9f59-853505903560 for instance with vm_state active and task_state shelving_image_uploading.
Nov 29 16:12:04 user nova-compute[75245]: DEBUG nova.compute.manager [req-5b36d003-76ce-4841-99c3-7a6c663f9d0c req-1740fdb8-3aec-4d86-a478-b12046076526 service nova] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Received event network-vif-plugged-0b3a82cf-e1cb-455a-9f59-853505903560 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:12:04 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-5b36d003-76ce-4841-99c3-7a6c663f9d0c req-1740fdb8-3aec-4d86-a478-b12046076526 service nova] Acquiring lock "3ab9d7cd-79cd-4c9b-8608-c1ef0f333305-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:12:04 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-5b36d003-76ce-4841-99c3-7a6c663f9d0c req-1740fdb8-3aec-4d86-a478-b12046076526 service nova] Lock "3ab9d7cd-79cd-4c9b-8608-c1ef0f333305-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:12:04 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-5b36d003-76ce-4841-99c3-7a6c663f9d0c req-1740fdb8-3aec-4d86-a478-b12046076526 service nova] Lock "3ab9d7cd-79cd-4c9b-8608-c1ef0f333305-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:12:04 user nova-compute[75245]: DEBUG nova.compute.manager [req-5b36d003-76ce-4841-99c3-7a6c663f9d0c req-1740fdb8-3aec-4d86-a478-b12046076526 service nova] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] No waiting events found dispatching network-vif-plugged-0b3a82cf-e1cb-455a-9f59-853505903560 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:12:04 user nova-compute[75245]: WARNING nova.compute.manager [req-5b36d003-76ce-4841-99c3-7a6c663f9d0c req-1740fdb8-3aec-4d86-a478-b12046076526 service nova] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Received unexpected event network-vif-plugged-0b3a82cf-e1cb-455a-9f59-853505903560 for instance with vm_state active and task_state shelving_image_uploading.
Nov 29 16:12:04 user nova-compute[75245]: DEBUG nova.compute.manager [req-5b36d003-76ce-4841-99c3-7a6c663f9d0c req-1740fdb8-3aec-4d86-a478-b12046076526 service nova] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Received event network-vif-unplugged-0b3a82cf-e1cb-455a-9f59-853505903560 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:12:04 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-5b36d003-76ce-4841-99c3-7a6c663f9d0c req-1740fdb8-3aec-4d86-a478-b12046076526 service nova] Acquiring lock "3ab9d7cd-79cd-4c9b-8608-c1ef0f333305-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:12:04 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-5b36d003-76ce-4841-99c3-7a6c663f9d0c req-1740fdb8-3aec-4d86-a478-b12046076526 service nova] Lock "3ab9d7cd-79cd-4c9b-8608-c1ef0f333305-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:12:04 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-5b36d003-76ce-4841-99c3-7a6c663f9d0c req-1740fdb8-3aec-4d86-a478-b12046076526 service nova] Lock "3ab9d7cd-79cd-4c9b-8608-c1ef0f333305-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:12:04 user nova-compute[75245]: DEBUG nova.compute.manager [req-5b36d003-76ce-4841-99c3-7a6c663f9d0c req-1740fdb8-3aec-4d86-a478-b12046076526 service nova] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] No waiting events found dispatching network-vif-unplugged-0b3a82cf-e1cb-455a-9f59-853505903560 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:12:04 user nova-compute[75245]: WARNING nova.compute.manager [req-5b36d003-76ce-4841-99c3-7a6c663f9d0c req-1740fdb8-3aec-4d86-a478-b12046076526 service nova] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Received unexpected event network-vif-unplugged-0b3a82cf-e1cb-455a-9f59-853505903560 for instance with vm_state active and task_state shelving_image_uploading.
Nov 29 16:12:04 user nova-compute[75245]: DEBUG nova.compute.manager [req-5b36d003-76ce-4841-99c3-7a6c663f9d0c req-1740fdb8-3aec-4d86-a478-b12046076526 service nova] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Received event network-vif-plugged-0b3a82cf-e1cb-455a-9f59-853505903560 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:12:04 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-5b36d003-76ce-4841-99c3-7a6c663f9d0c req-1740fdb8-3aec-4d86-a478-b12046076526 service nova] Acquiring lock "3ab9d7cd-79cd-4c9b-8608-c1ef0f333305-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:12:04 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-5b36d003-76ce-4841-99c3-7a6c663f9d0c req-1740fdb8-3aec-4d86-a478-b12046076526 service nova] Lock "3ab9d7cd-79cd-4c9b-8608-c1ef0f333305-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:12:04 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-5b36d003-76ce-4841-99c3-7a6c663f9d0c req-1740fdb8-3aec-4d86-a478-b12046076526 service nova] Lock "3ab9d7cd-79cd-4c9b-8608-c1ef0f333305-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:12:04 user nova-compute[75245]: DEBUG nova.compute.manager [req-5b36d003-76ce-4841-99c3-7a6c663f9d0c req-1740fdb8-3aec-4d86-a478-b12046076526 service nova] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] No waiting events found dispatching network-vif-plugged-0b3a82cf-e1cb-455a-9f59-853505903560 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:12:04 user nova-compute[75245]: WARNING nova.compute.manager [req-5b36d003-76ce-4841-99c3-7a6c663f9d0c req-1740fdb8-3aec-4d86-a478-b12046076526 service nova] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Received unexpected event network-vif-plugged-0b3a82cf-e1cb-455a-9f59-853505903560 for instance with vm_state active and task_state shelving_image_uploading.
Nov 29 16:12:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:05 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:05 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:05 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 738c0d7a-af77-41f7-9206-0e6b1f18a154] Instance destroyed successfully.
Nov 29 16:12:05 user nova-compute[75245]: DEBUG nova.objects.instance [None req-d431838b-ba47-4c07-8c51-a50a426b2e33 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Lazy-loading 'resources' on Instance uuid 738c0d7a-af77-41f7-9206-0e6b1f18a154 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:12:05 user nova-compute[75245]: DEBUG nova.compute.manager [req-5f36ee86-8620-4601-8214-c80ce2237114 req-085a97cb-0661-41d9-bd41-a34bf79a0c7d service nova] [instance: 738c0d7a-af77-41f7-9206-0e6b1f18a154] Received event network-vif-unplugged-6868c459-7c16-48e4-8806-577f44063ef2 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:12:05 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-5f36ee86-8620-4601-8214-c80ce2237114 req-085a97cb-0661-41d9-bd41-a34bf79a0c7d service nova] Acquiring lock "738c0d7a-af77-41f7-9206-0e6b1f18a154-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:12:05 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-5f36ee86-8620-4601-8214-c80ce2237114 req-085a97cb-0661-41d9-bd41-a34bf79a0c7d service nova] Lock "738c0d7a-af77-41f7-9206-0e6b1f18a154-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:12:05 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-5f36ee86-8620-4601-8214-c80ce2237114 req-085a97cb-0661-41d9-bd41-a34bf79a0c7d service nova] Lock "738c0d7a-af77-41f7-9206-0e6b1f18a154-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:12:05 user nova-compute[75245]: DEBUG nova.compute.manager [req-5f36ee86-8620-4601-8214-c80ce2237114 req-085a97cb-0661-41d9-bd41-a34bf79a0c7d service nova] [instance: 738c0d7a-af77-41f7-9206-0e6b1f18a154] No waiting events found dispatching network-vif-unplugged-6868c459-7c16-48e4-8806-577f44063ef2 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:12:05 user nova-compute[75245]: DEBUG nova.compute.manager [req-5f36ee86-8620-4601-8214-c80ce2237114 req-085a97cb-0661-41d9-bd41-a34bf79a0c7d service nova] [instance: 738c0d7a-af77-41f7-9206-0e6b1f18a154] Received event network-vif-unplugged-6868c459-7c16-48e4-8806-577f44063ef2 for instance with task_state deleting. {{(pid=75245) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 16:12:05 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-d431838b-ba47-4c07-8c51-a50a426b2e33 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:09:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-288100051',display_name='tempest-DeleteServersTestJSON-server-288100051',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-288100051',id=1,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:10:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6f499a0ff13e421b88e2712a21784fe0',ramdisk_id='',reservation_id='r-ikzi9196',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1443860988',owner_user_name='tempest-DeleteServersTestJSON-1443860988-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:10:13Z,user_data=None,user_id='cde8c21d201447c09429d4e043050086',uuid=738c0d7a-af77-41f7-9206-0e6b1f18a154,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6868c459-7c16-48e4-8806-577f44063ef2", "address": "fa:16:3e:0f:8f:e0", "network": {"id": "04c28abb-e8e0-4147-aa0d-a9d58efbb016", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-93900798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f499a0ff13e421b88e2712a21784fe0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6868c459-7c", "ovs_interfaceid": "6868c459-7c16-48e4-8806-577f44063ef2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 16:12:05 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-d431838b-ba47-4c07-8c51-a50a426b2e33 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Converting VIF {"id": "6868c459-7c16-48e4-8806-577f44063ef2", "address": "fa:16:3e:0f:8f:e0", "network": {"id": "04c28abb-e8e0-4147-aa0d-a9d58efbb016", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-93900798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f499a0ff13e421b88e2712a21784fe0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6868c459-7c", "ovs_interfaceid": "6868c459-7c16-48e4-8806-577f44063ef2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:12:05 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-d431838b-ba47-4c07-8c51-a50a426b2e33 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0f:8f:e0,bridge_name='br-int',has_traffic_filtering=True,id=6868c459-7c16-48e4-8806-577f44063ef2,network=Network(04c28abb-e8e0-4147-aa0d-a9d58efbb016),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6868c459-7c') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:12:05 user nova-compute[75245]: DEBUG os_vif [None req-d431838b-ba47-4c07-8c51-a50a426b2e33 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:8f:e0,bridge_name='br-int',has_traffic_filtering=True,id=6868c459-7c16-48e4-8806-577f44063ef2,network=Network(04c28abb-e8e0-4147-aa0d-a9d58efbb016),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6868c459-7c') {{(pid=75245) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 16:12:05 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:05 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6868c459-7c, bridge=br-int, if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:12:05 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:05 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:12:05 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:05 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:05 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=568bb8c5-52cf-46a0-bee2-ae4392481b83) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:12:05 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:05 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:12:05 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:05 user nova-compute[75245]: INFO os_vif [None req-d431838b-ba47-4c07-8c51-a50a426b2e33 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:8f:e0,bridge_name='br-int',has_traffic_filtering=True,id=6868c459-7c16-48e4-8806-577f44063ef2,network=Network(04c28abb-e8e0-4147-aa0d-a9d58efbb016),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6868c459-7c')
Nov 29 16:12:05 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d431838b-ba47-4c07-8c51-a50a426b2e33 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] [instance: 738c0d7a-af77-41f7-9206-0e6b1f18a154] calling os-brick to detach iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 16:12:05 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-d431838b-ba47-4c07-8c51-a50a426b2e33 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, {'target_iqn': 'iqn.2010-10.org.openstack:565529bd-33f8-43ed-a1d7-697afb9491f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WMHDCklN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:12:05 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-d431838b-ba47-4c07-8c51-a50a426b2e33 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:12:05 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-d431838b-ba47-4c07-8c51-a50a426b2e33 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:12:05 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-d431838b-ba47-4c07-8c51-a50a426b2e33 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:12:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:05 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6d7235-7f09-4b7e-a54b-90f32697bf6f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:565529bd-33f8-43ed-a1d7-697afb9491f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:05 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-d431838b-ba47-4c07-8c51-a50a426b2e33 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 16:12:05 user nova-compute[75245]: No targets found.
Nov 29 16:12:05 user nova-compute[75245]: iSNS:
Nov 29 16:12:05 user nova-compute[75245]: No targets found.
Nov 29 16:12:05 user nova-compute[75245]: STATIC:
Nov 29 16:12:05 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:565529bd-33f8-43ed-a1d7-697afb9491f3
Nov 29 16:12:05 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:12:05 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:12:05 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678
Nov 29 16:12:05 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:12:05 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:12:05 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311
Nov 29 16:12:05 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:12:05 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:12:05 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63
Nov 29 16:12:05 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:12:05 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:12:05 user nova-compute[75245]: FIRMWARE:
Nov 29 16:12:05 user nova-compute[75245]: No targets found.
Nov 29 16:12:05 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:12:05 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-d431838b-ba47-4c07-8c51-a50a426b2e33 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 16:12:05 user nova-compute[75245]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 16:12:05 user nova-compute[75245]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75245) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 16:12:05 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-d431838b-ba47-4c07-8c51-a50a426b2e33 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:565529bd-33f8-43ed-a1d7-697afb9491f3', 0)] {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 16:12:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:05 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f34a0c-d93b-42e3-848c-fb4ffbad1316]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:565529bd-33f8-43ed-a1d7-697afb9491f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:05 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d02311-c53e-42ff-b0cf-cd745bbaa6ec]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:565529bd-33f8-43ed-a1d7-697afb9491f3 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:05 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-d431838b-ba47-4c07-8c51-a50a426b2e33 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 (non-flash)
Nov 29 16:12:05 user nova-compute[75245]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311 (non-flash)
Nov 29 16:12:05 user nova-compute[75245]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63 (non-flash)
Nov 29 16:12:05 user nova-compute[75245]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:565529bd-33f8-43ed-a1d7-697afb9491f3 (non-flash)
Nov 29 16:12:05 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:12:05 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-d431838b-ba47-4c07-8c51-a50a426b2e33 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 (non-flash)
Nov 29 16:12:05 user nova-compute[75245]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311 (non-flash)
Nov 29 16:12:05 user nova-compute[75245]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63 (non-flash)
Nov 29 16:12:05 user nova-compute[75245]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:565529bd-33f8-43ed-a1d7-697afb9491f3 (non-flash)
Nov 29 16:12:05 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:12:05 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-d431838b-ba47-4c07-8c51-a50a426b2e33 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0d446e7c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:565529bd-33f8-43ed-a1d7-697afb9491f3'): ({'sde'}, set())}) {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 16:12:05 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-d431838b-ba47-4c07-8c51-a50a426b2e33 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Removing single pathed devices sde {{(pid=75245) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 16:12:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:05 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c89673-89bd-4469-80d4-b453ddf0d762]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:05 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9d8aa7-7433-4491-bd5c-9c0a2f278d75]: (4, ('ok\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:05 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-d431838b-ba47-4c07-8c51-a50a426b2e33 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Flushing IO for device /dev/sde {{(pid=75245) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 16:12:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:05 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce59de07-0699-43fb-97b1-1b329e172c3e]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:05 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-d431838b-ba47-4c07-8c51-a50a426b2e33 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75245) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 16:12:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.060s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:05 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e0483e-2555-483b-a04e-540f255450ba]: (4, ('1', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:05 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-d431838b-ba47-4c07-8c51-a50a426b2e33 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 16:12:05 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-d431838b-ba47-4c07-8c51-a50a426b2e33 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] SCSI volumes sde have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 16:12:05 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-d431838b-ba47-4c07-8c51-a50a426b2e33 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:565529bd-33f8-43ed-a1d7-697afb9491f3')] {{(pid=75245) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 16:12:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:565529bd-33f8-43ed-a1d7-697afb9491f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:565529bd-33f8-43ed-a1d7-697afb9491f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:05 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[27aa8562-e362-42fd-a6d7-8ed2bc709769]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:05 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-d431838b-ba47-4c07-8c51-a50a426b2e33 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:12:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:565529bd-33f8-43ed-a1d7-697afb9491f3 -p 172.16.0.220:3260 --logout {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:565529bd-33f8-43ed-a1d7-697afb9491f3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:05 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[16689aa0-9eac-4493-beed-4cf569e7ae3d]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:565529bd-33f8-43ed-a1d7-697afb9491f3, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:565529bd-33f8-43ed-a1d7-697afb9491f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:05 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-d431838b-ba47-4c07-8c51-a50a426b2e33 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:565529bd-33f8-43ed-a1d7-697afb9491f3, portal: 172.16.0.220,3260]
Nov 29 16:12:05 user nova-compute[75245]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:565529bd-33f8-43ed-a1d7-697afb9491f3, portal: 172.16.0.220,3260] successful.
Nov 29 16:12:05 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:12:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:565529bd-33f8-43ed-a1d7-697afb9491f3 -p 172.16.0.220:3260 --op delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:565529bd-33f8-43ed-a1d7-697afb9491f3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:05 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[17998d7c-eb9b-4929-9b04-cf9d85ec3785]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:05 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-d431838b-ba47-4c07-8c51-a50a426b2e33 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:12:05 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-d431838b-ba47-4c07-8c51-a50a426b2e33 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.379s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:12:05 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-d431838b-ba47-4c07-8c51-a50a426b2e33 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] <== disconnect_volume: return (380ms) None {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:12:05 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d431838b-ba47-4c07-8c51-a50a426b2e33 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] [instance: 738c0d7a-af77-41f7-9206-0e6b1f18a154] Disconnected iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 16:12:05 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-d431838b-ba47-4c07-8c51-a50a426b2e33 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] [instance: 738c0d7a-af77-41f7-9206-0e6b1f18a154] Deleting instance files /opt/stack/data/nova/instances/738c0d7a-af77-41f7-9206-0e6b1f18a154_del
Nov 29 16:12:05 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-d431838b-ba47-4c07-8c51-a50a426b2e33 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] [instance: 738c0d7a-af77-41f7-9206-0e6b1f18a154] Deletion of /opt/stack/data/nova/instances/738c0d7a-af77-41f7-9206-0e6b1f18a154_del complete
Nov 29 16:12:05 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d431838b-ba47-4c07-8c51-a50a426b2e33 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Checking UEFI support for host arch (x86_64) {{(pid=75245) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1753}}
Nov 29 16:12:05 user nova-compute[75245]: INFO nova.virt.libvirt.host [None req-d431838b-ba47-4c07-8c51-a50a426b2e33 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] UEFI support detected
Nov 29 16:12:05 user nova-compute[75245]: INFO nova.compute.manager [None req-d431838b-ba47-4c07-8c51-a50a426b2e33 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] [instance: 738c0d7a-af77-41f7-9206-0e6b1f18a154] Took 1.41 seconds to destroy the instance on the hypervisor.
Nov 29 16:12:05 user nova-compute[75245]: DEBUG oslo.service.loopingcall [None req-d431838b-ba47-4c07-8c51-a50a426b2e33 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75245) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 16:12:05 user nova-compute[75245]: DEBUG nova.compute.manager [-] [instance: 738c0d7a-af77-41f7-9206-0e6b1f18a154] Deallocating network for instance {{(pid=75245) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 16:12:05 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: 738c0d7a-af77-41f7-9206-0e6b1f18a154] deallocate_for_instance() {{(pid=75245) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 16:12:06 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: 738c0d7a-af77-41f7-9206-0e6b1f18a154] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:12:06 user nova-compute[75245]: INFO nova.compute.manager [-] [instance: 738c0d7a-af77-41f7-9206-0e6b1f18a154] Took 1.13 seconds to deallocate network for instance.
Nov 29 16:12:06 user nova-compute[75245]: DEBUG nova.compute.manager [req-0262fc08-52b3-40cf-843a-09391654a0b1 req-8fa89777-d760-44b0-b6ae-7a41b5f60e92 service nova] [instance: 738c0d7a-af77-41f7-9206-0e6b1f18a154] Received event network-vif-deleted-6868c459-7c16-48e4-8806-577f44063ef2 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:12:06 user nova-compute[75245]: INFO nova.compute.manager [req-0262fc08-52b3-40cf-843a-09391654a0b1 req-8fa89777-d760-44b0-b6ae-7a41b5f60e92 service nova] [instance: 738c0d7a-af77-41f7-9206-0e6b1f18a154] Neutron deleted interface 6868c459-7c16-48e4-8806-577f44063ef2; detaching it from the instance and deleting it from the info cache
Nov 29 16:12:06 user nova-compute[75245]: DEBUG nova.network.neutron [req-0262fc08-52b3-40cf-843a-09391654a0b1 req-8fa89777-d760-44b0-b6ae-7a41b5f60e92 service nova] [instance: 738c0d7a-af77-41f7-9206-0e6b1f18a154] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:12:06 user nova-compute[75245]: DEBUG nova.compute.manager [req-0262fc08-52b3-40cf-843a-09391654a0b1 req-8fa89777-d760-44b0-b6ae-7a41b5f60e92 service nova] [instance: 738c0d7a-af77-41f7-9206-0e6b1f18a154] Detach interface failed, port_id=6868c459-7c16-48e4-8806-577f44063ef2, reason: Instance 738c0d7a-af77-41f7-9206-0e6b1f18a154 could not be found. {{(pid=75245) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 16:12:07 user nova-compute[75245]: DEBUG nova.compute.manager [req-0159a9ba-8fe5-421a-93a0-adb094b9899c req-9d524c87-9620-4607-9a93-c61f1648d45a service nova] [instance: 738c0d7a-af77-41f7-9206-0e6b1f18a154] Received event network-vif-plugged-6868c459-7c16-48e4-8806-577f44063ef2 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:12:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-0159a9ba-8fe5-421a-93a0-adb094b9899c req-9d524c87-9620-4607-9a93-c61f1648d45a service nova] Acquiring lock "738c0d7a-af77-41f7-9206-0e6b1f18a154-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:12:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-0159a9ba-8fe5-421a-93a0-adb094b9899c req-9d524c87-9620-4607-9a93-c61f1648d45a service nova] Lock "738c0d7a-af77-41f7-9206-0e6b1f18a154-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:12:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-0159a9ba-8fe5-421a-93a0-adb094b9899c req-9d524c87-9620-4607-9a93-c61f1648d45a service nova] Lock "738c0d7a-af77-41f7-9206-0e6b1f18a154-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:12:07 user nova-compute[75245]: DEBUG nova.compute.manager [req-0159a9ba-8fe5-421a-93a0-adb094b9899c req-9d524c87-9620-4607-9a93-c61f1648d45a service nova] [instance: 738c0d7a-af77-41f7-9206-0e6b1f18a154] No waiting events found dispatching network-vif-plugged-6868c459-7c16-48e4-8806-577f44063ef2 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:12:07 user nova-compute[75245]: WARNING nova.compute.manager [req-0159a9ba-8fe5-421a-93a0-adb094b9899c req-9d524c87-9620-4607-9a93-c61f1648d45a service nova] [instance: 738c0d7a-af77-41f7-9206-0e6b1f18a154] Received unexpected event network-vif-plugged-6868c459-7c16-48e4-8806-577f44063ef2 for instance with vm_state active and task_state deleting.
Nov 29 16:12:07 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-d9385425-7227-4c05-ae40-6fc08d32f34e tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Snapshot image upload complete
Nov 29 16:12:07 user nova-compute[75245]: DEBUG nova.compute.manager [None req-d9385425-7227-4c05-ae40-6fc08d32f34e tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:12:07 user nova-compute[75245]: INFO nova.compute.manager [None req-d9385425-7227-4c05-ae40-6fc08d32f34e tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Shelve offloading
Nov 29 16:12:07 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Instance destroyed successfully.
Nov 29 16:12:07 user nova-compute[75245]: DEBUG nova.compute.manager [None req-d9385425-7227-4c05-ae40-6fc08d32f34e tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:12:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d9385425-7227-4c05-ae40-6fc08d32f34e tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Acquiring lock "refresh_cache-3ab9d7cd-79cd-4c9b-8608-c1ef0f333305" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:12:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d9385425-7227-4c05-ae40-6fc08d32f34e tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Acquired lock "refresh_cache-3ab9d7cd-79cd-4c9b-8608-c1ef0f333305" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:12:07 user nova-compute[75245]: DEBUG nova.network.neutron [None req-d9385425-7227-4c05-ae40-6fc08d32f34e tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 16:12:07 user nova-compute[75245]: DEBUG nova.compute.manager [req-364e9940-78d9-46f9-bfbb-af0214231cb8 req-9ce802ac-3c9f-45e2-b7d9-fa5b81a86fe4 service nova] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] Received event network-changed-507c0cd2-dea3-4352-b2ff-60000cc32053 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:12:07 user nova-compute[75245]: DEBUG nova.compute.manager [req-364e9940-78d9-46f9-bfbb-af0214231cb8 req-9ce802ac-3c9f-45e2-b7d9-fa5b81a86fe4 service nova] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] Refreshing instance network info cache due to event network-changed-507c0cd2-dea3-4352-b2ff-60000cc32053. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:12:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-364e9940-78d9-46f9-bfbb-af0214231cb8 req-9ce802ac-3c9f-45e2-b7d9-fa5b81a86fe4 service nova] Acquiring lock "refresh_cache-36728d4f-925b-46a3-b4b5-17f14b9c99c3" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:12:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-364e9940-78d9-46f9-bfbb-af0214231cb8 req-9ce802ac-3c9f-45e2-b7d9-fa5b81a86fe4 service nova] Acquired lock "refresh_cache-36728d4f-925b-46a3-b4b5-17f14b9c99c3" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:12:07 user nova-compute[75245]: DEBUG nova.network.neutron [req-364e9940-78d9-46f9-bfbb-af0214231cb8 req-9ce802ac-3c9f-45e2-b7d9-fa5b81a86fe4 service nova] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] Refreshing network info cache for port 507c0cd2-dea3-4352-b2ff-60000cc32053 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:12:07 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:07 user nova-compute[75245]: INFO nova.compute.manager [None req-d431838b-ba47-4c07-8c51-a50a426b2e33 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] [instance: 738c0d7a-af77-41f7-9206-0e6b1f18a154] Took 0.93 seconds to detach 1 volumes for instance.
Nov 29 16:12:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d431838b-ba47-4c07-8c51-a50a426b2e33 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:12:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d431838b-ba47-4c07-8c51-a50a426b2e33 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:12:08 user nova-compute[75245]: DEBUG nova.network.neutron [None req-d9385425-7227-4c05-ae40-6fc08d32f34e tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Updating instance_info_cache with network_info: [{"id": "0b3a82cf-e1cb-455a-9f59-853505903560", "address": "fa:16:3e:72:f8:5e", "network": {"id": "7f978dee-8a5e-4218-b6fc-2d550c0d7b5d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-53637364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd22948fbd074a7c94d8ad7614fbc220", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b3a82cf-e1", "ovs_interfaceid": "0b3a82cf-e1cb-455a-9f59-853505903560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:12:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d9385425-7227-4c05-ae40-6fc08d32f34e tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Releasing lock "refresh_cache-3ab9d7cd-79cd-4c9b-8608-c1ef0f333305" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:12:08 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-d431838b-ba47-4c07-8c51-a50a426b2e33 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:12:08 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-d431838b-ba47-4c07-8c51-a50a426b2e33 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:12:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d431838b-ba47-4c07-8c51-a50a426b2e33 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.393s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:12:08 user nova-compute[75245]: INFO nova.scheduler.client.report [None req-d431838b-ba47-4c07-8c51-a50a426b2e33 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Deleted allocations for instance 738c0d7a-af77-41f7-9206-0e6b1f18a154
Nov 29 16:12:08 user nova-compute[75245]: DEBUG nova.network.neutron [req-364e9940-78d9-46f9-bfbb-af0214231cb8 req-9ce802ac-3c9f-45e2-b7d9-fa5b81a86fe4 service nova] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] Updated VIF entry in instance network info cache for port 507c0cd2-dea3-4352-b2ff-60000cc32053. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:12:08 user nova-compute[75245]: DEBUG nova.network.neutron [req-364e9940-78d9-46f9-bfbb-af0214231cb8 req-9ce802ac-3c9f-45e2-b7d9-fa5b81a86fe4 service nova] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] Updating instance_info_cache with network_info: [{"id": "507c0cd2-dea3-4352-b2ff-60000cc32053", "address": "fa:16:3e:38:db:1f", "network": {"id": "ae7be65e-9c9f-4836-aee2-9d465d5d28f6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-521099242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a08c8f9089c4291b552c567e010b0c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap507c0cd2-de", "ovs_interfaceid": "507c0cd2-dea3-4352-b2ff-60000cc32053", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:12:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-364e9940-78d9-46f9-bfbb-af0214231cb8 req-9ce802ac-3c9f-45e2-b7d9-fa5b81a86fe4 service nova] Releasing lock "refresh_cache-36728d4f-925b-46a3-b4b5-17f14b9c99c3" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:12:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d431838b-ba47-4c07-8c51-a50a426b2e33 tempest-DeleteServersTestJSON-1443860988 tempest-DeleteServersTestJSON-1443860988-project-member] Lock "738c0d7a-af77-41f7-9206-0e6b1f18a154" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.080s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:12:08 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Instance destroyed successfully.
Nov 29 16:12:08 user nova-compute[75245]: DEBUG nova.objects.instance [None req-d9385425-7227-4c05-ae40-6fc08d32f34e tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lazy-loading 'resources' on Instance uuid 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:12:08 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-d9385425-7227-4c05-ae40-6fc08d32f34e tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:10:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-723691220',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-723691220',id=4,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEoMJZt+VqMN0mavu3vY5Kvut5aAyigJQLII/9twNBGC/SlV5jkUl2w3ylxxIBa5TyZWx/7AEPJj5EkYaLXE+xUAT6uZbyatxvBvA6jxLyD3SeE/POApEcydBOMofkwZ3w==',key_name='tempest-keypair-353472592',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:10:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='fd22948fbd074a7c94d8ad7614fbc220',ramdisk_id='',reservation_id='r-k0lo301j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1524245296',owner_user_name='tempest-AttachVolumeShelveTestJSON-1524245296-project-member',shelved_at='2023-11-29T16:12:07.347735',shelved_host='user',shelved_image_id='6ba0ba34-4cf5-43b8-aa8a-7941d541a1cd'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:12:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c4942f948584702a8c8b93248694a65',uuid=3ab9d7cd-79cd-4c9b-8608-c1ef0f333305,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "0b3a82cf-e1cb-455a-9f59-853505903560", "address": "fa:16:3e:72:f8:5e", "network": {"id": "7f978dee-8a5e-4218-b6fc-2d550c0d7b5d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-53637364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd22948fbd074a7c94d8ad7614fbc220", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b3a82cf-e1", "ovs_interfaceid": "0b3a82cf-e1cb-455a-9f59-853505903560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 16:12:08 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-d9385425-7227-4c05-ae40-6fc08d32f34e tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Converting VIF {"id": "0b3a82cf-e1cb-455a-9f59-853505903560", "address": "fa:16:3e:72:f8:5e", "network": {"id": "7f978dee-8a5e-4218-b6fc-2d550c0d7b5d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-53637364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd22948fbd074a7c94d8ad7614fbc220", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b3a82cf-e1", "ovs_interfaceid": "0b3a82cf-e1cb-455a-9f59-853505903560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:12:08 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-d9385425-7227-4c05-ae40-6fc08d32f34e tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:f8:5e,bridge_name='br-int',has_traffic_filtering=True,id=0b3a82cf-e1cb-455a-9f59-853505903560,network=Network(7f978dee-8a5e-4218-b6fc-2d550c0d7b5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b3a82cf-e1') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:12:08 user nova-compute[75245]: DEBUG os_vif [None req-d9385425-7227-4c05-ae40-6fc08d32f34e tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:f8:5e,bridge_name='br-int',has_traffic_filtering=True,id=0b3a82cf-e1cb-455a-9f59-853505903560,network=Network(7f978dee-8a5e-4218-b6fc-2d550c0d7b5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b3a82cf-e1') {{(pid=75245) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 16:12:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0b3a82cf-e1, bridge=br-int, if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:12:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:12:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b0a771b4-81ec-415c-9921-b589e7c2cf8a) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:12:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:08 user nova-compute[75245]: INFO os_vif [None req-d9385425-7227-4c05-ae40-6fc08d32f34e tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:f8:5e,bridge_name='br-int',has_traffic_filtering=True,id=0b3a82cf-e1cb-455a-9f59-853505903560,network=Network(7f978dee-8a5e-4218-b6fc-2d550c0d7b5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b3a82cf-e1')
Nov 29 16:12:08 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-d9385425-7227-4c05-ae40-6fc08d32f34e tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Deleting instance files /opt/stack/data/nova/instances/3ab9d7cd-79cd-4c9b-8608-c1ef0f333305_del
Nov 29 16:12:08 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-d9385425-7227-4c05-ae40-6fc08d32f34e tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Deletion of /opt/stack/data/nova/instances/3ab9d7cd-79cd-4c9b-8608-c1ef0f333305_del complete
Nov 29 16:12:08 user nova-compute[75245]: DEBUG nova.compute.manager [req-fea3bbe2-c992-4f3b-9365-219984d9c6fc req-2fe85551-3926-4a9c-8748-41c87b61aebd service nova] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Received event network-changed-0b3a82cf-e1cb-455a-9f59-853505903560 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:12:08 user nova-compute[75245]: DEBUG nova.compute.manager [req-fea3bbe2-c992-4f3b-9365-219984d9c6fc req-2fe85551-3926-4a9c-8748-41c87b61aebd service nova] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Refreshing instance network info cache due to event network-changed-0b3a82cf-e1cb-455a-9f59-853505903560. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:12:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-fea3bbe2-c992-4f3b-9365-219984d9c6fc req-2fe85551-3926-4a9c-8748-41c87b61aebd service nova] Acquiring lock "refresh_cache-3ab9d7cd-79cd-4c9b-8608-c1ef0f333305" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:12:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-fea3bbe2-c992-4f3b-9365-219984d9c6fc req-2fe85551-3926-4a9c-8748-41c87b61aebd service nova] Acquired lock "refresh_cache-3ab9d7cd-79cd-4c9b-8608-c1ef0f333305" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:12:08 user nova-compute[75245]: DEBUG nova.network.neutron [req-fea3bbe2-c992-4f3b-9365-219984d9c6fc req-2fe85551-3926-4a9c-8748-41c87b61aebd service nova] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Refreshing network info cache for port 0b3a82cf-e1cb-455a-9f59-853505903560 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:12:08 user nova-compute[75245]: INFO nova.scheduler.client.report [None req-d9385425-7227-4c05-ae40-6fc08d32f34e tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Deleted allocations for instance 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305
Nov 29 16:12:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d9385425-7227-4c05-ae40-6fc08d32f34e tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:12:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d9385425-7227-4c05-ae40-6fc08d32f34e tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:12:09 user nova-compute[75245]: DEBUG nova.objects.instance [None req-d9385425-7227-4c05-ae40-6fc08d32f34e tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lazy-loading 'numa_topology' on Instance uuid 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:12:09 user nova-compute[75245]: DEBUG nova.objects.base [None req-d9385425-7227-4c05-ae40-6fc08d32f34e tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Object Instance<3ab9d7cd-79cd-4c9b-8608-c1ef0f333305> lazy-loaded attributes: resources,numa_topology {{(pid=75245) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 16:12:09 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-d9385425-7227-4c05-ae40-6fc08d32f34e tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:12:09 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-d9385425-7227-4c05-ae40-6fc08d32f34e tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:12:09 user nova-compute[75245]: DEBUG nova.network.neutron [req-fea3bbe2-c992-4f3b-9365-219984d9c6fc req-2fe85551-3926-4a9c-8748-41c87b61aebd service nova] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Updated VIF entry in instance network info cache for port 0b3a82cf-e1cb-455a-9f59-853505903560. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:12:09 user nova-compute[75245]: DEBUG nova.network.neutron [req-fea3bbe2-c992-4f3b-9365-219984d9c6fc req-2fe85551-3926-4a9c-8748-41c87b61aebd service nova] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Updating instance_info_cache with network_info: [{"id": "0b3a82cf-e1cb-455a-9f59-853505903560", "address": "fa:16:3e:72:f8:5e", "network": {"id": "7f978dee-8a5e-4218-b6fc-2d550c0d7b5d", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-53637364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd22948fbd074a7c94d8ad7614fbc220", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap0b3a82cf-e1", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:12:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-fea3bbe2-c992-4f3b-9365-219984d9c6fc req-2fe85551-3926-4a9c-8748-41c87b61aebd service nova] Releasing lock "refresh_cache-3ab9d7cd-79cd-4c9b-8608-c1ef0f333305" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:12:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d9385425-7227-4c05-ae40-6fc08d32f34e tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.357s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:12:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d9385425-7227-4c05-ae40-6fc08d32f34e tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lock "3ab9d7cd-79cd-4c9b-8608-c1ef0f333305" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.430s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:12:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-faca5e4a-1245-4cda-b301-6d8e903100d5 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Acquiring lock "36728d4f-925b-46a3-b4b5-17f14b9c99c3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:12:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-faca5e4a-1245-4cda-b301-6d8e903100d5 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Lock "36728d4f-925b-46a3-b4b5-17f14b9c99c3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:12:10 user nova-compute[75245]: DEBUG nova.objects.instance [None req-faca5e4a-1245-4cda-b301-6d8e903100d5 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Lazy-loading 'flavor' on Instance uuid 36728d4f-925b-46a3-b4b5-17f14b9c99c3 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:12:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-faca5e4a-1245-4cda-b301-6d8e903100d5 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Lock "36728d4f-925b-46a3-b4b5-17f14b9c99c3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:12:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-faca5e4a-1245-4cda-b301-6d8e903100d5 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Acquiring lock "36728d4f-925b-46a3-b4b5-17f14b9c99c3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:12:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-faca5e4a-1245-4cda-b301-6d8e903100d5 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Lock "36728d4f-925b-46a3-b4b5-17f14b9c99c3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:12:10 user nova-compute[75245]: INFO nova.compute.manager [None req-faca5e4a-1245-4cda-b301-6d8e903100d5 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] Attaching volume c57cd57f-133d-4ec5-be2c-40dd8bd226cb to /dev/vdb
Nov 29 16:12:10 user nova-compute[75245]: DEBUG os_brick.utils [None req-faca5e4a-1245-4cda-b301-6d8e903100d5 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:12:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:10 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[038c4464-6a61-49cb-b952-dbe34d80180f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:69ed8ed87091\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:10 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb74ffa-d08b-488f-b609-32b639739ca3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:10 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0df154d-3954-4cf4-b970-c57940c9fe31]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:10 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[6659ffa4-2828-44e4-ade2-259c245fac5e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-faca5e4a-1245-4cda-b301-6d8e903100d5 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Running cmd (subprocess): nvme version {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-faca5e4a-1245-4cda-b301-6d8e903100d5 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] 'nvme version' failed. Not Retrying. {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:12:10 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.nvmeof [None req-faca5e4a-1245-4cda-b301-6d8e903100d5 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] nvme not present on system {{(pid=75245) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 16:12:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:12:10 user nova-compute[75245]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 16:12:10 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf287e2f-0909-401f-9aa6-591f5ba22ac0]: (4, '') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:10 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-faca5e4a-1245-4cda-b301-6d8e903100d5 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75245) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 16:12:10 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-faca5e4a-1245-4cda-b301-6d8e903100d5 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 16:12:10 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-faca5e4a-1245-4cda-b301-6d8e903100d5 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] LIGHTOS: no hostnqn found. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 16:12:10 user nova-compute[75245]: DEBUG os_brick.utils [None req-faca5e4a-1245-4cda-b301-6d8e903100d5 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:69ed8ed87091', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:12:10 user nova-compute[75245]: DEBUG nova.virt.block_device [None req-faca5e4a-1245-4cda-b301-6d8e903100d5 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] Updating existing volume attachment record: dc4c974b-f9bc-4220-922b-0df6781996d1 {{(pid=75245) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 16:12:12 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:15 user nova-compute[75245]: DEBUG nova.compute.manager [req-37c8c602-a658-4604-922a-96ba79e281f0 req-cf4e8795-061a-4b96-a6eb-4e43048843dc service nova] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] Received event network-changed-f4303524-45ab-49e7-bdac-5522f5c4b8f5 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:12:15 user nova-compute[75245]: DEBUG nova.compute.manager [req-37c8c602-a658-4604-922a-96ba79e281f0 req-cf4e8795-061a-4b96-a6eb-4e43048843dc service nova] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] Refreshing instance network info cache due to event network-changed-f4303524-45ab-49e7-bdac-5522f5c4b8f5. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:12:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-37c8c602-a658-4604-922a-96ba79e281f0 req-cf4e8795-061a-4b96-a6eb-4e43048843dc service nova] Acquiring lock "refresh_cache-e3fea3d2-6db1-4766-ad5b-9ad1e728ea10" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:12:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-37c8c602-a658-4604-922a-96ba79e281f0 req-cf4e8795-061a-4b96-a6eb-4e43048843dc service nova] Acquired lock "refresh_cache-e3fea3d2-6db1-4766-ad5b-9ad1e728ea10" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:12:15 user nova-compute[75245]: DEBUG nova.network.neutron [req-37c8c602-a658-4604-922a-96ba79e281f0 req-cf4e8795-061a-4b96-a6eb-4e43048843dc service nova] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] Refreshing network info cache for port f4303524-45ab-49e7-bdac-5522f5c4b8f5 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:12:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-32234c75-d92d-4c56-9b76-4912826ffbe7 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Acquiring lock "e3fea3d2-6db1-4766-ad5b-9ad1e728ea10" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:12:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-32234c75-d92d-4c56-9b76-4912826ffbe7 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Lock "e3fea3d2-6db1-4766-ad5b-9ad1e728ea10" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:12:15 user nova-compute[75245]: DEBUG nova.objects.instance [None req-32234c75-d92d-4c56-9b76-4912826ffbe7 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Lazy-loading 'flavor' on Instance uuid e3fea3d2-6db1-4766-ad5b-9ad1e728ea10 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:12:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-32234c75-d92d-4c56-9b76-4912826ffbe7 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Lock "e3fea3d2-6db1-4766-ad5b-9ad1e728ea10" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:12:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-32234c75-d92d-4c56-9b76-4912826ffbe7 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Acquiring lock "e3fea3d2-6db1-4766-ad5b-9ad1e728ea10" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:12:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-32234c75-d92d-4c56-9b76-4912826ffbe7 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Lock "e3fea3d2-6db1-4766-ad5b-9ad1e728ea10" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:12:15 user nova-compute[75245]: INFO nova.compute.manager [None req-32234c75-d92d-4c56-9b76-4912826ffbe7 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] Attaching volume 20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb to /dev/vdb
Nov 29 16:12:16 user nova-compute[75245]: DEBUG nova.network.neutron [req-37c8c602-a658-4604-922a-96ba79e281f0 req-cf4e8795-061a-4b96-a6eb-4e43048843dc service nova] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] Updated VIF entry in instance network info cache for port f4303524-45ab-49e7-bdac-5522f5c4b8f5. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:12:16 user nova-compute[75245]: DEBUG nova.network.neutron [req-37c8c602-a658-4604-922a-96ba79e281f0 req-cf4e8795-061a-4b96-a6eb-4e43048843dc service nova] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] Updating instance_info_cache with network_info: [{"id": "f4303524-45ab-49e7-bdac-5522f5c4b8f5", "address": "fa:16:3e:11:8d:50", "network": {"id": "b1ced6f5-b3ca-45c7-b841-353498cf4f5a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-812097196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6dc8fad291d4894a0906964a18a2ee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4303524-45", "ovs_interfaceid": "f4303524-45ab-49e7-bdac-5522f5c4b8f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:12:16 user nova-compute[75245]: DEBUG os_brick.utils [None req-32234c75-d92d-4c56-9b76-4912826ffbe7 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:12:16 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:16 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-37c8c602-a658-4604-922a-96ba79e281f0 req-cf4e8795-061a-4b96-a6eb-4e43048843dc service nova] Releasing lock "refresh_cache-e3fea3d2-6db1-4766-ad5b-9ad1e728ea10" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:12:16 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:16 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ab25ec-c3aa-4ac4-a269-748eb520123d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:69ed8ed87091\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:16 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:16 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:16 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[f73259db-7f28-46b9-b23f-35d15385a68e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:16 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:16 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:16 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec73e17-5b7a-4ff6-9470-c1ed0840361a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:16 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[b577159d-7a99-4760-bac2-d72919c6df1d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:16 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-32234c75-d92d-4c56-9b76-4912826ffbe7 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Running cmd (subprocess): nvme version {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:16 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-32234c75-d92d-4c56-9b76-4912826ffbe7 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] 'nvme version' failed. Not Retrying. {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:12:16 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.nvmeof [None req-32234c75-d92d-4c56-9b76-4912826ffbe7 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] nvme not present on system {{(pid=75245) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 16:12:16 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:16 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:12:16 user nova-compute[75245]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 16:12:16 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef70a246-ff01-407a-9b37-f82b978b0c43]: (4, '') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:16 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-32234c75-d92d-4c56-9b76-4912826ffbe7 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75245) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 16:12:16 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-32234c75-d92d-4c56-9b76-4912826ffbe7 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 16:12:16 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-32234c75-d92d-4c56-9b76-4912826ffbe7 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] LIGHTOS: no hostnqn found. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 16:12:16 user nova-compute[75245]: DEBUG os_brick.utils [None req-32234c75-d92d-4c56-9b76-4912826ffbe7 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:69ed8ed87091', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:12:16 user nova-compute[75245]: DEBUG nova.virt.block_device [None req-32234c75-d92d-4c56-9b76-4912826ffbe7 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] Updating existing volume attachment record: 86f6cc55-cde5-42a8-ba58-d4687fe70263 {{(pid=75245) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 16:12:17 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:18 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:18 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-faca5e4a-1245-4cda-b301-6d8e903100d5 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] Calling os-brick to attach iSCSI Volume {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 16:12:18 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-faca5e4a-1245-4cda-b301-6d8e903100d5 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c57cd57f-133d-4ec5-be2c-40dd8bd226cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rlchEgiW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:12:18 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-faca5e4a-1245-4cda-b301-6d8e903100d5 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:12:18 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-faca5e4a-1245-4cda-b301-6d8e903100d5 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:12:18 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-faca5e4a-1245-4cda-b301-6d8e903100d5 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:12:18 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-faca5e4a-1245-4cda-b301-6d8e903100d5 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:12:18 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-faca5e4a-1245-4cda-b301-6d8e903100d5 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c57cd57f-133d-4ec5-be2c-40dd8bd226cb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:12:18 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-faca5e4a-1245-4cda-b301-6d8e903100d5 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c57cd57f-133d-4ec5-be2c-40dd8bd226cb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:12:18 user nova-compute[75245]: INFO os_brick.initiator.connectors.iscsi [None req-faca5e4a-1245-4cda-b301-6d8e903100d5 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 16:12:18 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c57cd57f-133d-4ec5-be2c-40dd8bd226cb -p 172.16.0.220:3260 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:18 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c57cd57f-133d-4ec5-be2c-40dd8bd226cb -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:18 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca070025-6352-4eb3-8cdb-d7edffc90ca8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:18 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-faca5e4a-1245-4cda-b301-6d8e903100d5 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 16:12:18 user nova-compute[75245]:  {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:12:18 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c57cd57f-133d-4ec5-be2c-40dd8bd226cb -p 172.16.0.220:3260 --interface default --op new {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:18 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c57cd57f-133d-4ec5-be2c-40dd8bd226cb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:18 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[454f6e24-b40a-4f25-8436-503b3a4667f6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c57cd57f-133d-4ec5-be2c-40dd8bd226cb] added\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:18 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-faca5e4a-1245-4cda-b301-6d8e903100d5 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c57cd57f-133d-4ec5-be2c-40dd8bd226cb] added
Nov 29 16:12:18 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:12:18 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c57cd57f-133d-4ec5-be2c-40dd8bd226cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:18 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c57cd57f-133d-4ec5-be2c-40dd8bd226cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:18 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a7b69b-5d4e-45d0-873c-fe0f009b9ae1]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:18 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-faca5e4a-1245-4cda-b301-6d8e903100d5 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:12:18 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c57cd57f-133d-4ec5-be2c-40dd8bd226cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:18 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c57cd57f-133d-4ec5-be2c-40dd8bd226cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:18 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d01091-2eef-4a9d-ad0c-249cb74a570d]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:18 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-faca5e4a-1245-4cda-b301-6d8e903100d5 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:12:19 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c57cd57f-133d-4ec5-be2c-40dd8bd226cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rlchEgiW {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:19 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c57cd57f-133d-4ec5-be2c-40dd8bd226cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rlchEgiW" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:19 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e2a34d-b9ec-4b8d-8400-9566027fd7c6]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:19 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-faca5e4a-1245-4cda-b301-6d8e903100d5 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rlchEgiW'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:12:19 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c57cd57f-133d-4ec5-be2c-40dd8bd226cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:19 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c57cd57f-133d-4ec5-be2c-40dd8bd226cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:19 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca10869-6df5-4ee4-a586-7608bb018e6b]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:19 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-faca5e4a-1245-4cda-b301-6d8e903100d5 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:12:19 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:19 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:19 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff2f142-9844-4958-bc9f-250b9ef85c09]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:19 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-faca5e4a-1245-4cda-b301-6d8e903100d5 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 (non-flash)
Nov 29 16:12:19 user nova-compute[75245]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311 (non-flash)
Nov 29 16:12:19 user nova-compute[75245]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63 (non-flash)
Nov 29 16:12:19 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:12:19 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-faca5e4a-1245-4cda-b301-6d8e903100d5 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 (non-flash)
Nov 29 16:12:19 user nova-compute[75245]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311 (non-flash)
Nov 29 16:12:19 user nova-compute[75245]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63 (non-flash)
Nov 29 16:12:19 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:12:19 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c57cd57f-133d-4ec5-be2c-40dd8bd226cb -p 172.16.0.220:3260 --login {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:19 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c57cd57f-133d-4ec5-be2c-40dd8bd226cb -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:19 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c0d895-36aa-4e0a-908d-c0bd1878f669]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c57cd57f-133d-4ec5-be2c-40dd8bd226cb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c57cd57f-133d-4ec5-be2c-40dd8bd226cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:19 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-faca5e4a-1245-4cda-b301-6d8e903100d5 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c57cd57f-133d-4ec5-be2c-40dd8bd226cb, portal: 172.16.0.220,3260]
Nov 29 16:12:19 user nova-compute[75245]: Login to [iface: default, target: iqn.2010-10.org.openstack:c57cd57f-133d-4ec5-be2c-40dd8bd226cb, portal: 172.16.0.220,3260] successful.
Nov 29 16:12:19 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:12:19 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c57cd57f-133d-4ec5-be2c-40dd8bd226cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:19 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c57cd57f-133d-4ec5-be2c-40dd8bd226cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:19 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[95759423-dd58-46a9-a40e-33a745ce305e]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:19 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-faca5e4a-1245-4cda-b301-6d8e903100d5 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:12:19 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:19 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:19 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f4d6c72-40b0-4ff3-a781-65658c22bc14]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c57cd57f-133d-4ec5-be2c-40dd8bd226cb (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:19 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-faca5e4a-1245-4cda-b301-6d8e903100d5 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 (non-flash)
Nov 29 16:12:19 user nova-compute[75245]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311 (non-flash)
Nov 29 16:12:19 user nova-compute[75245]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63 (non-flash)
Nov 29 16:12:19 user nova-compute[75245]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c57cd57f-133d-4ec5-be2c-40dd8bd226cb (non-flash)
Nov 29 16:12:19 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:12:19 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-faca5e4a-1245-4cda-b301-6d8e903100d5 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 (non-flash)
Nov 29 16:12:19 user nova-compute[75245]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311 (non-flash)
Nov 29 16:12:19 user nova-compute[75245]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63 (non-flash)
Nov 29 16:12:19 user nova-compute[75245]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c57cd57f-133d-4ec5-be2c-40dd8bd226cb (non-flash)
Nov 29 16:12:19 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:12:19 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-faca5e4a-1245-4cda-b301-6d8e903100d5 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c57cd57f-133d-4ec5-be2c-40dd8bd226cb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:12:19 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-faca5e4a-1245-4cda-b301-6d8e903100d5 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Connected to 172.16.0.220:3260 {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 16:12:19 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-faca5e4a-1245-4cda-b301-6d8e903100d5 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=75245) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 16:12:19 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-faca5e4a-1245-4cda-b301-6d8e903100d5 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75245) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 16:12:19 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:19 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:19 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac0e641-dfb8-4bdc-bcd9-b0741ab57a07]: (4, ('- - 0', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:19 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-faca5e4a-1245-4cda-b301-6d8e903100d5 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: None {{(pid=75245) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 16:12:20 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-faca5e4a-1245-4cda-b301-6d8e903100d5 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75245) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 16:12:20 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-faca5e4a-1245-4cda-b301-6d8e903100d5 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:c57cd57f-133d-4ec5-be2c-40dd8bd226cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rlchEgiW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 16:12:20 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-faca5e4a-1245-4cda-b301-6d8e903100d5 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:12:20 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-faca5e4a-1245-4cda-b301-6d8e903100d5 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '26237616637303561', 'path': '/dev/sde'} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:12:20 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-faca5e4a-1245-4cda-b301-6d8e903100d5 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26237616637303561', 'path': '/dev/sde'} {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 16:12:20 user nova-compute[75245]: DEBUG nova.objects.instance [None req-faca5e4a-1245-4cda-b301-6d8e903100d5 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Lazy-loading 'flavor' on Instance uuid 36728d4f-925b-46a3-b4b5-17f14b9c99c3 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:12:20 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-faca5e4a-1245-4cda-b301-6d8e903100d5 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 16:12:20 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:12:20 user nova-compute[75245]:   <source dev="/dev/sde"/>
Nov 29 16:12:20 user nova-compute[75245]:   <target dev="vdb" bus="virtio"/>
Nov 29 16:12:20 user nova-compute[75245]:   <serial>c57cd57f-133d-4ec5-be2c-40dd8bd226cb</serial>
Nov 29 16:12:20 user nova-compute[75245]: </disk>
Nov 29 16:12:20 user nova-compute[75245]:  {{(pid=75245) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 16:12:20 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-faca5e4a-1245-4cda-b301-6d8e903100d5 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:12:20 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-faca5e4a-1245-4cda-b301-6d8e903100d5 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:12:20 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-faca5e4a-1245-4cda-b301-6d8e903100d5 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] No VIF found with MAC fa:16:3e:38:db:1f, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:12:20 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-faca5e4a-1245-4cda-b301-6d8e903100d5 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Lock "36728d4f-925b-46a3-b4b5-17f14b9c99c3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.307s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:12:22 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-7e6d022d-a167-4d85-bda8-1e89afbb98e1 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Acquiring lock "36728d4f-925b-46a3-b4b5-17f14b9c99c3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:12:22 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-7e6d022d-a167-4d85-bda8-1e89afbb98e1 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Lock "36728d4f-925b-46a3-b4b5-17f14b9c99c3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:12:22 user nova-compute[75245]: INFO nova.compute.manager [None req-7e6d022d-a167-4d85-bda8-1e89afbb98e1 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] Detaching volume c57cd57f-133d-4ec5-be2c-40dd8bd226cb
Nov 29 16:12:22 user nova-compute[75245]: INFO nova.virt.block_device [None req-7e6d022d-a167-4d85-bda8-1e89afbb98e1 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] Attempting to driver detach volume c57cd57f-133d-4ec5-be2c-40dd8bd226cb from mountpoint /dev/vdb
Nov 29 16:12:22 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-7e6d022d-a167-4d85-bda8-1e89afbb98e1 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Attempting to detach device vdb from instance 36728d4f-925b-46a3-b4b5-17f14b9c99c3 from the persistent domain config. {{(pid=75245) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 16:12:22 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-7e6d022d-a167-4d85-bda8-1e89afbb98e1 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 16:12:22 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:12:22 user nova-compute[75245]:   <source dev="/dev/sde"/>
Nov 29 16:12:22 user nova-compute[75245]:   <target dev="vdb" bus="virtio"/>
Nov 29 16:12:22 user nova-compute[75245]:   <serial>c57cd57f-133d-4ec5-be2c-40dd8bd226cb</serial>
Nov 29 16:12:22 user nova-compute[75245]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 16:12:22 user nova-compute[75245]: </disk>
Nov 29 16:12:22 user nova-compute[75245]:  {{(pid=75245) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 16:12:22 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-7e6d022d-a167-4d85-bda8-1e89afbb98e1 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Successfully detached device vdb from instance 36728d4f-925b-46a3-b4b5-17f14b9c99c3 from the persistent domain config.
Nov 29 16:12:22 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-7e6d022d-a167-4d85-bda8-1e89afbb98e1 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 36728d4f-925b-46a3-b4b5-17f14b9c99c3 from the live domain config. {{(pid=75245) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 16:12:22 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-7e6d022d-a167-4d85-bda8-1e89afbb98e1 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 16:12:22 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:12:22 user nova-compute[75245]:   <source dev="/dev/sde"/>
Nov 29 16:12:22 user nova-compute[75245]:   <target dev="vdb" bus="virtio"/>
Nov 29 16:12:22 user nova-compute[75245]:   <serial>c57cd57f-133d-4ec5-be2c-40dd8bd226cb</serial>
Nov 29 16:12:22 user nova-compute[75245]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 16:12:22 user nova-compute[75245]: </disk>
Nov 29 16:12:22 user nova-compute[75245]:  {{(pid=75245) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 16:12:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:22 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-7e6d022d-a167-4d85-bda8-1e89afbb98e1 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 36728d4f-925b-46a3-b4b5-17f14b9c99c3 {{(pid=75245) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 16:12:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:25 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32234c75-d92d-4c56-9b76-4912826ffbe7 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] Calling os-brick to attach iSCSI Volume {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 16:12:25 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-32234c75-d92d-4c56-9b76-4912826ffbe7 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oyrKtafB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:12:25 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-32234c75-d92d-4c56-9b76-4912826ffbe7 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:12:25 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-32234c75-d92d-4c56-9b76-4912826ffbe7 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:12:25 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-32234c75-d92d-4c56-9b76-4912826ffbe7 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:12:25 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-32234c75-d92d-4c56-9b76-4912826ffbe7 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:12:25 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-32234c75-d92d-4c56-9b76-4912826ffbe7 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:12:25 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-32234c75-d92d-4c56-9b76-4912826ffbe7 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:12:25 user nova-compute[75245]: INFO os_brick.initiator.connectors.iscsi [None req-32234c75-d92d-4c56-9b76-4912826ffbe7 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 16:12:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb -p 172.16.0.220:3260 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:25 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[a051f82d-3332-4d05-83a3-9008295b5eba]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:25 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-32234c75-d92d-4c56-9b76-4912826ffbe7 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 16:12:25 user nova-compute[75245]:  {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:12:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb -p 172.16.0.220:3260 --interface default --op new {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:25 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[22aa559e-3275-4762-a780-3c5d982272f7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb] added\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:25 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-32234c75-d92d-4c56-9b76-4912826ffbe7 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb] added
Nov 29 16:12:25 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:12:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:25 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[1174ab76-da3a-4958-ab36-37c99ec5d87c]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:25 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-32234c75-d92d-4c56-9b76-4912826ffbe7 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:12:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:25 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[199e9cf2-4bae-474e-b7b4-b8befa1bbafc]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:25 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-32234c75-d92d-4c56-9b76-4912826ffbe7 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:12:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oyrKtafB {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oyrKtafB" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:25 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d57199-271d-4205-929a-7503fd730e8c]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:25 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-32234c75-d92d-4c56-9b76-4912826ffbe7 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oyrKtafB'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:12:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:25 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[6027385e-2717-4a55-af68-5d77a1292078]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:25 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-32234c75-d92d-4c56-9b76-4912826ffbe7 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:12:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:25 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[90527980-7465-4790-8303-9206a65619e7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c57cd57f-133d-4ec5-be2c-40dd8bd226cb (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:25 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-32234c75-d92d-4c56-9b76-4912826ffbe7 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 (non-flash)
Nov 29 16:12:25 user nova-compute[75245]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311 (non-flash)
Nov 29 16:12:25 user nova-compute[75245]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63 (non-flash)
Nov 29 16:12:25 user nova-compute[75245]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c57cd57f-133d-4ec5-be2c-40dd8bd226cb (non-flash)
Nov 29 16:12:25 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:12:25 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-32234c75-d92d-4c56-9b76-4912826ffbe7 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 (non-flash)
Nov 29 16:12:25 user nova-compute[75245]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311 (non-flash)
Nov 29 16:12:25 user nova-compute[75245]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63 (non-flash)
Nov 29 16:12:25 user nova-compute[75245]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c57cd57f-133d-4ec5-be2c-40dd8bd226cb (non-flash)
Nov 29 16:12:25 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:12:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb -p 172.16.0.220:3260 --login {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:25 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6cc169-e15b-405c-93c1-1bfe7ef1d760]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:25 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-32234c75-d92d-4c56-9b76-4912826ffbe7 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb, portal: 172.16.0.220,3260]
Nov 29 16:12:25 user nova-compute[75245]: Login to [iface: default, target: iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb, portal: 172.16.0.220,3260] successful.
Nov 29 16:12:25 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:12:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:25 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58f7262-e367-4cfb-8a0f-d05065192558]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:25 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-32234c75-d92d-4c56-9b76-4912826ffbe7 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:12:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:25 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd08712-a23a-46dd-896c-cfdd41f7e3eb]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c57cd57f-133d-4ec5-be2c-40dd8bd226cb (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:25 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-32234c75-d92d-4c56-9b76-4912826ffbe7 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 (non-flash)
Nov 29 16:12:25 user nova-compute[75245]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311 (non-flash)
Nov 29 16:12:25 user nova-compute[75245]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63 (non-flash)
Nov 29 16:12:25 user nova-compute[75245]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c57cd57f-133d-4ec5-be2c-40dd8bd226cb (non-flash)
Nov 29 16:12:25 user nova-compute[75245]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb (non-flash)
Nov 29 16:12:25 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:12:25 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-32234c75-d92d-4c56-9b76-4912826ffbe7 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 (non-flash)
Nov 29 16:12:25 user nova-compute[75245]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311 (non-flash)
Nov 29 16:12:25 user nova-compute[75245]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63 (non-flash)
Nov 29 16:12:25 user nova-compute[75245]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c57cd57f-133d-4ec5-be2c-40dd8bd226cb (non-flash)
Nov 29 16:12:25 user nova-compute[75245]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb (non-flash)
Nov 29 16:12:25 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:12:25 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-32234c75-d92d-4c56-9b76-4912826ffbe7 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:12:25 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-32234c75-d92d-4c56-9b76-4912826ffbe7 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Connected to 172.16.0.220:3260 {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 16:12:25 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-32234c75-d92d-4c56-9b76-4912826ffbe7 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=75245) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 16:12:25 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-32234c75-d92d-4c56-9b76-4912826ffbe7 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75245) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 16:12:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.015s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:25 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[015167ac-a46b-4078-b535-e2be333fb24e]: (4, ('- - 0', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:25 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-32234c75-d92d-4c56-9b76-4912826ffbe7 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75245) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 16:12:25 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-32234c75-d92d-4c56-9b76-4912826ffbe7 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oyrKtafB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 16:12:26 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-32234c75-d92d-4c56-9b76-4912826ffbe7 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:12:26 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-32234c75-d92d-4c56-9b76-4912826ffbe7 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '26562393035626637', 'path': '/dev/sdf'} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:12:26 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32234c75-d92d-4c56-9b76-4912826ffbe7 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26562393035626637', 'path': '/dev/sdf'} {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 16:12:26 user nova-compute[75245]: DEBUG nova.objects.instance [None req-32234c75-d92d-4c56-9b76-4912826ffbe7 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Lazy-loading 'flavor' on Instance uuid e3fea3d2-6db1-4766-ad5b-9ad1e728ea10 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:12:26 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-32234c75-d92d-4c56-9b76-4912826ffbe7 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 16:12:26 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:12:26 user nova-compute[75245]:   <source dev="/dev/sdf"/>
Nov 29 16:12:26 user nova-compute[75245]:   <target dev="vdb" bus="virtio"/>
Nov 29 16:12:26 user nova-compute[75245]:   <serial>20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb</serial>
Nov 29 16:12:26 user nova-compute[75245]: </disk>
Nov 29 16:12:26 user nova-compute[75245]:  {{(pid=75245) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 16:12:27 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-32234c75-d92d-4c56-9b76-4912826ffbe7 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:12:27 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-32234c75-d92d-4c56-9b76-4912826ffbe7 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:12:27 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-32234c75-d92d-4c56-9b76-4912826ffbe7 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] No VIF found with MAC fa:16:3e:11:8d:50, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:12:27 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-32234c75-d92d-4c56-9b76-4912826ffbe7 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Lock "e3fea3d2-6db1-4766-ad5b-9ad1e728ea10" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.607s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:12:27 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:28 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4095d140-5e4e-4e4d-a0aa-3ab4ab26dd99 tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] Acquiring lock "e3fea3d2-6db1-4766-ad5b-9ad1e728ea10" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:12:28 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4095d140-5e4e-4e4d-a0aa-3ab4ab26dd99 tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] Lock "e3fea3d2-6db1-4766-ad5b-9ad1e728ea10" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:12:28 user nova-compute[75245]: DEBUG os_brick.utils [None req-4095d140-5e4e-4e4d-a0aa-3ab4ab26dd99 tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:12:28 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:28 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:28 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b43b68-a4e6-4fe4-b453-6d61cbe978aa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:69ed8ed87091\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:28 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:28 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:28 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a6a426-c67f-4961-a14e-d76c11a04de9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:28 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:28 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:28 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f35de1-5e0d-47bf-a2f3-025b5767a438]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:28 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[9045a15f-e5a1-47d6-a5cf-e53220444d91]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:28 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-4095d140-5e4e-4e4d-a0aa-3ab4ab26dd99 tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] Running cmd (subprocess): nvme version {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:28 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-4095d140-5e4e-4e4d-a0aa-3ab4ab26dd99 tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:12:28 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4095d140-5e4e-4e4d-a0aa-3ab4ab26dd99 tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] nvme not present on system {{(pid=75245) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 16:12:28 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:28 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:12:28 user nova-compute[75245]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 16:12:28 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fbfe71d-b592-4c51-a4e4-e8b2b9eb1678]: (4, '') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:28 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-4095d140-5e4e-4e4d-a0aa-3ab4ab26dd99 tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75245) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 16:12:28 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-4095d140-5e4e-4e4d-a0aa-3ab4ab26dd99 tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 16:12:28 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-4095d140-5e4e-4e4d-a0aa-3ab4ab26dd99 tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] LIGHTOS: no hostnqn found. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 16:12:28 user nova-compute[75245]: DEBUG os_brick.utils [None req-4095d140-5e4e-4e4d-a0aa-3ab4ab26dd99 tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:69ed8ed87091', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:12:29 user nova-compute[75245]: INFO nova.compute.manager [None req-4095d140-5e4e-4e4d-a0aa-3ab4ab26dd99 tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] Swapping volume 20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb for 9bcd2fed-1ce1-4028-9482-2f5695d71b49
Nov 29 16:12:30 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:31 user nova-compute[75245]: DEBUG nova.compute.manager [req-1ae51a90-6eaf-4ee0-baa9-29e06a42a740 req-7aa6a015-2868-4625-addc-8d866d1d1b0b service nova] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] Received event network-changed-eb8171a1-ecbc-43ba-86b5-c4d81f0231b4 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:12:31 user nova-compute[75245]: DEBUG nova.compute.manager [req-1ae51a90-6eaf-4ee0-baa9-29e06a42a740 req-7aa6a015-2868-4625-addc-8d866d1d1b0b service nova] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] Refreshing instance network info cache due to event network-changed-eb8171a1-ecbc-43ba-86b5-c4d81f0231b4. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:12:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-1ae51a90-6eaf-4ee0-baa9-29e06a42a740 req-7aa6a015-2868-4625-addc-8d866d1d1b0b service nova] Acquiring lock "refresh_cache-55f5b252-468d-4064-99b3-49bdcdf98db8" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:12:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-1ae51a90-6eaf-4ee0-baa9-29e06a42a740 req-7aa6a015-2868-4625-addc-8d866d1d1b0b service nova] Acquired lock "refresh_cache-55f5b252-468d-4064-99b3-49bdcdf98db8" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:12:31 user nova-compute[75245]: DEBUG nova.network.neutron [req-1ae51a90-6eaf-4ee0-baa9-29e06a42a740 req-7aa6a015-2868-4625-addc-8d866d1d1b0b service nova] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] Refreshing network info cache for port eb8171a1-ecbc-43ba-86b5-c4d81f0231b4 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:12:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-87783d82-f812-4ddd-b087-3b9d1512a0c4 tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] Acquiring lock "41ce739e-9d85-4d8c-980b-b6845d39e31c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:12:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-87783d82-f812-4ddd-b087-3b9d1512a0c4 tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] Lock "41ce739e-9d85-4d8c-980b-b6845d39e31c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:12:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-87783d82-f812-4ddd-b087-3b9d1512a0c4 tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] Acquiring lock "41ce739e-9d85-4d8c-980b-b6845d39e31c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:12:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-87783d82-f812-4ddd-b087-3b9d1512a0c4 tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] Lock "41ce739e-9d85-4d8c-980b-b6845d39e31c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:12:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-87783d82-f812-4ddd-b087-3b9d1512a0c4 tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] Lock "41ce739e-9d85-4d8c-980b-b6845d39e31c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:12:31 user nova-compute[75245]: INFO nova.compute.manager [None req-87783d82-f812-4ddd-b087-3b9d1512a0c4 tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] [instance: 41ce739e-9d85-4d8c-980b-b6845d39e31c] Terminating instance
Nov 29 16:12:31 user nova-compute[75245]: DEBUG nova.compute.manager [None req-87783d82-f812-4ddd-b087-3b9d1512a0c4 tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] [instance: 41ce739e-9d85-4d8c-980b-b6845d39e31c] Start destroying the instance on the hypervisor. {{(pid=75245) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 16:12:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-66149aaa-2c50-4648-9883-5fdae5e31ac9 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] Acquiring lock "55f5b252-468d-4064-99b3-49bdcdf98db8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:12:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-66149aaa-2c50-4648-9883-5fdae5e31ac9 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] Lock "55f5b252-468d-4064-99b3-49bdcdf98db8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:12:31 user nova-compute[75245]: DEBUG nova.objects.instance [None req-66149aaa-2c50-4648-9883-5fdae5e31ac9 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] Lazy-loading 'flavor' on Instance uuid 55f5b252-468d-4064-99b3-49bdcdf98db8 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:12:31 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-66149aaa-2c50-4648-9883-5fdae5e31ac9 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] Lock "55f5b252-468d-4064-99b3-49bdcdf98db8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.091s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:12:31 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:31 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:31 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:31 user nova-compute[75245]: DEBUG nova.network.neutron [req-1ae51a90-6eaf-4ee0-baa9-29e06a42a740 req-7aa6a015-2868-4625-addc-8d866d1d1b0b service nova] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] Updated VIF entry in instance network info cache for port eb8171a1-ecbc-43ba-86b5-c4d81f0231b4. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:12:31 user nova-compute[75245]: DEBUG nova.network.neutron [req-1ae51a90-6eaf-4ee0-baa9-29e06a42a740 req-7aa6a015-2868-4625-addc-8d866d1d1b0b service nova] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] Updating instance_info_cache with network_info: [{"id": "eb8171a1-ecbc-43ba-86b5-c4d81f0231b4", "address": "fa:16:3e:ec:7c:03", "network": {"id": "675752ef-e4b8-410c-a508-00abae320208", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1370872233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "631a4252b40c45a7a192d0fefabec0d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb8171a1-ec", "ovs_interfaceid": "eb8171a1-ecbc-43ba-86b5-c4d81f0231b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:12:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-1ae51a90-6eaf-4ee0-baa9-29e06a42a740 req-7aa6a015-2868-4625-addc-8d866d1d1b0b service nova] Releasing lock "refresh_cache-55f5b252-468d-4064-99b3-49bdcdf98db8" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:12:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-66149aaa-2c50-4648-9883-5fdae5e31ac9 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] Acquiring lock "55f5b252-468d-4064-99b3-49bdcdf98db8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:12:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-66149aaa-2c50-4648-9883-5fdae5e31ac9 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] Lock "55f5b252-468d-4064-99b3-49bdcdf98db8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:12:31 user nova-compute[75245]: INFO nova.compute.manager [None req-66149aaa-2c50-4648-9883-5fdae5e31ac9 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] Attaching volume d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1 to /dev/vdb
Nov 29 16:12:31 user nova-compute[75245]: DEBUG os_brick.utils [None req-66149aaa-2c50-4648-9883-5fdae5e31ac9 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:12:32 user nova-compute[75245]: DEBUG nova.compute.manager [req-8601611b-4d09-4b46-b3c8-86c21aefb8c4 req-d4e607b7-c4b1-4aa0-a9bf-105967249b3b service nova] [instance: 41ce739e-9d85-4d8c-980b-b6845d39e31c] Received event network-vif-unplugged-e63be854-02c3-4ae4-af88-5d7466611d32 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:12:32 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-8601611b-4d09-4b46-b3c8-86c21aefb8c4 req-d4e607b7-c4b1-4aa0-a9bf-105967249b3b service nova] Acquiring lock "41ce739e-9d85-4d8c-980b-b6845d39e31c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:12:32 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-8601611b-4d09-4b46-b3c8-86c21aefb8c4 req-d4e607b7-c4b1-4aa0-a9bf-105967249b3b service nova] Lock "41ce739e-9d85-4d8c-980b-b6845d39e31c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:12:32 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-8601611b-4d09-4b46-b3c8-86c21aefb8c4 req-d4e607b7-c4b1-4aa0-a9bf-105967249b3b service nova] Lock "41ce739e-9d85-4d8c-980b-b6845d39e31c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:12:32 user nova-compute[75245]: DEBUG nova.compute.manager [req-8601611b-4d09-4b46-b3c8-86c21aefb8c4 req-d4e607b7-c4b1-4aa0-a9bf-105967249b3b service nova] [instance: 41ce739e-9d85-4d8c-980b-b6845d39e31c] No waiting events found dispatching network-vif-unplugged-e63be854-02c3-4ae4-af88-5d7466611d32 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:12:32 user nova-compute[75245]: DEBUG nova.compute.manager [req-8601611b-4d09-4b46-b3c8-86c21aefb8c4 req-d4e607b7-c4b1-4aa0-a9bf-105967249b3b service nova] [instance: 41ce739e-9d85-4d8c-980b-b6845d39e31c] Received event network-vif-unplugged-e63be854-02c3-4ae4-af88-5d7466611d32 for instance with task_state deleting. {{(pid=75245) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 16:12:32 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:32 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:32 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd5f753a-9ef8-45f4-bf17-767506409942]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:69ed8ed87091\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:32 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:32 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:32 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa9e64c7-92cd-4075-b1dd-f71b0c5fa746]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:32 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:32 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:32 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1280c4-3cbc-430f-8729-d341672122e5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:32 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[16620fba-a56f-4d64-8ecd-c61691debf14]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:32 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-66149aaa-2c50-4648-9883-5fdae5e31ac9 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] Running cmd (subprocess): nvme version {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:32 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-66149aaa-2c50-4648-9883-5fdae5e31ac9 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:12:32 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.nvmeof [None req-66149aaa-2c50-4648-9883-5fdae5e31ac9 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] nvme not present on system {{(pid=75245) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 16:12:32 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:32 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:12:32 user nova-compute[75245]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 16:12:32 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea6528c-e8e4-4a74-9fb6-e8ac7a7792a4]: (4, '') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:32 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-66149aaa-2c50-4648-9883-5fdae5e31ac9 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75245) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 16:12:32 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-66149aaa-2c50-4648-9883-5fdae5e31ac9 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 16:12:32 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-66149aaa-2c50-4648-9883-5fdae5e31ac9 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] LIGHTOS: no hostnqn found. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 16:12:32 user nova-compute[75245]: DEBUG os_brick.utils [None req-66149aaa-2c50-4648-9883-5fdae5e31ac9 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:69ed8ed87091', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:12:32 user nova-compute[75245]: DEBUG nova.virt.block_device [None req-66149aaa-2c50-4648-9883-5fdae5e31ac9 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] Updating existing volume attachment record: 026c3118-76a4-45cf-a30e-d5b1445c88e2 {{(pid=75245) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 16:12:32 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 41ce739e-9d85-4d8c-980b-b6845d39e31c] Instance destroyed successfully.
Nov 29 16:12:32 user nova-compute[75245]: DEBUG nova.objects.instance [None req-87783d82-f812-4ddd-b087-3b9d1512a0c4 tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] Lazy-loading 'resources' on Instance uuid 41ce739e-9d85-4d8c-980b-b6845d39e31c {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:12:32 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-87783d82-f812-4ddd-b087-3b9d1512a0c4 tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:10:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1766655900',display_name='tempest-VolumesActionsTest-instance-1766655900',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1766655900',id=7,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:10:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a55afa28bc1b4b91bcbbdcf595cdf496',ramdisk_id='',reservation_id='r-lf88awj1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1821015742',owner_user_name='tempest-VolumesActionsTest-1821015742-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:10:45Z,user_data=None,user_id='f4cfa738baa54b359dbb2a62fc1664c6',uuid=41ce739e-9d85-4d8c-980b-b6845d39e31c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e63be854-02c3-4ae4-af88-5d7466611d32", "address": "fa:16:3e:b3:dc:9f", "network": {"id": "cc4c136b-246d-4996-ad6c-49779f146780", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1274060241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a55afa28bc1b4b91bcbbdcf595cdf496", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape63be854-02", "ovs_interfaceid": "e63be854-02c3-4ae4-af88-5d7466611d32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 16:12:32 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-87783d82-f812-4ddd-b087-3b9d1512a0c4 tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] Converting VIF {"id": "e63be854-02c3-4ae4-af88-5d7466611d32", "address": "fa:16:3e:b3:dc:9f", "network": {"id": "cc4c136b-246d-4996-ad6c-49779f146780", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1274060241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a55afa28bc1b4b91bcbbdcf595cdf496", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape63be854-02", "ovs_interfaceid": "e63be854-02c3-4ae4-af88-5d7466611d32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:12:32 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-87783d82-f812-4ddd-b087-3b9d1512a0c4 tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:dc:9f,bridge_name='br-int',has_traffic_filtering=True,id=e63be854-02c3-4ae4-af88-5d7466611d32,network=Network(cc4c136b-246d-4996-ad6c-49779f146780),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape63be854-02') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:12:32 user nova-compute[75245]: DEBUG os_vif [None req-87783d82-f812-4ddd-b087-3b9d1512a0c4 tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:dc:9f,bridge_name='br-int',has_traffic_filtering=True,id=e63be854-02c3-4ae4-af88-5d7466611d32,network=Network(cc4c136b-246d-4996-ad6c-49779f146780),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape63be854-02') {{(pid=75245) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 16:12:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape63be854-02, bridge=br-int, if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:12:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:12:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5b8c5eb0-ca15-4306-af69-b2484016dfe9) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:12:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:12:32 user nova-compute[75245]: INFO os_vif [None req-87783d82-f812-4ddd-b087-3b9d1512a0c4 tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:dc:9f,bridge_name='br-int',has_traffic_filtering=True,id=e63be854-02c3-4ae4-af88-5d7466611d32,network=Network(cc4c136b-246d-4996-ad6c-49779f146780),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape63be854-02')
Nov 29 16:12:32 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-87783d82-f812-4ddd-b087-3b9d1512a0c4 tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] [instance: 41ce739e-9d85-4d8c-980b-b6845d39e31c] Deleting instance files /opt/stack/data/nova/instances/41ce739e-9d85-4d8c-980b-b6845d39e31c_del
Nov 29 16:12:32 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-87783d82-f812-4ddd-b087-3b9d1512a0c4 tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] [instance: 41ce739e-9d85-4d8c-980b-b6845d39e31c] Deletion of /opt/stack/data/nova/instances/41ce739e-9d85-4d8c-980b-b6845d39e31c_del complete
Nov 29 16:12:32 user nova-compute[75245]: INFO nova.compute.manager [None req-87783d82-f812-4ddd-b087-3b9d1512a0c4 tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] [instance: 41ce739e-9d85-4d8c-980b-b6845d39e31c] Took 0.72 seconds to destroy the instance on the hypervisor.
Nov 29 16:12:32 user nova-compute[75245]: DEBUG oslo.service.loopingcall [None req-87783d82-f812-4ddd-b087-3b9d1512a0c4 tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75245) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 16:12:32 user nova-compute[75245]: DEBUG nova.compute.manager [-] [instance: 41ce739e-9d85-4d8c-980b-b6845d39e31c] Deallocating network for instance {{(pid=75245) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 16:12:32 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: 41ce739e-9d85-4d8c-980b-b6845d39e31c] deallocate_for_instance() {{(pid=75245) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 16:12:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:32 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: 41ce739e-9d85-4d8c-980b-b6845d39e31c] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:12:32 user nova-compute[75245]: INFO nova.compute.manager [-] [instance: 41ce739e-9d85-4d8c-980b-b6845d39e31c] Took 0.49 seconds to deallocate network for instance.
Nov 29 16:12:32 user nova-compute[75245]: DEBUG nova.compute.manager [req-04575f50-c4bd-4fdb-872f-580d49f523bc req-312e3592-a8e0-4b1e-81db-9a3d17bbf14b service nova] [instance: 41ce739e-9d85-4d8c-980b-b6845d39e31c] Received event network-vif-deleted-e63be854-02c3-4ae4-af88-5d7466611d32 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:12:32 user nova-compute[75245]: INFO nova.compute.manager [req-04575f50-c4bd-4fdb-872f-580d49f523bc req-312e3592-a8e0-4b1e-81db-9a3d17bbf14b service nova] [instance: 41ce739e-9d85-4d8c-980b-b6845d39e31c] Neutron deleted interface e63be854-02c3-4ae4-af88-5d7466611d32; detaching it from the instance and deleting it from the info cache
Nov 29 16:12:32 user nova-compute[75245]: DEBUG nova.network.neutron [req-04575f50-c4bd-4fdb-872f-580d49f523bc req-312e3592-a8e0-4b1e-81db-9a3d17bbf14b service nova] [instance: 41ce739e-9d85-4d8c-980b-b6845d39e31c] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:12:32 user nova-compute[75245]: DEBUG nova.compute.manager [req-04575f50-c4bd-4fdb-872f-580d49f523bc req-312e3592-a8e0-4b1e-81db-9a3d17bbf14b service nova] [instance: 41ce739e-9d85-4d8c-980b-b6845d39e31c] Detach interface failed, port_id=e63be854-02c3-4ae4-af88-5d7466611d32, reason: Instance 41ce739e-9d85-4d8c-980b-b6845d39e31c could not be found. {{(pid=75245) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 16:12:32 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-87783d82-f812-4ddd-b087-3b9d1512a0c4 tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:12:32 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-87783d82-f812-4ddd-b087-3b9d1512a0c4 tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:12:33 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-87783d82-f812-4ddd-b087-3b9d1512a0c4 tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:12:33 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-87783d82-f812-4ddd-b087-3b9d1512a0c4 tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:12:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-87783d82-f812-4ddd-b087-3b9d1512a0c4 tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.329s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:12:33 user nova-compute[75245]: INFO nova.scheduler.client.report [None req-87783d82-f812-4ddd-b087-3b9d1512a0c4 tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] Deleted allocations for instance 41ce739e-9d85-4d8c-980b-b6845d39e31c
Nov 29 16:12:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-87783d82-f812-4ddd-b087-3b9d1512a0c4 tempest-VolumesActionsTest-1821015742 tempest-VolumesActionsTest-1821015742-project-member] Lock "41ce739e-9d85-4d8c-980b-b6845d39e31c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.821s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:12:33 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:34 user nova-compute[75245]: DEBUG nova.compute.manager [req-e8084bee-8ecc-420f-8831-1d30e413db0b req-61606ce0-be83-4ab5-8e62-cb3fe92a9b68 service nova] [instance: 41ce739e-9d85-4d8c-980b-b6845d39e31c] Received event network-vif-plugged-e63be854-02c3-4ae4-af88-5d7466611d32 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:12:34 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-e8084bee-8ecc-420f-8831-1d30e413db0b req-61606ce0-be83-4ab5-8e62-cb3fe92a9b68 service nova] Acquiring lock "41ce739e-9d85-4d8c-980b-b6845d39e31c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:12:34 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-e8084bee-8ecc-420f-8831-1d30e413db0b req-61606ce0-be83-4ab5-8e62-cb3fe92a9b68 service nova] Lock "41ce739e-9d85-4d8c-980b-b6845d39e31c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:12:34 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-e8084bee-8ecc-420f-8831-1d30e413db0b req-61606ce0-be83-4ab5-8e62-cb3fe92a9b68 service nova] Lock "41ce739e-9d85-4d8c-980b-b6845d39e31c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:12:34 user nova-compute[75245]: DEBUG nova.compute.manager [req-e8084bee-8ecc-420f-8831-1d30e413db0b req-61606ce0-be83-4ab5-8e62-cb3fe92a9b68 service nova] [instance: 41ce739e-9d85-4d8c-980b-b6845d39e31c] No waiting events found dispatching network-vif-plugged-e63be854-02c3-4ae4-af88-5d7466611d32 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:12:34 user nova-compute[75245]: WARNING nova.compute.manager [req-e8084bee-8ecc-420f-8831-1d30e413db0b req-61606ce0-be83-4ab5-8e62-cb3fe92a9b68 service nova] [instance: 41ce739e-9d85-4d8c-980b-b6845d39e31c] Received unexpected event network-vif-plugged-e63be854-02c3-4ae4-af88-5d7466611d32 for instance with vm_state deleted and task_state None.
Nov 29 16:12:35 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:37 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:37 user nova-compute[75245]: DEBUG nova.compute.manager [None req-4095d140-5e4e-4e4d-a0aa-3ab4ab26dd99 tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rUSaphLT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e3fea3d2-6db1-4766-ad5b-9ad1e728ea10', 'attached_at': '', 'detached_at': '', 'volume_id': '9bcd2fed-1ce1-4028-9482-2f5695d71b49', 'serial': '9bcd2fed-1ce1-4028-9482-2f5695d71b49'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oyrKtafB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'e3fea3d2-6db1-4766-ad5b-9ad1e728ea10', 'attached_at': '', 'detached_at': '', 'volume_id': '20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb', 'serial'} {{(pid=75245) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 29 16:12:37 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4095d140-5e4e-4e4d-a0aa-3ab4ab26dd99 tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] Calling os-brick to attach iSCSI Volume {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 16:12:37 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-4095d140-5e4e-4e4d-a0aa-3ab4ab26dd99 tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rUSaphLT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:12:37 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-4095d140-5e4e-4e4d-a0aa-3ab4ab26dd99 tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:12:37 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-4095d140-5e4e-4e4d-a0aa-3ab4ab26dd99 tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:12:37 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-4095d140-5e4e-4e4d-a0aa-3ab4ab26dd99 tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:12:37 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-4095d140-5e4e-4e4d-a0aa-3ab4ab26dd99 tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:12:37 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-4095d140-5e4e-4e4d-a0aa-3ab4ab26dd99 tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:12:37 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-4095d140-5e4e-4e4d-a0aa-3ab4ab26dd99 tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:12:37 user nova-compute[75245]: INFO os_brick.initiator.connectors.iscsi [None req-4095d140-5e4e-4e4d-a0aa-3ab4ab26dd99 tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 16:12:37 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49 -p 172.16.0.220:3260 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:37 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:37 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0064d7e-980c-4d88-8f90-13ebb5819a25]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:37 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-4095d140-5e4e-4e4d-a0aa-3ab4ab26dd99 tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 16:12:37 user nova-compute[75245]:  {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:12:37 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49 -p 172.16.0.220:3260 --interface default --op new {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:37 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:37 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[3043f520-db7c-4647-b87c-359406392533]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49] added\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:37 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-4095d140-5e4e-4e4d-a0aa-3ab4ab26dd99 tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49] added
Nov 29 16:12:37 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:12:37 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:37 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:37 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[458d8470-ba69-4bcc-a804-2b0d4475b366]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:37 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-4095d140-5e4e-4e4d-a0aa-3ab4ab26dd99 tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:12:37 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:37 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:37 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd4c237-2e17-48a2-911b-858549408f31]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:37 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-4095d140-5e4e-4e4d-a0aa-3ab4ab26dd99 tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:12:37 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rUSaphLT {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:37 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:37 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rUSaphLT" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:37 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe607b3-8e2c-4cad-bfd1-08337efc4de8]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:37 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-4095d140-5e4e-4e4d-a0aa-3ab4ab26dd99 tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rUSaphLT'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:12:37 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:37 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:37 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[e83e7eee-95a7-4eba-a0af-cc5ecf8ef60d]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:37 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-4095d140-5e4e-4e4d-a0aa-3ab4ab26dd99 tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:12:37 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:37 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:37 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[14bb655f-3108-44fa-b383-bab9ed2d82fb]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c57cd57f-133d-4ec5-be2c-40dd8bd226cb (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:37 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-4095d140-5e4e-4e4d-a0aa-3ab4ab26dd99 tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 (non-flash)
Nov 29 16:12:37 user nova-compute[75245]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311 (non-flash)
Nov 29 16:12:37 user nova-compute[75245]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63 (non-flash)
Nov 29 16:12:37 user nova-compute[75245]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c57cd57f-133d-4ec5-be2c-40dd8bd226cb (non-flash)
Nov 29 16:12:37 user nova-compute[75245]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb (non-flash)
Nov 29 16:12:37 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:12:37 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-4095d140-5e4e-4e4d-a0aa-3ab4ab26dd99 tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 (non-flash)
Nov 29 16:12:37 user nova-compute[75245]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311 (non-flash)
Nov 29 16:12:37 user nova-compute[75245]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63 (non-flash)
Nov 29 16:12:37 user nova-compute[75245]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c57cd57f-133d-4ec5-be2c-40dd8bd226cb (non-flash)
Nov 29 16:12:37 user nova-compute[75245]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb (non-flash)
Nov 29 16:12:37 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:12:37 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49 -p 172.16.0.220:3260 --login {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:37 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:37 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8aafe3-51bf-4cf3-937b-1766a8522681]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:37 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-4095d140-5e4e-4e4d-a0aa-3ab4ab26dd99 tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49, portal: 172.16.0.220,3260]
Nov 29 16:12:37 user nova-compute[75245]: Login to [iface: default, target: iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49, portal: 172.16.0.220,3260] successful.
Nov 29 16:12:37 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:12:37 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:37 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:37 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[8141e527-6602-4f06-90da-f02686a46c7c]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:37 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-4095d140-5e4e-4e4d-a0aa-3ab4ab26dd99 tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:12:37 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:37 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:37 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6568afa-23b2-4755-9c01-eb50856e1e63]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c57cd57f-133d-4ec5-be2c-40dd8bd226cb (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:37 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-4095d140-5e4e-4e4d-a0aa-3ab4ab26dd99 tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 (non-flash)
Nov 29 16:12:37 user nova-compute[75245]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311 (non-flash)
Nov 29 16:12:37 user nova-compute[75245]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63 (non-flash)
Nov 29 16:12:37 user nova-compute[75245]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c57cd57f-133d-4ec5-be2c-40dd8bd226cb (non-flash)
Nov 29 16:12:37 user nova-compute[75245]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb (non-flash)
Nov 29 16:12:37 user nova-compute[75245]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49 (non-flash)
Nov 29 16:12:37 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:12:37 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-4095d140-5e4e-4e4d-a0aa-3ab4ab26dd99 tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 (non-flash)
Nov 29 16:12:37 user nova-compute[75245]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311 (non-flash)
Nov 29 16:12:37 user nova-compute[75245]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63 (non-flash)
Nov 29 16:12:37 user nova-compute[75245]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c57cd57f-133d-4ec5-be2c-40dd8bd226cb (non-flash)
Nov 29 16:12:37 user nova-compute[75245]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb (non-flash)
Nov 29 16:12:37 user nova-compute[75245]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49 (non-flash)
Nov 29 16:12:37 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:12:37 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-4095d140-5e4e-4e4d-a0aa-3ab4ab26dd99 tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.329s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:12:37 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-4095d140-5e4e-4e4d-a0aa-3ab4ab26dd99 tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] Connected to 172.16.0.220:3260 {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 16:12:37 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-4095d140-5e4e-4e4d-a0aa-3ab4ab26dd99 tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=75245) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 16:12:37 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-4095d140-5e4e-4e4d-a0aa-3ab4ab26dd99 tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] Scanning host 38 c: -, t: -, l: 0) {{(pid=75245) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 16:12:37 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:37 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:37 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[623554bd-0d8c-4e95-927b-45bc6ef27c8f]: (4, ('- - 0', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:37 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-4095d140-5e4e-4e4d-a0aa-3ab4ab26dd99 tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75245) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 16:12:37 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-4095d140-5e4e-4e4d-a0aa-3ab4ab26dd99 tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rUSaphLT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 16:12:38 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-4095d140-5e4e-4e4d-a0aa-3ab4ab26dd99 tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.368s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:12:38 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-4095d140-5e4e-4e4d-a0aa-3ab4ab26dd99 tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] <== connect_volume: return (1369ms) {'type': 'block', 'scsi_wwn': '26161326436636433', 'path': '/dev/sdg'} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:12:38 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4095d140-5e4e-4e4d-a0aa-3ab4ab26dd99 tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161326436636433', 'path': '/dev/sdg'} {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 16:12:38 user nova-compute[75245]: DEBUG nova.objects.instance [None req-4095d140-5e4e-4e4d-a0aa-3ab4ab26dd99 tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] Lazy-loading 'flavor' on Instance uuid e3fea3d2-6db1-4766-ad5b-9ad1e728ea10 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:12:39 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-4095d140-5e4e-4e4d-a0aa-3ab4ab26dd99 tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75245) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 16:12:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d5172343-715c-4028-9eb6-2c4748b16886 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] Acquiring lock "06ccc13b-8769-4c8b-9f9c-b9c26c8f7778" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:12:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d5172343-715c-4028-9eb6-2c4748b16886 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] Lock "06ccc13b-8769-4c8b-9f9c-b9c26c8f7778" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:12:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d5172343-715c-4028-9eb6-2c4748b16886 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] Acquiring lock "06ccc13b-8769-4c8b-9f9c-b9c26c8f7778-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:12:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d5172343-715c-4028-9eb6-2c4748b16886 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] Lock "06ccc13b-8769-4c8b-9f9c-b9c26c8f7778-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:12:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d5172343-715c-4028-9eb6-2c4748b16886 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] Lock "06ccc13b-8769-4c8b-9f9c-b9c26c8f7778-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:12:39 user nova-compute[75245]: INFO nova.compute.manager [None req-d5172343-715c-4028-9eb6-2c4748b16886 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] [instance: 06ccc13b-8769-4c8b-9f9c-b9c26c8f7778] Terminating instance
Nov 29 16:12:39 user nova-compute[75245]: DEBUG nova.compute.manager [None req-d5172343-715c-4028-9eb6-2c4748b16886 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] [instance: 06ccc13b-8769-4c8b-9f9c-b9c26c8f7778] Start destroying the instance on the hypervisor. {{(pid=75245) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 16:12:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:39 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-4095d140-5e4e-4e4d-a0aa-3ab4ab26dd99 tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] COPY block job progress, current cursor: 127926272 final cursor: 1073741824 {{(pid=75245) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 16:12:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:40 user nova-compute[75245]: DEBUG nova.compute.manager [req-a32d8992-b261-448b-a6e6-d72276ef3a7b req-c77efa04-831e-434d-a672-ac51e68b990c service nova] [instance: 06ccc13b-8769-4c8b-9f9c-b9c26c8f7778] Received event network-vif-unplugged-d21b7d48-b9e1-40d9-9dd9-3f04e172d8b6 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:12:40 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a32d8992-b261-448b-a6e6-d72276ef3a7b req-c77efa04-831e-434d-a672-ac51e68b990c service nova] Acquiring lock "06ccc13b-8769-4c8b-9f9c-b9c26c8f7778-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:12:40 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a32d8992-b261-448b-a6e6-d72276ef3a7b req-c77efa04-831e-434d-a672-ac51e68b990c service nova] Lock "06ccc13b-8769-4c8b-9f9c-b9c26c8f7778-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:12:40 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a32d8992-b261-448b-a6e6-d72276ef3a7b req-c77efa04-831e-434d-a672-ac51e68b990c service nova] Lock "06ccc13b-8769-4c8b-9f9c-b9c26c8f7778-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:12:40 user nova-compute[75245]: DEBUG nova.compute.manager [req-a32d8992-b261-448b-a6e6-d72276ef3a7b req-c77efa04-831e-434d-a672-ac51e68b990c service nova] [instance: 06ccc13b-8769-4c8b-9f9c-b9c26c8f7778] No waiting events found dispatching network-vif-unplugged-d21b7d48-b9e1-40d9-9dd9-3f04e172d8b6 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:12:40 user nova-compute[75245]: DEBUG nova.compute.manager [req-a32d8992-b261-448b-a6e6-d72276ef3a7b req-c77efa04-831e-434d-a672-ac51e68b990c service nova] [instance: 06ccc13b-8769-4c8b-9f9c-b9c26c8f7778] Received event network-vif-unplugged-d21b7d48-b9e1-40d9-9dd9-3f04e172d8b6 for instance with task_state deleting. {{(pid=75245) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 16:12:40 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:40 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-4095d140-5e4e-4e4d-a0aa-3ab4ab26dd99 tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] COPY block job progress, current cursor: 294649856 final cursor: 1073741824 {{(pid=75245) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 16:12:40 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 06ccc13b-8769-4c8b-9f9c-b9c26c8f7778] Instance destroyed successfully.
Nov 29 16:12:40 user nova-compute[75245]: DEBUG nova.objects.instance [None req-d5172343-715c-4028-9eb6-2c4748b16886 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] Lazy-loading 'resources' on Instance uuid 06ccc13b-8769-4c8b-9f9c-b9c26c8f7778 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:12:40 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-d5172343-715c-4028-9eb6-2c4748b16886 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:10:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-805162112',display_name='tempest-VolumesNegativeTest-instance-805162112',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-805162112',id=9,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:10:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a33a1fecac724d6f8baaa28f253bcc5f',ramdisk_id='',reservation_id='r-wtm3qtb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-591560084',owner_user_name='tempest-VolumesNegativeTest-591560084-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:10:59Z,user_data=None,user_id='d8e392186cf44341b3f7491662dc6b2a',uuid=06ccc13b-8769-4c8b-9f9c-b9c26c8f7778,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d21b7d48-b9e1-40d9-9dd9-3f04e172d8b6", "address": "fa:16:3e:91:06:a7", "network": {"id": "6de7b493-9ee2-479f-8e5b-7624f9fffc60", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ffdbebd41351498089cb0fadd3b40e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd21b7d48-b9", "ovs_interfaceid": "d21b7d48-b9e1-40d9-9dd9-3f04e172d8b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 16:12:40 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-d5172343-715c-4028-9eb6-2c4748b16886 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] Converting VIF {"id": "d21b7d48-b9e1-40d9-9dd9-3f04e172d8b6", "address": "fa:16:3e:91:06:a7", "network": {"id": "6de7b493-9ee2-479f-8e5b-7624f9fffc60", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ffdbebd41351498089cb0fadd3b40e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd21b7d48-b9", "ovs_interfaceid": "d21b7d48-b9e1-40d9-9dd9-3f04e172d8b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:12:40 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-d5172343-715c-4028-9eb6-2c4748b16886 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:06:a7,bridge_name='br-int',has_traffic_filtering=True,id=d21b7d48-b9e1-40d9-9dd9-3f04e172d8b6,network=Network(6de7b493-9ee2-479f-8e5b-7624f9fffc60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd21b7d48-b9') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:12:40 user nova-compute[75245]: DEBUG os_vif [None req-d5172343-715c-4028-9eb6-2c4748b16886 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:06:a7,bridge_name='br-int',has_traffic_filtering=True,id=d21b7d48-b9e1-40d9-9dd9-3f04e172d8b6,network=Network(6de7b493-9ee2-479f-8e5b-7624f9fffc60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd21b7d48-b9') {{(pid=75245) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 16:12:40 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:40 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd21b7d48-b9, bridge=br-int, if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:12:40 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:40 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:12:40 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:40 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9539e7cd-6b45-4b93-a9bb-c21ad5dfcae2) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:12:40 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:40 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:40 user nova-compute[75245]: INFO os_vif [None req-d5172343-715c-4028-9eb6-2c4748b16886 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:06:a7,bridge_name='br-int',has_traffic_filtering=True,id=d21b7d48-b9e1-40d9-9dd9-3f04e172d8b6,network=Network(6de7b493-9ee2-479f-8e5b-7624f9fffc60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd21b7d48-b9')
Nov 29 16:12:40 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-d5172343-715c-4028-9eb6-2c4748b16886 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] [instance: 06ccc13b-8769-4c8b-9f9c-b9c26c8f7778] Deleting instance files /opt/stack/data/nova/instances/06ccc13b-8769-4c8b-9f9c-b9c26c8f7778_del
Nov 29 16:12:40 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-d5172343-715c-4028-9eb6-2c4748b16886 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] [instance: 06ccc13b-8769-4c8b-9f9c-b9c26c8f7778] Deletion of /opt/stack/data/nova/instances/06ccc13b-8769-4c8b-9f9c-b9c26c8f7778_del complete
Nov 29 16:12:40 user nova-compute[75245]: INFO nova.compute.manager [None req-d5172343-715c-4028-9eb6-2c4748b16886 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] [instance: 06ccc13b-8769-4c8b-9f9c-b9c26c8f7778] Took 1.11 seconds to destroy the instance on the hypervisor.
Nov 29 16:12:40 user nova-compute[75245]: DEBUG oslo.service.loopingcall [None req-d5172343-715c-4028-9eb6-2c4748b16886 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75245) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 16:12:40 user nova-compute[75245]: DEBUG nova.compute.manager [-] [instance: 06ccc13b-8769-4c8b-9f9c-b9c26c8f7778] Deallocating network for instance {{(pid=75245) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 16:12:40 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: 06ccc13b-8769-4c8b-9f9c-b9c26c8f7778] deallocate_for_instance() {{(pid=75245) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 16:12:40 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-4095d140-5e4e-4e4d-a0aa-3ab4ab26dd99 tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] COPY block job progress, current cursor: 435159040 final cursor: 1073741824 {{(pid=75245) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 16:12:41 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-4095d140-5e4e-4e4d-a0aa-3ab4ab26dd99 tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] COPY block job progress, current cursor: 578813952 final cursor: 1073741824 {{(pid=75245) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 16:12:41 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66149aaa-2c50-4648-9883-5fdae5e31ac9 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] Calling os-brick to attach iSCSI Volume {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 16:12:41 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-66149aaa-2c50-4648-9883-5fdae5e31ac9 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jsHcbInE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:12:41 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-66149aaa-2c50-4648-9883-5fdae5e31ac9 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:12:41 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-66149aaa-2c50-4648-9883-5fdae5e31ac9 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:12:41 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-66149aaa-2c50-4648-9883-5fdae5e31ac9 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:12:41 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-66149aaa-2c50-4648-9883-5fdae5e31ac9 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:12:41 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-66149aaa-2c50-4648-9883-5fdae5e31ac9 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:12:41 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-66149aaa-2c50-4648-9883-5fdae5e31ac9 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:12:41 user nova-compute[75245]: INFO os_brick.initiator.connectors.iscsi [None req-66149aaa-2c50-4648-9883-5fdae5e31ac9 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 16:12:41 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1 -p 172.16.0.220:3260 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:41 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:41 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27ba436-ade9-4398-bc22-0890806ef284]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:41 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-66149aaa-2c50-4648-9883-5fdae5e31ac9 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 16:12:41 user nova-compute[75245]:  {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:12:41 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:41 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:41 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f67a0a5-1b8c-457a-a0e4-e29505f94fa4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1] added\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:41 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-66149aaa-2c50-4648-9883-5fdae5e31ac9 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1] added
Nov 29 16:12:41 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:12:41 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:41 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:41 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c0dd4e7-f34d-4239-9711-c87377dc2b58]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:41 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-66149aaa-2c50-4648-9883-5fdae5e31ac9 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:12:41 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:41 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:41 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b19d60-a949-4e92-9562-90cfacfa9141]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:41 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-66149aaa-2c50-4648-9883-5fdae5e31ac9 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:12:41 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jsHcbInE {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:41 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jsHcbInE" returned: 0 in 0.027s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:41 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[af758969-7c59-44d1-8418-c8c3c3698732]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:41 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-66149aaa-2c50-4648-9883-5fdae5e31ac9 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jsHcbInE'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:12:41 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:41 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:41 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[62436ec2-2ec5-491e-bf77-6a1a3c199a8f]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:41 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-66149aaa-2c50-4648-9883-5fdae5e31ac9 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:12:41 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:41 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:41 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1184860-3789-4058-b4f8-8fe0a2ba233a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c57cd57f-133d-4ec5-be2c-40dd8bd226cb (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:41 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-66149aaa-2c50-4648-9883-5fdae5e31ac9 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 (non-flash)
Nov 29 16:12:41 user nova-compute[75245]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311 (non-flash)
Nov 29 16:12:41 user nova-compute[75245]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63 (non-flash)
Nov 29 16:12:41 user nova-compute[75245]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c57cd57f-133d-4ec5-be2c-40dd8bd226cb (non-flash)
Nov 29 16:12:41 user nova-compute[75245]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb (non-flash)
Nov 29 16:12:41 user nova-compute[75245]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49 (non-flash)
Nov 29 16:12:41 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:12:41 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-66149aaa-2c50-4648-9883-5fdae5e31ac9 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 (non-flash)
Nov 29 16:12:41 user nova-compute[75245]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311 (non-flash)
Nov 29 16:12:41 user nova-compute[75245]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63 (non-flash)
Nov 29 16:12:41 user nova-compute[75245]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c57cd57f-133d-4ec5-be2c-40dd8bd226cb (non-flash)
Nov 29 16:12:41 user nova-compute[75245]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb (non-flash)
Nov 29 16:12:41 user nova-compute[75245]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49 (non-flash)
Nov 29 16:12:41 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:12:41 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1 -p 172.16.0.220:3260 --login {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:41 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-4095d140-5e4e-4e4d-a0aa-3ab4ab26dd99 tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] COPY block job progress, current cursor: 732954624 final cursor: 1073741824 {{(pid=75245) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 16:12:41 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1 -p 172.16.0.220:3260 --login" returned: 0 in 0.096s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:41 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[abec2e9e-321b-4860-87be-431dfe8fd514]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:41 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-66149aaa-2c50-4648-9883-5fdae5e31ac9 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1, portal: 172.16.0.220,3260]
Nov 29 16:12:41 user nova-compute[75245]: Login to [iface: default, target: iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1, portal: 172.16.0.220,3260] successful.
Nov 29 16:12:41 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:12:41 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:41 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:41 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e8757a-328f-423b-bd59-6dba12778ac1]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:41 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-66149aaa-2c50-4648-9883-5fdae5e31ac9 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:12:41 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:42 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:42 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0f5edb-a177-4db6-b7a6-63ed7c220396]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c57cd57f-133d-4ec5-be2c-40dd8bd226cb (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:42 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-66149aaa-2c50-4648-9883-5fdae5e31ac9 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 (non-flash)
Nov 29 16:12:42 user nova-compute[75245]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311 (non-flash)
Nov 29 16:12:42 user nova-compute[75245]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63 (non-flash)
Nov 29 16:12:42 user nova-compute[75245]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c57cd57f-133d-4ec5-be2c-40dd8bd226cb (non-flash)
Nov 29 16:12:42 user nova-compute[75245]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb (non-flash)
Nov 29 16:12:42 user nova-compute[75245]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49 (non-flash)
Nov 29 16:12:42 user nova-compute[75245]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1 (non-flash)
Nov 29 16:12:42 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:12:42 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-66149aaa-2c50-4648-9883-5fdae5e31ac9 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 (non-flash)
Nov 29 16:12:42 user nova-compute[75245]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311 (non-flash)
Nov 29 16:12:42 user nova-compute[75245]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63 (non-flash)
Nov 29 16:12:42 user nova-compute[75245]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c57cd57f-133d-4ec5-be2c-40dd8bd226cb (non-flash)
Nov 29 16:12:42 user nova-compute[75245]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb (non-flash)
Nov 29 16:12:42 user nova-compute[75245]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49 (non-flash)
Nov 29 16:12:42 user nova-compute[75245]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1 (non-flash)
Nov 29 16:12:42 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:12:42 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-66149aaa-2c50-4648-9883-5fdae5e31ac9 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.384s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:12:42 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-66149aaa-2c50-4648-9883-5fdae5e31ac9 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] Connected to 172.16.0.220:3260 {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 16:12:42 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-66149aaa-2c50-4648-9883-5fdae5e31ac9 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=75245) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 16:12:42 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-66149aaa-2c50-4648-9883-5fdae5e31ac9 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] Scanning host 39 c: -, t: -, l: 0) {{(pid=75245) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 16:12:42 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:42 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.022s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:42 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0c6fe4-d88a-4bb5-a75a-20cad95d87ce]: (4, ('- - 0', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:42 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-66149aaa-2c50-4648-9883-5fdae5e31ac9 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: None {{(pid=75245) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 16:12:42 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: 06ccc13b-8769-4c8b-9f9c-b9c26c8f7778] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:12:42 user nova-compute[75245]: INFO nova.compute.manager [-] [instance: 06ccc13b-8769-4c8b-9f9c-b9c26c8f7778] Took 1.38 seconds to deallocate network for instance.
Nov 29 16:12:42 user nova-compute[75245]: DEBUG nova.compute.manager [req-53760fd2-401a-480e-8da0-f63760d7c6b9 req-dedb602f-dd4f-4292-85f1-e22e1ad06443 service nova] [instance: 06ccc13b-8769-4c8b-9f9c-b9c26c8f7778] Received event network-vif-deleted-d21b7d48-b9e1-40d9-9dd9-3f04e172d8b6 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:12:42 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d5172343-715c-4028-9eb6-2c4748b16886 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:12:42 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d5172343-715c-4028-9eb6-2c4748b16886 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:12:42 user nova-compute[75245]: DEBUG nova.compute.manager [req-6efb039e-fa99-45e0-acd8-f03343e55b97 req-9788cef0-3208-4e3a-b0ab-c92aa268668c service nova] [instance: 06ccc13b-8769-4c8b-9f9c-b9c26c8f7778] Received event network-vif-plugged-d21b7d48-b9e1-40d9-9dd9-3f04e172d8b6 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:12:42 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-6efb039e-fa99-45e0-acd8-f03343e55b97 req-9788cef0-3208-4e3a-b0ab-c92aa268668c service nova] Acquiring lock "06ccc13b-8769-4c8b-9f9c-b9c26c8f7778-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:12:42 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-6efb039e-fa99-45e0-acd8-f03343e55b97 req-9788cef0-3208-4e3a-b0ab-c92aa268668c service nova] Lock "06ccc13b-8769-4c8b-9f9c-b9c26c8f7778-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:12:42 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-6efb039e-fa99-45e0-acd8-f03343e55b97 req-9788cef0-3208-4e3a-b0ab-c92aa268668c service nova] Lock "06ccc13b-8769-4c8b-9f9c-b9c26c8f7778-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:12:42 user nova-compute[75245]: DEBUG nova.compute.manager [req-6efb039e-fa99-45e0-acd8-f03343e55b97 req-9788cef0-3208-4e3a-b0ab-c92aa268668c service nova] [instance: 06ccc13b-8769-4c8b-9f9c-b9c26c8f7778] No waiting events found dispatching network-vif-plugged-d21b7d48-b9e1-40d9-9dd9-3f04e172d8b6 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:12:42 user nova-compute[75245]: WARNING nova.compute.manager [req-6efb039e-fa99-45e0-acd8-f03343e55b97 req-9788cef0-3208-4e3a-b0ab-c92aa268668c service nova] [instance: 06ccc13b-8769-4c8b-9f9c-b9c26c8f7778] Received unexpected event network-vif-plugged-d21b7d48-b9e1-40d9-9dd9-3f04e172d8b6 for instance with vm_state deleted and task_state None.
Nov 29 16:12:42 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-4095d140-5e4e-4e4d-a0aa-3ab4ab26dd99 tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] COPY block job progress, current cursor: 865075200 final cursor: 1073741824 {{(pid=75245) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 16:12:42 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:42 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-d5172343-715c-4028-9eb6-2c4748b16886 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:12:42 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-d5172343-715c-4028-9eb6-2c4748b16886 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:12:42 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d5172343-715c-4028-9eb6-2c4748b16886 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.466s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:12:42 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-7e6d022d-a167-4d85-bda8-1e89afbb98e1 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 36728d4f-925b-46a3-b4b5-17f14b9c99c3 is timed out.
Nov 29 16:12:42 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-7e6d022d-a167-4d85-bda8-1e89afbb98e1 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Successfully detached device vdb from instance 36728d4f-925b-46a3-b4b5-17f14b9c99c3 from the live domain config.
Nov 29 16:12:42 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e6d022d-a167-4d85-bda8-1e89afbb98e1 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] calling os-brick to detach iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 16:12:42 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6d022d-a167-4d85-bda8-1e89afbb98e1 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, {'target_iqn': 'iqn.2010-10.org.openstack:c57cd57f-133d-4ec5-be2c-40dd8bd226cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rlchEgiW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:12:42 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-7e6d022d-a167-4d85-bda8-1e89afbb98e1 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:12:42 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-7e6d022d-a167-4d85-bda8-1e89afbb98e1 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:12:42 user nova-compute[75245]: INFO nova.scheduler.client.report [None req-d5172343-715c-4028-9eb6-2c4748b16886 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] Deleted allocations for instance 06ccc13b-8769-4c8b-9f9c-b9c26c8f7778
Nov 29 16:12:42 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-4095d140-5e4e-4e4d-a0aa-3ab4ab26dd99 tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] COPY block job progress, current cursor: 1011875840 final cursor: 1073741824 {{(pid=75245) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d5172343-715c-4028-9eb6-2c4748b16886 tempest-VolumesNegativeTest-591560084 tempest-VolumesNegativeTest-591560084-project-member] Lock "06ccc13b-8769-4c8b-9f9c-b9c26c8f7778" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.285s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-66149aaa-2c50-4648-9883-5fdae5e31ac9 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75245) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-66149aaa-2c50-4648-9883-5fdae5e31ac9 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jsHcbInE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-66149aaa-2c50-4648-9883-5fdae5e31ac9 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.425s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-66149aaa-2c50-4648-9883-5fdae5e31ac9 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] <== connect_volume: return (1427ms) {'type': 'block', 'scsi_wwn': '26466633035393434', 'path': '/dev/sdh'} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66149aaa-2c50-4648-9883-5fdae5e31ac9 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26466633035393434', 'path': '/dev/sdh'} {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-7e6d022d-a167-4d85-bda8-1e89afbb98e1 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.147s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG nova.objects.instance [None req-66149aaa-2c50-4648-9883-5fdae5e31ac9 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] Lazy-loading 'flavor' on Instance uuid 55f5b252-468d-4064-99b3-49bdcdf98db8 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[7857d157-b2a5-4757-9705-1fd76cb7dccc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c57cd57f-133d-4ec5-be2c-40dd8bd226cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6d022d-a167-4d85-bda8-1e89afbb98e1 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 16:12:43 user nova-compute[75245]: No targets found.
Nov 29 16:12:43 user nova-compute[75245]: iSNS:
Nov 29 16:12:43 user nova-compute[75245]: No targets found.
Nov 29 16:12:43 user nova-compute[75245]: STATIC:
Nov 29 16:12:43 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678
Nov 29 16:12:43 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:12:43 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:12:43 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1
Nov 29 16:12:43 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:12:43 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:12:43 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:c57cd57f-133d-4ec5-be2c-40dd8bd226cb
Nov 29 16:12:43 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:12:43 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:12:43 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311
Nov 29 16:12:43 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:12:43 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:12:43 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49
Nov 29 16:12:43 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:12:43 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:12:43 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63
Nov 29 16:12:43 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:12:43 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:12:43 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb
Nov 29 16:12:43 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:12:43 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:12:43 user nova-compute[75245]: FIRMWARE:
Nov 29 16:12:43 user nova-compute[75245]: No targets found.
Nov 29 16:12:43 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6d022d-a167-4d85-bda8-1e89afbb98e1 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 16:12:43 user nova-compute[75245]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 16:12:43 user nova-compute[75245]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75245) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6d022d-a167-4d85-bda8-1e89afbb98e1 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c57cd57f-133d-4ec5-be2c-40dd8bd226cb', 0)] {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f0fbd6-2f59-485c-a4ee-4d1bcccc4506]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c57cd57f-133d-4ec5-be2c-40dd8bd226cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-66149aaa-2c50-4648-9883-5fdae5e31ac9 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] attach device xml: <disk type="block" device="disk">
Nov 29 16:12:43 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:12:43 user nova-compute[75245]:   <source dev="/dev/sdh"/>
Nov 29 16:12:43 user nova-compute[75245]:   <target dev="vdb" bus="virtio"/>
Nov 29 16:12:43 user nova-compute[75245]:   <serial>d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1</serial>
Nov 29 16:12:43 user nova-compute[75245]: </disk>
Nov 29 16:12:43 user nova-compute[75245]:  {{(pid=75245) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4ae315-fc1f-4424-aa8f-9550632d4c9e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c57cd57f-133d-4ec5-be2c-40dd8bd226cb (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6d022d-a167-4d85-bda8-1e89afbb98e1 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 (non-flash)
Nov 29 16:12:43 user nova-compute[75245]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311 (non-flash)
Nov 29 16:12:43 user nova-compute[75245]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63 (non-flash)
Nov 29 16:12:43 user nova-compute[75245]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c57cd57f-133d-4ec5-be2c-40dd8bd226cb (non-flash)
Nov 29 16:12:43 user nova-compute[75245]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb (non-flash)
Nov 29 16:12:43 user nova-compute[75245]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49 (non-flash)
Nov 29 16:12:43 user nova-compute[75245]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1 (non-flash)
Nov 29 16:12:43 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6d022d-a167-4d85-bda8-1e89afbb98e1 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 (non-flash)
Nov 29 16:12:43 user nova-compute[75245]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311 (non-flash)
Nov 29 16:12:43 user nova-compute[75245]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63 (non-flash)
Nov 29 16:12:43 user nova-compute[75245]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c57cd57f-133d-4ec5-be2c-40dd8bd226cb (non-flash)
Nov 29 16:12:43 user nova-compute[75245]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb (non-flash)
Nov 29 16:12:43 user nova-compute[75245]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49 (non-flash)
Nov 29 16:12:43 user nova-compute[75245]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1 (non-flash)
Nov 29 16:12:43 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6d022d-a167-4d85-bda8-1e89afbb98e1 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0d4d43dcf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c57cd57f-133d-4ec5-be2c-40dd8bd226cb'): ({'sde'}, set())}) {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-7e6d022d-a167-4d85-bda8-1e89afbb98e1 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Removing single pathed devices sde {{(pid=75245) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[679e1579-d74b-4310-8126-0a05e6b56940]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea470eb-fff0-4585-81d6-7aed9b0845ec]: (4, ('ok\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-7e6d022d-a167-4d85-bda8-1e89afbb98e1 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Flushing IO for device /dev/sde {{(pid=75245) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a610481-7ee4-4f30-89cc-cc1102466d4d]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-7e6d022d-a167-4d85-bda8-1e89afbb98e1 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75245) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.050s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb421e4-b423-4ade-be64-d2d247d4976b]: (4, ('1', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-7e6d022d-a167-4d85-bda8-1e89afbb98e1 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-7e6d022d-a167-4d85-bda8-1e89afbb98e1 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] SCSI volumes sde have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6d022d-a167-4d85-bda8-1e89afbb98e1 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c57cd57f-133d-4ec5-be2c-40dd8bd226cb')] {{(pid=75245) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c57cd57f-133d-4ec5-be2c-40dd8bd226cb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c57cd57f-133d-4ec5-be2c-40dd8bd226cb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[20485c91-f919-4d51-8baf-b501c0a80b57]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6d022d-a167-4d85-bda8-1e89afbb98e1 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c57cd57f-133d-4ec5-be2c-40dd8bd226cb -p 172.16.0.220:3260 --logout {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c57cd57f-133d-4ec5-be2c-40dd8bd226cb -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[305c68bc-c21a-47ff-a0e6-f2de9df2dd3b]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:c57cd57f-133d-4ec5-be2c-40dd8bd226cb, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:c57cd57f-133d-4ec5-be2c-40dd8bd226cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6d022d-a167-4d85-bda8-1e89afbb98e1 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:c57cd57f-133d-4ec5-be2c-40dd8bd226cb, portal: 172.16.0.220,3260]
Nov 29 16:12:43 user nova-compute[75245]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:c57cd57f-133d-4ec5-be2c-40dd8bd226cb, portal: 172.16.0.220,3260] successful.
Nov 29 16:12:43 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c57cd57f-133d-4ec5-be2c-40dd8bd226cb -p 172.16.0.220:3260 --op delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-4095d140-5e4e-4e4d-a0aa-3ab4ab26dd99 tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75245) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c57cd57f-133d-4ec5-be2c-40dd8bd226cb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d22f81-24bf-4ea1-b7e8-9089f13cba53]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6d022d-a167-4d85-bda8-1e89afbb98e1 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-7e6d022d-a167-4d85-bda8-1e89afbb98e1 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.388s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6d022d-a167-4d85-bda8-1e89afbb98e1 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] <== disconnect_volume: return (536ms) None {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e6d022d-a167-4d85-bda8-1e89afbb98e1 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] Disconnected iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-66149aaa-2c50-4648-9883-5fdae5e31ac9 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-66149aaa-2c50-4648-9883-5fdae5e31ac9 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-66149aaa-2c50-4648-9883-5fdae5e31ac9 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] No VIF found with MAC fa:16:3e:ec:7c:03, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4095d140-5e4e-4e4d-a0aa-3ab4ab26dd99 tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] calling os-brick to detach iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-4095d140-5e4e-4e4d-a0aa-3ab4ab26dd99 tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, {'target_iqn': 'iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oyrKtafB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:12:43 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-4095d140-5e4e-4e4d-a0aa-3ab4ab26dd99 tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:12:43 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-4095d140-5e4e-4e4d-a0aa-3ab4ab26dd99 tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-4095d140-5e4e-4e4d-a0aa-3ab4ab26dd99 tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[089635fb-ebd0-443d-880f-db1fdb13a967]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-4095d140-5e4e-4e4d-a0aa-3ab4ab26dd99 tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 16:12:43 user nova-compute[75245]: No targets found.
Nov 29 16:12:43 user nova-compute[75245]: iSNS:
Nov 29 16:12:43 user nova-compute[75245]: No targets found.
Nov 29 16:12:43 user nova-compute[75245]: STATIC:
Nov 29 16:12:43 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678
Nov 29 16:12:43 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:12:43 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:12:43 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1
Nov 29 16:12:43 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:12:43 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:12:43 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311
Nov 29 16:12:43 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:12:43 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:12:43 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49
Nov 29 16:12:43 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:12:43 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:12:43 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63
Nov 29 16:12:43 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:12:43 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:12:43 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb
Nov 29 16:12:43 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:12:43 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:12:43 user nova-compute[75245]: FIRMWARE:
Nov 29 16:12:43 user nova-compute[75245]: No targets found.
Nov 29 16:12:43 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-4095d140-5e4e-4e4d-a0aa-3ab4ab26dd99 tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 16:12:43 user nova-compute[75245]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 16:12:43 user nova-compute[75245]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75245) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-4095d140-5e4e-4e4d-a0aa-3ab4ab26dd99 tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb', 0)] {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1fd91f-02de-4ccd-b704-2b3621c2e48c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91dffec-acf2-45d3-ba66-08b8e76b97a1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-4095d140-5e4e-4e4d-a0aa-3ab4ab26dd99 tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 (non-flash)
Nov 29 16:12:43 user nova-compute[75245]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311 (non-flash)
Nov 29 16:12:43 user nova-compute[75245]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63 (non-flash)
Nov 29 16:12:43 user nova-compute[75245]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb (non-flash)
Nov 29 16:12:43 user nova-compute[75245]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49 (non-flash)
Nov 29 16:12:43 user nova-compute[75245]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1 (non-flash)
Nov 29 16:12:43 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-4095d140-5e4e-4e4d-a0aa-3ab4ab26dd99 tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 (non-flash)
Nov 29 16:12:43 user nova-compute[75245]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311 (non-flash)
Nov 29 16:12:43 user nova-compute[75245]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63 (non-flash)
Nov 29 16:12:43 user nova-compute[75245]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb (non-flash)
Nov 29 16:12:43 user nova-compute[75245]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49 (non-flash)
Nov 29 16:12:43 user nova-compute[75245]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1 (non-flash)
Nov 29 16:12:43 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-4095d140-5e4e-4e4d-a0aa-3ab4ab26dd99 tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0d4c1db640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb'): ({'sdf'}, set())}) {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-4095d140-5e4e-4e4d-a0aa-3ab4ab26dd99 tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] Removing single pathed devices sdf {{(pid=75245) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb3ccfae-2b54-4cd0-b23f-0281b93bbc67]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec20ea14-3483-4190-89dc-9c76762bc294]: (4, ('ok\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-4095d140-5e4e-4e4d-a0aa-3ab4ab26dd99 tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] Flushing IO for device /dev/sdf {{(pid=75245) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[616cb8fd-bb30-4a15-a27b-a3a731daa927]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-4095d140-5e4e-4e4d-a0aa-3ab4ab26dd99 tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75245) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-66149aaa-2c50-4648-9883-5fdae5e31ac9 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] Lock "55f5b252-468d-4064-99b3-49bdcdf98db8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.868s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.054s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c679b1-110e-49ce-89fe-ebaae7ae8fff]: (4, ('1', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-4095d140-5e4e-4e4d-a0aa-3ab4ab26dd99 tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-4095d140-5e4e-4e4d-a0aa-3ab4ab26dd99 tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] SCSI volumes sdf have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-4095d140-5e4e-4e4d-a0aa-3ab4ab26dd99 tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb')] {{(pid=75245) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[205d5f84-7db8-4807-9804-18089d0bb6c9]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-4095d140-5e4e-4e4d-a0aa-3ab4ab26dd99 tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb -p 172.16.0.220:3260 --logout {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef92b9f-8e1c-40e0-88f0-d956d31da102]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-4095d140-5e4e-4e4d-a0aa-3ab4ab26dd99 tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb, portal: 172.16.0.220,3260]
Nov 29 16:12:43 user nova-compute[75245]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb, portal: 172.16.0.220,3260] successful.
Nov 29 16:12:43 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb -p 172.16.0.220:3260 --op delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ca109c-49e4-45e4-ac46-289adcc0a4b6]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-4095d140-5e4e-4e4d-a0aa-3ab4ab26dd99 tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-4095d140-5e4e-4e4d-a0aa-3ab4ab26dd99 tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.379s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-4095d140-5e4e-4e4d-a0aa-3ab4ab26dd99 tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] <== disconnect_volume: return (382ms) None {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:12:43 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4095d140-5e4e-4e4d-a0aa-3ab4ab26dd99 tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] Disconnected iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 16:12:44 user nova-compute[75245]: DEBUG nova.compute.manager [None req-4095d140-5e4e-4e4d-a0aa-3ab4ab26dd99 tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rUSaphLT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': 'e3fea3d2-6db1-4766-ad5b-9ad1e728ea10', 'attached_at': '', 'detached_at': '', 'volume_id': '9bcd2fed-1ce1-4028-9482-2f5695d71b49', 'serial'} {{(pid=75245) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 29 16:12:44 user nova-compute[75245]: DEBUG nova.compute.manager [None req-4095d140-5e4e-4e4d-a0aa-3ab4ab26dd99 tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] swap_volume: removing Cinder connection for volume 20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb {{(pid=75245) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 29 16:12:44 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-d8e55ec5-baf5-45b6-bc7a-4827bc04ec21 tempest-VolumesAssistedSnapshotsTest-1032046954 tempest-VolumesAssistedSnapshotsTest-1032046954-project] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] volume_snapshot_create: create_info: {'snapshot_id': 'bafc0546-669b-4258-8450-2c5c2a3f6e9b', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75245) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 29 16:12:44 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-d8e55ec5-baf5-45b6-bc7a-4827bc04ec21 tempest-VolumesAssistedSnapshotsTest-1032046954 tempest-VolumesAssistedSnapshotsTest-1032046954-project] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] snap xml: <domainsnapshot>
Nov 29 16:12:44 user nova-compute[75245]:   <disks>
Nov 29 16:12:44 user nova-compute[75245]:     <disk name="/dev/sdh" snapshot="external" type="file">
Nov 29 16:12:44 user nova-compute[75245]:       <source file="/dev/new_file"/>
Nov 29 16:12:44 user nova-compute[75245]:     </disk>
Nov 29 16:12:44 user nova-compute[75245]:     <disk name="vda" snapshot="no"/>
Nov 29 16:12:44 user nova-compute[75245]:   </disks>
Nov 29 16:12:44 user nova-compute[75245]: </domainsnapshot>
Nov 29 16:12:44 user nova-compute[75245]:  {{(pid=75245) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 29 16:12:44 user nova-compute[75245]: DEBUG nova.objects.instance [None req-d8e55ec5-baf5-45b6-bc7a-4827bc04ec21 tempest-VolumesAssistedSnapshotsTest-1032046954 tempest-VolumesAssistedSnapshotsTest-1032046954-project] Lazy-loading 'system_metadata' on Instance uuid 55f5b252-468d-4064-99b3-49bdcdf98db8 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:12:44 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-fac45040-cdc4-4725-998e-81111300ff5e tempest-VolumesAssistedSnapshotsTest-1032046954 tempest-VolumesAssistedSnapshotsTest-1032046954-project] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] volume_snapshot_delete: delete_info: {'volume_id': 'd2fb29a5-c3e1-4062-b3a5-2abad0b84dd1'} {{(pid=75245) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver [None req-fac45040-cdc4-4725-998e-81111300ff5e tempest-VolumesAssistedSnapshotsTest-1032046954 tempest-VolumesAssistedSnapshotsTest-1032046954-project] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] Traceback (most recent call last):
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8]     if delete_info['type'] != 'qcow2':
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] KeyError: 'type'
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] 
Nov 29 16:12:44 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-d8e55ec5-baf5-45b6-bc7a-4827bc04ec21 tempest-VolumesAssistedSnapshotsTest-1032046954 tempest-VolumesAssistedSnapshotsTest-1032046954-project] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver [None req-d8e55ec5-baf5-45b6-bc7a-4827bc04ec21 tempest-VolumesAssistedSnapshotsTest-1032046954 tempest-VolumesAssistedSnapshotsTest-1032046954-project] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] Traceback (most recent call last):
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8]     rv = execute(f, *args, **kwargs)
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8]     six.reraise(c, e, tb)
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8]     raise value
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8]     rv = meth(*args, **kwargs)
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] 
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver [None req-d8e55ec5-baf5-45b6-bc7a-4827bc04ec21 tempest-VolumesAssistedSnapshotsTest-1032046954 tempest-VolumesAssistedSnapshotsTest-1032046954-project] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] Traceback (most recent call last):
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8]     self._volume_snapshot_create(context, instance, guest,
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8]     rv = execute(f, *args, **kwargs)
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8]     six.reraise(c, e, tb)
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8]     raise value
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8]     rv = meth(*args, **kwargs)
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] 
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver [None req-fac45040-cdc4-4725-998e-81111300ff5e tempest-VolumesAssistedSnapshotsTest-1032046954 tempest-VolumesAssistedSnapshotsTest-1032046954-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver 
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver 
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-b3bc3e6a-e26d-4ce7-99c3-c17e8ebaa8b4)
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver 
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver 
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver 
Nov 29 16:12:44 user nova-compute[75245]: DEBUG nova.objects.instance [None req-7e6d022d-a167-4d85-bda8-1e89afbb98e1 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Lazy-loading 'flavor' on Instance uuid 36728d4f-925b-46a3-b4b5-17f14b9c99c3 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver [None req-d8e55ec5-baf5-45b6-bc7a-4827bc04ec21 tempest-VolumesAssistedSnapshotsTest-1032046954 tempest-VolumesAssistedSnapshotsTest-1032046954-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot bafc0546-669b-4258-8450-2c5c2a3f6e9b could not be found.
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver     raise value
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver 
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver 
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot bafc0546-669b-4258-8450-2c5c2a3f6e9b could not be found. (HTTP 404) (Request-ID: req-0e4ccbac-1dc0-442d-9a15-10c1f699d80a)
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver 
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver 
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot bafc0546-669b-4258-8450-2c5c2a3f6e9b could not be found.
Nov 29 16:12:44 user nova-compute[75245]: ERROR nova.virt.libvirt.driver 
Nov 29 16:12:44 user nova-compute[75245]: ERROR oslo_messaging.rpc.server [None req-fac45040-cdc4-4725-998e-81111300ff5e tempest-VolumesAssistedSnapshotsTest-1032046954 tempest-VolumesAssistedSnapshotsTest-1032046954-project] Exception during message handling: KeyError: 'type'
Nov 29 16:12:44 user nova-compute[75245]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 29 16:12:44 user nova-compute[75245]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 29 16:12:44 user nova-compute[75245]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 29 16:12:44 user nova-compute[75245]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 29 16:12:44 user nova-compute[75245]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 29 16:12:44 user nova-compute[75245]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 29 16:12:44 user nova-compute[75245]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 29 16:12:44 user nova-compute[75245]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 29 16:12:44 user nova-compute[75245]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 29 16:12:44 user nova-compute[75245]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 29 16:12:44 user nova-compute[75245]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 16:12:44 user nova-compute[75245]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 16:12:44 user nova-compute[75245]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 16:12:44 user nova-compute[75245]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 16:12:44 user nova-compute[75245]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 16:12:44 user nova-compute[75245]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 29 16:12:44 user nova-compute[75245]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 29 16:12:44 user nova-compute[75245]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 29 16:12:44 user nova-compute[75245]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 29 16:12:44 user nova-compute[75245]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 29 16:12:44 user nova-compute[75245]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 16:12:44 user nova-compute[75245]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 16:12:44 user nova-compute[75245]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 16:12:44 user nova-compute[75245]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 16:12:44 user nova-compute[75245]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 16:12:44 user nova-compute[75245]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 29 16:12:44 user nova-compute[75245]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 29 16:12:44 user nova-compute[75245]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 29 16:12:44 user nova-compute[75245]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 29 16:12:44 user nova-compute[75245]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 29 16:12:44 user nova-compute[75245]: ERROR oslo_messaging.rpc.server 
Nov 29 16:12:44 user nova-compute[75245]: ERROR oslo_messaging.rpc.server [None req-d8e55ec5-baf5-45b6-bc7a-4827bc04ec21 tempest-VolumesAssistedSnapshotsTest-1032046954 tempest-VolumesAssistedSnapshotsTest-1032046954-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 29 16:12:44 user nova-compute[75245]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 29 16:12:44 user nova-compute[75245]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 29 16:12:44 user nova-compute[75245]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 29 16:12:44 user nova-compute[75245]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 29 16:12:44 user nova-compute[75245]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 29 16:12:44 user nova-compute[75245]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 29 16:12:44 user nova-compute[75245]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 29 16:12:44 user nova-compute[75245]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 29 16:12:44 user nova-compute[75245]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 29 16:12:44 user nova-compute[75245]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 29 16:12:44 user nova-compute[75245]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 16:12:44 user nova-compute[75245]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 16:12:44 user nova-compute[75245]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 16:12:44 user nova-compute[75245]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 16:12:44 user nova-compute[75245]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 16:12:44 user nova-compute[75245]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 29 16:12:44 user nova-compute[75245]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 29 16:12:44 user nova-compute[75245]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 29 16:12:44 user nova-compute[75245]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 29 16:12:44 user nova-compute[75245]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 29 16:12:44 user nova-compute[75245]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 16:12:44 user nova-compute[75245]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 16:12:44 user nova-compute[75245]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 16:12:44 user nova-compute[75245]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 16:12:44 user nova-compute[75245]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 16:12:44 user nova-compute[75245]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 29 16:12:44 user nova-compute[75245]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 29 16:12:44 user nova-compute[75245]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 29 16:12:44 user nova-compute[75245]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 29 16:12:44 user nova-compute[75245]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 29 16:12:44 user nova-compute[75245]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 29 16:12:44 user nova-compute[75245]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 29 16:12:44 user nova-compute[75245]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 29 16:12:44 user nova-compute[75245]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 29 16:12:44 user nova-compute[75245]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 29 16:12:44 user nova-compute[75245]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 29 16:12:44 user nova-compute[75245]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 29 16:12:44 user nova-compute[75245]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 29 16:12:44 user nova-compute[75245]: ERROR oslo_messaging.rpc.server     raise value
Nov 29 16:12:44 user nova-compute[75245]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 29 16:12:44 user nova-compute[75245]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 29 16:12:44 user nova-compute[75245]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 29 16:12:44 user nova-compute[75245]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 29 16:12:44 user nova-compute[75245]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 29 16:12:44 user nova-compute[75245]: ERROR oslo_messaging.rpc.server 
Nov 29 16:12:44 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-7e6d022d-a167-4d85-bda8-1e89afbb98e1 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Lock "36728d4f-925b-46a3-b4b5-17f14b9c99c3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.143s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:12:44 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-9be09120-7d2c-415d-9580-59f8134e7843 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] Acquiring lock "55f5b252-468d-4064-99b3-49bdcdf98db8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:12:44 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-9be09120-7d2c-415d-9580-59f8134e7843 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] Lock "55f5b252-468d-4064-99b3-49bdcdf98db8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:12:44 user nova-compute[75245]: INFO nova.compute.manager [None req-9be09120-7d2c-415d-9580-59f8134e7843 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] Detaching volume d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1
Nov 29 16:12:45 user nova-compute[75245]: INFO nova.virt.block_device [None req-9be09120-7d2c-415d-9580-59f8134e7843 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] Attempting to driver detach volume d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1 from mountpoint /dev/vdb
Nov 29 16:12:45 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-9be09120-7d2c-415d-9580-59f8134e7843 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] Attempting to detach device vdb from instance 55f5b252-468d-4064-99b3-49bdcdf98db8 from the persistent domain config. {{(pid=75245) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 16:12:45 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-9be09120-7d2c-415d-9580-59f8134e7843 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] detach device xml: <disk type="block" device="disk">
Nov 29 16:12:45 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:12:45 user nova-compute[75245]:   <source dev="/dev/sdh"/>
Nov 29 16:12:45 user nova-compute[75245]:   <target dev="vdb" bus="virtio"/>
Nov 29 16:12:45 user nova-compute[75245]:   <serial>d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1</serial>
Nov 29 16:12:45 user nova-compute[75245]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 16:12:45 user nova-compute[75245]: </disk>
Nov 29 16:12:45 user nova-compute[75245]:  {{(pid=75245) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 16:12:45 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-9be09120-7d2c-415d-9580-59f8134e7843 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] Successfully detached device vdb from instance 55f5b252-468d-4064-99b3-49bdcdf98db8 from the persistent domain config.
Nov 29 16:12:45 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-9be09120-7d2c-415d-9580-59f8134e7843 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 55f5b252-468d-4064-99b3-49bdcdf98db8 from the live domain config. {{(pid=75245) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 16:12:45 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-9be09120-7d2c-415d-9580-59f8134e7843 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] detach device xml: <disk type="block" device="disk">
Nov 29 16:12:45 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:12:45 user nova-compute[75245]:   <source dev="/dev/sdh"/>
Nov 29 16:12:45 user nova-compute[75245]:   <target dev="vdb" bus="virtio"/>
Nov 29 16:12:45 user nova-compute[75245]:   <serial>d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1</serial>
Nov 29 16:12:45 user nova-compute[75245]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 16:12:45 user nova-compute[75245]: </disk>
Nov 29 16:12:45 user nova-compute[75245]:  {{(pid=75245) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 16:12:45 user nova-compute[75245]: DEBUG nova.compute.manager [None req-4095d140-5e4e-4e4d-a0aa-3ab4ab26dd99 tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] swap_volume: Updating volume 20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "rUSaphLT", "auth_password": "gl4xmhIQYCunXJ", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdg", "volume_id": "9bcd2fed-1ce1-4028-9482-2f5695d71b49"}, "status": "reserved", "instance": "e3fea3d2-6db1-4766-ad5b-9ad1e728ea10", "attached_at": "", "detached_at": "", "volume_id": "9bcd2fed-1ce1-4028-9482-2f5695d71b49", "serial": "9bcd2fed-1ce1-4028-9482-2f5695d71b49"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '9bcd2fed-1ce1-4028-9482-2f5695d71b49', 'no_device': None, 'attachment_id': '823a157d-f0a9-4cd8-972a-5315d8ac8126'} {{(pid=75245) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 29 16:12:45 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4095d140-5e4e-4e4d-a0aa-3ab4ab26dd99 tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] Lock "e3fea3d2-6db1-4766-ad5b-9ad1e728ea10" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 16.450s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:12:45 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:45 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-9be09120-7d2c-415d-9580-59f8134e7843 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 55f5b252-468d-4064-99b3-49bdcdf98db8 {{(pid=75245) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 16:12:45 user nova-compute[75245]: DEBUG nova.compute.manager [req-7eb690c0-ef36-4c86-9dd6-306c38908115 req-b32c71cb-34fe-4fe0-bbae-ec17d2b52250 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Received event network-changed-d116100d-dfd6-4666-86cd-659d5539871a {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:12:45 user nova-compute[75245]: DEBUG nova.compute.manager [req-7eb690c0-ef36-4c86-9dd6-306c38908115 req-b32c71cb-34fe-4fe0-bbae-ec17d2b52250 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Refreshing instance network info cache due to event network-changed-d116100d-dfd6-4666-86cd-659d5539871a. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:12:45 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-7eb690c0-ef36-4c86-9dd6-306c38908115 req-b32c71cb-34fe-4fe0-bbae-ec17d2b52250 service nova] Acquiring lock "refresh_cache-696417e7-8eff-46f3-a6f1-11a9f5191627" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:12:45 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-7eb690c0-ef36-4c86-9dd6-306c38908115 req-b32c71cb-34fe-4fe0-bbae-ec17d2b52250 service nova] Acquired lock "refresh_cache-696417e7-8eff-46f3-a6f1-11a9f5191627" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:12:45 user nova-compute[75245]: DEBUG nova.network.neutron [req-7eb690c0-ef36-4c86-9dd6-306c38908115 req-b32c71cb-34fe-4fe0-bbae-ec17d2b52250 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Refreshing network info cache for port d116100d-dfd6-4666-86cd-659d5539871a {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:12:46 user nova-compute[75245]: DEBUG nova.network.neutron [req-7eb690c0-ef36-4c86-9dd6-306c38908115 req-b32c71cb-34fe-4fe0-bbae-ec17d2b52250 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Updated VIF entry in instance network info cache for port d116100d-dfd6-4666-86cd-659d5539871a. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:12:46 user nova-compute[75245]: DEBUG nova.network.neutron [req-7eb690c0-ef36-4c86-9dd6-306c38908115 req-b32c71cb-34fe-4fe0-bbae-ec17d2b52250 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Updating instance_info_cache with network_info: [{"id": "d116100d-dfd6-4666-86cd-659d5539871a", "address": "fa:16:3e:aa:b6:e1", "network": {"id": "8a90347e-c47f-450a-8b31-4bf8d24e9aee", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-923062507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd116100d-df", "ovs_interfaceid": "d116100d-dfd6-4666-86cd-659d5539871a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e2cbf31f-6cf8-4a30-9d9b-3bbb3645a660", "address": "fa:16:3e:0e:64:29", "network": {"id": "891dd2c7-8a6d-4a31-b5d4-6edcd5e2f9ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-214436945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2cbf31f-6c", "ovs_interfaceid": "e2cbf31f-6cf8-4a30-9d9b-3bbb3645a660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6a5d2bae-9b9d-4331-b080-badfed69c6b1", "address": "fa:16:3e:cb:f8:53", "network": {"id": "891dd2c7-8a6d-4a31-b5d4-6edcd5e2f9ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-214436945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a5d2bae-9b", "ovs_interfaceid": "6a5d2bae-9b9d-4331-b080-badfed69c6b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1bcb8f7b-abf5-4fe1-8ad9-a1d0316f951a", "address": "fa:16:3e:4e:09:93", "network": {"id": "891dd2c7-8a6d-4a31-b5d4-6edcd5e2f9ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-214436945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bcb8f7b-ab", "ovs_interfaceid": "1bcb8f7b-abf5-4fe1-8ad9-a1d0316f951a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f91c7d1f-43fd-4e3e-9748-dd25010699bd", "address": "fa:16:3e:3f:11:4e", "network": {"id": "891dd2c7-8a6d-4a31-b5d4-6edcd5e2f9ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-214436945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91c7d1f-43", "ovs_interfaceid": "f91c7d1f-43fd-4e3e-9748-dd25010699bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "56b28d7b-1c3c-4e60-bbd6-7fd01f07fc6c", "address": "fa:16:3e:83:2f:60", "network": {"id": "e6c7f35e-5af2-440d-8433-00e0c0f5e62c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1457199759", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56b28d7b-1c", "ovs_interfaceid": "56b28d7b-1c3c-4e60-bbd6-7fd01f07fc6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d6c559e9-afbf-473d-b4b0-f3cdff6938bc", "address": "fa:16:3e:21:9f:17", "network": {"id": "e6c7f35e-5af2-440d-8433-00e0c0f5e62c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1457199759", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c559e9-af", "ovs_interfaceid": "d6c559e9-afbf-473d-b4b0-f3cdff6938bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:12:46 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-7eb690c0-ef36-4c86-9dd6-306c38908115 req-b32c71cb-34fe-4fe0-bbae-ec17d2b52250 service nova] Releasing lock "refresh_cache-696417e7-8eff-46f3-a6f1-11a9f5191627" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:12:46 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] Acquiring lock "e3fea3d2-6db1-4766-ad5b-9ad1e728ea10" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:12:46 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] Lock "e3fea3d2-6db1-4766-ad5b-9ad1e728ea10" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:12:46 user nova-compute[75245]: DEBUG os_brick.utils [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:12:46 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:46 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:46 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[090267fe-dbb1-47e0-8260-fc4cd3318e8a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:69ed8ed87091\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:46 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:46 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:46 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b1243f-3926-4b19-b988-d3d08f4c0da2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:46 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:46 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:46 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc88580-8f55-4dd7-8747-2985bddafffb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:46 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a1db83-7ca3-4af5-86d7-98876ae5778d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:46 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] Running cmd (subprocess): nvme version {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:46 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:12:46 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] nvme not present on system {{(pid=75245) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 16:12:46 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:46 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:12:46 user nova-compute[75245]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 16:12:46 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e3a0777-ae71-4214-82d0-bdd45c2b6966]: (4, '') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:46 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75245) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 16:12:46 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 16:12:46 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] LIGHTOS: no hostnqn found. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 16:12:46 user nova-compute[75245]: DEBUG os_brick.utils [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:69ed8ed87091', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:12:46 user nova-compute[75245]: INFO nova.compute.manager [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] Swapping volume 9bcd2fed-1ce1-4028-9482-2f5695d71b49 for 20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb
Nov 29 16:12:47 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:47 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Acquiring lock "fd819060-4388-444d-809e-94f6b2e8f102" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:12:47 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Lock "fd819060-4388-444d-809e-94f6b2e8f102" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:12:47 user nova-compute[75245]: DEBUG nova.compute.manager [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] [instance: fd819060-4388-444d-809e-94f6b2e8f102] Starting instance... {{(pid=75245) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 16:12:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:12:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:12:48 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75245) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 16:12:48 user nova-compute[75245]: INFO nova.compute.claims [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] [instance: fd819060-4388-444d-809e-94f6b2e8f102] Claim successful on node user
Nov 29 16:12:48 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:12:48 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:12:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.399s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:12:48 user nova-compute[75245]: DEBUG nova.compute.manager [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] [instance: fd819060-4388-444d-809e-94f6b2e8f102] Start building networks asynchronously for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 16:12:48 user nova-compute[75245]: DEBUG nova.compute.manager [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] [instance: fd819060-4388-444d-809e-94f6b2e8f102] Allocating IP information in the background. {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 16:12:48 user nova-compute[75245]: DEBUG nova.network.neutron [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] [instance: fd819060-4388-444d-809e-94f6b2e8f102] allocate_for_instance() {{(pid=75245) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 16:12:48 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] [instance: fd819060-4388-444d-809e-94f6b2e8f102] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 16:12:48 user nova-compute[75245]: DEBUG nova.compute.manager [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] [instance: fd819060-4388-444d-809e-94f6b2e8f102] Start building block device mappings for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 16:12:48 user nova-compute[75245]: DEBUG nova.policy [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '577a5571c39b493d8ea0f177f26aad27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0009bdf2ef8f43a59341dd6eea441b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75245) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 16:12:48 user nova-compute[75245]: DEBUG nova.compute.manager [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] [instance: fd819060-4388-444d-809e-94f6b2e8f102] Start spawning the instance on the hypervisor. {{(pid=75245) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 16:12:48 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] [instance: fd819060-4388-444d-809e-94f6b2e8f102] Creating instance directory {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 16:12:48 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] [instance: fd819060-4388-444d-809e-94f6b2e8f102] Creating image(s)
Nov 29 16:12:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Acquiring lock "/opt/stack/data/nova/instances/fd819060-4388-444d-809e-94f6b2e8f102/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:12:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Lock "/opt/stack/data/nova/instances/fd819060-4388-444d-809e-94f6b2e8f102/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:12:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Lock "/opt/stack/data/nova/instances/fd819060-4388-444d-809e-94f6b2e8f102/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:12:48 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Acquiring lock "696417e7-8eff-46f3-a6f1-11a9f5191627" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:12:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Lock "696417e7-8eff-46f3-a6f1-11a9f5191627" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:12:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Acquiring lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:12:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:12:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:12:48 user nova-compute[75245]: INFO nova.compute.manager [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Terminating instance
Nov 29 16:12:48 user nova-compute[75245]: DEBUG nova.compute.manager [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Start destroying the instance on the hypervisor. {{(pid=75245) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 16:12:48 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.196s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Acquiring lock "d654f7206043e05d3525550b0fc885556eb999f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:12:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:12:48 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:48 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:49 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.224s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:49 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/fd819060-4388-444d-809e-94f6b2e8f102/disk 1073741824 {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:49 user nova-compute[75245]: DEBUG nova.compute.manager [req-acab5970-f016-4892-9522-66695c359b05 req-349d960c-a366-47f6-9c55-ac2b22c31bac service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Received event network-vif-unplugged-d116100d-dfd6-4666-86cd-659d5539871a {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:12:49 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-acab5970-f016-4892-9522-66695c359b05 req-349d960c-a366-47f6-9c55-ac2b22c31bac service nova] Acquiring lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:12:49 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-acab5970-f016-4892-9522-66695c359b05 req-349d960c-a366-47f6-9c55-ac2b22c31bac service nova] Lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:12:49 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-acab5970-f016-4892-9522-66695c359b05 req-349d960c-a366-47f6-9c55-ac2b22c31bac service nova] Lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.006s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:12:49 user nova-compute[75245]: DEBUG nova.compute.manager [req-acab5970-f016-4892-9522-66695c359b05 req-349d960c-a366-47f6-9c55-ac2b22c31bac service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] No waiting events found dispatching network-vif-unplugged-d116100d-dfd6-4666-86cd-659d5539871a {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:12:49 user nova-compute[75245]: DEBUG nova.compute.manager [req-acab5970-f016-4892-9522-66695c359b05 req-349d960c-a366-47f6-9c55-ac2b22c31bac service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Received event network-vif-unplugged-d116100d-dfd6-4666-86cd-659d5539871a for instance with task_state deleting. {{(pid=75245) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 16:12:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:49 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/fd819060-4388-444d-809e-94f6b2e8f102/disk 1073741824" returned: 0 in 0.077s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:49 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.306s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:12:49 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:49 user nova-compute[75245]: DEBUG nova.network.neutron [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] [instance: fd819060-4388-444d-809e-94f6b2e8f102] Successfully created port: e11ba0cd-c449-4b18-a32e-41d267535482 {{(pid=75245) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 16:12:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:49 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.228s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:49 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fd819060-4388-444d-809e-94f6b2e8f102/disk. size=1073741824 {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 16:12:49 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd819060-4388-444d-809e-94f6b2e8f102/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:49 user nova-compute[75245]: DEBUG nova.compute.manager [req-975d17db-3d95-4998-b559-46f1077ce6f2 req-6629732e-4b95-446d-851c-5affd97f5759 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Received event network-vif-unplugged-6a5d2bae-9b9d-4331-b080-badfed69c6b1 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:12:49 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-975d17db-3d95-4998-b559-46f1077ce6f2 req-6629732e-4b95-446d-851c-5affd97f5759 service nova] Acquiring lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:12:49 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-975d17db-3d95-4998-b559-46f1077ce6f2 req-6629732e-4b95-446d-851c-5affd97f5759 service nova] Lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:12:49 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-975d17db-3d95-4998-b559-46f1077ce6f2 req-6629732e-4b95-446d-851c-5affd97f5759 service nova] Lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:12:49 user nova-compute[75245]: DEBUG nova.compute.manager [req-975d17db-3d95-4998-b559-46f1077ce6f2 req-6629732e-4b95-446d-851c-5affd97f5759 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] No waiting events found dispatching network-vif-unplugged-6a5d2bae-9b9d-4331-b080-badfed69c6b1 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:12:49 user nova-compute[75245]: DEBUG nova.compute.manager [req-975d17db-3d95-4998-b559-46f1077ce6f2 req-6629732e-4b95-446d-851c-5affd97f5759 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Received event network-vif-unplugged-6a5d2bae-9b9d-4331-b080-badfed69c6b1 for instance with task_state deleting. {{(pid=75245) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 16:12:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:49 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd819060-4388-444d-809e-94f6b2e8f102/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:49 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Cannot resize image /opt/stack/data/nova/instances/fd819060-4388-444d-809e-94f6b2e8f102/disk to a smaller size. {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 16:12:49 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] [instance: fd819060-4388-444d-809e-94f6b2e8f102] Created local disks {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 16:12:49 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] [instance: fd819060-4388-444d-809e-94f6b2e8f102] Ensure instance console log exists: /opt/stack/data/nova/instances/fd819060-4388-444d-809e-94f6b2e8f102/console.log {{(pid=75245) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 16:12:49 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:12:49 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:12:49 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:12:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:50 user nova-compute[75245]: DEBUG nova.compute.manager [req-a725bcf7-eadc-482b-adcd-cbeab2ca36bd req-811f9665-c331-4eb5-b722-327eb8b0b977 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Received event network-vif-unplugged-1bcb8f7b-abf5-4fe1-8ad9-a1d0316f951a {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:12:50 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a725bcf7-eadc-482b-adcd-cbeab2ca36bd req-811f9665-c331-4eb5-b722-327eb8b0b977 service nova] Acquiring lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:12:50 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a725bcf7-eadc-482b-adcd-cbeab2ca36bd req-811f9665-c331-4eb5-b722-327eb8b0b977 service nova] Lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:12:50 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a725bcf7-eadc-482b-adcd-cbeab2ca36bd req-811f9665-c331-4eb5-b722-327eb8b0b977 service nova] Lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:12:50 user nova-compute[75245]: DEBUG nova.compute.manager [req-a725bcf7-eadc-482b-adcd-cbeab2ca36bd req-811f9665-c331-4eb5-b722-327eb8b0b977 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] No waiting events found dispatching network-vif-unplugged-1bcb8f7b-abf5-4fe1-8ad9-a1d0316f951a {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:12:50 user nova-compute[75245]: DEBUG nova.compute.manager [req-a725bcf7-eadc-482b-adcd-cbeab2ca36bd req-811f9665-c331-4eb5-b722-327eb8b0b977 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Received event network-vif-unplugged-1bcb8f7b-abf5-4fe1-8ad9-a1d0316f951a for instance with task_state deleting. {{(pid=75245) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 16:12:50 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:12:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:50 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Instance destroyed successfully.
Nov 29 16:12:50 user nova-compute[75245]: DEBUG nova.objects.instance [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Lazy-loading 'resources' on Instance uuid 696417e7-8eff-46f3-a6f1-11a9f5191627 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:12:50 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T16:10:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1163488234',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1163488234',id=10,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOw/5U9h5ccex2qnP/5hOTP78ppDsOgRNSxy0KA0i1xSCXR5NDTKu7hvcsmkDcFw/WanqDVtSpFbkkBVHht7EsYDS15+PaPoF0OH31h4AuA0XHHkSzaU9hrZMTJL7pI2Mg==',key_name='tempest-keypair-1884616232',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:11:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1e751c778a804388a05afe573a7b7828',ramdisk_id='',reservation_id='r-6eckmld2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1192969410',owner_user_name='tempest-TaggedBootDevicesTest-1192969410-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:11:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fc59a8c008f4270a8643280e6649e94',uuid=696417e7-8eff-46f3-a6f1-11a9f5191627,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d116100d-dfd6-4666-86cd-659d5539871a", "address": "fa:16:3e:aa:b6:e1", "network": {"id": "8a90347e-c47f-450a-8b31-4bf8d24e9aee", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-923062507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd116100d-df", "ovs_interfaceid": "d116100d-dfd6-4666-86cd-659d5539871a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 16:12:50 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Converting VIF {"id": "d116100d-dfd6-4666-86cd-659d5539871a", "address": "fa:16:3e:aa:b6:e1", "network": {"id": "8a90347e-c47f-450a-8b31-4bf8d24e9aee", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-923062507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd116100d-df", "ovs_interfaceid": "d116100d-dfd6-4666-86cd-659d5539871a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:12:50 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:aa:b6:e1,bridge_name='br-int',has_traffic_filtering=True,id=d116100d-dfd6-4666-86cd-659d5539871a,network=Network(8a90347e-c47f-450a-8b31-4bf8d24e9aee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd116100d-df') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:12:50 user nova-compute[75245]: DEBUG os_vif [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:b6:e1,bridge_name='br-int',has_traffic_filtering=True,id=d116100d-dfd6-4666-86cd-659d5539871a,network=Network(8a90347e-c47f-450a-8b31-4bf8d24e9aee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd116100d-df') {{(pid=75245) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 16:12:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd116100d-df, bridge=br-int, if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:12:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:12:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8717fbb9-c10e-4998-8502-0a5b24c74513) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:12:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:12:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:50 user nova-compute[75245]: INFO os_vif [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:b6:e1,bridge_name='br-int',has_traffic_filtering=True,id=d116100d-dfd6-4666-86cd-659d5539871a,network=Network(8a90347e-c47f-450a-8b31-4bf8d24e9aee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd116100d-df')
Nov 29 16:12:50 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T16:10:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1163488234',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1163488234',id=10,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOw/5U9h5ccex2qnP/5hOTP78ppDsOgRNSxy0KA0i1xSCXR5NDTKu7hvcsmkDcFw/WanqDVtSpFbkkBVHht7EsYDS15+PaPoF0OH31h4AuA0XHHkSzaU9hrZMTJL7pI2Mg==',key_name='tempest-keypair-1884616232',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:11:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1e751c778a804388a05afe573a7b7828',ramdisk_id='',reservation_id='r-6eckmld2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1192969410',owner_user_name='tempest-TaggedBootDevicesTest-1192969410-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:11:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fc59a8c008f4270a8643280e6649e94',uuid=696417e7-8eff-46f3-a6f1-11a9f5191627,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e2cbf31f-6cf8-4a30-9d9b-3bbb3645a660", "address": "fa:16:3e:0e:64:29", "network": {"id": "891dd2c7-8a6d-4a31-b5d4-6edcd5e2f9ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-214436945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2cbf31f-6c", "ovs_interfaceid": "e2cbf31f-6cf8-4a30-9d9b-3bbb3645a660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75245) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 16:12:50 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Converting VIF {"id": "e2cbf31f-6cf8-4a30-9d9b-3bbb3645a660", "address": "fa:16:3e:0e:64:29", "network": {"id": "891dd2c7-8a6d-4a31-b5d4-6edcd5e2f9ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-214436945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2cbf31f-6c", "ovs_interfaceid": "e2cbf31f-6cf8-4a30-9d9b-3bbb3645a660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:12:50 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:64:29,bridge_name='br-int',has_traffic_filtering=True,id=e2cbf31f-6cf8-4a30-9d9b-3bbb3645a660,network=Network(891dd2c7-8a6d-4a31-b5d4-6edcd5e2f9ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape2cbf31f-6c') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:12:50 user nova-compute[75245]: DEBUG os_vif [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:64:29,bridge_name='br-int',has_traffic_filtering=True,id=e2cbf31f-6cf8-4a30-9d9b-3bbb3645a660,network=Network(891dd2c7-8a6d-4a31-b5d4-6edcd5e2f9ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape2cbf31f-6c') {{(pid=75245) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 16:12:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape2cbf31f-6c, bridge=br-int, if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:12:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:12:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=69adb4a6-e456-4b54-a7dd-be98c79079f4) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:12:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:51 user nova-compute[75245]: INFO os_vif [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:64:29,bridge_name='br-int',has_traffic_filtering=True,id=e2cbf31f-6cf8-4a30-9d9b-3bbb3645a660,network=Network(891dd2c7-8a6d-4a31-b5d4-6edcd5e2f9ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape2cbf31f-6c')
Nov 29 16:12:51 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T16:10:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1163488234',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1163488234',id=10,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOw/5U9h5ccex2qnP/5hOTP78ppDsOgRNSxy0KA0i1xSCXR5NDTKu7hvcsmkDcFw/WanqDVtSpFbkkBVHht7EsYDS15+PaPoF0OH31h4AuA0XHHkSzaU9hrZMTJL7pI2Mg==',key_name='tempest-keypair-1884616232',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:11:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1e751c778a804388a05afe573a7b7828',ramdisk_id='',reservation_id='r-6eckmld2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1192969410',owner_user_name='tempest-TaggedBootDevicesTest-1192969410-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:11:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fc59a8c008f4270a8643280e6649e94',uuid=696417e7-8eff-46f3-a6f1-11a9f5191627,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6a5d2bae-9b9d-4331-b080-badfed69c6b1", "address": "fa:16:3e:cb:f8:53", "network": {"id": "891dd2c7-8a6d-4a31-b5d4-6edcd5e2f9ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-214436945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a5d2bae-9b", "ovs_interfaceid": "6a5d2bae-9b9d-4331-b080-badfed69c6b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75245) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Converting VIF {"id": "6a5d2bae-9b9d-4331-b080-badfed69c6b1", "address": "fa:16:3e:cb:f8:53", "network": {"id": "891dd2c7-8a6d-4a31-b5d4-6edcd5e2f9ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-214436945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a5d2bae-9b", "ovs_interfaceid": "6a5d2bae-9b9d-4331-b080-badfed69c6b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:f8:53,bridge_name='br-int',has_traffic_filtering=True,id=6a5d2bae-9b9d-4331-b080-badfed69c6b1,network=Network(891dd2c7-8a6d-4a31-b5d4-6edcd5e2f9ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6a5d2bae-9b') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG os_vif [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:f8:53,bridge_name='br-int',has_traffic_filtering=True,id=6a5d2bae-9b9d-4331-b080-badfed69c6b1,network=Network(891dd2c7-8a6d-4a31-b5d4-6edcd5e2f9ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6a5d2bae-9b') {{(pid=75245) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6a5d2bae-9b, bridge=br-int, if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=faa0f118-5f22-41e5-bb69-55f2245a9752) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG nova.network.neutron [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] [instance: fd819060-4388-444d-809e-94f6b2e8f102] Successfully updated port: e11ba0cd-c449-4b18-a32e-41d267535482 {{(pid=75245) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Acquiring lock "refresh_cache-fd819060-4388-444d-809e-94f6b2e8f102" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Acquired lock "refresh_cache-fd819060-4388-444d-809e-94f6b2e8f102" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG nova.network.neutron [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] [instance: fd819060-4388-444d-809e-94f6b2e8f102] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:51 user nova-compute[75245]: INFO os_vif [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:f8:53,bridge_name='br-int',has_traffic_filtering=True,id=6a5d2bae-9b9d-4331-b080-badfed69c6b1,network=Network(891dd2c7-8a6d-4a31-b5d4-6edcd5e2f9ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6a5d2bae-9b')
Nov 29 16:12:51 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T16:10:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1163488234',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1163488234',id=10,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOw/5U9h5ccex2qnP/5hOTP78ppDsOgRNSxy0KA0i1xSCXR5NDTKu7hvcsmkDcFw/WanqDVtSpFbkkBVHht7EsYDS15+PaPoF0OH31h4AuA0XHHkSzaU9hrZMTJL7pI2Mg==',key_name='tempest-keypair-1884616232',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:11:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1e751c778a804388a05afe573a7b7828',ramdisk_id='',reservation_id='r-6eckmld2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1192969410',owner_user_name='tempest-TaggedBootDevicesTest-1192969410-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:11:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fc59a8c008f4270a8643280e6649e94',uuid=696417e7-8eff-46f3-a6f1-11a9f5191627,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1bcb8f7b-abf5-4fe1-8ad9-a1d0316f951a", "address": "fa:16:3e:4e:09:93", "network": {"id": "891dd2c7-8a6d-4a31-b5d4-6edcd5e2f9ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-214436945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bcb8f7b-ab", "ovs_interfaceid": "1bcb8f7b-abf5-4fe1-8ad9-a1d0316f951a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Converting VIF {"id": "1bcb8f7b-abf5-4fe1-8ad9-a1d0316f951a", "address": "fa:16:3e:4e:09:93", "network": {"id": "891dd2c7-8a6d-4a31-b5d4-6edcd5e2f9ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-214436945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bcb8f7b-ab", "ovs_interfaceid": "1bcb8f7b-abf5-4fe1-8ad9-a1d0316f951a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:09:93,bridge_name='br-int',has_traffic_filtering=True,id=1bcb8f7b-abf5-4fe1-8ad9-a1d0316f951a,network=Network(891dd2c7-8a6d-4a31-b5d4-6edcd5e2f9ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bcb8f7b-ab') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG os_vif [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:09:93,bridge_name='br-int',has_traffic_filtering=True,id=1bcb8f7b-abf5-4fe1-8ad9-a1d0316f951a,network=Network(891dd2c7-8a6d-4a31-b5d4-6edcd5e2f9ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bcb8f7b-ab') {{(pid=75245) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1bcb8f7b-ab, bridge=br-int, if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=451ae516-3d75-43e9-8666-40a4d6a7a904) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:51 user nova-compute[75245]: INFO os_vif [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:09:93,bridge_name='br-int',has_traffic_filtering=True,id=1bcb8f7b-abf5-4fe1-8ad9-a1d0316f951a,network=Network(891dd2c7-8a6d-4a31-b5d4-6edcd5e2f9ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bcb8f7b-ab')
Nov 29 16:12:51 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T16:10:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1163488234',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1163488234',id=10,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOw/5U9h5ccex2qnP/5hOTP78ppDsOgRNSxy0KA0i1xSCXR5NDTKu7hvcsmkDcFw/WanqDVtSpFbkkBVHht7EsYDS15+PaPoF0OH31h4AuA0XHHkSzaU9hrZMTJL7pI2Mg==',key_name='tempest-keypair-1884616232',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:11:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1e751c778a804388a05afe573a7b7828',ramdisk_id='',reservation_id='r-6eckmld2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1192969410',owner_user_name='tempest-TaggedBootDevicesTest-1192969410-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:11:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fc59a8c008f4270a8643280e6649e94',uuid=696417e7-8eff-46f3-a6f1-11a9f5191627,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f91c7d1f-43fd-4e3e-9748-dd25010699bd", "address": "fa:16:3e:3f:11:4e", "network": {"id": "891dd2c7-8a6d-4a31-b5d4-6edcd5e2f9ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-214436945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91c7d1f-43", "ovs_interfaceid": "f91c7d1f-43fd-4e3e-9748-dd25010699bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Converting VIF {"id": "f91c7d1f-43fd-4e3e-9748-dd25010699bd", "address": "fa:16:3e:3f:11:4e", "network": {"id": "891dd2c7-8a6d-4a31-b5d4-6edcd5e2f9ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-214436945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91c7d1f-43", "ovs_interfaceid": "f91c7d1f-43fd-4e3e-9748-dd25010699bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:11:4e,bridge_name='br-int',has_traffic_filtering=True,id=f91c7d1f-43fd-4e3e-9748-dd25010699bd,network=Network(891dd2c7-8a6d-4a31-b5d4-6edcd5e2f9ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf91c7d1f-43') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG os_vif [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:11:4e,bridge_name='br-int',has_traffic_filtering=True,id=f91c7d1f-43fd-4e3e-9748-dd25010699bd,network=Network(891dd2c7-8a6d-4a31-b5d4-6edcd5e2f9ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf91c7d1f-43') {{(pid=75245) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG nova.network.neutron [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] [instance: fd819060-4388-444d-809e-94f6b2e8f102] Instance cache missing network info. {{(pid=75245) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf91c7d1f-43, bridge=br-int, if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b54c77a9-b47b-4412-a895-8a61c378799e) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG nova.compute.manager [req-67958122-5ff7-452d-bc93-f6f18effeca7 req-93645242-3676-4b2e-9915-5a38122a3abb service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Received event network-vif-plugged-d116100d-dfd6-4666-86cd-659d5539871a {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-67958122-5ff7-452d-bc93-f6f18effeca7 req-93645242-3676-4b2e-9915-5a38122a3abb service nova] Acquiring lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-67958122-5ff7-452d-bc93-f6f18effeca7 req-93645242-3676-4b2e-9915-5a38122a3abb service nova] Lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-67958122-5ff7-452d-bc93-f6f18effeca7 req-93645242-3676-4b2e-9915-5a38122a3abb service nova] Lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG nova.compute.manager [req-67958122-5ff7-452d-bc93-f6f18effeca7 req-93645242-3676-4b2e-9915-5a38122a3abb service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] No waiting events found dispatching network-vif-plugged-d116100d-dfd6-4666-86cd-659d5539871a {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:12:51 user nova-compute[75245]: WARNING nova.compute.manager [req-67958122-5ff7-452d-bc93-f6f18effeca7 req-93645242-3676-4b2e-9915-5a38122a3abb service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Received unexpected event network-vif-plugged-d116100d-dfd6-4666-86cd-659d5539871a for instance with vm_state active and task_state deleting.
Nov 29 16:12:51 user nova-compute[75245]: DEBUG nova.compute.manager [req-67958122-5ff7-452d-bc93-f6f18effeca7 req-93645242-3676-4b2e-9915-5a38122a3abb service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Received event network-vif-unplugged-e2cbf31f-6cf8-4a30-9d9b-3bbb3645a660 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-67958122-5ff7-452d-bc93-f6f18effeca7 req-93645242-3676-4b2e-9915-5a38122a3abb service nova] Acquiring lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-67958122-5ff7-452d-bc93-f6f18effeca7 req-93645242-3676-4b2e-9915-5a38122a3abb service nova] Lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-67958122-5ff7-452d-bc93-f6f18effeca7 req-93645242-3676-4b2e-9915-5a38122a3abb service nova] Lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG nova.compute.manager [req-67958122-5ff7-452d-bc93-f6f18effeca7 req-93645242-3676-4b2e-9915-5a38122a3abb service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] No waiting events found dispatching network-vif-unplugged-e2cbf31f-6cf8-4a30-9d9b-3bbb3645a660 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG nova.compute.manager [req-67958122-5ff7-452d-bc93-f6f18effeca7 req-93645242-3676-4b2e-9915-5a38122a3abb service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Received event network-vif-unplugged-e2cbf31f-6cf8-4a30-9d9b-3bbb3645a660 for instance with task_state deleting. {{(pid=75245) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG nova.compute.manager [req-67958122-5ff7-452d-bc93-f6f18effeca7 req-93645242-3676-4b2e-9915-5a38122a3abb service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Received event network-vif-plugged-e2cbf31f-6cf8-4a30-9d9b-3bbb3645a660 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-67958122-5ff7-452d-bc93-f6f18effeca7 req-93645242-3676-4b2e-9915-5a38122a3abb service nova] Acquiring lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-67958122-5ff7-452d-bc93-f6f18effeca7 req-93645242-3676-4b2e-9915-5a38122a3abb service nova] Lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-67958122-5ff7-452d-bc93-f6f18effeca7 req-93645242-3676-4b2e-9915-5a38122a3abb service nova] Lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG nova.compute.manager [req-67958122-5ff7-452d-bc93-f6f18effeca7 req-93645242-3676-4b2e-9915-5a38122a3abb service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] No waiting events found dispatching network-vif-plugged-e2cbf31f-6cf8-4a30-9d9b-3bbb3645a660 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:12:51 user nova-compute[75245]: WARNING nova.compute.manager [req-67958122-5ff7-452d-bc93-f6f18effeca7 req-93645242-3676-4b2e-9915-5a38122a3abb service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Received unexpected event network-vif-plugged-e2cbf31f-6cf8-4a30-9d9b-3bbb3645a660 for instance with vm_state active and task_state deleting.
Nov 29 16:12:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:51 user nova-compute[75245]: INFO os_vif [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:11:4e,bridge_name='br-int',has_traffic_filtering=True,id=f91c7d1f-43fd-4e3e-9748-dd25010699bd,network=Network(891dd2c7-8a6d-4a31-b5d4-6edcd5e2f9ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf91c7d1f-43')
Nov 29 16:12:51 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T16:10:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1163488234',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1163488234',id=10,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOw/5U9h5ccex2qnP/5hOTP78ppDsOgRNSxy0KA0i1xSCXR5NDTKu7hvcsmkDcFw/WanqDVtSpFbkkBVHht7EsYDS15+PaPoF0OH31h4AuA0XHHkSzaU9hrZMTJL7pI2Mg==',key_name='tempest-keypair-1884616232',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:11:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1e751c778a804388a05afe573a7b7828',ramdisk_id='',reservation_id='r-6eckmld2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1192969410',owner_user_name='tempest-TaggedBootDevicesTest-1192969410-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:11:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fc59a8c008f4270a8643280e6649e94',uuid=696417e7-8eff-46f3-a6f1-11a9f5191627,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "56b28d7b-1c3c-4e60-bbd6-7fd01f07fc6c", "address": "fa:16:3e:83:2f:60", "network": {"id": "e6c7f35e-5af2-440d-8433-00e0c0f5e62c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1457199759", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56b28d7b-1c", "ovs_interfaceid": "56b28d7b-1c3c-4e60-bbd6-7fd01f07fc6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Converting VIF {"id": "56b28d7b-1c3c-4e60-bbd6-7fd01f07fc6c", "address": "fa:16:3e:83:2f:60", "network": {"id": "e6c7f35e-5af2-440d-8433-00e0c0f5e62c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1457199759", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56b28d7b-1c", "ovs_interfaceid": "56b28d7b-1c3c-4e60-bbd6-7fd01f07fc6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:2f:60,bridge_name='br-int',has_traffic_filtering=True,id=56b28d7b-1c3c-4e60-bbd6-7fd01f07fc6c,network=Network(e6c7f35e-5af2-440d-8433-00e0c0f5e62c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56b28d7b-1c') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG os_vif [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:2f:60,bridge_name='br-int',has_traffic_filtering=True,id=56b28d7b-1c3c-4e60-bbd6-7fd01f07fc6c,network=Network(e6c7f35e-5af2-440d-8433-00e0c0f5e62c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56b28d7b-1c') {{(pid=75245) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap56b28d7b-1c, bridge=br-int, if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f7aacd1f-5268-4e4c-9215-0762c174841d) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:51 user nova-compute[75245]: INFO os_vif [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:2f:60,bridge_name='br-int',has_traffic_filtering=True,id=56b28d7b-1c3c-4e60-bbd6-7fd01f07fc6c,network=Network(e6c7f35e-5af2-440d-8433-00e0c0f5e62c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56b28d7b-1c')
Nov 29 16:12:51 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T16:10:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1163488234',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1163488234',id=10,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOw/5U9h5ccex2qnP/5hOTP78ppDsOgRNSxy0KA0i1xSCXR5NDTKu7hvcsmkDcFw/WanqDVtSpFbkkBVHht7EsYDS15+PaPoF0OH31h4AuA0XHHkSzaU9hrZMTJL7pI2Mg==',key_name='tempest-keypair-1884616232',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:11:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1e751c778a804388a05afe573a7b7828',ramdisk_id='',reservation_id='r-6eckmld2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1192969410',owner_user_name='tempest-TaggedBootDevicesTest-1192969410-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:11:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fc59a8c008f4270a8643280e6649e94',uuid=696417e7-8eff-46f3-a6f1-11a9f5191627,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d6c559e9-afbf-473d-b4b0-f3cdff6938bc", "address": "fa:16:3e:21:9f:17", "network": {"id": "e6c7f35e-5af2-440d-8433-00e0c0f5e62c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1457199759", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c559e9-af", "ovs_interfaceid": "d6c559e9-afbf-473d-b4b0-f3cdff6938bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Converting VIF {"id": "d6c559e9-afbf-473d-b4b0-f3cdff6938bc", "address": "fa:16:3e:21:9f:17", "network": {"id": "e6c7f35e-5af2-440d-8433-00e0c0f5e62c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1457199759", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c559e9-af", "ovs_interfaceid": "d6c559e9-afbf-473d-b4b0-f3cdff6938bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:9f:17,bridge_name='br-int',has_traffic_filtering=True,id=d6c559e9-afbf-473d-b4b0-f3cdff6938bc,network=Network(e6c7f35e-5af2-440d-8433-00e0c0f5e62c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6c559e9-af') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG os_vif [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:9f:17,bridge_name='br-int',has_traffic_filtering=True,id=d6c559e9-afbf-473d-b4b0-f3cdff6938bc,network=Network(e6c7f35e-5af2-440d-8433-00e0c0f5e62c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6c559e9-af') {{(pid=75245) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd6c559e9-af, bridge=br-int, if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b9613eb5-a003-4c88-88b2-efda983c5187) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:12:51 user nova-compute[75245]: INFO os_vif [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:9f:17,bridge_name='br-int',has_traffic_filtering=True,id=d6c559e9-afbf-473d-b4b0-f3cdff6938bc,network=Network(e6c7f35e-5af2-440d-8433-00e0c0f5e62c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6c559e9-af')
Nov 29 16:12:51 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] calling os-brick to detach iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, {'target_iqn': 'iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qkfYeGDa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:12:51 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:12:51 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[c36441ed-cd6e-4207-a5bf-ecec0423b0d6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 16:12:51 user nova-compute[75245]: No targets found.
Nov 29 16:12:51 user nova-compute[75245]: iSNS:
Nov 29 16:12:51 user nova-compute[75245]: No targets found.
Nov 29 16:12:51 user nova-compute[75245]: STATIC:
Nov 29 16:12:51 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678
Nov 29 16:12:51 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:12:51 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:12:51 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1
Nov 29 16:12:51 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:12:51 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:12:51 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311
Nov 29 16:12:51 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:12:51 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:12:51 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49
Nov 29 16:12:51 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:12:51 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:12:51 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63
Nov 29 16:12:51 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:12:51 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:12:51 user nova-compute[75245]: FIRMWARE:
Nov 29 16:12:51 user nova-compute[75245]: No targets found.
Nov 29 16:12:51 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 16:12:51 user nova-compute[75245]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 16:12:51 user nova-compute[75245]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75245) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311', 0)] {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[22eec976-6a57-48dd-a3ff-550e6c84beb3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[3504b711-ade7-4178-b740-f90a46a97c14]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 (non-flash)
Nov 29 16:12:51 user nova-compute[75245]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311 (non-flash)
Nov 29 16:12:51 user nova-compute[75245]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63 (non-flash)
Nov 29 16:12:51 user nova-compute[75245]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49 (non-flash)
Nov 29 16:12:51 user nova-compute[75245]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1 (non-flash)
Nov 29 16:12:51 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 (non-flash)
Nov 29 16:12:51 user nova-compute[75245]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311 (non-flash)
Nov 29 16:12:51 user nova-compute[75245]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63 (non-flash)
Nov 29 16:12:51 user nova-compute[75245]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49 (non-flash)
Nov 29 16:12:51 user nova-compute[75245]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1 (non-flash)
Nov 29 16:12:51 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0d442e3010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311'): ({'sdc'}, set())}) {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Removing single pathed devices sdc {{(pid=75245) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG nova.network.neutron [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] [instance: fd819060-4388-444d-809e-94f6b2e8f102] Updating instance_info_cache with network_info: [{"id": "e11ba0cd-c449-4b18-a32e-41d267535482", "address": "fa:16:3e:a4:25:65", "network": {"id": "11119178-094d-4c14-8eea-233947dddfe4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1660525559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0009bdf2ef8f43a59341dd6eea441b02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape11ba0cd-c4", "ovs_interfaceid": "e11ba0cd-c449-4b18-a32e-41d267535482", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[1861456c-9eac-4a80-85bb-ca1696a03432]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Releasing lock "refresh_cache-fd819060-4388-444d-809e-94f6b2e8f102" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG nova.compute.manager [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] [instance: fd819060-4388-444d-809e-94f6b2e8f102] Instance network_info: |[{"id": "e11ba0cd-c449-4b18-a32e-41d267535482", "address": "fa:16:3e:a4:25:65", "network": {"id": "11119178-094d-4c14-8eea-233947dddfe4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1660525559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0009bdf2ef8f43a59341dd6eea441b02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape11ba0cd-c4", "ovs_interfaceid": "e11ba0cd-c449-4b18-a32e-41d267535482", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] [instance: fd819060-4388-444d-809e-94f6b2e8f102] Start _get_guest_xml network_info=[{"id": "e11ba0cd-c449-4b18-a32e-41d267535482", "address": "fa:16:3e:a4:25:65", "network": {"id": "11119178-094d-4c14-8eea-233947dddfe4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1660525559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0009bdf2ef8f43a59341dd6eea441b02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape11ba0cd-c4", "ovs_interfaceid": "e11ba0cd-c449-4b18-a32e-41d267535482", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'a291d9c3-be02-4c6c-9649-4b45c5b7f487'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.030s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[33fc192a-c08c-4ce8-a5cb-fcd3e8c46c9d]: (4, ('ok\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Flushing IO for device /dev/sdc {{(pid=75245) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:51 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:12:51 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:12:51 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] CPU controller missing on host. {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] CPU controller found on host. {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75245) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T16:06:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Flavor limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Image limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Flavor pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Image pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Got 1 possible topologies {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:12:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1191837883',display_name='tempest-TestServerVolumeAttachmentScenario-server-1191837883',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1191837883',id=12,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqIAcvL8oOHh14XiJ8Jw34Fv+TabeY+nKRvPbM4RQlW2iQfoCOJ6QkZq8sbm/svDFL6vYihoQRx3m74p2mQdaKcXZMvvxWrFblyl0gLgaWHEavJaTl6Pd6G28sSWZnMoQ==',key_name='tempest-keypair-997920350',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0009bdf2ef8f43a59341dd6eea441b02',ramdisk_id='',reservation_id='r-2o8molwz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-126150791',owner_user_name='tempest-TestServerVolumeAttachmentScenario-126150791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:12:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='577a5571c39b493d8ea0f177f26aad27',uuid=fd819060-4388-444d-809e-94f6b2e8f102,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e11ba0cd-c449-4b18-a32e-41d267535482", "address": "fa:16:3e:a4:25:65", "network": {"id": "11119178-094d-4c14-8eea-233947dddfe4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1660525559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0009bdf2ef8f43a59341dd6eea441b02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape11ba0cd-c4", "ovs_interfaceid": "e11ba0cd-c449-4b18-a32e-41d267535482", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Converting VIF {"id": "e11ba0cd-c449-4b18-a32e-41d267535482", "address": "fa:16:3e:a4:25:65", "network": {"id": "11119178-094d-4c14-8eea-233947dddfe4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1660525559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0009bdf2ef8f43a59341dd6eea441b02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape11ba0cd-c4", "ovs_interfaceid": "e11ba0cd-c449-4b18-a32e-41d267535482", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:25:65,bridge_name='br-int',has_traffic_filtering=True,id=e11ba0cd-c449-4b18-a32e-41d267535482,network=Network(11119178-094d-4c14-8eea-233947dddfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape11ba0cd-c4') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG nova.objects.instance [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Lazy-loading 'pci_devices' on Instance uuid fd819060-4388-444d-809e-94f6b2e8f102 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf3c8cc-545a-456c-8a42-76a57e982bbd]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75245) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] [instance: fd819060-4388-444d-809e-94f6b2e8f102] End _get_guest_xml xml=<domain type="kvm">
Nov 29 16:12:51 user nova-compute[75245]:   <uuid>fd819060-4388-444d-809e-94f6b2e8f102</uuid>
Nov 29 16:12:51 user nova-compute[75245]:   <name>instance-0000000c</name>
Nov 29 16:12:51 user nova-compute[75245]:   <memory>524288</memory>
Nov 29 16:12:51 user nova-compute[75245]:   <vcpu>1</vcpu>
Nov 29 16:12:51 user nova-compute[75245]:   <metadata>
Nov 29 16:12:51 user nova-compute[75245]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 16:12:51 user nova-compute[75245]:       <nova:package version="0.0.0"/>
Nov 29 16:12:51 user nova-compute[75245]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1191837883</nova:name>
Nov 29 16:12:51 user nova-compute[75245]:       <nova:creationTime>2023-11-29 16:12:51</nova:creationTime>
Nov 29 16:12:51 user nova-compute[75245]:       <nova:flavor name="m1.tiny">
Nov 29 16:12:51 user nova-compute[75245]:         <nova:memory>512</nova:memory>
Nov 29 16:12:51 user nova-compute[75245]:         <nova:disk>1</nova:disk>
Nov 29 16:12:51 user nova-compute[75245]:         <nova:swap>0</nova:swap>
Nov 29 16:12:51 user nova-compute[75245]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 16:12:51 user nova-compute[75245]:         <nova:vcpus>1</nova:vcpus>
Nov 29 16:12:51 user nova-compute[75245]:       </nova:flavor>
Nov 29 16:12:51 user nova-compute[75245]:       <nova:owner>
Nov 29 16:12:51 user nova-compute[75245]:         <nova:user uuid="577a5571c39b493d8ea0f177f26aad27">tempest-TestServerVolumeAttachmentScenario-126150791-project-member</nova:user>
Nov 29 16:12:51 user nova-compute[75245]:         <nova:project uuid="0009bdf2ef8f43a59341dd6eea441b02">tempest-TestServerVolumeAttachmentScenario-126150791</nova:project>
Nov 29 16:12:51 user nova-compute[75245]:       </nova:owner>
Nov 29 16:12:51 user nova-compute[75245]:       <nova:root type="image" uuid="a291d9c3-be02-4c6c-9649-4b45c5b7f487"/>
Nov 29 16:12:51 user nova-compute[75245]:       <nova:ports>
Nov 29 16:12:51 user nova-compute[75245]:         <nova:port uuid="e11ba0cd-c449-4b18-a32e-41d267535482">
Nov 29 16:12:51 user nova-compute[75245]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 16:12:51 user nova-compute[75245]:         </nova:port>
Nov 29 16:12:51 user nova-compute[75245]:       </nova:ports>
Nov 29 16:12:51 user nova-compute[75245]:     </nova:instance>
Nov 29 16:12:51 user nova-compute[75245]:   </metadata>
Nov 29 16:12:51 user nova-compute[75245]:   <sysinfo type="smbios">
Nov 29 16:12:51 user nova-compute[75245]:     <system>
Nov 29 16:12:51 user nova-compute[75245]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 16:12:51 user nova-compute[75245]:       <entry name="product">OpenStack Nova</entry>
Nov 29 16:12:51 user nova-compute[75245]:       <entry name="version">0.0.0</entry>
Nov 29 16:12:51 user nova-compute[75245]:       <entry name="serial">fd819060-4388-444d-809e-94f6b2e8f102</entry>
Nov 29 16:12:51 user nova-compute[75245]:       <entry name="uuid">fd819060-4388-444d-809e-94f6b2e8f102</entry>
Nov 29 16:12:51 user nova-compute[75245]:       <entry name="family">Virtual Machine</entry>
Nov 29 16:12:51 user nova-compute[75245]:     </system>
Nov 29 16:12:51 user nova-compute[75245]:   </sysinfo>
Nov 29 16:12:51 user nova-compute[75245]:   <os>
Nov 29 16:12:51 user nova-compute[75245]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 16:12:51 user nova-compute[75245]:     <boot dev="hd"/>
Nov 29 16:12:51 user nova-compute[75245]:     <smbios mode="sysinfo"/>
Nov 29 16:12:51 user nova-compute[75245]:   </os>
Nov 29 16:12:51 user nova-compute[75245]:   <features>
Nov 29 16:12:51 user nova-compute[75245]:     <acpi/>
Nov 29 16:12:51 user nova-compute[75245]:     <apic/>
Nov 29 16:12:51 user nova-compute[75245]:     <vmcoreinfo/>
Nov 29 16:12:51 user nova-compute[75245]:   </features>
Nov 29 16:12:51 user nova-compute[75245]:   <clock offset="utc">
Nov 29 16:12:51 user nova-compute[75245]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 16:12:51 user nova-compute[75245]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 16:12:51 user nova-compute[75245]:     <timer name="hpet" present="no"/>
Nov 29 16:12:51 user nova-compute[75245]:   </clock>
Nov 29 16:12:51 user nova-compute[75245]:   <cpu mode="custom" match="exact">
Nov 29 16:12:51 user nova-compute[75245]:     <model>Nehalem</model>
Nov 29 16:12:51 user nova-compute[75245]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 16:12:51 user nova-compute[75245]:   </cpu>
Nov 29 16:12:51 user nova-compute[75245]:   <devices>
Nov 29 16:12:51 user nova-compute[75245]:     <disk type="file" device="disk">
Nov 29 16:12:51 user nova-compute[75245]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 16:12:51 user nova-compute[75245]:       <source file="/opt/stack/data/nova/instances/fd819060-4388-444d-809e-94f6b2e8f102/disk"/>
Nov 29 16:12:51 user nova-compute[75245]:       <target dev="vda" bus="virtio"/>
Nov 29 16:12:51 user nova-compute[75245]:     </disk>
Nov 29 16:12:51 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 16:12:51 user nova-compute[75245]:       <mac address="fa:16:3e:a4:25:65"/>
Nov 29 16:12:51 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:12:51 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 16:12:51 user nova-compute[75245]:       <target dev="tape11ba0cd-c4"/>
Nov 29 16:12:51 user nova-compute[75245]:     </interface>
Nov 29 16:12:51 user nova-compute[75245]:     <serial type="pty">
Nov 29 16:12:51 user nova-compute[75245]:       <log file="/opt/stack/data/nova/instances/fd819060-4388-444d-809e-94f6b2e8f102/console.log" append="off"/>
Nov 29 16:12:51 user nova-compute[75245]:     </serial>
Nov 29 16:12:51 user nova-compute[75245]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 16:12:51 user nova-compute[75245]:     <video>
Nov 29 16:12:51 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:12:51 user nova-compute[75245]:     </video>
Nov 29 16:12:51 user nova-compute[75245]:     <rng model="virtio">
Nov 29 16:12:51 user nova-compute[75245]:       <backend model="random">/dev/urandom</backend>
Nov 29 16:12:51 user nova-compute[75245]:     </rng>
Nov 29 16:12:51 user nova-compute[75245]:     <controller type="usb" index="0" model="none"/>
Nov 29 16:12:51 user nova-compute[75245]:     <memballoon model="virtio">
Nov 29 16:12:51 user nova-compute[75245]:       <stats period="10"/>
Nov 29 16:12:51 user nova-compute[75245]:     </memballoon>
Nov 29 16:12:51 user nova-compute[75245]:   </devices>
Nov 29 16:12:51 user nova-compute[75245]: </domain>
Nov 29 16:12:51 user nova-compute[75245]:  {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:12:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1191837883',display_name='tempest-TestServerVolumeAttachmentScenario-server-1191837883',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1191837883',id=12,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqIAcvL8oOHh14XiJ8Jw34Fv+TabeY+nKRvPbM4RQlW2iQfoCOJ6QkZq8sbm/svDFL6vYihoQRx3m74p2mQdaKcXZMvvxWrFblyl0gLgaWHEavJaTl6Pd6G28sSWZnMoQ==',key_name='tempest-keypair-997920350',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0009bdf2ef8f43a59341dd6eea441b02',ramdisk_id='',reservation_id='r-2o8molwz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-126150791',owner_user_name='tempest-TestServerVolumeAttachmentScenario-126150791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:12:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='577a5571c39b493d8ea0f177f26aad27',uuid=fd819060-4388-444d-809e-94f6b2e8f102,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e11ba0cd-c449-4b18-a32e-41d267535482", "address": "fa:16:3e:a4:25:65", "network": {"id": "11119178-094d-4c14-8eea-233947dddfe4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1660525559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0009bdf2ef8f43a59341dd6eea441b02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape11ba0cd-c4", "ovs_interfaceid": "e11ba0cd-c449-4b18-a32e-41d267535482", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Converting VIF {"id": "e11ba0cd-c449-4b18-a32e-41d267535482", "address": "fa:16:3e:a4:25:65", "network": {"id": "11119178-094d-4c14-8eea-233947dddfe4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1660525559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0009bdf2ef8f43a59341dd6eea441b02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape11ba0cd-c4", "ovs_interfaceid": "e11ba0cd-c449-4b18-a32e-41d267535482", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:25:65,bridge_name='br-int',has_traffic_filtering=True,id=e11ba0cd-c449-4b18-a32e-41d267535482,network=Network(11119178-094d-4c14-8eea-233947dddfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape11ba0cd-c4') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG os_vif [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:25:65,bridge_name='br-int',has_traffic_filtering=True,id=e11ba0cd-c449-4b18-a32e-41d267535482,network=Network(11119178-094d-4c14-8eea-233947dddfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape11ba0cd-c4') {{(pid=75245) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '16601d36-161f-5f5a-8049-0a46ffcf5d6e', '_type': 'linux-noop'}}, row=False) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape11ba0cd-c4, may_exist=True, interface_attrs={}) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape11ba0cd-c4, col_values=(('qos', UUID('57129fff-f93f-4474-94e9-3276b96dcb9e')),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape11ba0cd-c4, col_values=(('external_ids', {'iface-id': 'e11ba0cd-c449-4b18-a32e-41d267535482', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:25:65', 'vm-uuid': 'fd819060-4388-444d-809e-94f6b2e8f102'}),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:51 user nova-compute[75245]: INFO os_vif [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:25:65,bridge_name='br-int',has_traffic_filtering=True,id=e11ba0cd-c449-4b18-a32e-41d267535482,network=Network(11119178-094d-4c14-8eea-233947dddfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape11ba0cd-c4')
Nov 29 16:12:51 user nova-compute[75245]: DEBUG nova.compute.manager [req-34f6b397-5355-4dad-b5f4-99327aca18a5 req-2599b90d-3714-446f-8fe3-2c8875288387 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Received event network-vif-plugged-6a5d2bae-9b9d-4331-b080-badfed69c6b1 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-34f6b397-5355-4dad-b5f4-99327aca18a5 req-2599b90d-3714-446f-8fe3-2c8875288387 service nova] Acquiring lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-34f6b397-5355-4dad-b5f4-99327aca18a5 req-2599b90d-3714-446f-8fe3-2c8875288387 service nova] Lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-34f6b397-5355-4dad-b5f4-99327aca18a5 req-2599b90d-3714-446f-8fe3-2c8875288387 service nova] Lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG nova.compute.manager [req-34f6b397-5355-4dad-b5f4-99327aca18a5 req-2599b90d-3714-446f-8fe3-2c8875288387 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] No waiting events found dispatching network-vif-plugged-6a5d2bae-9b9d-4331-b080-badfed69c6b1 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:12:51 user nova-compute[75245]: WARNING nova.compute.manager [req-34f6b397-5355-4dad-b5f4-99327aca18a5 req-2599b90d-3714-446f-8fe3-2c8875288387 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Received unexpected event network-vif-plugged-6a5d2bae-9b9d-4331-b080-badfed69c6b1 for instance with vm_state active and task_state deleting.
Nov 29 16:12:51 user nova-compute[75245]: DEBUG nova.compute.manager [req-34f6b397-5355-4dad-b5f4-99327aca18a5 req-2599b90d-3714-446f-8fe3-2c8875288387 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Received event network-vif-unplugged-f91c7d1f-43fd-4e3e-9748-dd25010699bd {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-34f6b397-5355-4dad-b5f4-99327aca18a5 req-2599b90d-3714-446f-8fe3-2c8875288387 service nova] Acquiring lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-34f6b397-5355-4dad-b5f4-99327aca18a5 req-2599b90d-3714-446f-8fe3-2c8875288387 service nova] Lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-34f6b397-5355-4dad-b5f4-99327aca18a5 req-2599b90d-3714-446f-8fe3-2c8875288387 service nova] Lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG nova.compute.manager [req-34f6b397-5355-4dad-b5f4-99327aca18a5 req-2599b90d-3714-446f-8fe3-2c8875288387 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] No waiting events found dispatching network-vif-unplugged-f91c7d1f-43fd-4e3e-9748-dd25010699bd {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG nova.compute.manager [req-34f6b397-5355-4dad-b5f4-99327aca18a5 req-2599b90d-3714-446f-8fe3-2c8875288387 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Received event network-vif-unplugged-f91c7d1f-43fd-4e3e-9748-dd25010699bd for instance with task_state deleting. {{(pid=75245) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG nova.compute.manager [req-34f6b397-5355-4dad-b5f4-99327aca18a5 req-2599b90d-3714-446f-8fe3-2c8875288387 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Received event network-vif-plugged-f91c7d1f-43fd-4e3e-9748-dd25010699bd {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-34f6b397-5355-4dad-b5f4-99327aca18a5 req-2599b90d-3714-446f-8fe3-2c8875288387 service nova] Acquiring lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-34f6b397-5355-4dad-b5f4-99327aca18a5 req-2599b90d-3714-446f-8fe3-2c8875288387 service nova] Lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-34f6b397-5355-4dad-b5f4-99327aca18a5 req-2599b90d-3714-446f-8fe3-2c8875288387 service nova] Lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG nova.compute.manager [req-34f6b397-5355-4dad-b5f4-99327aca18a5 req-2599b90d-3714-446f-8fe3-2c8875288387 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] No waiting events found dispatching network-vif-plugged-f91c7d1f-43fd-4e3e-9748-dd25010699bd {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:12:51 user nova-compute[75245]: WARNING nova.compute.manager [req-34f6b397-5355-4dad-b5f4-99327aca18a5 req-2599b90d-3714-446f-8fe3-2c8875288387 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Received unexpected event network-vif-plugged-f91c7d1f-43fd-4e3e-9748-dd25010699bd for instance with vm_state active and task_state deleting.
Nov 29 16:12:51 user nova-compute[75245]: DEBUG nova.compute.manager [req-34f6b397-5355-4dad-b5f4-99327aca18a5 req-2599b90d-3714-446f-8fe3-2c8875288387 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Received event network-vif-unplugged-d6c559e9-afbf-473d-b4b0-f3cdff6938bc {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-34f6b397-5355-4dad-b5f4-99327aca18a5 req-2599b90d-3714-446f-8fe3-2c8875288387 service nova] Acquiring lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-34f6b397-5355-4dad-b5f4-99327aca18a5 req-2599b90d-3714-446f-8fe3-2c8875288387 service nova] Lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-34f6b397-5355-4dad-b5f4-99327aca18a5 req-2599b90d-3714-446f-8fe3-2c8875288387 service nova] Lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG nova.compute.manager [req-34f6b397-5355-4dad-b5f4-99327aca18a5 req-2599b90d-3714-446f-8fe3-2c8875288387 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] No waiting events found dispatching network-vif-unplugged-d6c559e9-afbf-473d-b4b0-f3cdff6938bc {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG nova.compute.manager [req-34f6b397-5355-4dad-b5f4-99327aca18a5 req-2599b90d-3714-446f-8fe3-2c8875288387 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Received event network-vif-unplugged-d6c559e9-afbf-473d-b4b0-f3cdff6938bc for instance with task_state deleting. {{(pid=75245) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG nova.compute.manager [req-34f6b397-5355-4dad-b5f4-99327aca18a5 req-2599b90d-3714-446f-8fe3-2c8875288387 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Received event network-vif-plugged-d6c559e9-afbf-473d-b4b0-f3cdff6938bc {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-34f6b397-5355-4dad-b5f4-99327aca18a5 req-2599b90d-3714-446f-8fe3-2c8875288387 service nova] Acquiring lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-34f6b397-5355-4dad-b5f4-99327aca18a5 req-2599b90d-3714-446f-8fe3-2c8875288387 service nova] Lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-34f6b397-5355-4dad-b5f4-99327aca18a5 req-2599b90d-3714-446f-8fe3-2c8875288387 service nova] Lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG nova.compute.manager [req-34f6b397-5355-4dad-b5f4-99327aca18a5 req-2599b90d-3714-446f-8fe3-2c8875288387 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] No waiting events found dispatching network-vif-plugged-d6c559e9-afbf-473d-b4b0-f3cdff6938bc {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:12:51 user nova-compute[75245]: WARNING nova.compute.manager [req-34f6b397-5355-4dad-b5f4-99327aca18a5 req-2599b90d-3714-446f-8fe3-2c8875288387 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Received unexpected event network-vif-plugged-d6c559e9-afbf-473d-b4b0-f3cdff6938bc for instance with vm_state active and task_state deleting.
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.060s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[f627a9a1-18dc-4e45-b34b-b9cef313cd34]: (4, ('1', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] SCSI volumes sdc have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311')] {{(pid=75245) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[d60710bf-9d97-4df8-b07d-998bc6392920]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311 -p 172.16.0.220:3260 --logout {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] No VIF found with MAC fa:16:3e:a4:25:65, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[47480887-510f-4829-93bd-a480f52c1404]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311, portal: 172.16.0.220,3260]
Nov 29 16:12:51 user nova-compute[75245]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311, portal: 172.16.0.220,3260] successful.
Nov 29 16:12:51 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311 -p 172.16.0.220:3260 --op delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a923d37-4d88-41bf-a160-1e163236f311 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[2646d0ec-5671-49e5-aa87-fc4affb20143]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.415s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] <== disconnect_volume: return (417ms) None {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Disconnected iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] calling os-brick to detach iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, {'target_iqn': 'iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qwDRiYpW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:12:51 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:12:51 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[1debfa09-3c2f-400c-aa83-a21069bc4c40]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 16:12:51 user nova-compute[75245]: No targets found.
Nov 29 16:12:51 user nova-compute[75245]: iSNS:
Nov 29 16:12:51 user nova-compute[75245]: No targets found.
Nov 29 16:12:51 user nova-compute[75245]: STATIC:
Nov 29 16:12:51 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678
Nov 29 16:12:51 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:12:51 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:12:51 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1
Nov 29 16:12:51 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:12:51 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:12:51 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49
Nov 29 16:12:51 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:12:51 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:12:51 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63
Nov 29 16:12:51 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:12:51 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:12:51 user nova-compute[75245]: FIRMWARE:
Nov 29 16:12:51 user nova-compute[75245]: No targets found.
Nov 29 16:12:51 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 16:12:51 user nova-compute[75245]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 16:12:51 user nova-compute[75245]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75245) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63', 0)] {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe8ba27d-2b94-4038-8be0-2a180c8c8a14]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e7656f-cc7e-47e9-ab5f-699c06d5dbae]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 (non-flash)
Nov 29 16:12:51 user nova-compute[75245]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63 (non-flash)
Nov 29 16:12:51 user nova-compute[75245]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49 (non-flash)
Nov 29 16:12:51 user nova-compute[75245]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1 (non-flash)
Nov 29 16:12:51 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 (non-flash)
Nov 29 16:12:51 user nova-compute[75245]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63 (non-flash)
Nov 29 16:12:51 user nova-compute[75245]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49 (non-flash)
Nov 29 16:12:51 user nova-compute[75245]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1 (non-flash)
Nov 29 16:12:51 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0d4c3870a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63'): ({'sdd'}, set())}) {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Removing single pathed devices sdd {{(pid=75245) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98c1971-4d39-445d-868c-1df772ef9b4b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[c315e681-8ebe-4db7-939e-f5d624ccdae8]: (4, ('ok\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Flushing IO for device /dev/sdd {{(pid=75245) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4d0a83-99ec-4932-a10a-2e5d9a51884a]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75245) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.034s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9366191-c2ab-4821-b0f4-f1f939875b59]: (4, ('1', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] SCSI volumes sdd have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63')] {{(pid=75245) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e80f731-5f7d-4647-bdf0-b11bab09b02f]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:12:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63 -p 172.16.0.220:3260 --logout {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[771e19f6-501f-4e14-a6bc-1d573aef7d4b]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63, portal: 172.16.0.220,3260]
Nov 29 16:12:52 user nova-compute[75245]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63, portal: 172.16.0.220,3260] successful.
Nov 29 16:12:52 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63 -p 172.16.0.220:3260 --op delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51c84145-9618-45af-ad49-4fd8c925bb63 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d1b7e5-71a2-4e87-acd1-b61d6d32d9f4]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] <== disconnect_volume: return (286ms) None {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Disconnected iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] calling os-brick to detach iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, {'target_iqn': 'iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yYxhBraG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:12:52 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:12:52 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c2812a-edf6-4fe4-a38f-da8f5f965ff2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 16:12:52 user nova-compute[75245]: No targets found.
Nov 29 16:12:52 user nova-compute[75245]: iSNS:
Nov 29 16:12:52 user nova-compute[75245]: No targets found.
Nov 29 16:12:52 user nova-compute[75245]: STATIC:
Nov 29 16:12:52 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678
Nov 29 16:12:52 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:12:52 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:12:52 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1
Nov 29 16:12:52 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:12:52 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:12:52 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49
Nov 29 16:12:52 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:12:52 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:12:52 user nova-compute[75245]: FIRMWARE:
Nov 29 16:12:52 user nova-compute[75245]: No targets found.
Nov 29 16:12:52 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 16:12:52 user nova-compute[75245]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 16:12:52 user nova-compute[75245]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75245) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678', 0)] {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b5af215-068a-4977-accb-9fecdad5fbda]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f886483-dfe2-488c-9e91-02c95080bdd7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 (non-flash)
Nov 29 16:12:52 user nova-compute[75245]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49 (non-flash)
Nov 29 16:12:52 user nova-compute[75245]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1 (non-flash)
Nov 29 16:12:52 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 (non-flash)
Nov 29 16:12:52 user nova-compute[75245]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49 (non-flash)
Nov 29 16:12:52 user nova-compute[75245]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1 (non-flash)
Nov 29 16:12:52 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0d4c3870a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678'): ({'sdb'}, set())}) {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Removing single pathed devices sdb {{(pid=75245) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4867fec-9239-43b0-b172-1fc7c75a435a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde88196-d49e-498e-a551-88f3450d1876]: (4, ('ok\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Flushing IO for device /dev/sdb {{(pid=75245) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.011s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d71818-bfdf-436a-b16c-7cf032f65629]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75245) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff8fa16-57bb-4f31-b3ff-c87a69e8bba2]: (4, ('1', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] SCSI volumes sdb have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678')] {{(pid=75245) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee8f92c-3428-4fa8-97c5-d59c52b3765c]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 -p 172.16.0.220:3260 --logout {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f8eec8-5f46-4d90-8ae0-23dd99df820c]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678, portal: 172.16.0.220,3260]
Nov 29 16:12:52 user nova-compute[75245]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678, portal: 172.16.0.220,3260] successful.
Nov 29 16:12:52 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 -p 172.16.0.220:3260 --op delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86bd6476-7e72-486f-8c34-0dea88db3678 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f3b0b0-2e6a-41c2-bae8-54ff1dbd72be]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] <== disconnect_volume: return (293ms) None {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Disconnected iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 16:12:52 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Deleting instance files /opt/stack/data/nova/instances/696417e7-8eff-46f3-a6f1-11a9f5191627_del
Nov 29 16:12:52 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Deletion of /opt/stack/data/nova/instances/696417e7-8eff-46f3-a6f1-11a9f5191627_del complete
Nov 29 16:12:52 user nova-compute[75245]: INFO nova.compute.manager [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Took 3.53 seconds to destroy the instance on the hypervisor.
Nov 29 16:12:52 user nova-compute[75245]: DEBUG oslo.service.loopingcall [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75245) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG nova.compute.manager [-] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Deallocating network for instance {{(pid=75245) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] deallocate_for_instance() {{(pid=75245) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG nova.compute.manager [req-e80474d0-1aa8-4616-a9fd-4ee270272e6b req-31febd94-9c48-4386-be08-f4c95b1dbf45 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Received event network-vif-plugged-1bcb8f7b-abf5-4fe1-8ad9-a1d0316f951a {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-e80474d0-1aa8-4616-a9fd-4ee270272e6b req-31febd94-9c48-4386-be08-f4c95b1dbf45 service nova] Acquiring lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-e80474d0-1aa8-4616-a9fd-4ee270272e6b req-31febd94-9c48-4386-be08-f4c95b1dbf45 service nova] Lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-e80474d0-1aa8-4616-a9fd-4ee270272e6b req-31febd94-9c48-4386-be08-f4c95b1dbf45 service nova] Lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG nova.compute.manager [req-e80474d0-1aa8-4616-a9fd-4ee270272e6b req-31febd94-9c48-4386-be08-f4c95b1dbf45 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] No waiting events found dispatching network-vif-plugged-1bcb8f7b-abf5-4fe1-8ad9-a1d0316f951a {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:12:52 user nova-compute[75245]: WARNING nova.compute.manager [req-e80474d0-1aa8-4616-a9fd-4ee270272e6b req-31febd94-9c48-4386-be08-f4c95b1dbf45 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Received unexpected event network-vif-plugged-1bcb8f7b-abf5-4fe1-8ad9-a1d0316f951a for instance with vm_state active and task_state deleting.
Nov 29 16:12:52 user nova-compute[75245]: DEBUG nova.compute.manager [req-e80474d0-1aa8-4616-a9fd-4ee270272e6b req-31febd94-9c48-4386-be08-f4c95b1dbf45 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Received event network-vif-unplugged-56b28d7b-1c3c-4e60-bbd6-7fd01f07fc6c {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-e80474d0-1aa8-4616-a9fd-4ee270272e6b req-31febd94-9c48-4386-be08-f4c95b1dbf45 service nova] Acquiring lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-e80474d0-1aa8-4616-a9fd-4ee270272e6b req-31febd94-9c48-4386-be08-f4c95b1dbf45 service nova] Lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-e80474d0-1aa8-4616-a9fd-4ee270272e6b req-31febd94-9c48-4386-be08-f4c95b1dbf45 service nova] Lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG nova.compute.manager [req-e80474d0-1aa8-4616-a9fd-4ee270272e6b req-31febd94-9c48-4386-be08-f4c95b1dbf45 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] No waiting events found dispatching network-vif-unplugged-56b28d7b-1c3c-4e60-bbd6-7fd01f07fc6c {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG nova.compute.manager [req-e80474d0-1aa8-4616-a9fd-4ee270272e6b req-31febd94-9c48-4386-be08-f4c95b1dbf45 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Received event network-vif-unplugged-56b28d7b-1c3c-4e60-bbd6-7fd01f07fc6c for instance with task_state deleting. {{(pid=75245) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG nova.compute.manager [req-e80474d0-1aa8-4616-a9fd-4ee270272e6b req-31febd94-9c48-4386-be08-f4c95b1dbf45 service nova] [instance: fd819060-4388-444d-809e-94f6b2e8f102] Received event network-changed-e11ba0cd-c449-4b18-a32e-41d267535482 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG nova.compute.manager [req-e80474d0-1aa8-4616-a9fd-4ee270272e6b req-31febd94-9c48-4386-be08-f4c95b1dbf45 service nova] [instance: fd819060-4388-444d-809e-94f6b2e8f102] Refreshing instance network info cache due to event network-changed-e11ba0cd-c449-4b18-a32e-41d267535482. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-e80474d0-1aa8-4616-a9fd-4ee270272e6b req-31febd94-9c48-4386-be08-f4c95b1dbf45 service nova] Acquiring lock "refresh_cache-fd819060-4388-444d-809e-94f6b2e8f102" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-e80474d0-1aa8-4616-a9fd-4ee270272e6b req-31febd94-9c48-4386-be08-f4c95b1dbf45 service nova] Acquired lock "refresh_cache-fd819060-4388-444d-809e-94f6b2e8f102" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG nova.network.neutron [req-e80474d0-1aa8-4616-a9fd-4ee270272e6b req-31febd94-9c48-4386-be08-f4c95b1dbf45 service nova] [instance: fd819060-4388-444d-809e-94f6b2e8f102] Refreshing network info cache for port e11ba0cd-c449-4b18-a32e-41d267535482 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75245) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:52 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:53 user nova-compute[75245]: DEBUG nova.network.neutron [req-e80474d0-1aa8-4616-a9fd-4ee270272e6b req-31febd94-9c48-4386-be08-f4c95b1dbf45 service nova] [instance: fd819060-4388-444d-809e-94f6b2e8f102] Updated VIF entry in instance network info cache for port e11ba0cd-c449-4b18-a32e-41d267535482. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:12:53 user nova-compute[75245]: DEBUG nova.network.neutron [req-e80474d0-1aa8-4616-a9fd-4ee270272e6b req-31febd94-9c48-4386-be08-f4c95b1dbf45 service nova] [instance: fd819060-4388-444d-809e-94f6b2e8f102] Updating instance_info_cache with network_info: [{"id": "e11ba0cd-c449-4b18-a32e-41d267535482", "address": "fa:16:3e:a4:25:65", "network": {"id": "11119178-094d-4c14-8eea-233947dddfe4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1660525559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0009bdf2ef8f43a59341dd6eea441b02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape11ba0cd-c4", "ovs_interfaceid": "e11ba0cd-c449-4b18-a32e-41d267535482", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:12:53 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-e80474d0-1aa8-4616-a9fd-4ee270272e6b req-31febd94-9c48-4386-be08-f4c95b1dbf45 service nova] Releasing lock "refresh_cache-fd819060-4388-444d-809e-94f6b2e8f102" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:12:53 user nova-compute[75245]: DEBUG nova.compute.manager [req-e80474d0-1aa8-4616-a9fd-4ee270272e6b req-31febd94-9c48-4386-be08-f4c95b1dbf45 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Received event network-vif-plugged-56b28d7b-1c3c-4e60-bbd6-7fd01f07fc6c {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:12:53 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-e80474d0-1aa8-4616-a9fd-4ee270272e6b req-31febd94-9c48-4386-be08-f4c95b1dbf45 service nova] Acquiring lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:12:53 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-e80474d0-1aa8-4616-a9fd-4ee270272e6b req-31febd94-9c48-4386-be08-f4c95b1dbf45 service nova] Lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:12:53 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-e80474d0-1aa8-4616-a9fd-4ee270272e6b req-31febd94-9c48-4386-be08-f4c95b1dbf45 service nova] Lock "696417e7-8eff-46f3-a6f1-11a9f5191627-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:12:53 user nova-compute[75245]: DEBUG nova.compute.manager [req-e80474d0-1aa8-4616-a9fd-4ee270272e6b req-31febd94-9c48-4386-be08-f4c95b1dbf45 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] No waiting events found dispatching network-vif-plugged-56b28d7b-1c3c-4e60-bbd6-7fd01f07fc6c {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:12:53 user nova-compute[75245]: WARNING nova.compute.manager [req-e80474d0-1aa8-4616-a9fd-4ee270272e6b req-31febd94-9c48-4386-be08-f4c95b1dbf45 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Received unexpected event network-vif-plugged-56b28d7b-1c3c-4e60-bbd6-7fd01f07fc6c for instance with vm_state active and task_state deleting.
Nov 29 16:12:53 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:53 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd819060-4388-444d-809e-94f6b2e8f102/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:53 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:53 user nova-compute[75245]: DEBUG nova.compute.manager [req-fefaea7e-162f-48fb-83f2-cf18742bec45 req-dd6351a3-f406-4bd0-9b45-7698f6b6851f service nova] [instance: fd819060-4388-444d-809e-94f6b2e8f102] Received event network-vif-plugged-e11ba0cd-c449-4b18-a32e-41d267535482 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:12:53 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-fefaea7e-162f-48fb-83f2-cf18742bec45 req-dd6351a3-f406-4bd0-9b45-7698f6b6851f service nova] Acquiring lock "fd819060-4388-444d-809e-94f6b2e8f102-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:12:53 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-fefaea7e-162f-48fb-83f2-cf18742bec45 req-dd6351a3-f406-4bd0-9b45-7698f6b6851f service nova] Lock "fd819060-4388-444d-809e-94f6b2e8f102-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:12:53 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-fefaea7e-162f-48fb-83f2-cf18742bec45 req-dd6351a3-f406-4bd0-9b45-7698f6b6851f service nova] Lock "fd819060-4388-444d-809e-94f6b2e8f102-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:12:53 user nova-compute[75245]: DEBUG nova.compute.manager [req-fefaea7e-162f-48fb-83f2-cf18742bec45 req-dd6351a3-f406-4bd0-9b45-7698f6b6851f service nova] [instance: fd819060-4388-444d-809e-94f6b2e8f102] No waiting events found dispatching network-vif-plugged-e11ba0cd-c449-4b18-a32e-41d267535482 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:12:53 user nova-compute[75245]: WARNING nova.compute.manager [req-fefaea7e-162f-48fb-83f2-cf18742bec45 req-dd6351a3-f406-4bd0-9b45-7698f6b6851f service nova] [instance: fd819060-4388-444d-809e-94f6b2e8f102] Received unexpected event network-vif-plugged-e11ba0cd-c449-4b18-a32e-41d267535482 for instance with vm_state building and task_state spawning.
Nov 29 16:12:53 user nova-compute[75245]: DEBUG nova.compute.manager [req-fefaea7e-162f-48fb-83f2-cf18742bec45 req-dd6351a3-f406-4bd0-9b45-7698f6b6851f service nova] [instance: fd819060-4388-444d-809e-94f6b2e8f102] Received event network-vif-plugged-e11ba0cd-c449-4b18-a32e-41d267535482 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:12:53 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-fefaea7e-162f-48fb-83f2-cf18742bec45 req-dd6351a3-f406-4bd0-9b45-7698f6b6851f service nova] Acquiring lock "fd819060-4388-444d-809e-94f6b2e8f102-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:12:53 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-fefaea7e-162f-48fb-83f2-cf18742bec45 req-dd6351a3-f406-4bd0-9b45-7698f6b6851f service nova] Lock "fd819060-4388-444d-809e-94f6b2e8f102-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:12:53 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-fefaea7e-162f-48fb-83f2-cf18742bec45 req-dd6351a3-f406-4bd0-9b45-7698f6b6851f service nova] Lock "fd819060-4388-444d-809e-94f6b2e8f102-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:12:53 user nova-compute[75245]: DEBUG nova.compute.manager [req-fefaea7e-162f-48fb-83f2-cf18742bec45 req-dd6351a3-f406-4bd0-9b45-7698f6b6851f service nova] [instance: fd819060-4388-444d-809e-94f6b2e8f102] No waiting events found dispatching network-vif-plugged-e11ba0cd-c449-4b18-a32e-41d267535482 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:12:53 user nova-compute[75245]: WARNING nova.compute.manager [req-fefaea7e-162f-48fb-83f2-cf18742bec45 req-dd6351a3-f406-4bd0-9b45-7698f6b6851f service nova] [instance: fd819060-4388-444d-809e-94f6b2e8f102] Received unexpected event network-vif-plugged-e11ba0cd-c449-4b18-a32e-41d267535482 for instance with vm_state building and task_state spawning.
Nov 29 16:12:53 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd819060-4388-444d-809e-94f6b2e8f102/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:53 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd819060-4388-444d-809e-94f6b2e8f102/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:53 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd819060-4388-444d-809e-94f6b2e8f102/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:53 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55f5b252-468d-4064-99b3-49bdcdf98db8/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:54 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55f5b252-468d-4064-99b3-49bdcdf98db8/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:54 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55f5b252-468d-4064-99b3-49bdcdf98db8/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:54 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55f5b252-468d-4064-99b3-49bdcdf98db8/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:54 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:54 user nova-compute[75245]: DEBUG nova.compute.manager [req-6cacb3f1-b155-4811-9bcd-3c55f7dc0bca req-7b7d92a0-8b96-4628-bc1a-fd972ebf46c0 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Received event network-vif-deleted-f91c7d1f-43fd-4e3e-9748-dd25010699bd {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:12:54 user nova-compute[75245]: INFO nova.compute.manager [req-6cacb3f1-b155-4811-9bcd-3c55f7dc0bca req-7b7d92a0-8b96-4628-bc1a-fd972ebf46c0 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Neutron deleted interface f91c7d1f-43fd-4e3e-9748-dd25010699bd; detaching it from the instance and deleting it from the info cache
Nov 29 16:12:54 user nova-compute[75245]: DEBUG nova.network.neutron [req-6cacb3f1-b155-4811-9bcd-3c55f7dc0bca req-7b7d92a0-8b96-4628-bc1a-fd972ebf46c0 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Updating instance_info_cache with network_info: [{"id": "d116100d-dfd6-4666-86cd-659d5539871a", "address": "fa:16:3e:aa:b6:e1", "network": {"id": "8a90347e-c47f-450a-8b31-4bf8d24e9aee", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-923062507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd116100d-df", "ovs_interfaceid": "d116100d-dfd6-4666-86cd-659d5539871a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e2cbf31f-6cf8-4a30-9d9b-3bbb3645a660", "address": "fa:16:3e:0e:64:29", "network": {"id": "891dd2c7-8a6d-4a31-b5d4-6edcd5e2f9ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-214436945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2cbf31f-6c", "ovs_interfaceid": "e2cbf31f-6cf8-4a30-9d9b-3bbb3645a660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6a5d2bae-9b9d-4331-b080-badfed69c6b1", "address": "fa:16:3e:cb:f8:53", "network": {"id": "891dd2c7-8a6d-4a31-b5d4-6edcd5e2f9ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-214436945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a5d2bae-9b", "ovs_interfaceid": "6a5d2bae-9b9d-4331-b080-badfed69c6b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1bcb8f7b-abf5-4fe1-8ad9-a1d0316f951a", "address": "fa:16:3e:4e:09:93", "network": {"id": "891dd2c7-8a6d-4a31-b5d4-6edcd5e2f9ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-214436945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bcb8f7b-ab", "ovs_interfaceid": "1bcb8f7b-abf5-4fe1-8ad9-a1d0316f951a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "56b28d7b-1c3c-4e60-bbd6-7fd01f07fc6c", "address": "fa:16:3e:83:2f:60", "network": {"id": "e6c7f35e-5af2-440d-8433-00e0c0f5e62c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1457199759", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56b28d7b-1c", "ovs_interfaceid": "56b28d7b-1c3c-4e60-bbd6-7fd01f07fc6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d6c559e9-afbf-473d-b4b0-f3cdff6938bc", "address": "fa:16:3e:21:9f:17", "network": {"id": "e6c7f35e-5af2-440d-8433-00e0c0f5e62c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1457199759", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1e751c778a804388a05afe573a7b7828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6c559e9-af", "ovs_interfaceid": "d6c559e9-afbf-473d-b4b0-f3cdff6938bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:12:54 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:54 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:54 user nova-compute[75245]: DEBUG nova.compute.manager [req-6cacb3f1-b155-4811-9bcd-3c55f7dc0bca req-7b7d92a0-8b96-4628-bc1a-fd972ebf46c0 service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Detach interface failed, port_id=f91c7d1f-43fd-4e3e-9748-dd25010699bd, reason: Instance 696417e7-8eff-46f3-a6f1-11a9f5191627 could not be found. {{(pid=75245) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 16:12:54 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:54 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fea3d2-6db1-4766-ad5b-9ad1e728ea10/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:54 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fea3d2-6db1-4766-ad5b-9ad1e728ea10/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:54 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fea3d2-6db1-4766-ad5b-9ad1e728ea10/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fea3d2-6db1-4766-ad5b-9ad1e728ea10/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:55 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:12:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:55 user nova-compute[75245]: DEBUG nova.compute.manager [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] [instance: fd819060-4388-444d-809e-94f6b2e8f102] Instance event wait completed in 0 seconds for  {{(pid=75245) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 16:12:55 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] [instance: fd819060-4388-444d-809e-94f6b2e8f102] Guest created on hypervisor {{(pid=75245) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 16:12:55 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: fd819060-4388-444d-809e-94f6b2e8f102] Instance spawned successfully.
Nov 29 16:12:55 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] [instance: fd819060-4388-444d-809e-94f6b2e8f102] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 16:12:55 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] [instance: fd819060-4388-444d-809e-94f6b2e8f102] Found default for hw_cdrom_bus of ide {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:12:55 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] [instance: fd819060-4388-444d-809e-94f6b2e8f102] Found default for hw_disk_bus of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:12:55 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] [instance: fd819060-4388-444d-809e-94f6b2e8f102] Found default for hw_input_bus of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:12:55 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] [instance: fd819060-4388-444d-809e-94f6b2e8f102] Found default for hw_pointer_model of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:12:55 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] [instance: fd819060-4388-444d-809e-94f6b2e8f102] Found default for hw_video_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:12:55 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] [instance: fd819060-4388-444d-809e-94f6b2e8f102] Found default for hw_vif_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:12:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:55 user nova-compute[75245]: INFO nova.compute.manager [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] [instance: fd819060-4388-444d-809e-94f6b2e8f102] Took 6.68 seconds to spawn the instance on the hypervisor.
Nov 29 16:12:55 user nova-compute[75245]: DEBUG nova.compute.manager [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] [instance: fd819060-4388-444d-809e-94f6b2e8f102] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:12:55 user nova-compute[75245]: INFO nova.compute.manager [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] [instance: fd819060-4388-444d-809e-94f6b2e8f102] Took 7.43 seconds to build instance.
Nov 29 16:12:55 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-f1f91405-0451-48d6-885d-110072f55366 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Lock "fd819060-4388-444d-809e-94f6b2e8f102" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.545s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:12:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36728d4f-925b-46a3-b4b5-17f14b9c99c3/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36728d4f-925b-46a3-b4b5-17f14b9c99c3/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36728d4f-925b-46a3-b4b5-17f14b9c99c3/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:55 user nova-compute[75245]: DEBUG nova.compute.manager [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oyrKtafB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e3fea3d2-6db1-4766-ad5b-9ad1e728ea10', 'attached_at': '', 'detached_at': '', 'volume_id': '20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb', 'serial': '20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rUSaphLT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg', 'volume_id': '9bcd2fed-1ce1-4028-9482-2f5695d71b49'}, 'status': 'reserved', 'instance': 'e3fea3d2-6db1-4766-ad5b-9ad1e728ea10', 'attached_at': '', 'detached_at': '', 'volume_id': '9bcd2fed-1ce1-4028-9482-2f5695d71b49', 'serial'} {{(pid=75245) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 29 16:12:55 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] Calling os-brick to attach iSCSI Volume {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 16:12:55 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oyrKtafB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:12:55 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:12:55 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:12:55 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:12:55 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:12:55 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:12:55 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:12:55 user nova-compute[75245]: INFO os_brick.initiator.connectors.iscsi [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 16:12:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb -p 172.16.0.220:3260 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:55 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f99f3b5-c58e-4947-a79b-dffaaf573094]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:55 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 16:12:55 user nova-compute[75245]:  {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:12:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb -p 172.16.0.220:3260 --interface default --op new {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:55 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[158b3af9-e274-4317-a5b4-1f1c68339108]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb] added\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:55 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb] added
Nov 29 16:12:55 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:12:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36728d4f-925b-46a3-b4b5-17f14b9c99c3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d55e6c2e-9791-4154-85f5-fec852577c2d/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:55 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[c691cf14-f17b-4ec9-95e4-d32250cdc4a1]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:55 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:12:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.033s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:55 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[4367ab58-2f52-4b19-8e79-83750b1780ef]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:55 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:12:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oyrKtafB {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oyrKtafB" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:56 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[9716a350-ae9a-4656-b0aa-4abc514830cc]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:56 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oyrKtafB'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:12:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:56 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[af05521e-a34a-4158-b47b-a4906d60c1a7]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:56 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:12:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:56 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5efc372-a9a4-4333-94db-9fc4a728e345]: (4, ('tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:56 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49 (non-flash)
Nov 29 16:12:56 user nova-compute[75245]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1 (non-flash)
Nov 29 16:12:56 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:12:56 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] iscsi session list stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49 (non-flash)
Nov 29 16:12:56 user nova-compute[75245]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1 (non-flash)
Nov 29 16:12:56 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:12:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb -p 172.16.0.220:3260 --login {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d55e6c2e-9791-4154-85f5-fec852577c2d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d55e6c2e-9791-4154-85f5-fec852577c2d/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:56 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f7fa5b0-5584-4b8e-bb8d-cda8a8a774c6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:56 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb, portal: 172.16.0.220,3260]
Nov 29 16:12:56 user nova-compute[75245]: Login to [iface: default, target: iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb, portal: 172.16.0.220,3260] successful.
Nov 29 16:12:56 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:12:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:56 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6fc9a4d-7fa4-4c1e-9144-242d839e3262]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:56 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:12:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:56 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[86bcdc37-b0f0-4535-86cc-30c6e3427f8e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:56 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb (non-flash)
Nov 29 16:12:56 user nova-compute[75245]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49 (non-flash)
Nov 29 16:12:56 user nova-compute[75245]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1 (non-flash)
Nov 29 16:12:56 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:12:56 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb (non-flash)
Nov 29 16:12:56 user nova-compute[75245]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49 (non-flash)
Nov 29 16:12:56 user nova-compute[75245]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1 (non-flash)
Nov 29 16:12:56 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:12:56 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:12:56 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] Connected to 172.16.0.220:3260 {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 16:12:56 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] HCTL ('33', '-', '-', 0) found on session 10 with lun 0 {{(pid=75245) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 16:12:56 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=75245) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 16:12:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:12:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:56 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[f897b832-be4c-49f6-9803-545888ea1efc]: (4, ('- - 0', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:12:56 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] Searching for a device in session 10 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75245) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 16:12:56 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oyrKtafB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 16:12:56 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:12:56 user nova-compute[75245]: INFO nova.compute.manager [-] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Took 3.86 seconds to deallocate network for instance.
Nov 29 16:12:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d55e6c2e-9791-4154-85f5-fec852577c2d/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:12:56 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:56 user nova-compute[75245]: DEBUG nova.compute.manager [req-be7e56a7-5b82-474a-a5c4-09228bcb9eb9 req-e4af97ea-4315-4596-b958-4c0a85491e2c service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Received event network-vif-deleted-1bcb8f7b-abf5-4fe1-8ad9-a1d0316f951a {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:12:56 user nova-compute[75245]: DEBUG nova.compute.manager [req-be7e56a7-5b82-474a-a5c4-09228bcb9eb9 req-e4af97ea-4315-4596-b958-4c0a85491e2c service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Received event network-vif-deleted-56b28d7b-1c3c-4e60-bbd6-7fd01f07fc6c {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:12:56 user nova-compute[75245]: DEBUG nova.compute.manager [req-be7e56a7-5b82-474a-a5c4-09228bcb9eb9 req-e4af97ea-4315-4596-b958-4c0a85491e2c service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Received event network-vif-deleted-d6c559e9-afbf-473d-b4b0-f3cdff6938bc {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:12:56 user nova-compute[75245]: DEBUG nova.compute.manager [req-be7e56a7-5b82-474a-a5c4-09228bcb9eb9 req-e4af97ea-4315-4596-b958-4c0a85491e2c service nova] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Received event network-vif-deleted-d116100d-dfd6-4666-86cd-659d5539871a {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:12:56 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:12:56 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:12:56 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Hypervisor/Node resource view: name=user free_ram=7866MB free_disk=25.587329864501953GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75245) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 16:12:56 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:12:56 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:12:56 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:12:56 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance ed9a6a4e-2e7d-443c-82ef-f14f11d32c81 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:12:56 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 36728d4f-925b-46a3-b4b5-17f14b9c99c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:12:56 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance e3fea3d2-6db1-4766-ad5b-9ad1e728ea10 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:12:56 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 55f5b252-468d-4064-99b3-49bdcdf98db8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:12:56 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 696417e7-8eff-46f3-a6f1-11a9f5191627 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:12:56 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance d55e6c2e-9791-4154-85f5-fec852577c2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:12:56 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance fd819060-4388-444d-809e-94f6b2e8f102 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:12:56 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 16:12:56 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 16:12:57 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:12:57 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:12:57 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] <== connect_volume: return (1381ms) {'type': 'block', 'scsi_wwn': '26562393035626637', 'path': '/dev/sdb'} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:12:57 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26562393035626637', 'path': '/dev/sdb'} {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 16:12:57 user nova-compute[75245]: DEBUG nova.objects.instance [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] Lazy-loading 'flavor' on Instance uuid e3fea3d2-6db1-4766-ad5b-9ad1e728ea10 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:12:57 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:12:57 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Compute_service record updated for user:user {{(pid=75245) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 16:12:57 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.615s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:12:57 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:12:57 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75245) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 16:12:58 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] COPY block job progress, current cursor: 97517568 final cursor: 1073741824 {{(pid=75245) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 16:12:58 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:12:58 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:12:58 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Starting heal instance info cache {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 16:12:58 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "refresh_cache-ed9a6a4e-2e7d-443c-82ef-f14f11d32c81" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:12:58 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquired lock "refresh_cache-ed9a6a4e-2e7d-443c-82ef-f14f11d32c81" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:12:58 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] Forcefully refreshing network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 16:12:58 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] COPY block job progress, current cursor: 132120576 final cursor: 1073741824 {{(pid=75245) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 16:12:58 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] Updating instance_info_cache with network_info: [{"id": "c72edead-bad2-45c4-9ac8-90dd2a4f8ed5", "address": "fa:16:3e:bb:74:67", "network": {"id": "f1fac2f4-e789-443e-b6a5-1a3f829bc302", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1199431077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6b87e18ef1f48d19a6907b28cb54f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc72edead-ba", "ovs_interfaceid": "c72edead-bad2-45c4-9ac8-90dd2a4f8ed5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:12:58 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Releasing lock "refresh_cache-ed9a6a4e-2e7d-443c-82ef-f14f11d32c81" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:12:58 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] Updated the network info_cache for instance {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 16:12:58 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:12:58 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:12:58 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:12:58 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:12:58 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75245) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 16:12:59 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] COPY block job progress, current cursor: 203423744 final cursor: 1073741824 {{(pid=75245) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 16:12:59 user nova-compute[75245]: INFO nova.compute.manager [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] [instance: 696417e7-8eff-46f3-a6f1-11a9f5191627] Took 3.45 seconds to detach 3 volumes for instance.
Nov 29 16:12:59 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:12:59 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:12:59 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] COPY block job progress, current cursor: 295698432 final cursor: 1073741824 {{(pid=75245) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 16:13:00 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:13:00 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:13:00 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] COPY block job progress, current cursor: 440401920 final cursor: 1073741824 {{(pid=75245) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 16:13:00 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.566s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:13:00 user nova-compute[75245]: INFO nova.scheduler.client.report [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Deleted allocations for instance 696417e7-8eff-46f3-a6f1-11a9f5191627
Nov 29 16:13:00 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-eaf9a5d5-d308-432c-9fac-19d88c7db6cb tempest-TaggedBootDevicesTest-1192969410 tempest-TaggedBootDevicesTest-1192969410-project-member] Lock "696417e7-8eff-46f3-a6f1-11a9f5191627" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.718s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:13:00 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] COPY block job progress, current cursor: 595591168 final cursor: 1073741824 {{(pid=75245) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 16:13:01 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] COPY block job progress, current cursor: 769654784 final cursor: 1073741824 {{(pid=75245) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 16:13:01 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:13:01 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] COPY block job progress, current cursor: 941621248 final cursor: 1073741824 {{(pid=75245) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 16:13:02 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] COPY block job progress, current cursor: 1054867456 final cursor: 1073741824 {{(pid=75245) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 16:13:02 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:13:02 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75245) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 16:13:02 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] calling os-brick to detach iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 16:13:02 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, {'target_iqn': 'iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rUSaphLT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg', 'volume_id': '9bcd2fed-1ce1-4028-9482-2f5695d71b49'}, None), 'kwargs': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:13:02 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:13:02 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:13:02 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:13:02 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:13:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:13:03 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff5a2802-c935-4745-8274-f24ac69950d1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:13:03 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 16:13:03 user nova-compute[75245]: No targets found.
Nov 29 16:13:03 user nova-compute[75245]: iSNS:
Nov 29 16:13:03 user nova-compute[75245]: No targets found.
Nov 29 16:13:03 user nova-compute[75245]: STATIC:
Nov 29 16:13:03 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1
Nov 29 16:13:03 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:13:03 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:13:03 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49
Nov 29 16:13:03 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:13:03 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:13:03 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb
Nov 29 16:13:03 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:13:03 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:13:03 user nova-compute[75245]: FIRMWARE:
Nov 29 16:13:03 user nova-compute[75245]: No targets found.
Nov 29 16:13:03 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:13:03 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 16:13:03 user nova-compute[75245]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 16:13:03 user nova-compute[75245]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75245) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 16:13:03 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49', 0)] {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 16:13:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:13:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:13:03 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4341c44-32fd-4f17-b19f-bd30b0b676d3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:13:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:13:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:13:03 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa11b098-6a69-4bca-af7d-4689a98b8641]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:13:03 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb (non-flash)
Nov 29 16:13:03 user nova-compute[75245]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49 (non-flash)
Nov 29 16:13:03 user nova-compute[75245]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1 (non-flash)
Nov 29 16:13:03 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:13:03 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb (non-flash)
Nov 29 16:13:03 user nova-compute[75245]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49 (non-flash)
Nov 29 16:13:03 user nova-compute[75245]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1 (non-flash)
Nov 29 16:13:03 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:13:03 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0d4d43e3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49'): ({'sdg'}, set())}) {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 16:13:03 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] Removing single pathed devices sdg {{(pid=75245) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 16:13:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:13:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:13:03 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6772fdd-c35a-4c1e-a821-2436105b0da7]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:13:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:13:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:13:03 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15537a3-9493-4680-b188-39f5b2a4c6ab]: (4, ('ok\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:13:03 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] Flushing IO for device /dev/sdg {{(pid=75245) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 16:13:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:13:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:13:03 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a837c30-1676-47af-8aed-b5aa301330a7]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:13:03 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75245) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 16:13:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:13:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.039s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:13:03 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2ec974-200d-43d1-99c1-8eec11a2b81a]: (4, ('1', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:13:03 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] Checking to see if SCSI volumes sdg have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 16:13:03 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] SCSI volumes sdg have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 16:13:03 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49')] {{(pid=75245) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 16:13:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:13:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:13:03 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[949aa43e-5c25-4090-a5ba-96d77a85b176]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:13:03 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:13:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49 -p 172.16.0.220:3260 --logout {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:13:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:13:03 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[92fe5a96-e18d-404c-ad91-c9be9ba1aed9]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:13:03 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49, portal: 172.16.0.220,3260]
Nov 29 16:13:03 user nova-compute[75245]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49, portal: 172.16.0.220,3260] successful.
Nov 29 16:13:03 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:13:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49 -p 172.16.0.220:3260 --op delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:13:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bcd2fed-1ce1-4028-9482-2f5695d71b49 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:13:03 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b56fc8-2971-42c1-a427-9d0d437d9632]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:13:03 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:13:03 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:13:03 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] <== disconnect_volume: return (306ms) None {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:13:03 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] Disconnected iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 16:13:03 user nova-compute[75245]: DEBUG nova.compute.manager [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oyrKtafB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'e3fea3d2-6db1-4766-ad5b-9ad1e728ea10', 'attached_at': '', 'detached_at': '', 'volume_id': '20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb', 'serial'} {{(pid=75245) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 29 16:13:03 user nova-compute[75245]: DEBUG nova.compute.manager [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] swap_volume: removing Cinder connection for volume 9bcd2fed-1ce1-4028-9482-2f5695d71b49 {{(pid=75245) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 29 16:13:03 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:13:04 user nova-compute[75245]: DEBUG nova.compute.manager [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] swap_volume: Updating volume 9bcd2fed-1ce1-4028-9482-2f5695d71b49 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "oyrKtafB", "auth_password": "Z8Ux3e5SwcHE7q", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb"}, "status": "reserved", "instance": "e3fea3d2-6db1-4766-ad5b-9ad1e728ea10", "attached_at": "", "detached_at": "", "volume_id": "20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb", "serial": "20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb', 'no_device': None, 'attachment_id': '6465ebc9-8a4c-4dc3-91e1-aea368bf5dac'} {{(pid=75245) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 29 16:13:04 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-e11a9dc1-e702-46ad-a948-50ec54bf117e tempest-TestVolumeSwap-1262021632 tempest-TestVolumeSwap-1262021632-project-admin] Lock "e3fea3d2-6db1-4766-ad5b-9ad1e728ea10" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 17.667s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:13:05 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-e4b03e1c-ce9e-4cb9-a1d8-4b5cf666a413 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Acquiring lock "e3fea3d2-6db1-4766-ad5b-9ad1e728ea10" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:13:05 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-e4b03e1c-ce9e-4cb9-a1d8-4b5cf666a413 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Lock "e3fea3d2-6db1-4766-ad5b-9ad1e728ea10" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:13:05 user nova-compute[75245]: INFO nova.compute.manager [None req-e4b03e1c-ce9e-4cb9-a1d8-4b5cf666a413 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] Detaching volume 20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb
Nov 29 16:13:05 user nova-compute[75245]: INFO nova.virt.block_device [None req-e4b03e1c-ce9e-4cb9-a1d8-4b5cf666a413 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] Attempting to driver detach volume 20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb from mountpoint /dev/vdb
Nov 29 16:13:05 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-e4b03e1c-ce9e-4cb9-a1d8-4b5cf666a413 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Attempting to detach device vdb from instance e3fea3d2-6db1-4766-ad5b-9ad1e728ea10 from the persistent domain config. {{(pid=75245) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 16:13:05 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-e4b03e1c-ce9e-4cb9-a1d8-4b5cf666a413 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 16:13:05 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:13:05 user nova-compute[75245]:   <source dev="/dev/sdb"/>
Nov 29 16:13:05 user nova-compute[75245]:   <target dev="vdb" bus="virtio"/>
Nov 29 16:13:05 user nova-compute[75245]:   <serial>20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb</serial>
Nov 29 16:13:05 user nova-compute[75245]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 16:13:05 user nova-compute[75245]: </disk>
Nov 29 16:13:05 user nova-compute[75245]:  {{(pid=75245) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 16:13:05 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-e4b03e1c-ce9e-4cb9-a1d8-4b5cf666a413 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Successfully detached device vdb from instance e3fea3d2-6db1-4766-ad5b-9ad1e728ea10 from the persistent domain config.
Nov 29 16:13:05 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-e4b03e1c-ce9e-4cb9-a1d8-4b5cf666a413 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e3fea3d2-6db1-4766-ad5b-9ad1e728ea10 from the live domain config. {{(pid=75245) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 16:13:05 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-e4b03e1c-ce9e-4cb9-a1d8-4b5cf666a413 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 16:13:05 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:13:05 user nova-compute[75245]:   <source dev="/dev/sdb"/>
Nov 29 16:13:05 user nova-compute[75245]:   <target dev="vdb" bus="virtio"/>
Nov 29 16:13:05 user nova-compute[75245]:   <serial>20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb</serial>
Nov 29 16:13:05 user nova-compute[75245]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 16:13:05 user nova-compute[75245]: </disk>
Nov 29 16:13:05 user nova-compute[75245]:  {{(pid=75245) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 16:13:05 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-9be09120-7d2c-415d-9580-59f8134e7843 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 55f5b252-468d-4064-99b3-49bdcdf98db8 is timed out.
Nov 29 16:13:05 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-9be09120-7d2c-415d-9580-59f8134e7843 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] Successfully detached device vdb from instance 55f5b252-468d-4064-99b3-49bdcdf98db8 from the live domain config.
Nov 29 16:13:05 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9be09120-7d2c-415d-9580-59f8134e7843 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] calling os-brick to detach iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 16:13:05 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be09120-7d2c-415d-9580-59f8134e7843 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, {'target_iqn': 'iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jsHcbInE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:13:05 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-9be09120-7d2c-415d-9580-59f8134e7843 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:13:05 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-9be09120-7d2c-415d-9580-59f8134e7843 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:13:05 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-9be09120-7d2c-415d-9580-59f8134e7843 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:13:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:13:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.116s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:13:05 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[663f93e6-108c-44ad-af8c-cd654f03b9a3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:13:05 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be09120-7d2c-415d-9580-59f8134e7843 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 16:13:05 user nova-compute[75245]: No targets found.
Nov 29 16:13:05 user nova-compute[75245]: iSNS:
Nov 29 16:13:05 user nova-compute[75245]: No targets found.
Nov 29 16:13:05 user nova-compute[75245]: STATIC:
Nov 29 16:13:05 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1
Nov 29 16:13:05 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:13:05 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:13:05 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb
Nov 29 16:13:05 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:13:05 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:13:05 user nova-compute[75245]: FIRMWARE:
Nov 29 16:13:05 user nova-compute[75245]: No targets found.
Nov 29 16:13:05 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:13:05 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be09120-7d2c-415d-9580-59f8134e7843 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 16:13:05 user nova-compute[75245]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 16:13:05 user nova-compute[75245]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75245) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 16:13:05 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be09120-7d2c-415d-9580-59f8134e7843 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1', 0)] {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 16:13:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:13:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:13:05 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3672c5-5fcc-4702-bdf9-0c434f05cbe9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:13:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:13:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:13:05 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e6e367b-f543-46f5-af50-faf47034b722]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:13:05 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be09120-7d2c-415d-9580-59f8134e7843 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb (non-flash)
Nov 29 16:13:05 user nova-compute[75245]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1 (non-flash)
Nov 29 16:13:05 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:13:05 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be09120-7d2c-415d-9580-59f8134e7843 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb (non-flash)
Nov 29 16:13:05 user nova-compute[75245]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1 (non-flash)
Nov 29 16:13:05 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:13:05 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be09120-7d2c-415d-9580-59f8134e7843 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0d4c384dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1'): ({'sdh'}, set())}) {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 16:13:05 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-9be09120-7d2c-415d-9580-59f8134e7843 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] Removing single pathed devices sdh {{(pid=75245) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 16:13:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:13:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:13:05 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c5a2d7-38c1-48ba-ab60-1fb3b0d6f683]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:13:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:13:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:13:06 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dbfa2d5-39e7-4908-9e86-027450160a77]: (4, ('ok\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:13:06 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-9be09120-7d2c-415d-9580-59f8134e7843 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] Flushing IO for device /dev/sdh {{(pid=75245) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 16:13:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:13:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.011s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:13:06 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[67582f08-f9ad-4563-956d-186ae565784a]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:13:06 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-9be09120-7d2c-415d-9580-59f8134e7843 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75245) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 16:13:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:13:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.034s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:13:06 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[669365d5-9020-4283-b0b2-6a4e8e374a45]: (4, ('1', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:13:06 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-9be09120-7d2c-415d-9580-59f8134e7843 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] Checking to see if SCSI volumes sdh have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 16:13:06 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-9be09120-7d2c-415d-9580-59f8134e7843 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] SCSI volumes sdh have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 16:13:06 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be09120-7d2c-415d-9580-59f8134e7843 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1')] {{(pid=75245) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 16:13:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:13:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:13:06 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[b544c09c-0127-4790-84c6-f8efadddb4b8]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:13:06 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be09120-7d2c-415d-9580-59f8134e7843 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:13:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1 -p 172.16.0.220:3260 --logout {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:13:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:13:06 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb3eebc-0a2c-4fe5-a07c-f92facc65517]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:13:06 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be09120-7d2c-415d-9580-59f8134e7843 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1, portal: 172.16.0.220,3260]
Nov 29 16:13:06 user nova-compute[75245]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1, portal: 172.16.0.220,3260] successful.
Nov 29 16:13:06 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:13:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1 -p 172.16.0.220:3260 --op delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:13:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2fb29a5-c3e1-4062-b3a5-2abad0b84dd1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:13:06 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[b998471f-72a3-4110-b457-598795051362]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:13:06 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be09120-7d2c-415d-9580-59f8134e7843 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:13:06 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-9be09120-7d2c-415d-9580-59f8134e7843 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:13:06 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be09120-7d2c-415d-9580-59f8134e7843 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] <== disconnect_volume: return (359ms) None {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:13:06 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9be09120-7d2c-415d-9580-59f8134e7843 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] Disconnected iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 16:13:06 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-e4b03e1c-ce9e-4cb9-a1d8-4b5cf666a413 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e3fea3d2-6db1-4766-ad5b-9ad1e728ea10 {{(pid=75245) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 16:13:06 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:13:07 user nova-compute[75245]: DEBUG nova.objects.instance [None req-9be09120-7d2c-415d-9580-59f8134e7843 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] Lazy-loading 'flavor' on Instance uuid 55f5b252-468d-4064-99b3-49bdcdf98db8 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:13:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-9be09120-7d2c-415d-9580-59f8134e7843 tempest-VolumesAssistedSnapshotsTest-1429646767 tempest-VolumesAssistedSnapshotsTest-1429646767-project-admin] Lock "55f5b252-468d-4064-99b3-49bdcdf98db8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.135s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:13:07 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:13:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:13:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:13:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:13:12 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:13:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Acquiring lock "0db15db5-e8a9-46a8-98cc-99d7fde61508" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:13:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Lock "0db15db5-e8a9-46a8-98cc-99d7fde61508" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:13:13 user nova-compute[75245]: DEBUG nova.compute.manager [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 0db15db5-e8a9-46a8-98cc-99d7fde61508] Starting instance... {{(pid=75245) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 16:13:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:13:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:13:13 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75245) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 16:13:13 user nova-compute[75245]: INFO nova.compute.claims [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 0db15db5-e8a9-46a8-98cc-99d7fde61508] Claim successful on node user
Nov 29 16:13:14 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:13:14 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:13:14 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.367s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:13:14 user nova-compute[75245]: DEBUG nova.compute.manager [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 0db15db5-e8a9-46a8-98cc-99d7fde61508] Start building networks asynchronously for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 16:13:14 user nova-compute[75245]: DEBUG nova.compute.manager [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 0db15db5-e8a9-46a8-98cc-99d7fde61508] Allocating IP information in the background. {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 16:13:14 user nova-compute[75245]: DEBUG nova.network.neutron [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 0db15db5-e8a9-46a8-98cc-99d7fde61508] allocate_for_instance() {{(pid=75245) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 16:13:14 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 0db15db5-e8a9-46a8-98cc-99d7fde61508] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 16:13:14 user nova-compute[75245]: DEBUG nova.compute.manager [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 0db15db5-e8a9-46a8-98cc-99d7fde61508] Start building block device mappings for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 16:13:14 user nova-compute[75245]: DEBUG nova.policy [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '39676e279e7f4fea9383dacfb0ea7875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a08c8f9089c4291b552c567e010b0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75245) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 16:13:14 user nova-compute[75245]: DEBUG nova.compute.manager [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 0db15db5-e8a9-46a8-98cc-99d7fde61508] Start spawning the instance on the hypervisor. {{(pid=75245) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 16:13:14 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 0db15db5-e8a9-46a8-98cc-99d7fde61508] Creating instance directory {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 16:13:14 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 0db15db5-e8a9-46a8-98cc-99d7fde61508] Creating image(s)
Nov 29 16:13:14 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Acquiring lock "/opt/stack/data/nova/instances/0db15db5-e8a9-46a8-98cc-99d7fde61508/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:13:14 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Lock "/opt/stack/data/nova/instances/0db15db5-e8a9-46a8-98cc-99d7fde61508/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:13:14 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Lock "/opt/stack/data/nova/instances/0db15db5-e8a9-46a8-98cc-99d7fde61508/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:13:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:13:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.183s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:13:14 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Acquiring lock "d654f7206043e05d3525550b0fc885556eb999f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:13:14 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:13:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:13:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:13:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.185s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:13:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/0db15db5-e8a9-46a8-98cc-99d7fde61508/disk 1073741824 {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:13:14 user nova-compute[75245]: DEBUG nova.network.neutron [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 0db15db5-e8a9-46a8-98cc-99d7fde61508] Successfully created port: 769ef353-e386-451b-b882-d7d1b0deeb52 {{(pid=75245) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 16:13:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/0db15db5-e8a9-46a8-98cc-99d7fde61508/disk 1073741824" returned: 0 in 0.055s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:13:14 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:13:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:13:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.176s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:13:14 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0db15db5-e8a9-46a8-98cc-99d7fde61508/disk. size=1073741824 {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 16:13:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0db15db5-e8a9-46a8-98cc-99d7fde61508/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:13:15 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0db15db5-e8a9-46a8-98cc-99d7fde61508/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:13:15 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Cannot resize image /opt/stack/data/nova/instances/0db15db5-e8a9-46a8-98cc-99d7fde61508/disk to a smaller size. {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 16:13:15 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 0db15db5-e8a9-46a8-98cc-99d7fde61508] Created local disks {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 16:13:15 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 0db15db5-e8a9-46a8-98cc-99d7fde61508] Ensure instance console log exists: /opt/stack/data/nova/instances/0db15db5-e8a9-46a8-98cc-99d7fde61508/console.log {{(pid=75245) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 16:13:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:13:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:13:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:13:15 user nova-compute[75245]: DEBUG nova.network.neutron [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 0db15db5-e8a9-46a8-98cc-99d7fde61508] Successfully updated port: 769ef353-e386-451b-b882-d7d1b0deeb52 {{(pid=75245) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 16:13:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Acquiring lock "refresh_cache-0db15db5-e8a9-46a8-98cc-99d7fde61508" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:13:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Acquired lock "refresh_cache-0db15db5-e8a9-46a8-98cc-99d7fde61508" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:13:15 user nova-compute[75245]: DEBUG nova.network.neutron [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 0db15db5-e8a9-46a8-98cc-99d7fde61508] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 16:13:15 user nova-compute[75245]: DEBUG nova.compute.manager [req-b2980e6e-ed80-412b-9efc-cc81157ff5ce req-17782757-2efd-4241-81de-5d1eb4b380c3 service nova] [instance: 0db15db5-e8a9-46a8-98cc-99d7fde61508] Received event network-changed-769ef353-e386-451b-b882-d7d1b0deeb52 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:13:15 user nova-compute[75245]: DEBUG nova.compute.manager [req-b2980e6e-ed80-412b-9efc-cc81157ff5ce req-17782757-2efd-4241-81de-5d1eb4b380c3 service nova] [instance: 0db15db5-e8a9-46a8-98cc-99d7fde61508] Refreshing instance network info cache due to event network-changed-769ef353-e386-451b-b882-d7d1b0deeb52. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:13:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b2980e6e-ed80-412b-9efc-cc81157ff5ce req-17782757-2efd-4241-81de-5d1eb4b380c3 service nova] Acquiring lock "refresh_cache-0db15db5-e8a9-46a8-98cc-99d7fde61508" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:13:15 user nova-compute[75245]: DEBUG nova.network.neutron [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 0db15db5-e8a9-46a8-98cc-99d7fde61508] Instance cache missing network info. {{(pid=75245) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 16:13:15 user nova-compute[75245]: DEBUG nova.network.neutron [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 0db15db5-e8a9-46a8-98cc-99d7fde61508] Updating instance_info_cache with network_info: [{"id": "769ef353-e386-451b-b882-d7d1b0deeb52", "address": "fa:16:3e:57:53:dc", "network": {"id": "ae7be65e-9c9f-4836-aee2-9d465d5d28f6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-521099242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a08c8f9089c4291b552c567e010b0c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap769ef353-e3", "ovs_interfaceid": "769ef353-e386-451b-b882-d7d1b0deeb52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:13:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Releasing lock "refresh_cache-0db15db5-e8a9-46a8-98cc-99d7fde61508" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:13:15 user nova-compute[75245]: DEBUG nova.compute.manager [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 0db15db5-e8a9-46a8-98cc-99d7fde61508] Instance network_info: |[{"id": "769ef353-e386-451b-b882-d7d1b0deeb52", "address": "fa:16:3e:57:53:dc", "network": {"id": "ae7be65e-9c9f-4836-aee2-9d465d5d28f6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-521099242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a08c8f9089c4291b552c567e010b0c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap769ef353-e3", "ovs_interfaceid": "769ef353-e386-451b-b882-d7d1b0deeb52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 16:13:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b2980e6e-ed80-412b-9efc-cc81157ff5ce req-17782757-2efd-4241-81de-5d1eb4b380c3 service nova] Acquired lock "refresh_cache-0db15db5-e8a9-46a8-98cc-99d7fde61508" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:13:15 user nova-compute[75245]: DEBUG nova.network.neutron [req-b2980e6e-ed80-412b-9efc-cc81157ff5ce req-17782757-2efd-4241-81de-5d1eb4b380c3 service nova] [instance: 0db15db5-e8a9-46a8-98cc-99d7fde61508] Refreshing network info cache for port 769ef353-e386-451b-b882-d7d1b0deeb52 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:13:15 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 0db15db5-e8a9-46a8-98cc-99d7fde61508] Start _get_guest_xml network_info=[{"id": "769ef353-e386-451b-b882-d7d1b0deeb52", "address": "fa:16:3e:57:53:dc", "network": {"id": "ae7be65e-9c9f-4836-aee2-9d465d5d28f6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-521099242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a08c8f9089c4291b552c567e010b0c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap769ef353-e3", "ovs_interfaceid": "769ef353-e386-451b-b882-d7d1b0deeb52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'a291d9c3-be02-4c6c-9649-4b45c5b7f487'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 16:13:15 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:13:15 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:13:15 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 16:13:15 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] CPU controller missing on host. {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 16:13:15 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 16:13:15 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] CPU controller found on host. {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 16:13:15 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75245) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 16:13:15 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T16:06:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 16:13:15 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Flavor limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 16:13:15 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Image limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 16:13:15 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Flavor pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 16:13:15 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Image pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 16:13:15 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 16:13:15 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 16:13:15 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 16:13:15 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Got 1 possible topologies {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 16:13:15 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 16:13:15 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 16:13:15 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:13:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1557265249',display_name='tempest-VolumesAdminNegativeTest-server-1557265249',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1557265249',id=13,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a08c8f9089c4291b552c567e010b0c5',ramdisk_id='',reservation_id='r-bdyslm7k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-193480502',owner_user_name='tempest-VolumesAdminNegativeTest-193480502-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:13:14Z,user_data=None,user_id='39676e279e7f4fea9383dacfb0ea7875',uuid=0db15db5-e8a9-46a8-98cc-99d7fde61508,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "769ef353-e386-451b-b882-d7d1b0deeb52", "address": "fa:16:3e:57:53:dc", "network": {"id": "ae7be65e-9c9f-4836-aee2-9d465d5d28f6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-521099242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a08c8f9089c4291b552c567e010b0c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap769ef353-e3", "ovs_interfaceid": "769ef353-e386-451b-b882-d7d1b0deeb52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:13:15 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Converting VIF {"id": "769ef353-e386-451b-b882-d7d1b0deeb52", "address": "fa:16:3e:57:53:dc", "network": {"id": "ae7be65e-9c9f-4836-aee2-9d465d5d28f6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-521099242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a08c8f9089c4291b552c567e010b0c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap769ef353-e3", "ovs_interfaceid": "769ef353-e386-451b-b882-d7d1b0deeb52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:13:15 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:53:dc,bridge_name='br-int',has_traffic_filtering=True,id=769ef353-e386-451b-b882-d7d1b0deeb52,network=Network(ae7be65e-9c9f-4836-aee2-9d465d5d28f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap769ef353-e3') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:13:15 user nova-compute[75245]: DEBUG nova.objects.instance [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Lazy-loading 'pci_devices' on Instance uuid 0db15db5-e8a9-46a8-98cc-99d7fde61508 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:13:15 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 0db15db5-e8a9-46a8-98cc-99d7fde61508] End _get_guest_xml xml=<domain type="kvm">
Nov 29 16:13:15 user nova-compute[75245]:   <uuid>0db15db5-e8a9-46a8-98cc-99d7fde61508</uuid>
Nov 29 16:13:15 user nova-compute[75245]:   <name>instance-0000000d</name>
Nov 29 16:13:15 user nova-compute[75245]:   <memory>524288</memory>
Nov 29 16:13:15 user nova-compute[75245]:   <vcpu>1</vcpu>
Nov 29 16:13:15 user nova-compute[75245]:   <metadata>
Nov 29 16:13:15 user nova-compute[75245]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 16:13:15 user nova-compute[75245]:       <nova:package version="0.0.0"/>
Nov 29 16:13:15 user nova-compute[75245]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1557265249</nova:name>
Nov 29 16:13:15 user nova-compute[75245]:       <nova:creationTime>2023-11-29 16:13:15</nova:creationTime>
Nov 29 16:13:15 user nova-compute[75245]:       <nova:flavor name="m1.tiny">
Nov 29 16:13:15 user nova-compute[75245]:         <nova:memory>512</nova:memory>
Nov 29 16:13:15 user nova-compute[75245]:         <nova:disk>1</nova:disk>
Nov 29 16:13:15 user nova-compute[75245]:         <nova:swap>0</nova:swap>
Nov 29 16:13:15 user nova-compute[75245]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 16:13:15 user nova-compute[75245]:         <nova:vcpus>1</nova:vcpus>
Nov 29 16:13:15 user nova-compute[75245]:       </nova:flavor>
Nov 29 16:13:15 user nova-compute[75245]:       <nova:owner>
Nov 29 16:13:15 user nova-compute[75245]:         <nova:user uuid="39676e279e7f4fea9383dacfb0ea7875">tempest-VolumesAdminNegativeTest-193480502-project-member</nova:user>
Nov 29 16:13:15 user nova-compute[75245]:         <nova:project uuid="2a08c8f9089c4291b552c567e010b0c5">tempest-VolumesAdminNegativeTest-193480502</nova:project>
Nov 29 16:13:15 user nova-compute[75245]:       </nova:owner>
Nov 29 16:13:15 user nova-compute[75245]:       <nova:root type="image" uuid="a291d9c3-be02-4c6c-9649-4b45c5b7f487"/>
Nov 29 16:13:15 user nova-compute[75245]:       <nova:ports>
Nov 29 16:13:15 user nova-compute[75245]:         <nova:port uuid="769ef353-e386-451b-b882-d7d1b0deeb52">
Nov 29 16:13:15 user nova-compute[75245]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 16:13:15 user nova-compute[75245]:         </nova:port>
Nov 29 16:13:15 user nova-compute[75245]:       </nova:ports>
Nov 29 16:13:15 user nova-compute[75245]:     </nova:instance>
Nov 29 16:13:15 user nova-compute[75245]:   </metadata>
Nov 29 16:13:15 user nova-compute[75245]:   <sysinfo type="smbios">
Nov 29 16:13:15 user nova-compute[75245]:     <system>
Nov 29 16:13:15 user nova-compute[75245]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 16:13:15 user nova-compute[75245]:       <entry name="product">OpenStack Nova</entry>
Nov 29 16:13:15 user nova-compute[75245]:       <entry name="version">0.0.0</entry>
Nov 29 16:13:15 user nova-compute[75245]:       <entry name="serial">0db15db5-e8a9-46a8-98cc-99d7fde61508</entry>
Nov 29 16:13:15 user nova-compute[75245]:       <entry name="uuid">0db15db5-e8a9-46a8-98cc-99d7fde61508</entry>
Nov 29 16:13:15 user nova-compute[75245]:       <entry name="family">Virtual Machine</entry>
Nov 29 16:13:15 user nova-compute[75245]:     </system>
Nov 29 16:13:15 user nova-compute[75245]:   </sysinfo>
Nov 29 16:13:15 user nova-compute[75245]:   <os>
Nov 29 16:13:15 user nova-compute[75245]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 16:13:15 user nova-compute[75245]:     <boot dev="hd"/>
Nov 29 16:13:15 user nova-compute[75245]:     <smbios mode="sysinfo"/>
Nov 29 16:13:15 user nova-compute[75245]:   </os>
Nov 29 16:13:15 user nova-compute[75245]:   <features>
Nov 29 16:13:15 user nova-compute[75245]:     <acpi/>
Nov 29 16:13:15 user nova-compute[75245]:     <apic/>
Nov 29 16:13:15 user nova-compute[75245]:     <vmcoreinfo/>
Nov 29 16:13:15 user nova-compute[75245]:   </features>
Nov 29 16:13:15 user nova-compute[75245]:   <clock offset="utc">
Nov 29 16:13:15 user nova-compute[75245]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 16:13:15 user nova-compute[75245]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 16:13:15 user nova-compute[75245]:     <timer name="hpet" present="no"/>
Nov 29 16:13:15 user nova-compute[75245]:   </clock>
Nov 29 16:13:15 user nova-compute[75245]:   <cpu mode="custom" match="exact">
Nov 29 16:13:15 user nova-compute[75245]:     <model>Nehalem</model>
Nov 29 16:13:15 user nova-compute[75245]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 16:13:15 user nova-compute[75245]:   </cpu>
Nov 29 16:13:15 user nova-compute[75245]:   <devices>
Nov 29 16:13:15 user nova-compute[75245]:     <disk type="file" device="disk">
Nov 29 16:13:15 user nova-compute[75245]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 16:13:15 user nova-compute[75245]:       <source file="/opt/stack/data/nova/instances/0db15db5-e8a9-46a8-98cc-99d7fde61508/disk"/>
Nov 29 16:13:15 user nova-compute[75245]:       <target dev="vda" bus="virtio"/>
Nov 29 16:13:15 user nova-compute[75245]:     </disk>
Nov 29 16:13:15 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 16:13:15 user nova-compute[75245]:       <mac address="fa:16:3e:57:53:dc"/>
Nov 29 16:13:15 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:13:15 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 16:13:15 user nova-compute[75245]:       <target dev="tap769ef353-e3"/>
Nov 29 16:13:15 user nova-compute[75245]:     </interface>
Nov 29 16:13:15 user nova-compute[75245]:     <serial type="pty">
Nov 29 16:13:15 user nova-compute[75245]:       <log file="/opt/stack/data/nova/instances/0db15db5-e8a9-46a8-98cc-99d7fde61508/console.log" append="off"/>
Nov 29 16:13:15 user nova-compute[75245]:     </serial>
Nov 29 16:13:15 user nova-compute[75245]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 16:13:15 user nova-compute[75245]:     <video>
Nov 29 16:13:15 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:13:15 user nova-compute[75245]:     </video>
Nov 29 16:13:15 user nova-compute[75245]:     <rng model="virtio">
Nov 29 16:13:15 user nova-compute[75245]:       <backend model="random">/dev/urandom</backend>
Nov 29 16:13:15 user nova-compute[75245]:     </rng>
Nov 29 16:13:15 user nova-compute[75245]:     <controller type="usb" index="0" model="none"/>
Nov 29 16:13:15 user nova-compute[75245]:     <memballoon model="virtio">
Nov 29 16:13:15 user nova-compute[75245]:       <stats period="10"/>
Nov 29 16:13:15 user nova-compute[75245]:     </memballoon>
Nov 29 16:13:15 user nova-compute[75245]:   </devices>
Nov 29 16:13:15 user nova-compute[75245]: </domain>
Nov 29 16:13:15 user nova-compute[75245]:  {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 16:13:15 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:13:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1557265249',display_name='tempest-VolumesAdminNegativeTest-server-1557265249',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1557265249',id=13,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a08c8f9089c4291b552c567e010b0c5',ramdisk_id='',reservation_id='r-bdyslm7k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-193480502',owner_user_name='tempest-VolumesAdminNegativeTest-193480502-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:13:14Z,user_data=None,user_id='39676e279e7f4fea9383dacfb0ea7875',uuid=0db15db5-e8a9-46a8-98cc-99d7fde61508,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "769ef353-e386-451b-b882-d7d1b0deeb52", "address": "fa:16:3e:57:53:dc", "network": {"id": "ae7be65e-9c9f-4836-aee2-9d465d5d28f6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-521099242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a08c8f9089c4291b552c567e010b0c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap769ef353-e3", "ovs_interfaceid": "769ef353-e386-451b-b882-d7d1b0deeb52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 16:13:15 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Converting VIF {"id": "769ef353-e386-451b-b882-d7d1b0deeb52", "address": "fa:16:3e:57:53:dc", "network": {"id": "ae7be65e-9c9f-4836-aee2-9d465d5d28f6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-521099242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a08c8f9089c4291b552c567e010b0c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap769ef353-e3", "ovs_interfaceid": "769ef353-e386-451b-b882-d7d1b0deeb52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:13:15 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:53:dc,bridge_name='br-int',has_traffic_filtering=True,id=769ef353-e386-451b-b882-d7d1b0deeb52,network=Network(ae7be65e-9c9f-4836-aee2-9d465d5d28f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap769ef353-e3') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:13:15 user nova-compute[75245]: DEBUG os_vif [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:53:dc,bridge_name='br-int',has_traffic_filtering=True,id=769ef353-e386-451b-b882-d7d1b0deeb52,network=Network(ae7be65e-9c9f-4836-aee2-9d465d5d28f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap769ef353-e3') {{(pid=75245) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 16:13:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:13:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:13:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 16:13:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:13:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '18ac0fdf-d8e2-594a-8759-82a148f28950', '_type': 'linux-noop'}}, row=False) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:13:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:13:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:13:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:13:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap769ef353-e3, may_exist=True, interface_attrs={}) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:13:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap769ef353-e3, col_values=(('qos', UUID('d5ef2272-8b07-4aa4-bf16-3c2c2cd9a52f')),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:13:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap769ef353-e3, col_values=(('external_ids', {'iface-id': '769ef353-e386-451b-b882-d7d1b0deeb52', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:53:dc', 'vm-uuid': '0db15db5-e8a9-46a8-98cc-99d7fde61508'}),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:13:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:13:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:13:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:13:15 user nova-compute[75245]: INFO os_vif [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:53:dc,bridge_name='br-int',has_traffic_filtering=True,id=769ef353-e386-451b-b882-d7d1b0deeb52,network=Network(ae7be65e-9c9f-4836-aee2-9d465d5d28f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap769ef353-e3')
Nov 29 16:13:15 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:13:15 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] No VIF found with MAC fa:16:3e:57:53:dc, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:13:16 user nova-compute[75245]: DEBUG nova.network.neutron [req-b2980e6e-ed80-412b-9efc-cc81157ff5ce req-17782757-2efd-4241-81de-5d1eb4b380c3 service nova] [instance: 0db15db5-e8a9-46a8-98cc-99d7fde61508] Updated VIF entry in instance network info cache for port 769ef353-e386-451b-b882-d7d1b0deeb52. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:13:16 user nova-compute[75245]: DEBUG nova.network.neutron [req-b2980e6e-ed80-412b-9efc-cc81157ff5ce req-17782757-2efd-4241-81de-5d1eb4b380c3 service nova] [instance: 0db15db5-e8a9-46a8-98cc-99d7fde61508] Updating instance_info_cache with network_info: [{"id": "769ef353-e386-451b-b882-d7d1b0deeb52", "address": "fa:16:3e:57:53:dc", "network": {"id": "ae7be65e-9c9f-4836-aee2-9d465d5d28f6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-521099242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a08c8f9089c4291b552c567e010b0c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap769ef353-e3", "ovs_interfaceid": "769ef353-e386-451b-b882-d7d1b0deeb52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:13:16 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b2980e6e-ed80-412b-9efc-cc81157ff5ce req-17782757-2efd-4241-81de-5d1eb4b380c3 service nova] Releasing lock "refresh_cache-0db15db5-e8a9-46a8-98cc-99d7fde61508" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:13:16 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:13:17 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:13:17 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:13:17 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:13:17 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:13:17 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:13:17 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:13:19 user nova-compute[75245]: DEBUG nova.compute.manager [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 0db15db5-e8a9-46a8-98cc-99d7fde61508] Instance event wait completed in 0 seconds for  {{(pid=75245) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 16:13:19 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 0db15db5-e8a9-46a8-98cc-99d7fde61508] Guest created on hypervisor {{(pid=75245) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 16:13:19 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 0db15db5-e8a9-46a8-98cc-99d7fde61508] Instance spawned successfully.
Nov 29 16:13:19 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 0db15db5-e8a9-46a8-98cc-99d7fde61508] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 16:13:19 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 0db15db5-e8a9-46a8-98cc-99d7fde61508] Found default for hw_cdrom_bus of ide {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:13:19 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 0db15db5-e8a9-46a8-98cc-99d7fde61508] Found default for hw_disk_bus of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:13:19 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 0db15db5-e8a9-46a8-98cc-99d7fde61508] Found default for hw_input_bus of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:13:19 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 0db15db5-e8a9-46a8-98cc-99d7fde61508] Found default for hw_pointer_model of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:13:19 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 0db15db5-e8a9-46a8-98cc-99d7fde61508] Found default for hw_video_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:13:19 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 0db15db5-e8a9-46a8-98cc-99d7fde61508] Found default for hw_vif_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:13:19 user nova-compute[75245]: INFO nova.compute.manager [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 0db15db5-e8a9-46a8-98cc-99d7fde61508] Took 5.10 seconds to spawn the instance on the hypervisor.
Nov 29 16:13:19 user nova-compute[75245]: DEBUG nova.compute.manager [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 0db15db5-e8a9-46a8-98cc-99d7fde61508] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:13:19 user nova-compute[75245]: INFO nova.compute.manager [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 0db15db5-e8a9-46a8-98cc-99d7fde61508] Took 5.81 seconds to build instance.
Nov 29 16:13:19 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-914b0a58-2433-4c64-b0cc-f290737462f4 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Lock "0db15db5-e8a9-46a8-98cc-99d7fde61508" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.904s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:13:20 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:13:21 user nova-compute[75245]: DEBUG nova.compute.manager [req-c432023d-65f0-4ba9-84c0-de1cbe46fc49 req-2ac54a8b-b7f9-40d7-9bad-9690e224b538 service nova] [instance: 0db15db5-e8a9-46a8-98cc-99d7fde61508] Received event network-vif-plugged-769ef353-e386-451b-b882-d7d1b0deeb52 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:13:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-c432023d-65f0-4ba9-84c0-de1cbe46fc49 req-2ac54a8b-b7f9-40d7-9bad-9690e224b538 service nova] Acquiring lock "0db15db5-e8a9-46a8-98cc-99d7fde61508-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:13:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-c432023d-65f0-4ba9-84c0-de1cbe46fc49 req-2ac54a8b-b7f9-40d7-9bad-9690e224b538 service nova] Lock "0db15db5-e8a9-46a8-98cc-99d7fde61508-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:13:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-c432023d-65f0-4ba9-84c0-de1cbe46fc49 req-2ac54a8b-b7f9-40d7-9bad-9690e224b538 service nova] Lock "0db15db5-e8a9-46a8-98cc-99d7fde61508-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:13:21 user nova-compute[75245]: DEBUG nova.compute.manager [req-c432023d-65f0-4ba9-84c0-de1cbe46fc49 req-2ac54a8b-b7f9-40d7-9bad-9690e224b538 service nova] [instance: 0db15db5-e8a9-46a8-98cc-99d7fde61508] No waiting events found dispatching network-vif-plugged-769ef353-e386-451b-b882-d7d1b0deeb52 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:13:21 user nova-compute[75245]: WARNING nova.compute.manager [req-c432023d-65f0-4ba9-84c0-de1cbe46fc49 req-2ac54a8b-b7f9-40d7-9bad-9690e224b538 service nova] [instance: 0db15db5-e8a9-46a8-98cc-99d7fde61508] Received unexpected event network-vif-plugged-769ef353-e386-451b-b882-d7d1b0deeb52 for instance with vm_state active and task_state None.
Nov 29 16:13:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:13:23 user nova-compute[75245]: DEBUG nova.compute.manager [req-42d848da-b94d-4074-9ebf-2076cf007896 req-1443db62-61ef-432a-8065-4e732e4922b8 service nova] [instance: 0db15db5-e8a9-46a8-98cc-99d7fde61508] Received event network-vif-plugged-769ef353-e386-451b-b882-d7d1b0deeb52 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:13:23 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-42d848da-b94d-4074-9ebf-2076cf007896 req-1443db62-61ef-432a-8065-4e732e4922b8 service nova] Acquiring lock "0db15db5-e8a9-46a8-98cc-99d7fde61508-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:13:23 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-42d848da-b94d-4074-9ebf-2076cf007896 req-1443db62-61ef-432a-8065-4e732e4922b8 service nova] Lock "0db15db5-e8a9-46a8-98cc-99d7fde61508-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:13:23 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-42d848da-b94d-4074-9ebf-2076cf007896 req-1443db62-61ef-432a-8065-4e732e4922b8 service nova] Lock "0db15db5-e8a9-46a8-98cc-99d7fde61508-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:13:23 user nova-compute[75245]: DEBUG nova.compute.manager [req-42d848da-b94d-4074-9ebf-2076cf007896 req-1443db62-61ef-432a-8065-4e732e4922b8 service nova] [instance: 0db15db5-e8a9-46a8-98cc-99d7fde61508] No waiting events found dispatching network-vif-plugged-769ef353-e386-451b-b882-d7d1b0deeb52 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:13:23 user nova-compute[75245]: WARNING nova.compute.manager [req-42d848da-b94d-4074-9ebf-2076cf007896 req-1443db62-61ef-432a-8065-4e732e4922b8 service nova] [instance: 0db15db5-e8a9-46a8-98cc-99d7fde61508] Received unexpected event network-vif-plugged-769ef353-e386-451b-b882-d7d1b0deeb52 for instance with vm_state active and task_state None.
Nov 29 16:13:25 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:13:26 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-e4b03e1c-ce9e-4cb9-a1d8-4b5cf666a413 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e3fea3d2-6db1-4766-ad5b-9ad1e728ea10 is timed out.
Nov 29 16:13:26 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-e4b03e1c-ce9e-4cb9-a1d8-4b5cf666a413 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Successfully detached device vdb from instance e3fea3d2-6db1-4766-ad5b-9ad1e728ea10 from the live domain config.
Nov 29 16:13:26 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4b03e1c-ce9e-4cb9-a1d8-4b5cf666a413 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] calling os-brick to detach iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 16:13:26 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4b03e1c-ce9e-4cb9-a1d8-4b5cf666a413 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, {'target_iqn': 'iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oyrKtafB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': '20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb'}, None), 'kwargs': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:13:26 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-e4b03e1c-ce9e-4cb9-a1d8-4b5cf666a413 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:13:26 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-e4b03e1c-ce9e-4cb9-a1d8-4b5cf666a413 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:13:26 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-e4b03e1c-ce9e-4cb9-a1d8-4b5cf666a413 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.006s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:13:26 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:13:26 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:13:26 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[871b5659-597c-41ca-bb17-8dbe9894e0b1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:13:26 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4b03e1c-ce9e-4cb9-a1d8-4b5cf666a413 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 16:13:26 user nova-compute[75245]: No targets found.
Nov 29 16:13:26 user nova-compute[75245]: iSNS:
Nov 29 16:13:26 user nova-compute[75245]: No targets found.
Nov 29 16:13:26 user nova-compute[75245]: STATIC:
Nov 29 16:13:26 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb
Nov 29 16:13:26 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:13:26 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:13:26 user nova-compute[75245]: FIRMWARE:
Nov 29 16:13:26 user nova-compute[75245]: No targets found.
Nov 29 16:13:26 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:13:26 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4b03e1c-ce9e-4cb9-a1d8-4b5cf666a413 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 16:13:26 user nova-compute[75245]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 16:13:26 user nova-compute[75245]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75245) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 16:13:26 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4b03e1c-ce9e-4cb9-a1d8-4b5cf666a413 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb', 0)] {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 16:13:26 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:13:26 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.034s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:13:26 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2dfb455-e337-422e-aef2-a184590fdeeb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:13:26 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:13:26 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:13:26 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[868004b7-6d56-42bd-bc08-2a2590f68aac]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:13:26 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4b03e1c-ce9e-4cb9-a1d8-4b5cf666a413 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb (non-flash)
Nov 29 16:13:26 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:13:26 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4b03e1c-ce9e-4cb9-a1d8-4b5cf666a413 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb (non-flash)
Nov 29 16:13:26 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:13:26 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4b03e1c-ce9e-4cb9-a1d8-4b5cf666a413 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0d4414c670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb'): ({'sdb'}, set())}) {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 16:13:26 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-e4b03e1c-ce9e-4cb9-a1d8-4b5cf666a413 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Removing single pathed devices sdb {{(pid=75245) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 16:13:26 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:13:26 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:13:26 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c23625-22c4-46ec-8a18-852da2c867ec]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:13:26 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:13:26 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:13:26 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[f241ef94-f9d9-4d73-8537-43f60603d3e5]: (4, ('ok\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:13:26 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-e4b03e1c-ce9e-4cb9-a1d8-4b5cf666a413 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Flushing IO for device /dev/sdb {{(pid=75245) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 16:13:26 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:13:26 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:13:26 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[3695d9ad-2474-4c78-9411-c8ee8955f78b]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:13:26 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-e4b03e1c-ce9e-4cb9-a1d8-4b5cf666a413 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75245) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 16:13:26 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:13:26 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:13:26 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b921b7-bcf6-415f-9ecf-89eaa4b61894]: (4, ('1', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:13:26 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-e4b03e1c-ce9e-4cb9-a1d8-4b5cf666a413 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 16:13:26 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-e4b03e1c-ce9e-4cb9-a1d8-4b5cf666a413 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] SCSI volumes sdb have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 16:13:26 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4b03e1c-ce9e-4cb9-a1d8-4b5cf666a413 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb')] {{(pid=75245) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 16:13:26 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:13:26 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:13:26 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[307ccea7-ba2b-4f37-a4a7-4c50dc1e610c]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:13:26 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4b03e1c-ce9e-4cb9-a1d8-4b5cf666a413 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:13:26 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb -p 172.16.0.220:3260 --logout {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:13:26 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:13:26 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[1479b87f-1c8e-4dd4-87b9-6bbafdb61619]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:13:26 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4b03e1c-ce9e-4cb9-a1d8-4b5cf666a413 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb, portal: 172.16.0.220,3260]
Nov 29 16:13:26 user nova-compute[75245]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb, portal: 172.16.0.220,3260] successful.
Nov 29 16:13:26 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:13:26 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb -p 172.16.0.220:3260 --op delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:13:26 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d96a77-3ba0-4b40-b61e-b8d8bd6a1eeb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:13:26 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[da704f12-cdba-47a0-a95e-273551e673ad]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:13:26 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4b03e1c-ce9e-4cb9-a1d8-4b5cf666a413 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:13:26 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-e4b03e1c-ce9e-4cb9-a1d8-4b5cf666a413 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:13:26 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4b03e1c-ce9e-4cb9-a1d8-4b5cf666a413 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] <== disconnect_volume: return (339ms) None {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:13:26 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4b03e1c-ce9e-4cb9-a1d8-4b5cf666a413 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] Disconnected iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 16:13:27 user nova-compute[75245]: DEBUG nova.objects.instance [None req-e4b03e1c-ce9e-4cb9-a1d8-4b5cf666a413 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Lazy-loading 'flavor' on Instance uuid e3fea3d2-6db1-4766-ad5b-9ad1e728ea10 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:13:27 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-e4b03e1c-ce9e-4cb9-a1d8-4b5cf666a413 tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Lock "e3fea3d2-6db1-4766-ad5b-9ad1e728ea10" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.104s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:13:27 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:13:30 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:13:30 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:13:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:13:35 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:13:37 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:13:37 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Acquiring lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:13:37 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:13:37 user nova-compute[75245]: DEBUG nova.compute.manager [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Starting instance... {{(pid=75245) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 16:13:37 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:13:37 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:13:37 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75245) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 16:13:37 user nova-compute[75245]: INFO nova.compute.claims [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Claim successful on node user
Nov 29 16:13:38 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:13:38 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:13:38 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.446s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:13:38 user nova-compute[75245]: DEBUG nova.compute.manager [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Start building networks asynchronously for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 16:13:38 user nova-compute[75245]: DEBUG nova.compute.manager [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Allocating IP information in the background. {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 16:13:38 user nova-compute[75245]: DEBUG nova.network.neutron [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] allocate_for_instance() {{(pid=75245) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 16:13:38 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 16:13:38 user nova-compute[75245]: DEBUG nova.compute.manager [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Start building block device mappings for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 16:13:38 user nova-compute[75245]: INFO nova.virt.block_device [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Booting with volume 021db3af-a7f2-4f6c-b702-35cec416ee18 at /dev/vda
Nov 29 16:13:38 user nova-compute[75245]: DEBUG os_brick.utils [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:13:38 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:13:38 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:13:38 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd4444a-3721-4673-8be3-4f35e3d480c9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:69ed8ed87091\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:13:38 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:13:38 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:13:38 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a29046-da3c-43f5-b5a6-d48112ccd442]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:13:38 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:13:38 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:13:38 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a6e4d4-7c8d-443a-ba3c-da41a09de9e5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:13:38 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa113d62-a997-4cfc-b957-8695be4a6693]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:13:38 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Running cmd (subprocess): nvme version {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:13:38 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] 'nvme version' failed. Not Retrying. {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:13:38 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] nvme not present on system {{(pid=75245) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 16:13:38 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:13:38 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:13:38 user nova-compute[75245]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 16:13:38 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[03975974-5432-4198-8fce-6e48cb67f56c]: (4, '') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:13:38 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75245) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 16:13:38 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 16:13:38 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] LIGHTOS: no hostnqn found. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 16:13:38 user nova-compute[75245]: DEBUG os_brick.utils [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:69ed8ed87091', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:13:38 user nova-compute[75245]: DEBUG nova.virt.block_device [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Updating existing volume attachment record: f2694a72-2d4b-4c08-9a0d-abcfb6958c02 {{(pid=75245) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 16:13:38 user nova-compute[75245]: DEBUG nova.policy [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8e9d4764cc9949bdb6fe3df0ca89daed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f45ede2eb64458870da9d0ca494178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75245) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 16:13:39 user nova-compute[75245]: DEBUG nova.network.neutron [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Successfully created port: e76a4989-a78d-47cf-8df0-b0b71180b60e {{(pid=75245) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 16:13:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-e227d878-1a0a-4407-bc74-a97a0fd695ad tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Acquiring lock "d55e6c2e-9791-4154-85f5-fec852577c2d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:13:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-e227d878-1a0a-4407-bc74-a97a0fd695ad tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Lock "d55e6c2e-9791-4154-85f5-fec852577c2d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:13:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-e227d878-1a0a-4407-bc74-a97a0fd695ad tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Acquiring lock "d55e6c2e-9791-4154-85f5-fec852577c2d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:13:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-e227d878-1a0a-4407-bc74-a97a0fd695ad tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Lock "d55e6c2e-9791-4154-85f5-fec852577c2d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:13:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-e227d878-1a0a-4407-bc74-a97a0fd695ad tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Lock "d55e6c2e-9791-4154-85f5-fec852577c2d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:13:39 user nova-compute[75245]: INFO nova.compute.manager [None req-e227d878-1a0a-4407-bc74-a97a0fd695ad tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] [instance: d55e6c2e-9791-4154-85f5-fec852577c2d] Terminating instance
Nov 29 16:13:39 user nova-compute[75245]: DEBUG nova.compute.manager [None req-e227d878-1a0a-4407-bc74-a97a0fd695ad tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] [instance: d55e6c2e-9791-4154-85f5-fec852577c2d] Start destroying the instance on the hypervisor. {{(pid=75245) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 16:13:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:13:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:13:39 user nova-compute[75245]: DEBUG nova.compute.manager [req-6c3c585f-619b-40b4-ac3b-bcacbad66d9a req-4db58d62-ba79-427c-8024-1898432b2432 service nova] [instance: d55e6c2e-9791-4154-85f5-fec852577c2d] Received event network-vif-unplugged-5a304ad9-9181-4384-b792-a8e80af9a86b {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:13:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-6c3c585f-619b-40b4-ac3b-bcacbad66d9a req-4db58d62-ba79-427c-8024-1898432b2432 service nova] Acquiring lock "d55e6c2e-9791-4154-85f5-fec852577c2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:13:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-6c3c585f-619b-40b4-ac3b-bcacbad66d9a req-4db58d62-ba79-427c-8024-1898432b2432 service nova] Lock "d55e6c2e-9791-4154-85f5-fec852577c2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:13:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-6c3c585f-619b-40b4-ac3b-bcacbad66d9a req-4db58d62-ba79-427c-8024-1898432b2432 service nova] Lock "d55e6c2e-9791-4154-85f5-fec852577c2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:13:39 user nova-compute[75245]: DEBUG nova.compute.manager [req-6c3c585f-619b-40b4-ac3b-bcacbad66d9a req-4db58d62-ba79-427c-8024-1898432b2432 service nova] [instance: d55e6c2e-9791-4154-85f5-fec852577c2d] No waiting events found dispatching network-vif-unplugged-5a304ad9-9181-4384-b792-a8e80af9a86b {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:13:39 user nova-compute[75245]: DEBUG nova.compute.manager [req-6c3c585f-619b-40b4-ac3b-bcacbad66d9a req-4db58d62-ba79-427c-8024-1898432b2432 service nova] [instance: d55e6c2e-9791-4154-85f5-fec852577c2d] Received event network-vif-unplugged-5a304ad9-9181-4384-b792-a8e80af9a86b for instance with task_state deleting. {{(pid=75245) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 16:13:40 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:13:40 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:13:40 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:13:40 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:13:40 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:13:40 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: d55e6c2e-9791-4154-85f5-fec852577c2d] Instance destroyed successfully.
Nov 29 16:13:40 user nova-compute[75245]: DEBUG nova.objects.instance [None req-e227d878-1a0a-4407-bc74-a97a0fd695ad tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Lazy-loading 'resources' on Instance uuid d55e6c2e-9791-4154-85f5-fec852577c2d {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:13:40 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-e227d878-1a0a-4407-bc74-a97a0fd695ad tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:11:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2029969502',display_name='tempest-ServersNegativeTestJSON-server-2029969502',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2029969502',id=11,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:11:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='17fcceabdcb74404971adda76fd4e48d',ramdisk_id='',reservation_id='r-ooowwp2q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1566439864',owner_user_name='tempest-ServersNegativeTestJSON-1566439864-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:11:58Z,user_data=None,user_id='97d9ea0d0a1842649850d631bed11ac1',uuid=d55e6c2e-9791-4154-85f5-fec852577c2d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5a304ad9-9181-4384-b792-a8e80af9a86b", "address": "fa:16:3e:f4:ca:eb", "network": {"id": "04f30281-e256-4d60-82d2-89004740b1b8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-649945802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17fcceabdcb74404971adda76fd4e48d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a304ad9-91", "ovs_interfaceid": "5a304ad9-9181-4384-b792-a8e80af9a86b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 16:13:40 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-e227d878-1a0a-4407-bc74-a97a0fd695ad tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Converting VIF {"id": "5a304ad9-9181-4384-b792-a8e80af9a86b", "address": "fa:16:3e:f4:ca:eb", "network": {"id": "04f30281-e256-4d60-82d2-89004740b1b8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-649945802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17fcceabdcb74404971adda76fd4e48d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a304ad9-91", "ovs_interfaceid": "5a304ad9-9181-4384-b792-a8e80af9a86b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:13:40 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-e227d878-1a0a-4407-bc74-a97a0fd695ad tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:ca:eb,bridge_name='br-int',has_traffic_filtering=True,id=5a304ad9-9181-4384-b792-a8e80af9a86b,network=Network(04f30281-e256-4d60-82d2-89004740b1b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a304ad9-91') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:13:40 user nova-compute[75245]: DEBUG os_vif [None req-e227d878-1a0a-4407-bc74-a97a0fd695ad tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:ca:eb,bridge_name='br-int',has_traffic_filtering=True,id=5a304ad9-9181-4384-b792-a8e80af9a86b,network=Network(04f30281-e256-4d60-82d2-89004740b1b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a304ad9-91') {{(pid=75245) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 16:13:40 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:13:40 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5a304ad9-91, bridge=br-int, if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:13:40 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:13:40 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:13:40 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=be901679-ca93-4fa4-ac78-7186ff7a1a29) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:13:40 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:13:40 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:13:40 user nova-compute[75245]: INFO os_vif [None req-e227d878-1a0a-4407-bc74-a97a0fd695ad tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:ca:eb,bridge_name='br-int',has_traffic_filtering=True,id=5a304ad9-9181-4384-b792-a8e80af9a86b,network=Network(04f30281-e256-4d60-82d2-89004740b1b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a304ad9-91')
Nov 29 16:13:40 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-e227d878-1a0a-4407-bc74-a97a0fd695ad tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] [instance: d55e6c2e-9791-4154-85f5-fec852577c2d] Deleting instance files /opt/stack/data/nova/instances/d55e6c2e-9791-4154-85f5-fec852577c2d_del
Nov 29 16:13:40 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-e227d878-1a0a-4407-bc74-a97a0fd695ad tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] [instance: d55e6c2e-9791-4154-85f5-fec852577c2d] Deletion of /opt/stack/data/nova/instances/d55e6c2e-9791-4154-85f5-fec852577c2d_del complete
Nov 29 16:13:40 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:13:40 user nova-compute[75245]: INFO nova.compute.manager [None req-e227d878-1a0a-4407-bc74-a97a0fd695ad tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] [instance: d55e6c2e-9791-4154-85f5-fec852577c2d] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 29 16:13:40 user nova-compute[75245]: DEBUG oslo.service.loopingcall [None req-e227d878-1a0a-4407-bc74-a97a0fd695ad tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75245) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 16:13:40 user nova-compute[75245]: DEBUG nova.compute.manager [-] [instance: d55e6c2e-9791-4154-85f5-fec852577c2d] Deallocating network for instance {{(pid=75245) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 16:13:40 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: d55e6c2e-9791-4154-85f5-fec852577c2d] deallocate_for_instance() {{(pid=75245) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 16:13:40 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:13:40 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:13:40 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-a1bf9bcb-2ef5-4b46-a226-4d3cff7804dc tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] Acquiring lock "55f5b252-468d-4064-99b3-49bdcdf98db8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:13:40 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-a1bf9bcb-2ef5-4b46-a226-4d3cff7804dc tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] Lock "55f5b252-468d-4064-99b3-49bdcdf98db8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:13:40 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-a1bf9bcb-2ef5-4b46-a226-4d3cff7804dc tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] Acquiring lock "55f5b252-468d-4064-99b3-49bdcdf98db8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:13:40 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-a1bf9bcb-2ef5-4b46-a226-4d3cff7804dc tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] Lock "55f5b252-468d-4064-99b3-49bdcdf98db8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:13:40 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-a1bf9bcb-2ef5-4b46-a226-4d3cff7804dc tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] Lock "55f5b252-468d-4064-99b3-49bdcdf98db8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:13:40 user nova-compute[75245]: INFO nova.compute.manager [None req-a1bf9bcb-2ef5-4b46-a226-4d3cff7804dc tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] Terminating instance
Nov 29 16:13:40 user nova-compute[75245]: DEBUG nova.compute.manager [None req-a1bf9bcb-2ef5-4b46-a226-4d3cff7804dc tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] Start destroying the instance on the hypervisor. {{(pid=75245) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 16:13:40 user nova-compute[75245]: DEBUG nova.network.neutron [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Successfully created port: 10e71fa4-4f0d-420a-9ea3-502e0a1eb1f7 {{(pid=75245) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 16:13:40 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:13:40 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:13:40 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:13:41 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:13:41 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:13:41 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:13:41 user nova-compute[75245]: DEBUG nova.compute.manager [req-d3b6bd12-0f42-47d3-8402-54cc1960997d req-a9109fb9-b66c-4f1c-9fb3-c6625e5b1a4b service nova] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] Received event network-vif-unplugged-eb8171a1-ecbc-43ba-86b5-c4d81f0231b4 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:13:41 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d3b6bd12-0f42-47d3-8402-54cc1960997d req-a9109fb9-b66c-4f1c-9fb3-c6625e5b1a4b service nova] Acquiring lock "55f5b252-468d-4064-99b3-49bdcdf98db8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:13:41 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d3b6bd12-0f42-47d3-8402-54cc1960997d req-a9109fb9-b66c-4f1c-9fb3-c6625e5b1a4b service nova] Lock "55f5b252-468d-4064-99b3-49bdcdf98db8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:13:41 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d3b6bd12-0f42-47d3-8402-54cc1960997d req-a9109fb9-b66c-4f1c-9fb3-c6625e5b1a4b service nova] Lock "55f5b252-468d-4064-99b3-49bdcdf98db8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:13:41 user nova-compute[75245]: DEBUG nova.compute.manager [req-d3b6bd12-0f42-47d3-8402-54cc1960997d req-a9109fb9-b66c-4f1c-9fb3-c6625e5b1a4b service nova] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] No waiting events found dispatching network-vif-unplugged-eb8171a1-ecbc-43ba-86b5-c4d81f0231b4 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:13:41 user nova-compute[75245]: DEBUG nova.compute.manager [req-d3b6bd12-0f42-47d3-8402-54cc1960997d req-a9109fb9-b66c-4f1c-9fb3-c6625e5b1a4b service nova] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] Received event network-vif-unplugged-eb8171a1-ecbc-43ba-86b5-c4d81f0231b4 for instance with task_state deleting. {{(pid=75245) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 16:13:41 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] Instance destroyed successfully.
Nov 29 16:13:41 user nova-compute[75245]: DEBUG nova.objects.instance [None req-a1bf9bcb-2ef5-4b46-a226-4d3cff7804dc tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] Lazy-loading 'resources' on Instance uuid 55f5b252-468d-4064-99b3-49bdcdf98db8 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:13:41 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-a1bf9bcb-2ef5-4b46-a226-4d3cff7804dc tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:10:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-2039927274',display_name='tempest-VolumesAssistedSnapshotsTest-server-2039927274',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-2039927274',id=8,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIlDZJSu5j7dU2EIWtn3rkn43PtYiKLciomrgOwP2Fg5AB4HbaKLm7AtTLVa2LMXb4hEXOVjnMhJq3LbqcLb39Web1zncwTZqYeK4/jz3ZLSncdM+cp8q7f4ljCgRK0hUA==',key_name='tempest-keypair-752852639',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:10:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='631a4252b40c45a7a192d0fefabec0d5',ramdisk_id='',reservation_id='r-s6z0usbp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-818874217',owner_user_name='tempest-VolumesAssistedSnapshotsTest-818874217-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:10:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64e190ebe1954fd6b7db1eeb3b96c7b0',uuid=55f5b252-468d-4064-99b3-49bdcdf98db8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eb8171a1-ecbc-43ba-86b5-c4d81f0231b4", "address": "fa:16:3e:ec:7c:03", "network": {"id": "675752ef-e4b8-410c-a508-00abae320208", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1370872233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "631a4252b40c45a7a192d0fefabec0d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb8171a1-ec", "ovs_interfaceid": "eb8171a1-ecbc-43ba-86b5-c4d81f0231b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 16:13:41 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-a1bf9bcb-2ef5-4b46-a226-4d3cff7804dc tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] Converting VIF {"id": "eb8171a1-ecbc-43ba-86b5-c4d81f0231b4", "address": "fa:16:3e:ec:7c:03", "network": {"id": "675752ef-e4b8-410c-a508-00abae320208", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1370872233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "631a4252b40c45a7a192d0fefabec0d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb8171a1-ec", "ovs_interfaceid": "eb8171a1-ecbc-43ba-86b5-c4d81f0231b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:13:41 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-a1bf9bcb-2ef5-4b46-a226-4d3cff7804dc tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ec:7c:03,bridge_name='br-int',has_traffic_filtering=True,id=eb8171a1-ecbc-43ba-86b5-c4d81f0231b4,network=Network(675752ef-e4b8-410c-a508-00abae320208),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb8171a1-ec') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:13:41 user nova-compute[75245]: DEBUG os_vif [None req-a1bf9bcb-2ef5-4b46-a226-4d3cff7804dc tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:7c:03,bridge_name='br-int',has_traffic_filtering=True,id=eb8171a1-ecbc-43ba-86b5-c4d81f0231b4,network=Network(675752ef-e4b8-410c-a508-00abae320208),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb8171a1-ec') {{(pid=75245) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 16:13:41 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: d55e6c2e-9791-4154-85f5-fec852577c2d] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:13:41 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:13:41 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeb8171a1-ec, bridge=br-int, if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:13:41 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:13:41 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:13:41 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:13:41 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b366209b-97d8-4eef-8f76-fca1670c097b) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:13:41 user nova-compute[75245]: DEBUG nova.compute.manager [req-709a5db3-75af-4bd9-87c4-28d5c0946144 req-817739cf-9ca2-40e2-b69a-4f74f6bf99ab service nova] [instance: d55e6c2e-9791-4154-85f5-fec852577c2d] Received event network-vif-deleted-5a304ad9-9181-4384-b792-a8e80af9a86b {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:13:41 user nova-compute[75245]: INFO nova.compute.manager [req-709a5db3-75af-4bd9-87c4-28d5c0946144 req-817739cf-9ca2-40e2-b69a-4f74f6bf99ab service nova] [instance: d55e6c2e-9791-4154-85f5-fec852577c2d] Neutron deleted interface 5a304ad9-9181-4384-b792-a8e80af9a86b; detaching it from the instance and deleting it from the info cache
Nov 29 16:13:41 user nova-compute[75245]: DEBUG nova.network.neutron [req-709a5db3-75af-4bd9-87c4-28d5c0946144 req-817739cf-9ca2-40e2-b69a-4f74f6bf99ab service nova] [instance: d55e6c2e-9791-4154-85f5-fec852577c2d] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:13:41 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:13:41 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:13:41 user nova-compute[75245]: INFO nova.compute.manager [-] [instance: d55e6c2e-9791-4154-85f5-fec852577c2d] Took 1.00 seconds to deallocate network for instance.
Nov 29 16:13:41 user nova-compute[75245]: INFO os_vif [None req-a1bf9bcb-2ef5-4b46-a226-4d3cff7804dc tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:7c:03,bridge_name='br-int',has_traffic_filtering=True,id=eb8171a1-ecbc-43ba-86b5-c4d81f0231b4,network=Network(675752ef-e4b8-410c-a508-00abae320208),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb8171a1-ec')
Nov 29 16:13:41 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-a1bf9bcb-2ef5-4b46-a226-4d3cff7804dc tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] Deleting instance files /opt/stack/data/nova/instances/55f5b252-468d-4064-99b3-49bdcdf98db8_del
Nov 29 16:13:41 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-a1bf9bcb-2ef5-4b46-a226-4d3cff7804dc tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] Deletion of /opt/stack/data/nova/instances/55f5b252-468d-4064-99b3-49bdcdf98db8_del complete
Nov 29 16:13:41 user nova-compute[75245]: DEBUG nova.compute.manager [req-709a5db3-75af-4bd9-87c4-28d5c0946144 req-817739cf-9ca2-40e2-b69a-4f74f6bf99ab service nova] [instance: d55e6c2e-9791-4154-85f5-fec852577c2d] Detach interface failed, port_id=5a304ad9-9181-4384-b792-a8e80af9a86b, reason: Instance d55e6c2e-9791-4154-85f5-fec852577c2d could not be found. {{(pid=75245) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 16:13:41 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-e227d878-1a0a-4407-bc74-a97a0fd695ad tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:13:41 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-e227d878-1a0a-4407-bc74-a97a0fd695ad tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:13:41 user nova-compute[75245]: INFO nova.compute.manager [None req-a1bf9bcb-2ef5-4b46-a226-4d3cff7804dc tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 29 16:13:41 user nova-compute[75245]: DEBUG oslo.service.loopingcall [None req-a1bf9bcb-2ef5-4b46-a226-4d3cff7804dc tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75245) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 16:13:41 user nova-compute[75245]: DEBUG nova.compute.manager [-] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] Deallocating network for instance {{(pid=75245) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 16:13:41 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] deallocate_for_instance() {{(pid=75245) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 16:13:41 user nova-compute[75245]: DEBUG nova.network.neutron [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Successfully created port: 706111a2-b6f0-4311-ac82-a60a93fa2f51 {{(pid=75245) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 16:13:42 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-e227d878-1a0a-4407-bc74-a97a0fd695ad tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:13:42 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-e227d878-1a0a-4407-bc74-a97a0fd695ad tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:13:42 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-e227d878-1a0a-4407-bc74-a97a0fd695ad tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.368s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:13:42 user nova-compute[75245]: DEBUG nova.compute.manager [req-af673ee9-cf27-454a-b7bb-0037f6392891 req-9dd4e822-76df-45ca-ad8e-ce1bc1d106b2 service nova] [instance: d55e6c2e-9791-4154-85f5-fec852577c2d] Received event network-vif-plugged-5a304ad9-9181-4384-b792-a8e80af9a86b {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:13:42 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-af673ee9-cf27-454a-b7bb-0037f6392891 req-9dd4e822-76df-45ca-ad8e-ce1bc1d106b2 service nova] Acquiring lock "d55e6c2e-9791-4154-85f5-fec852577c2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:13:42 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-af673ee9-cf27-454a-b7bb-0037f6392891 req-9dd4e822-76df-45ca-ad8e-ce1bc1d106b2 service nova] Lock "d55e6c2e-9791-4154-85f5-fec852577c2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:13:42 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-af673ee9-cf27-454a-b7bb-0037f6392891 req-9dd4e822-76df-45ca-ad8e-ce1bc1d106b2 service nova] Lock "d55e6c2e-9791-4154-85f5-fec852577c2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:13:42 user nova-compute[75245]: DEBUG nova.compute.manager [req-af673ee9-cf27-454a-b7bb-0037f6392891 req-9dd4e822-76df-45ca-ad8e-ce1bc1d106b2 service nova] [instance: d55e6c2e-9791-4154-85f5-fec852577c2d] No waiting events found dispatching network-vif-plugged-5a304ad9-9181-4384-b792-a8e80af9a86b {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:13:42 user nova-compute[75245]: WARNING nova.compute.manager [req-af673ee9-cf27-454a-b7bb-0037f6392891 req-9dd4e822-76df-45ca-ad8e-ce1bc1d106b2 service nova] [instance: d55e6c2e-9791-4154-85f5-fec852577c2d] Received unexpected event network-vif-plugged-5a304ad9-9181-4384-b792-a8e80af9a86b for instance with vm_state deleted and task_state None.
Nov 29 16:13:42 user nova-compute[75245]: DEBUG nova.compute.manager [req-af673ee9-cf27-454a-b7bb-0037f6392891 req-9dd4e822-76df-45ca-ad8e-ce1bc1d106b2 service nova] [instance: d55e6c2e-9791-4154-85f5-fec852577c2d] Received event network-vif-plugged-5a304ad9-9181-4384-b792-a8e80af9a86b {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:13:42 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-af673ee9-cf27-454a-b7bb-0037f6392891 req-9dd4e822-76df-45ca-ad8e-ce1bc1d106b2 service nova] Acquiring lock "d55e6c2e-9791-4154-85f5-fec852577c2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:13:42 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-af673ee9-cf27-454a-b7bb-0037f6392891 req-9dd4e822-76df-45ca-ad8e-ce1bc1d106b2 service nova] Lock "d55e6c2e-9791-4154-85f5-fec852577c2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:13:42 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-af673ee9-cf27-454a-b7bb-0037f6392891 req-9dd4e822-76df-45ca-ad8e-ce1bc1d106b2 service nova] Lock "d55e6c2e-9791-4154-85f5-fec852577c2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:13:42 user nova-compute[75245]: DEBUG nova.compute.manager [req-af673ee9-cf27-454a-b7bb-0037f6392891 req-9dd4e822-76df-45ca-ad8e-ce1bc1d106b2 service nova] [instance: d55e6c2e-9791-4154-85f5-fec852577c2d] No waiting events found dispatching network-vif-plugged-5a304ad9-9181-4384-b792-a8e80af9a86b {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:13:42 user nova-compute[75245]: WARNING nova.compute.manager [req-af673ee9-cf27-454a-b7bb-0037f6392891 req-9dd4e822-76df-45ca-ad8e-ce1bc1d106b2 service nova] [instance: d55e6c2e-9791-4154-85f5-fec852577c2d] Received unexpected event network-vif-plugged-5a304ad9-9181-4384-b792-a8e80af9a86b for instance with vm_state deleted and task_state None.
Nov 29 16:13:42 user nova-compute[75245]: DEBUG nova.compute.manager [req-af673ee9-cf27-454a-b7bb-0037f6392891 req-9dd4e822-76df-45ca-ad8e-ce1bc1d106b2 service nova] [instance: d55e6c2e-9791-4154-85f5-fec852577c2d] Received event network-vif-plugged-5a304ad9-9181-4384-b792-a8e80af9a86b {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:13:42 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-af673ee9-cf27-454a-b7bb-0037f6392891 req-9dd4e822-76df-45ca-ad8e-ce1bc1d106b2 service nova] Acquiring lock "d55e6c2e-9791-4154-85f5-fec852577c2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:13:42 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-af673ee9-cf27-454a-b7bb-0037f6392891 req-9dd4e822-76df-45ca-ad8e-ce1bc1d106b2 service nova] Lock "d55e6c2e-9791-4154-85f5-fec852577c2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:13:42 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-af673ee9-cf27-454a-b7bb-0037f6392891 req-9dd4e822-76df-45ca-ad8e-ce1bc1d106b2 service nova] Lock "d55e6c2e-9791-4154-85f5-fec852577c2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:13:42 user nova-compute[75245]: DEBUG nova.compute.manager [req-af673ee9-cf27-454a-b7bb-0037f6392891 req-9dd4e822-76df-45ca-ad8e-ce1bc1d106b2 service nova] [instance: d55e6c2e-9791-4154-85f5-fec852577c2d] No waiting events found dispatching network-vif-plugged-5a304ad9-9181-4384-b792-a8e80af9a86b {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:13:42 user nova-compute[75245]: WARNING nova.compute.manager [req-af673ee9-cf27-454a-b7bb-0037f6392891 req-9dd4e822-76df-45ca-ad8e-ce1bc1d106b2 service nova] [instance: d55e6c2e-9791-4154-85f5-fec852577c2d] Received unexpected event network-vif-plugged-5a304ad9-9181-4384-b792-a8e80af9a86b for instance with vm_state deleted and task_state None.
Nov 29 16:13:42 user nova-compute[75245]: DEBUG nova.compute.manager [req-af673ee9-cf27-454a-b7bb-0037f6392891 req-9dd4e822-76df-45ca-ad8e-ce1bc1d106b2 service nova] [instance: d55e6c2e-9791-4154-85f5-fec852577c2d] Received event network-vif-unplugged-5a304ad9-9181-4384-b792-a8e80af9a86b {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:13:42 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-af673ee9-cf27-454a-b7bb-0037f6392891 req-9dd4e822-76df-45ca-ad8e-ce1bc1d106b2 service nova] Acquiring lock "d55e6c2e-9791-4154-85f5-fec852577c2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:13:42 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-af673ee9-cf27-454a-b7bb-0037f6392891 req-9dd4e822-76df-45ca-ad8e-ce1bc1d106b2 service nova] Lock "d55e6c2e-9791-4154-85f5-fec852577c2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:13:42 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-af673ee9-cf27-454a-b7bb-0037f6392891 req-9dd4e822-76df-45ca-ad8e-ce1bc1d106b2 service nova] Lock "d55e6c2e-9791-4154-85f5-fec852577c2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:13:42 user nova-compute[75245]: DEBUG nova.compute.manager [req-af673ee9-cf27-454a-b7bb-0037f6392891 req-9dd4e822-76df-45ca-ad8e-ce1bc1d106b2 service nova] [instance: d55e6c2e-9791-4154-85f5-fec852577c2d] No waiting events found dispatching network-vif-unplugged-5a304ad9-9181-4384-b792-a8e80af9a86b {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:13:42 user nova-compute[75245]: WARNING nova.compute.manager [req-af673ee9-cf27-454a-b7bb-0037f6392891 req-9dd4e822-76df-45ca-ad8e-ce1bc1d106b2 service nova] [instance: d55e6c2e-9791-4154-85f5-fec852577c2d] Received unexpected event network-vif-unplugged-5a304ad9-9181-4384-b792-a8e80af9a86b for instance with vm_state deleted and task_state None.
Nov 29 16:13:42 user nova-compute[75245]: DEBUG nova.compute.manager [req-af673ee9-cf27-454a-b7bb-0037f6392891 req-9dd4e822-76df-45ca-ad8e-ce1bc1d106b2 service nova] [instance: d55e6c2e-9791-4154-85f5-fec852577c2d] Received event network-vif-plugged-5a304ad9-9181-4384-b792-a8e80af9a86b {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:13:42 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-af673ee9-cf27-454a-b7bb-0037f6392891 req-9dd4e822-76df-45ca-ad8e-ce1bc1d106b2 service nova] Acquiring lock "d55e6c2e-9791-4154-85f5-fec852577c2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:13:42 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-af673ee9-cf27-454a-b7bb-0037f6392891 req-9dd4e822-76df-45ca-ad8e-ce1bc1d106b2 service nova] Lock "d55e6c2e-9791-4154-85f5-fec852577c2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:13:42 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-af673ee9-cf27-454a-b7bb-0037f6392891 req-9dd4e822-76df-45ca-ad8e-ce1bc1d106b2 service nova] Lock "d55e6c2e-9791-4154-85f5-fec852577c2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:13:42 user nova-compute[75245]: DEBUG nova.compute.manager [req-af673ee9-cf27-454a-b7bb-0037f6392891 req-9dd4e822-76df-45ca-ad8e-ce1bc1d106b2 service nova] [instance: d55e6c2e-9791-4154-85f5-fec852577c2d] No waiting events found dispatching network-vif-plugged-5a304ad9-9181-4384-b792-a8e80af9a86b {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:13:42 user nova-compute[75245]: WARNING nova.compute.manager [req-af673ee9-cf27-454a-b7bb-0037f6392891 req-9dd4e822-76df-45ca-ad8e-ce1bc1d106b2 service nova] [instance: d55e6c2e-9791-4154-85f5-fec852577c2d] Received unexpected event network-vif-plugged-5a304ad9-9181-4384-b792-a8e80af9a86b for instance with vm_state deleted and task_state None.
Nov 29 16:13:42 user nova-compute[75245]: INFO nova.scheduler.client.report [None req-e227d878-1a0a-4407-bc74-a97a0fd695ad tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Deleted allocations for instance d55e6c2e-9791-4154-85f5-fec852577c2d
Nov 29 16:13:42 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-e227d878-1a0a-4407-bc74-a97a0fd695ad tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Lock "d55e6c2e-9791-4154-85f5-fec852577c2d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.723s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:13:42 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:13:43 user nova-compute[75245]: DEBUG nova.network.neutron [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Successfully created port: 5e39b868-de11-4bc1-b68a-11621bf7f057 {{(pid=75245) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 16:13:43 user nova-compute[75245]: DEBUG nova.compute.manager [req-62feefbd-639a-4a08-97be-9a82e05b2259 req-ade213eb-a83f-4fbb-9088-be8780559b6d service nova] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] Received event network-vif-plugged-eb8171a1-ecbc-43ba-86b5-c4d81f0231b4 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:13:43 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-62feefbd-639a-4a08-97be-9a82e05b2259 req-ade213eb-a83f-4fbb-9088-be8780559b6d service nova] Acquiring lock "55f5b252-468d-4064-99b3-49bdcdf98db8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:13:43 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-62feefbd-639a-4a08-97be-9a82e05b2259 req-ade213eb-a83f-4fbb-9088-be8780559b6d service nova] Lock "55f5b252-468d-4064-99b3-49bdcdf98db8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:13:43 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-62feefbd-639a-4a08-97be-9a82e05b2259 req-ade213eb-a83f-4fbb-9088-be8780559b6d service nova] Lock "55f5b252-468d-4064-99b3-49bdcdf98db8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:13:43 user nova-compute[75245]: DEBUG nova.compute.manager [req-62feefbd-639a-4a08-97be-9a82e05b2259 req-ade213eb-a83f-4fbb-9088-be8780559b6d service nova] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] No waiting events found dispatching network-vif-plugged-eb8171a1-ecbc-43ba-86b5-c4d81f0231b4 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:13:43 user nova-compute[75245]: WARNING nova.compute.manager [req-62feefbd-639a-4a08-97be-9a82e05b2259 req-ade213eb-a83f-4fbb-9088-be8780559b6d service nova] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] Received unexpected event network-vif-plugged-eb8171a1-ecbc-43ba-86b5-c4d81f0231b4 for instance with vm_state active and task_state deleting.
Nov 29 16:13:43 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:13:43 user nova-compute[75245]: INFO nova.compute.manager [-] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] Took 1.71 seconds to deallocate network for instance.
Nov 29 16:13:43 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-a1bf9bcb-2ef5-4b46-a226-4d3cff7804dc tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:13:43 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-a1bf9bcb-2ef5-4b46-a226-4d3cff7804dc tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:13:43 user nova-compute[75245]: DEBUG nova.compute.manager [req-14c04296-30e7-4e45-ac83-0e4582db2143 req-e01d3cdb-78ed-4758-89ca-41df7f0d9b56 service nova] [instance: 55f5b252-468d-4064-99b3-49bdcdf98db8] Received event network-vif-deleted-eb8171a1-ecbc-43ba-86b5-c4d81f0231b4 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:13:43 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-a1bf9bcb-2ef5-4b46-a226-4d3cff7804dc tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:13:43 user nova-compute[75245]: DEBUG nova.network.neutron [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Successfully created port: 52f4aecd-3b06-4a52-9541-b7bc96acf5d4 {{(pid=75245) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 16:13:43 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-a1bf9bcb-2ef5-4b46-a226-4d3cff7804dc tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:13:43 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-a1bf9bcb-2ef5-4b46-a226-4d3cff7804dc tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.369s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:13:43 user nova-compute[75245]: INFO nova.scheduler.client.report [None req-a1bf9bcb-2ef5-4b46-a226-4d3cff7804dc tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] Deleted allocations for instance 55f5b252-468d-4064-99b3-49bdcdf98db8
Nov 29 16:13:44 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-a1bf9bcb-2ef5-4b46-a226-4d3cff7804dc tempest-VolumesAssistedSnapshotsTest-818874217 tempest-VolumesAssistedSnapshotsTest-818874217-project-member] Lock "55f5b252-468d-4064-99b3-49bdcdf98db8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.230s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:13:44 user nova-compute[75245]: DEBUG nova.network.neutron [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Successfully updated port: e76a4989-a78d-47cf-8df0-b0b71180b60e {{(pid=75245) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 16:13:45 user nova-compute[75245]: DEBUG nova.network.neutron [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Successfully updated port: 4dd25469-cfd1-468f-8fa3-a58c5613c96b {{(pid=75245) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 16:13:45 user nova-compute[75245]: DEBUG nova.compute.manager [req-b1adecd4-3cdf-449b-8063-ca8805523150 req-68ec9144-2018-4c14-9d7d-deaafd2600eb service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Received event network-changed-e76a4989-a78d-47cf-8df0-b0b71180b60e {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:13:45 user nova-compute[75245]: DEBUG nova.compute.manager [req-b1adecd4-3cdf-449b-8063-ca8805523150 req-68ec9144-2018-4c14-9d7d-deaafd2600eb service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Refreshing instance network info cache due to event network-changed-e76a4989-a78d-47cf-8df0-b0b71180b60e. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:13:45 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b1adecd4-3cdf-449b-8063-ca8805523150 req-68ec9144-2018-4c14-9d7d-deaafd2600eb service nova] Acquiring lock "refresh_cache-5f2a6f15-e413-47a2-be3e-961dd9ee7deb" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:13:45 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b1adecd4-3cdf-449b-8063-ca8805523150 req-68ec9144-2018-4c14-9d7d-deaafd2600eb service nova] Acquired lock "refresh_cache-5f2a6f15-e413-47a2-be3e-961dd9ee7deb" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:13:45 user nova-compute[75245]: DEBUG nova.network.neutron [req-b1adecd4-3cdf-449b-8063-ca8805523150 req-68ec9144-2018-4c14-9d7d-deaafd2600eb service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Refreshing network info cache for port e76a4989-a78d-47cf-8df0-b0b71180b60e {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:13:45 user nova-compute[75245]: DEBUG nova.network.neutron [req-b1adecd4-3cdf-449b-8063-ca8805523150 req-68ec9144-2018-4c14-9d7d-deaafd2600eb service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Instance cache missing network info. {{(pid=75245) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 16:13:46 user nova-compute[75245]: DEBUG nova.network.neutron [req-b1adecd4-3cdf-449b-8063-ca8805523150 req-68ec9144-2018-4c14-9d7d-deaafd2600eb service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:13:46 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b1adecd4-3cdf-449b-8063-ca8805523150 req-68ec9144-2018-4c14-9d7d-deaafd2600eb service nova] Releasing lock "refresh_cache-5f2a6f15-e413-47a2-be3e-961dd9ee7deb" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:13:46 user nova-compute[75245]: DEBUG nova.compute.manager [req-b1adecd4-3cdf-449b-8063-ca8805523150 req-68ec9144-2018-4c14-9d7d-deaafd2600eb service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Received event network-changed-4dd25469-cfd1-468f-8fa3-a58c5613c96b {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:13:46 user nova-compute[75245]: DEBUG nova.compute.manager [req-b1adecd4-3cdf-449b-8063-ca8805523150 req-68ec9144-2018-4c14-9d7d-deaafd2600eb service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Refreshing instance network info cache due to event network-changed-4dd25469-cfd1-468f-8fa3-a58c5613c96b. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:13:46 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b1adecd4-3cdf-449b-8063-ca8805523150 req-68ec9144-2018-4c14-9d7d-deaafd2600eb service nova] Acquiring lock "refresh_cache-5f2a6f15-e413-47a2-be3e-961dd9ee7deb" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:13:46 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b1adecd4-3cdf-449b-8063-ca8805523150 req-68ec9144-2018-4c14-9d7d-deaafd2600eb service nova] Acquired lock "refresh_cache-5f2a6f15-e413-47a2-be3e-961dd9ee7deb" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:13:46 user nova-compute[75245]: DEBUG nova.network.neutron [req-b1adecd4-3cdf-449b-8063-ca8805523150 req-68ec9144-2018-4c14-9d7d-deaafd2600eb service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Refreshing network info cache for port 4dd25469-cfd1-468f-8fa3-a58c5613c96b {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:13:46 user nova-compute[75245]: DEBUG nova.network.neutron [req-b1adecd4-3cdf-449b-8063-ca8805523150 req-68ec9144-2018-4c14-9d7d-deaafd2600eb service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Instance cache missing network info. {{(pid=75245) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 16:13:46 user nova-compute[75245]: DEBUG nova.network.neutron [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Successfully updated port: 7b6625ae-3097-4e56-bb72-3b67ff4996b6 {{(pid=75245) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 16:13:46 user nova-compute[75245]: DEBUG nova.network.neutron [req-b1adecd4-3cdf-449b-8063-ca8805523150 req-68ec9144-2018-4c14-9d7d-deaafd2600eb service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:13:46 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b1adecd4-3cdf-449b-8063-ca8805523150 req-68ec9144-2018-4c14-9d7d-deaafd2600eb service nova] Releasing lock "refresh_cache-5f2a6f15-e413-47a2-be3e-961dd9ee7deb" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:13:46 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:13:47 user nova-compute[75245]: DEBUG nova.network.neutron [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Successfully updated port: 10e71fa4-4f0d-420a-9ea3-502e0a1eb1f7 {{(pid=75245) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 16:13:47 user nova-compute[75245]: INFO nova.virt.block_device [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Booting with volume 92465e1e-d975-4701-a213-bc8906dafc49 at /dev/vdb
Nov 29 16:13:47 user nova-compute[75245]: DEBUG os_brick.utils [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:13:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:13:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:13:47 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae70073-4265-4b78-a840-76e4d2a5d11e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:69ed8ed87091\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:13:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:13:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:13:47 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc3b8c18-90a0-420a-a5da-f62c740d244e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:13:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:13:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:13:47 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a4faba-b4e7-4685-b742-e0a85e97e246]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:13:47 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[a077a310-0234-46a6-a165-b904f9a8308f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:13:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Running cmd (subprocess): nvme version {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:13:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] 'nvme version' failed. Not Retrying. {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:13:47 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] nvme not present on system {{(pid=75245) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 16:13:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:13:47 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:13:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:13:47 user nova-compute[75245]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 16:13:47 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c1ad4f-878d-4322-bd60-3f0b046b167c]: (4, '') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:13:47 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75245) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 16:13:47 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 16:13:47 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] LIGHTOS: no hostnqn found. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 16:13:47 user nova-compute[75245]: DEBUG os_brick.utils [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:69ed8ed87091', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:13:47 user nova-compute[75245]: DEBUG nova.virt.block_device [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Updating existing volume attachment record: 8e7dc227-eab0-4890-8e7e-bf64a4758a8f {{(pid=75245) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 16:13:47 user nova-compute[75245]: DEBUG nova.compute.manager [req-a0bab3dc-e94c-4938-a9d7-d3de95adc9c0 req-f9184fb3-533f-40e3-9308-a13021b079f3 service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Received event network-changed-7b6625ae-3097-4e56-bb72-3b67ff4996b6 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:13:47 user nova-compute[75245]: DEBUG nova.compute.manager [req-a0bab3dc-e94c-4938-a9d7-d3de95adc9c0 req-f9184fb3-533f-40e3-9308-a13021b079f3 service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Refreshing instance network info cache due to event network-changed-7b6625ae-3097-4e56-bb72-3b67ff4996b6. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:13:47 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a0bab3dc-e94c-4938-a9d7-d3de95adc9c0 req-f9184fb3-533f-40e3-9308-a13021b079f3 service nova] Acquiring lock "refresh_cache-5f2a6f15-e413-47a2-be3e-961dd9ee7deb" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:13:47 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a0bab3dc-e94c-4938-a9d7-d3de95adc9c0 req-f9184fb3-533f-40e3-9308-a13021b079f3 service nova] Acquired lock "refresh_cache-5f2a6f15-e413-47a2-be3e-961dd9ee7deb" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:13:47 user nova-compute[75245]: DEBUG nova.network.neutron [req-a0bab3dc-e94c-4938-a9d7-d3de95adc9c0 req-f9184fb3-533f-40e3-9308-a13021b079f3 service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Refreshing network info cache for port 7b6625ae-3097-4e56-bb72-3b67ff4996b6 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:13:48 user nova-compute[75245]: DEBUG nova.network.neutron [req-a0bab3dc-e94c-4938-a9d7-d3de95adc9c0 req-f9184fb3-533f-40e3-9308-a13021b079f3 service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Instance cache missing network info. {{(pid=75245) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 16:13:48 user nova-compute[75245]: DEBUG nova.network.neutron [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Successfully updated port: 706111a2-b6f0-4311-ac82-a60a93fa2f51 {{(pid=75245) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 16:13:48 user nova-compute[75245]: DEBUG nova.network.neutron [req-a0bab3dc-e94c-4938-a9d7-d3de95adc9c0 req-f9184fb3-533f-40e3-9308-a13021b079f3 service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:13:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a0bab3dc-e94c-4938-a9d7-d3de95adc9c0 req-f9184fb3-533f-40e3-9308-a13021b079f3 service nova] Releasing lock "refresh_cache-5f2a6f15-e413-47a2-be3e-961dd9ee7deb" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:13:48 user nova-compute[75245]: DEBUG nova.compute.manager [req-a0bab3dc-e94c-4938-a9d7-d3de95adc9c0 req-f9184fb3-533f-40e3-9308-a13021b079f3 service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Received event network-changed-10e71fa4-4f0d-420a-9ea3-502e0a1eb1f7 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:13:48 user nova-compute[75245]: DEBUG nova.compute.manager [req-a0bab3dc-e94c-4938-a9d7-d3de95adc9c0 req-f9184fb3-533f-40e3-9308-a13021b079f3 service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Refreshing instance network info cache due to event network-changed-10e71fa4-4f0d-420a-9ea3-502e0a1eb1f7. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:13:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a0bab3dc-e94c-4938-a9d7-d3de95adc9c0 req-f9184fb3-533f-40e3-9308-a13021b079f3 service nova] Acquiring lock "refresh_cache-5f2a6f15-e413-47a2-be3e-961dd9ee7deb" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:13:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a0bab3dc-e94c-4938-a9d7-d3de95adc9c0 req-f9184fb3-533f-40e3-9308-a13021b079f3 service nova] Acquired lock "refresh_cache-5f2a6f15-e413-47a2-be3e-961dd9ee7deb" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:13:48 user nova-compute[75245]: DEBUG nova.network.neutron [req-a0bab3dc-e94c-4938-a9d7-d3de95adc9c0 req-f9184fb3-533f-40e3-9308-a13021b079f3 service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Refreshing network info cache for port 10e71fa4-4f0d-420a-9ea3-502e0a1eb1f7 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:13:48 user nova-compute[75245]: DEBUG nova.network.neutron [req-a0bab3dc-e94c-4938-a9d7-d3de95adc9c0 req-f9184fb3-533f-40e3-9308-a13021b079f3 service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Instance cache missing network info. {{(pid=75245) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 16:13:48 user nova-compute[75245]: DEBUG nova.network.neutron [req-a0bab3dc-e94c-4938-a9d7-d3de95adc9c0 req-f9184fb3-533f-40e3-9308-a13021b079f3 service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:13:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a0bab3dc-e94c-4938-a9d7-d3de95adc9c0 req-f9184fb3-533f-40e3-9308-a13021b079f3 service nova] Releasing lock "refresh_cache-5f2a6f15-e413-47a2-be3e-961dd9ee7deb" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:13:49 user nova-compute[75245]: DEBUG nova.network.neutron [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Successfully updated port: 5e39b868-de11-4bc1-b68a-11621bf7f057 {{(pid=75245) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 16:13:49 user nova-compute[75245]: DEBUG nova.network.neutron [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Successfully updated port: 52f4aecd-3b06-4a52-9541-b7bc96acf5d4 {{(pid=75245) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 16:13:49 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Acquiring lock "refresh_cache-5f2a6f15-e413-47a2-be3e-961dd9ee7deb" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:13:49 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Acquired lock "refresh_cache-5f2a6f15-e413-47a2-be3e-961dd9ee7deb" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:13:49 user nova-compute[75245]: DEBUG nova.network.neutron [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 16:13:49 user nova-compute[75245]: DEBUG nova.compute.manager [req-d45b6d7d-d5a7-42cc-930c-a780b61c910d req-bd2eb819-9cbf-415a-87f0-293e5d0566fc service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Received event network-changed-706111a2-b6f0-4311-ac82-a60a93fa2f51 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:13:49 user nova-compute[75245]: DEBUG nova.compute.manager [req-d45b6d7d-d5a7-42cc-930c-a780b61c910d req-bd2eb819-9cbf-415a-87f0-293e5d0566fc service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Refreshing instance network info cache due to event network-changed-706111a2-b6f0-4311-ac82-a60a93fa2f51. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:13:49 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d45b6d7d-d5a7-42cc-930c-a780b61c910d req-bd2eb819-9cbf-415a-87f0-293e5d0566fc service nova] Acquiring lock "refresh_cache-5f2a6f15-e413-47a2-be3e-961dd9ee7deb" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:13:49 user nova-compute[75245]: DEBUG nova.network.neutron [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Instance cache missing network info. {{(pid=75245) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 16:13:50 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Acquiring lock "816edb0e-c4fc-470b-8151-f98502e50789" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:13:50 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "816edb0e-c4fc-470b-8151-f98502e50789" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:13:50 user nova-compute[75245]: DEBUG nova.compute.manager [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Starting instance... {{(pid=75245) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 16:13:50 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:13:50 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:13:50 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75245) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 16:13:50 user nova-compute[75245]: INFO nova.compute.claims [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Claim successful on node user
Nov 29 16:13:51 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:13:51 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:13:51 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.396s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:13:51 user nova-compute[75245]: DEBUG nova.compute.manager [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Start building networks asynchronously for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 16:13:51 user nova-compute[75245]: DEBUG nova.compute.manager [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Allocating IP information in the background. {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 16:13:51 user nova-compute[75245]: DEBUG nova.network.neutron [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] allocate_for_instance() {{(pid=75245) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 16:13:51 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 16:13:51 user nova-compute[75245]: DEBUG nova.compute.manager [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Start building block device mappings for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 16:13:51 user nova-compute[75245]: DEBUG nova.policy [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'be595c3f7084413180f2ab86e9c56a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6b87e18ef1f48d19a6907b28cb54f04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75245) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 16:13:51 user nova-compute[75245]: DEBUG nova.compute.manager [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Start spawning the instance on the hypervisor. {{(pid=75245) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 16:13:51 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Creating instance directory {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 16:13:51 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Creating image(s)
Nov 29 16:13:51 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Acquiring lock "/opt/stack/data/nova/instances/816edb0e-c4fc-470b-8151-f98502e50789/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:13:51 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "/opt/stack/data/nova/instances/816edb0e-c4fc-470b-8151-f98502e50789/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:13:51 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "/opt/stack/data/nova/instances/816edb0e-c4fc-470b-8151-f98502e50789/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.057s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:13:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:13:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:13:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.205s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:13:51 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Acquiring lock "d654f7206043e05d3525550b0fc885556eb999f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:13:51 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:13:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:13:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.189s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:13:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/816edb0e-c4fc-470b-8151-f98502e50789/disk 1073741824 {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:13:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/816edb0e-c4fc-470b-8151-f98502e50789/disk 1073741824" returned: 0 in 0.065s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:13:51 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:13:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:13:52 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.202s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:13:52 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Checking if we can resize image /opt/stack/data/nova/instances/816edb0e-c4fc-470b-8151-f98502e50789/disk. size=1073741824 {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 16:13:52 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/816edb0e-c4fc-470b-8151-f98502e50789/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:13:52 user nova-compute[75245]: DEBUG nova.network.neutron [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Successfully created port: f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76 {{(pid=75245) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 16:13:52 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/816edb0e-c4fc-470b-8151-f98502e50789/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:13:52 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Cannot resize image /opt/stack/data/nova/instances/816edb0e-c4fc-470b-8151-f98502e50789/disk to a smaller size. {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 16:13:52 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Created local disks {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 16:13:52 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Ensure instance console log exists: /opt/stack/data/nova/instances/816edb0e-c4fc-470b-8151-f98502e50789/console.log {{(pid=75245) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 16:13:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:13:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:13:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:13:52 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:13:52 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:13:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:13:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:13:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:13:52 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75245) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 16:13:52 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd819060-4388-444d-809e-94f6b2e8f102/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:13:52 user nova-compute[75245]: DEBUG nova.network.neutron [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Updating instance_info_cache with network_info: [{"id": "e76a4989-a78d-47cf-8df0-b0b71180b60e", "address": "fa:16:3e:76:29:fe", "network": {"id": "0e5af197-7146-4691-9357-c6d470646e65", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1607694636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape76a4989-a7", "ovs_interfaceid": "e76a4989-a78d-47cf-8df0-b0b71180b60e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4dd25469-cfd1-468f-8fa3-a58c5613c96b", "address": "fa:16:3e:16:dd:65", "network": {"id": "33ed6d1c-906e-49c8-9731-a0d23f716434", "bridge": "br-int", "label": "tempest-device-tagging-net1-322196721", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dd25469-cf", "ovs_interfaceid": "4dd25469-cfd1-468f-8fa3-a58c5613c96b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7b6625ae-3097-4e56-bb72-3b67ff4996b6", "address": "fa:16:3e:be:8a:fe", "network": {"id": "33ed6d1c-906e-49c8-9731-a0d23f716434", "bridge": "br-int", "label": "tempest-device-tagging-net1-322196721", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b6625ae-30", "ovs_interfaceid": "7b6625ae-3097-4e56-bb72-3b67ff4996b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "10e71fa4-4f0d-420a-9ea3-502e0a1eb1f7", "address": "fa:16:3e:3a:e0:19", "network": {"id": "33ed6d1c-906e-49c8-9731-a0d23f716434", "bridge": "br-int", "label": "tempest-device-tagging-net1-322196721", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e71fa4-4f", "ovs_interfaceid": "10e71fa4-4f0d-420a-9ea3-502e0a1eb1f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "706111a2-b6f0-4311-ac82-a60a93fa2f51", "address": "fa:16:3e:db:77:11", "network": {"id": "33ed6d1c-906e-49c8-9731-a0d23f716434", "bridge": "br-int", "label": "tempest-device-tagging-net1-322196721", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap706111a2-b6", "ovs_interfaceid": "706111a2-b6f0-4311-ac82-a60a93fa2f51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5e39b868-de11-4bc1-b68a-11621bf7f057", "address": "fa:16:3e:44:89:16", "network": {"id": "c815e5db-bcac-4915-b581-63c2f697d2e5", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132953712", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e39b868-de", "ovs_interfaceid": "5e39b868-de11-4bc1-b68a-11621bf7f057", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "52f4aecd-3b06-4a52-9541-b7bc96acf5d4", "address": "fa:16:3e:f9:b9:5f", "network": {"id": "c815e5db-bcac-4915-b581-63c2f697d2e5", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132953712", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52f4aecd-3b", "ovs_interfaceid": "52f4aecd-3b06-4a52-9541-b7bc96acf5d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:13:52 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:13:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Releasing lock "refresh_cache-5f2a6f15-e413-47a2-be3e-961dd9ee7deb" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:13:52 user nova-compute[75245]: DEBUG nova.compute.manager [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Instance network_info: |[{"id": "e76a4989-a78d-47cf-8df0-b0b71180b60e", "address": "fa:16:3e:76:29:fe", "network": {"id": "0e5af197-7146-4691-9357-c6d470646e65", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1607694636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape76a4989-a7", "ovs_interfaceid": "e76a4989-a78d-47cf-8df0-b0b71180b60e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4dd25469-cfd1-468f-8fa3-a58c5613c96b", "address": "fa:16:3e:16:dd:65", "network": {"id": "33ed6d1c-906e-49c8-9731-a0d23f716434", "bridge": "br-int", "label": "tempest-device-tagging-net1-322196721", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dd25469-cf", "ovs_interfaceid": "4dd25469-cfd1-468f-8fa3-a58c5613c96b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7b6625ae-3097-4e56-bb72-3b67ff4996b6", "address": "fa:16:3e:be:8a:fe", "network": {"id": "33ed6d1c-906e-49c8-9731-a0d23f716434", "bridge": "br-int", "label": "tempest-device-tagging-net1-322196721", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b6625ae-30", "ovs_interfaceid": "7b6625ae-3097-4e56-bb72-3b67ff4996b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "10e71fa4-4f0d-420a-9ea3-502e0a1eb1f7", "address": "fa:16:3e:3a:e0:19", "network": {"id": "33ed6d1c-906e-49c8-9731-a0d23f716434", "bridge": "br-int", "label": "tempest-device-tagging-net1-322196721", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e71fa4-4f", "ovs_interfaceid": "10e71fa4-4f0d-420a-9ea3-502e0a1eb1f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "706111a2-b6f0-4311-ac82-a60a93fa2f51", "address": "fa:16:3e:db:77:11", "network": {"id": "33ed6d1c-906e-49c8-9731-a0d23f716434", "bridge": "br-int", "label": "tempest-device-tagging-net1-322196721", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap706111a2-b6", "ovs_interfaceid": "706111a2-b6f0-4311-ac82-a60a93fa2f51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5e39b868-de11-4bc1-b68a-11621bf7f057", "address": "fa:16:3e:44:89:16", "network": {"id": "c815e5db-bcac-4915-b581-63c2f697d2e5", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132953712", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e39b868-de", "ovs_interfaceid": "5e39b868-de11-4bc1-b68a-11621bf7f057", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "52f4aecd-3b06-4a52-9541-b7bc96acf5d4", "address": "fa:16:3e:f9:b9:5f", "network": {"id": "c815e5db-bcac-4915-b581-63c2f697d2e5", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132953712", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52f4aecd-3b", "ovs_interfaceid": "52f4aecd-3b06-4a52-9541-b7bc96acf5d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 16:13:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d45b6d7d-d5a7-42cc-930c-a780b61c910d req-bd2eb819-9cbf-415a-87f0-293e5d0566fc service nova] Acquired lock "refresh_cache-5f2a6f15-e413-47a2-be3e-961dd9ee7deb" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:13:52 user nova-compute[75245]: DEBUG nova.network.neutron [req-d45b6d7d-d5a7-42cc-930c-a780b61c910d req-bd2eb819-9cbf-415a-87f0-293e5d0566fc service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Refreshing network info cache for port 706111a2-b6f0-4311-ac82-a60a93fa2f51 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:13:52 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd819060-4388-444d-809e-94f6b2e8f102/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:13:52 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd819060-4388-444d-809e-94f6b2e8f102/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:13:53 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd819060-4388-444d-809e-94f6b2e8f102/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:13:53 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:13:53 user nova-compute[75245]: DEBUG nova.network.neutron [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Successfully updated port: f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76 {{(pid=75245) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 16:13:53 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:13:53 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:13:53 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Acquiring lock "refresh_cache-816edb0e-c4fc-470b-8151-f98502e50789" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:13:53 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Acquired lock "refresh_cache-816edb0e-c4fc-470b-8151-f98502e50789" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:13:53 user nova-compute[75245]: DEBUG nova.network.neutron [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 16:13:53 user nova-compute[75245]: DEBUG nova.compute.manager [req-3e62af19-c8e3-4464-a1a1-726478ffdab6 req-560844e9-0838-4fa6-8912-871703cf3e9e service nova] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Received event network-changed-f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:13:53 user nova-compute[75245]: DEBUG nova.compute.manager [req-3e62af19-c8e3-4464-a1a1-726478ffdab6 req-560844e9-0838-4fa6-8912-871703cf3e9e service nova] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Refreshing instance network info cache due to event network-changed-f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:13:53 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-3e62af19-c8e3-4464-a1a1-726478ffdab6 req-560844e9-0838-4fa6-8912-871703cf3e9e service nova] Acquiring lock "refresh_cache-816edb0e-c4fc-470b-8151-f98502e50789" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:13:53 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:13:53 user nova-compute[75245]: DEBUG nova.network.neutron [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Instance cache missing network info. {{(pid=75245) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 16:13:53 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fea3d2-6db1-4766-ad5b-9ad1e728ea10/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:13:53 user nova-compute[75245]: DEBUG nova.network.neutron [req-d45b6d7d-d5a7-42cc-930c-a780b61c910d req-bd2eb819-9cbf-415a-87f0-293e5d0566fc service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Updated VIF entry in instance network info cache for port 706111a2-b6f0-4311-ac82-a60a93fa2f51. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:13:53 user nova-compute[75245]: DEBUG nova.network.neutron [req-d45b6d7d-d5a7-42cc-930c-a780b61c910d req-bd2eb819-9cbf-415a-87f0-293e5d0566fc service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Updating instance_info_cache with network_info: [{"id": "e76a4989-a78d-47cf-8df0-b0b71180b60e", "address": "fa:16:3e:76:29:fe", "network": {"id": "0e5af197-7146-4691-9357-c6d470646e65", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1607694636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape76a4989-a7", "ovs_interfaceid": "e76a4989-a78d-47cf-8df0-b0b71180b60e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4dd25469-cfd1-468f-8fa3-a58c5613c96b", "address": "fa:16:3e:16:dd:65", "network": {"id": "33ed6d1c-906e-49c8-9731-a0d23f716434", "bridge": "br-int", "label": "tempest-device-tagging-net1-322196721", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dd25469-cf", "ovs_interfaceid": "4dd25469-cfd1-468f-8fa3-a58c5613c96b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7b6625ae-3097-4e56-bb72-3b67ff4996b6", "address": "fa:16:3e:be:8a:fe", "network": {"id": "33ed6d1c-906e-49c8-9731-a0d23f716434", "bridge": "br-int", "label": "tempest-device-tagging-net1-322196721", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b6625ae-30", "ovs_interfaceid": "7b6625ae-3097-4e56-bb72-3b67ff4996b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "10e71fa4-4f0d-420a-9ea3-502e0a1eb1f7", "address": "fa:16:3e:3a:e0:19", "network": {"id": "33ed6d1c-906e-49c8-9731-a0d23f716434", "bridge": "br-int", "label": "tempest-device-tagging-net1-322196721", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e71fa4-4f", "ovs_interfaceid": "10e71fa4-4f0d-420a-9ea3-502e0a1eb1f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "706111a2-b6f0-4311-ac82-a60a93fa2f51", "address": "fa:16:3e:db:77:11", "network": {"id": "33ed6d1c-906e-49c8-9731-a0d23f716434", "bridge": "br-int", "label": "tempest-device-tagging-net1-322196721", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap706111a2-b6", "ovs_interfaceid": "706111a2-b6f0-4311-ac82-a60a93fa2f51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5e39b868-de11-4bc1-b68a-11621bf7f057", "address": "fa:16:3e:44:89:16", "network": {"id": "c815e5db-bcac-4915-b581-63c2f697d2e5", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132953712", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e39b868-de", "ovs_interfaceid": "5e39b868-de11-4bc1-b68a-11621bf7f057", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "52f4aecd-3b06-4a52-9541-b7bc96acf5d4", "address": "fa:16:3e:f9:b9:5f", "network": {"id": "c815e5db-bcac-4915-b581-63c2f697d2e5", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132953712", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52f4aecd-3b", "ovs_interfaceid": "52f4aecd-3b06-4a52-9541-b7bc96acf5d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:13:53 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d45b6d7d-d5a7-42cc-930c-a780b61c910d req-bd2eb819-9cbf-415a-87f0-293e5d0566fc service nova] Releasing lock "refresh_cache-5f2a6f15-e413-47a2-be3e-961dd9ee7deb" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:13:53 user nova-compute[75245]: DEBUG nova.compute.manager [req-d45b6d7d-d5a7-42cc-930c-a780b61c910d req-bd2eb819-9cbf-415a-87f0-293e5d0566fc service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Received event network-changed-5e39b868-de11-4bc1-b68a-11621bf7f057 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:13:53 user nova-compute[75245]: DEBUG nova.compute.manager [req-d45b6d7d-d5a7-42cc-930c-a780b61c910d req-bd2eb819-9cbf-415a-87f0-293e5d0566fc service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Refreshing instance network info cache due to event network-changed-5e39b868-de11-4bc1-b68a-11621bf7f057. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:13:53 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d45b6d7d-d5a7-42cc-930c-a780b61c910d req-bd2eb819-9cbf-415a-87f0-293e5d0566fc service nova] Acquiring lock "refresh_cache-5f2a6f15-e413-47a2-be3e-961dd9ee7deb" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:13:53 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d45b6d7d-d5a7-42cc-930c-a780b61c910d req-bd2eb819-9cbf-415a-87f0-293e5d0566fc service nova] Acquired lock "refresh_cache-5f2a6f15-e413-47a2-be3e-961dd9ee7deb" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:13:53 user nova-compute[75245]: DEBUG nova.network.neutron [req-d45b6d7d-d5a7-42cc-930c-a780b61c910d req-bd2eb819-9cbf-415a-87f0-293e5d0566fc service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Refreshing network info cache for port 5e39b868-de11-4bc1-b68a-11621bf7f057 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:13:53 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fea3d2-6db1-4766-ad5b-9ad1e728ea10/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:13:53 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fea3d2-6db1-4766-ad5b-9ad1e728ea10/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:13:54 user nova-compute[75245]: DEBUG nova.network.neutron [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Updating instance_info_cache with network_info: [{"id": "f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76", "address": "fa:16:3e:f9:3e:bc", "network": {"id": "f1fac2f4-e789-443e-b6a5-1a3f829bc302", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1199431077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6b87e18ef1f48d19a6907b28cb54f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf038ddf7-a5", "ovs_interfaceid": "f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:13:54 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Releasing lock "refresh_cache-816edb0e-c4fc-470b-8151-f98502e50789" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:13:54 user nova-compute[75245]: DEBUG nova.compute.manager [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Instance network_info: |[{"id": "f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76", "address": "fa:16:3e:f9:3e:bc", "network": {"id": "f1fac2f4-e789-443e-b6a5-1a3f829bc302", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1199431077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6b87e18ef1f48d19a6907b28cb54f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf038ddf7-a5", "ovs_interfaceid": "f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 16:13:54 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-3e62af19-c8e3-4464-a1a1-726478ffdab6 req-560844e9-0838-4fa6-8912-871703cf3e9e service nova] Acquired lock "refresh_cache-816edb0e-c4fc-470b-8151-f98502e50789" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:13:54 user nova-compute[75245]: DEBUG nova.network.neutron [req-3e62af19-c8e3-4464-a1a1-726478ffdab6 req-560844e9-0838-4fa6-8912-871703cf3e9e service nova] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Refreshing network info cache for port f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:13:54 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Start _get_guest_xml network_info=[{"id": "f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76", "address": "fa:16:3e:f9:3e:bc", "network": {"id": "f1fac2f4-e789-443e-b6a5-1a3f829bc302", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1199431077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6b87e18ef1f48d19a6907b28cb54f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf038ddf7-a5", "ovs_interfaceid": "f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'a291d9c3-be02-4c6c-9649-4b45c5b7f487'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 16:13:54 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:13:54 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:13:54 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fea3d2-6db1-4766-ad5b-9ad1e728ea10/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:13:54 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 16:13:54 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] CPU controller missing on host. {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 16:13:54 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 16:13:54 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] CPU controller found on host. {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 16:13:54 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75245) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 16:13:54 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T16:06:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 16:13:54 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Flavor limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 16:13:54 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Image limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 16:13:54 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Flavor pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 16:13:54 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Image pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 16:13:54 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 16:13:54 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 16:13:54 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 16:13:54 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Got 1 possible topologies {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 16:13:54 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 16:13:54 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 16:13:54 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:13:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1242011736',display_name='tempest-tempest.common.compute-instance-1242011736',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1242011736',id=15,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqtiPWs7C4RKGy4yNsp7JTc2XDL0TwaTur5f1RRj6K0Rb6+sFA2CPy5UHpa1YR4wGjwq9AoHpMqOkkk3stctHMw5fDz8nndvq/jbvNk3M28JEwy6jco6tcwC+4eKQq8uQ==',key_name='tempest-keypair-1228788968',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6b87e18ef1f48d19a6907b28cb54f04',ramdisk_id='',reservation_id='r-zsz4hlok',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1840344781',owner_user_name='tempest-ServerActionsTestOtherA-1840344781-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:13:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be595c3f7084413180f2ab86e9c56a64',uuid=816edb0e-c4fc-470b-8151-f98502e50789,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76", "address": "fa:16:3e:f9:3e:bc", "network": {"id": "f1fac2f4-e789-443e-b6a5-1a3f829bc302", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1199431077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6b87e18ef1f48d19a6907b28cb54f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf038ddf7-a5", "ovs_interfaceid": "f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:13:54 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Converting VIF {"id": "f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76", "address": "fa:16:3e:f9:3e:bc", "network": {"id": "f1fac2f4-e789-443e-b6a5-1a3f829bc302", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1199431077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6b87e18ef1f48d19a6907b28cb54f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf038ddf7-a5", "ovs_interfaceid": "f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:13:54 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:3e:bc,bridge_name='br-int',has_traffic_filtering=True,id=f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76,network=Network(f1fac2f4-e789-443e-b6a5-1a3f829bc302),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf038ddf7-a5') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:13:54 user nova-compute[75245]: DEBUG nova.objects.instance [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lazy-loading 'pci_devices' on Instance uuid 816edb0e-c4fc-470b-8151-f98502e50789 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:13:54 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:13:54 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] End _get_guest_xml xml=<domain type="kvm">
Nov 29 16:13:54 user nova-compute[75245]:   <uuid>816edb0e-c4fc-470b-8151-f98502e50789</uuid>
Nov 29 16:13:54 user nova-compute[75245]:   <name>instance-0000000f</name>
Nov 29 16:13:54 user nova-compute[75245]:   <memory>524288</memory>
Nov 29 16:13:54 user nova-compute[75245]:   <vcpu>1</vcpu>
Nov 29 16:13:54 user nova-compute[75245]:   <metadata>
Nov 29 16:13:54 user nova-compute[75245]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 16:13:54 user nova-compute[75245]:       <nova:package version="0.0.0"/>
Nov 29 16:13:54 user nova-compute[75245]:       <nova:name>tempest-tempest.common.compute-instance-1242011736</nova:name>
Nov 29 16:13:54 user nova-compute[75245]:       <nova:creationTime>2023-11-29 16:13:54</nova:creationTime>
Nov 29 16:13:54 user nova-compute[75245]:       <nova:flavor name="m1.tiny">
Nov 29 16:13:54 user nova-compute[75245]:         <nova:memory>512</nova:memory>
Nov 29 16:13:54 user nova-compute[75245]:         <nova:disk>1</nova:disk>
Nov 29 16:13:54 user nova-compute[75245]:         <nova:swap>0</nova:swap>
Nov 29 16:13:54 user nova-compute[75245]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 16:13:54 user nova-compute[75245]:         <nova:vcpus>1</nova:vcpus>
Nov 29 16:13:54 user nova-compute[75245]:       </nova:flavor>
Nov 29 16:13:54 user nova-compute[75245]:       <nova:owner>
Nov 29 16:13:54 user nova-compute[75245]:         <nova:user uuid="be595c3f7084413180f2ab86e9c56a64">tempest-ServerActionsTestOtherA-1840344781-project-member</nova:user>
Nov 29 16:13:54 user nova-compute[75245]:         <nova:project uuid="c6b87e18ef1f48d19a6907b28cb54f04">tempest-ServerActionsTestOtherA-1840344781</nova:project>
Nov 29 16:13:54 user nova-compute[75245]:       </nova:owner>
Nov 29 16:13:54 user nova-compute[75245]:       <nova:root type="image" uuid="a291d9c3-be02-4c6c-9649-4b45c5b7f487"/>
Nov 29 16:13:54 user nova-compute[75245]:       <nova:ports>
Nov 29 16:13:54 user nova-compute[75245]:         <nova:port uuid="f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76">
Nov 29 16:13:54 user nova-compute[75245]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 29 16:13:54 user nova-compute[75245]:         </nova:port>
Nov 29 16:13:54 user nova-compute[75245]:       </nova:ports>
Nov 29 16:13:54 user nova-compute[75245]:     </nova:instance>
Nov 29 16:13:54 user nova-compute[75245]:   </metadata>
Nov 29 16:13:54 user nova-compute[75245]:   <sysinfo type="smbios">
Nov 29 16:13:54 user nova-compute[75245]:     <system>
Nov 29 16:13:54 user nova-compute[75245]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 16:13:54 user nova-compute[75245]:       <entry name="product">OpenStack Nova</entry>
Nov 29 16:13:54 user nova-compute[75245]:       <entry name="version">0.0.0</entry>
Nov 29 16:13:54 user nova-compute[75245]:       <entry name="serial">816edb0e-c4fc-470b-8151-f98502e50789</entry>
Nov 29 16:13:54 user nova-compute[75245]:       <entry name="uuid">816edb0e-c4fc-470b-8151-f98502e50789</entry>
Nov 29 16:13:54 user nova-compute[75245]:       <entry name="family">Virtual Machine</entry>
Nov 29 16:13:54 user nova-compute[75245]:     </system>
Nov 29 16:13:54 user nova-compute[75245]:   </sysinfo>
Nov 29 16:13:54 user nova-compute[75245]:   <os>
Nov 29 16:13:54 user nova-compute[75245]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 16:13:54 user nova-compute[75245]:     <boot dev="hd"/>
Nov 29 16:13:54 user nova-compute[75245]:     <smbios mode="sysinfo"/>
Nov 29 16:13:54 user nova-compute[75245]:   </os>
Nov 29 16:13:54 user nova-compute[75245]:   <features>
Nov 29 16:13:54 user nova-compute[75245]:     <acpi/>
Nov 29 16:13:54 user nova-compute[75245]:     <apic/>
Nov 29 16:13:54 user nova-compute[75245]:     <vmcoreinfo/>
Nov 29 16:13:54 user nova-compute[75245]:   </features>
Nov 29 16:13:54 user nova-compute[75245]:   <clock offset="utc">
Nov 29 16:13:54 user nova-compute[75245]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 16:13:54 user nova-compute[75245]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 16:13:54 user nova-compute[75245]:     <timer name="hpet" present="no"/>
Nov 29 16:13:54 user nova-compute[75245]:   </clock>
Nov 29 16:13:54 user nova-compute[75245]:   <cpu mode="custom" match="exact">
Nov 29 16:13:54 user nova-compute[75245]:     <model>Nehalem</model>
Nov 29 16:13:54 user nova-compute[75245]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 16:13:54 user nova-compute[75245]:   </cpu>
Nov 29 16:13:54 user nova-compute[75245]:   <devices>
Nov 29 16:13:54 user nova-compute[75245]:     <disk type="file" device="disk">
Nov 29 16:13:54 user nova-compute[75245]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 16:13:54 user nova-compute[75245]:       <source file="/opt/stack/data/nova/instances/816edb0e-c4fc-470b-8151-f98502e50789/disk"/>
Nov 29 16:13:54 user nova-compute[75245]:       <target dev="vda" bus="virtio"/>
Nov 29 16:13:54 user nova-compute[75245]:     </disk>
Nov 29 16:13:54 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 16:13:54 user nova-compute[75245]:       <mac address="fa:16:3e:f9:3e:bc"/>
Nov 29 16:13:54 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:13:54 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 16:13:54 user nova-compute[75245]:       <target dev="tapf038ddf7-a5"/>
Nov 29 16:13:54 user nova-compute[75245]:     </interface>
Nov 29 16:13:54 user nova-compute[75245]:     <serial type="pty">
Nov 29 16:13:54 user nova-compute[75245]:       <log file="/opt/stack/data/nova/instances/816edb0e-c4fc-470b-8151-f98502e50789/console.log" append="off"/>
Nov 29 16:13:54 user nova-compute[75245]:     </serial>
Nov 29 16:13:54 user nova-compute[75245]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 16:13:54 user nova-compute[75245]:     <video>
Nov 29 16:13:54 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:13:54 user nova-compute[75245]:     </video>
Nov 29 16:13:54 user nova-compute[75245]:     <rng model="virtio">
Nov 29 16:13:54 user nova-compute[75245]:       <backend model="random">/dev/urandom</backend>
Nov 29 16:13:54 user nova-compute[75245]:     </rng>
Nov 29 16:13:54 user nova-compute[75245]:     <controller type="usb" index="0" model="none"/>
Nov 29 16:13:54 user nova-compute[75245]:     <memballoon model="virtio">
Nov 29 16:13:54 user nova-compute[75245]:       <stats period="10"/>
Nov 29 16:13:54 user nova-compute[75245]:     </memballoon>
Nov 29 16:13:54 user nova-compute[75245]:   </devices>
Nov 29 16:13:54 user nova-compute[75245]: </domain>
Nov 29 16:13:54 user nova-compute[75245]:  {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 16:13:54 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:13:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1242011736',display_name='tempest-tempest.common.compute-instance-1242011736',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1242011736',id=15,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqtiPWs7C4RKGy4yNsp7JTc2XDL0TwaTur5f1RRj6K0Rb6+sFA2CPy5UHpa1YR4wGjwq9AoHpMqOkkk3stctHMw5fDz8nndvq/jbvNk3M28JEwy6jco6tcwC+4eKQq8uQ==',key_name='tempest-keypair-1228788968',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6b87e18ef1f48d19a6907b28cb54f04',ramdisk_id='',reservation_id='r-zsz4hlok',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1840344781',owner_user_name='tempest-ServerActionsTestOtherA-1840344781-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:13:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be595c3f7084413180f2ab86e9c56a64',uuid=816edb0e-c4fc-470b-8151-f98502e50789,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76", "address": "fa:16:3e:f9:3e:bc", "network": {"id": "f1fac2f4-e789-443e-b6a5-1a3f829bc302", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1199431077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6b87e18ef1f48d19a6907b28cb54f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf038ddf7-a5", "ovs_interfaceid": "f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 16:13:54 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Converting VIF {"id": "f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76", "address": "fa:16:3e:f9:3e:bc", "network": {"id": "f1fac2f4-e789-443e-b6a5-1a3f829bc302", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1199431077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6b87e18ef1f48d19a6907b28cb54f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf038ddf7-a5", "ovs_interfaceid": "f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:13:54 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:3e:bc,bridge_name='br-int',has_traffic_filtering=True,id=f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76,network=Network(f1fac2f4-e789-443e-b6a5-1a3f829bc302),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf038ddf7-a5') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:13:54 user nova-compute[75245]: DEBUG os_vif [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:3e:bc,bridge_name='br-int',has_traffic_filtering=True,id=f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76,network=Network(f1fac2f4-e789-443e-b6a5-1a3f829bc302),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf038ddf7-a5') {{(pid=75245) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 16:13:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:13:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:13:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 16:13:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:13:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '784e6b5a-54ad-51bf-a850-a20ece090785', '_type': 'linux-noop'}}, row=False) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:13:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:13:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:13:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:13:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf038ddf7-a5, may_exist=True, interface_attrs={}) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:13:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf038ddf7-a5, col_values=(('qos', UUID('6565fa6f-32aa-41a4-9723-2583f4d4987d')),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:13:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf038ddf7-a5, col_values=(('external_ids', {'iface-id': 'f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:3e:bc', 'vm-uuid': '816edb0e-c4fc-470b-8151-f98502e50789'}),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:13:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:13:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:13:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:13:54 user nova-compute[75245]: INFO os_vif [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:3e:bc,bridge_name='br-int',has_traffic_filtering=True,id=f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76,network=Network(f1fac2f4-e789-443e-b6a5-1a3f829bc302),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf038ddf7-a5')
Nov 29 16:13:54 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:13:54 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:13:54 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:13:54 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] No VIF found with MAC fa:16:3e:f9:3e:bc, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:13:54 user nova-compute[75245]: DEBUG nova.network.neutron [req-d45b6d7d-d5a7-42cc-930c-a780b61c910d req-bd2eb819-9cbf-415a-87f0-293e5d0566fc service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Updated VIF entry in instance network info cache for port 5e39b868-de11-4bc1-b68a-11621bf7f057. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:13:54 user nova-compute[75245]: DEBUG nova.network.neutron [req-d45b6d7d-d5a7-42cc-930c-a780b61c910d req-bd2eb819-9cbf-415a-87f0-293e5d0566fc service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Updating instance_info_cache with network_info: [{"id": "e76a4989-a78d-47cf-8df0-b0b71180b60e", "address": "fa:16:3e:76:29:fe", "network": {"id": "0e5af197-7146-4691-9357-c6d470646e65", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1607694636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape76a4989-a7", "ovs_interfaceid": "e76a4989-a78d-47cf-8df0-b0b71180b60e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4dd25469-cfd1-468f-8fa3-a58c5613c96b", "address": "fa:16:3e:16:dd:65", "network": {"id": "33ed6d1c-906e-49c8-9731-a0d23f716434", "bridge": "br-int", "label": "tempest-device-tagging-net1-322196721", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dd25469-cf", "ovs_interfaceid": "4dd25469-cfd1-468f-8fa3-a58c5613c96b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7b6625ae-3097-4e56-bb72-3b67ff4996b6", "address": "fa:16:3e:be:8a:fe", "network": {"id": "33ed6d1c-906e-49c8-9731-a0d23f716434", "bridge": "br-int", "label": "tempest-device-tagging-net1-322196721", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b6625ae-30", "ovs_interfaceid": "7b6625ae-3097-4e56-bb72-3b67ff4996b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "10e71fa4-4f0d-420a-9ea3-502e0a1eb1f7", "address": "fa:16:3e:3a:e0:19", "network": {"id": "33ed6d1c-906e-49c8-9731-a0d23f716434", "bridge": "br-int", "label": "tempest-device-tagging-net1-322196721", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e71fa4-4f", "ovs_interfaceid": "10e71fa4-4f0d-420a-9ea3-502e0a1eb1f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "706111a2-b6f0-4311-ac82-a60a93fa2f51", "address": "fa:16:3e:db:77:11", "network": {"id": "33ed6d1c-906e-49c8-9731-a0d23f716434", "bridge": "br-int", "label": "tempest-device-tagging-net1-322196721", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap706111a2-b6", "ovs_interfaceid": "706111a2-b6f0-4311-ac82-a60a93fa2f51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5e39b868-de11-4bc1-b68a-11621bf7f057", "address": "fa:16:3e:44:89:16", "network": {"id": "c815e5db-bcac-4915-b581-63c2f697d2e5", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132953712", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e39b868-de", "ovs_interfaceid": "5e39b868-de11-4bc1-b68a-11621bf7f057", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "52f4aecd-3b06-4a52-9541-b7bc96acf5d4", "address": "fa:16:3e:f9:b9:5f", "network": {"id": "c815e5db-bcac-4915-b581-63c2f697d2e5", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132953712", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52f4aecd-3b", "ovs_interfaceid": "52f4aecd-3b06-4a52-9541-b7bc96acf5d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:13:54 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk --force-share --output=json" returned: 0 in 0.278s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:13:54 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0db15db5-e8a9-46a8-98cc-99d7fde61508/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:13:54 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d45b6d7d-d5a7-42cc-930c-a780b61c910d req-bd2eb819-9cbf-415a-87f0-293e5d0566fc service nova] Releasing lock "refresh_cache-5f2a6f15-e413-47a2-be3e-961dd9ee7deb" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:13:54 user nova-compute[75245]: DEBUG nova.compute.manager [req-d45b6d7d-d5a7-42cc-930c-a780b61c910d req-bd2eb819-9cbf-415a-87f0-293e5d0566fc service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Received event network-changed-52f4aecd-3b06-4a52-9541-b7bc96acf5d4 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:13:54 user nova-compute[75245]: DEBUG nova.compute.manager [req-d45b6d7d-d5a7-42cc-930c-a780b61c910d req-bd2eb819-9cbf-415a-87f0-293e5d0566fc service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Refreshing instance network info cache due to event network-changed-52f4aecd-3b06-4a52-9541-b7bc96acf5d4. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:13:54 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d45b6d7d-d5a7-42cc-930c-a780b61c910d req-bd2eb819-9cbf-415a-87f0-293e5d0566fc service nova] Acquiring lock "refresh_cache-5f2a6f15-e413-47a2-be3e-961dd9ee7deb" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:13:54 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d45b6d7d-d5a7-42cc-930c-a780b61c910d req-bd2eb819-9cbf-415a-87f0-293e5d0566fc service nova] Acquired lock "refresh_cache-5f2a6f15-e413-47a2-be3e-961dd9ee7deb" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:13:54 user nova-compute[75245]: DEBUG nova.network.neutron [req-d45b6d7d-d5a7-42cc-930c-a780b61c910d req-bd2eb819-9cbf-415a-87f0-293e5d0566fc service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Refreshing network info cache for port 52f4aecd-3b06-4a52-9541-b7bc96acf5d4 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:13:54 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0db15db5-e8a9-46a8-98cc-99d7fde61508/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:13:54 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0db15db5-e8a9-46a8-98cc-99d7fde61508/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:13:54 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Acquiring lock "3ab9d7cd-79cd-4c9b-8608-c1ef0f333305" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:13:54 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lock "3ab9d7cd-79cd-4c9b-8608-c1ef0f333305" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:13:54 user nova-compute[75245]: INFO nova.compute.manager [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Unshelving
Nov 29 16:13:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0db15db5-e8a9-46a8-98cc-99d7fde61508/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:13:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36728d4f-925b-46a3-b4b5-17f14b9c99c3/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:13:55 user nova-compute[75245]: DEBUG nova.network.neutron [req-3e62af19-c8e3-4464-a1a1-726478ffdab6 req-560844e9-0838-4fa6-8912-871703cf3e9e service nova] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Updated VIF entry in instance network info cache for port f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:13:55 user nova-compute[75245]: DEBUG nova.network.neutron [req-3e62af19-c8e3-4464-a1a1-726478ffdab6 req-560844e9-0838-4fa6-8912-871703cf3e9e service nova] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Updating instance_info_cache with network_info: [{"id": "f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76", "address": "fa:16:3e:f9:3e:bc", "network": {"id": "f1fac2f4-e789-443e-b6a5-1a3f829bc302", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1199431077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6b87e18ef1f48d19a6907b28cb54f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf038ddf7-a5", "ovs_interfaceid": "f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:13:55 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-3e62af19-c8e3-4464-a1a1-726478ffdab6 req-560844e9-0838-4fa6-8912-871703cf3e9e service nova] Releasing lock "refresh_cache-816edb0e-c4fc-470b-8151-f98502e50789" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:13:55 user nova-compute[75245]: INFO nova.virt.block_device [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Booting with volume a74ae150-7d3d-47ca-80a6-1bc324280bd5 at /dev/vdc
Nov 29 16:13:55 user nova-compute[75245]: DEBUG os_brick.utils [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:13:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:13:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:13:55 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[b49b3104-711c-40aa-93fb-eb4d9ba74b13]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:69ed8ed87091\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:13:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:13:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36728d4f-925b-46a3-b4b5-17f14b9c99c3/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:13:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36728d4f-925b-46a3-b4b5-17f14b9c99c3/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:13:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:13:55 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[e580977b-d4cc-4ff3-8f9e-e5421c27d2e4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:13:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:13:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:13:55 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a238ff-1128-422e-9753-045df4cfc77c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:13:55 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d456a95-5d99-439e-8cd0-b4c6f99b9599]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:13:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Running cmd (subprocess): nvme version {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:13:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] 'nvme version' failed. Not Retrying. {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:13:55 user nova-compute[75245]: DEBUG nova.network.neutron [req-d45b6d7d-d5a7-42cc-930c-a780b61c910d req-bd2eb819-9cbf-415a-87f0-293e5d0566fc service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Updated VIF entry in instance network info cache for port 52f4aecd-3b06-4a52-9541-b7bc96acf5d4. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:13:55 user nova-compute[75245]: DEBUG nova.network.neutron [req-d45b6d7d-d5a7-42cc-930c-a780b61c910d req-bd2eb819-9cbf-415a-87f0-293e5d0566fc service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Updating instance_info_cache with network_info: [{"id": "e76a4989-a78d-47cf-8df0-b0b71180b60e", "address": "fa:16:3e:76:29:fe", "network": {"id": "0e5af197-7146-4691-9357-c6d470646e65", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1607694636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape76a4989-a7", "ovs_interfaceid": "e76a4989-a78d-47cf-8df0-b0b71180b60e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4dd25469-cfd1-468f-8fa3-a58c5613c96b", "address": "fa:16:3e:16:dd:65", "network": {"id": "33ed6d1c-906e-49c8-9731-a0d23f716434", "bridge": "br-int", "label": "tempest-device-tagging-net1-322196721", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dd25469-cf", "ovs_interfaceid": "4dd25469-cfd1-468f-8fa3-a58c5613c96b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7b6625ae-3097-4e56-bb72-3b67ff4996b6", "address": "fa:16:3e:be:8a:fe", "network": {"id": "33ed6d1c-906e-49c8-9731-a0d23f716434", "bridge": "br-int", "label": "tempest-device-tagging-net1-322196721", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b6625ae-30", "ovs_interfaceid": "7b6625ae-3097-4e56-bb72-3b67ff4996b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "10e71fa4-4f0d-420a-9ea3-502e0a1eb1f7", "address": "fa:16:3e:3a:e0:19", "network": {"id": "33ed6d1c-906e-49c8-9731-a0d23f716434", "bridge": "br-int", "label": "tempest-device-tagging-net1-322196721", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e71fa4-4f", "ovs_interfaceid": "10e71fa4-4f0d-420a-9ea3-502e0a1eb1f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "706111a2-b6f0-4311-ac82-a60a93fa2f51", "address": "fa:16:3e:db:77:11", "network": {"id": "33ed6d1c-906e-49c8-9731-a0d23f716434", "bridge": "br-int", "label": "tempest-device-tagging-net1-322196721", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap706111a2-b6", "ovs_interfaceid": "706111a2-b6f0-4311-ac82-a60a93fa2f51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5e39b868-de11-4bc1-b68a-11621bf7f057", "address": "fa:16:3e:44:89:16", "network": {"id": "c815e5db-bcac-4915-b581-63c2f697d2e5", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132953712", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e39b868-de", "ovs_interfaceid": "5e39b868-de11-4bc1-b68a-11621bf7f057", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "52f4aecd-3b06-4a52-9541-b7bc96acf5d4", "address": "fa:16:3e:f9:b9:5f", "network": {"id": "c815e5db-bcac-4915-b581-63c2f697d2e5", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132953712", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52f4aecd-3b", "ovs_interfaceid": "52f4aecd-3b06-4a52-9541-b7bc96acf5d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:13:55 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.nvmeof [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] nvme not present on system {{(pid=75245) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 16:13:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:13:55 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d45b6d7d-d5a7-42cc-930c-a780b61c910d req-bd2eb819-9cbf-415a-87f0-293e5d0566fc service nova] Releasing lock "refresh_cache-5f2a6f15-e413-47a2-be3e-961dd9ee7deb" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:13:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:13:55 user nova-compute[75245]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 16:13:55 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[855809ca-80e2-4ef2-8372-0698db708f06]: (4, '') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:13:55 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75245) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 16:13:55 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 16:13:55 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] LIGHTOS: no hostnqn found. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 16:13:55 user nova-compute[75245]: DEBUG os_brick.utils [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] <== get_connector_properties: return (197ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:69ed8ed87091', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:13:55 user nova-compute[75245]: DEBUG nova.virt.block_device [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Updating existing volume attachment record: 866a858a-3093-4cbc-b4d5-a6d3319966dc {{(pid=75245) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 16:13:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36728d4f-925b-46a3-b4b5-17f14b9c99c3/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:13:56 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:13:56 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:13:56 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:13:56 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Hypervisor/Node resource view: name=user free_ram=7993MB free_disk=25.570789337158203GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75245) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 16:13:56 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:13:56 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:13:56 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-9a477598-a166-479f-b99a-7f8e4dc3141d tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Acquiring lock "e3fea3d2-6db1-4766-ad5b-9ad1e728ea10" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:13:56 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-9a477598-a166-479f-b99a-7f8e4dc3141d tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Lock "e3fea3d2-6db1-4766-ad5b-9ad1e728ea10" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:13:56 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-9a477598-a166-479f-b99a-7f8e4dc3141d tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Acquiring lock "e3fea3d2-6db1-4766-ad5b-9ad1e728ea10-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:13:56 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-9a477598-a166-479f-b99a-7f8e4dc3141d tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Lock "e3fea3d2-6db1-4766-ad5b-9ad1e728ea10-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:13:56 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-9a477598-a166-479f-b99a-7f8e4dc3141d tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Lock "e3fea3d2-6db1-4766-ad5b-9ad1e728ea10-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:13:56 user nova-compute[75245]: INFO nova.compute.manager [None req-9a477598-a166-479f-b99a-7f8e4dc3141d tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] Terminating instance
Nov 29 16:13:56 user nova-compute[75245]: DEBUG nova.compute.manager [None req-9a477598-a166-479f-b99a-7f8e4dc3141d tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] Start destroying the instance on the hypervisor. {{(pid=75245) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 16:13:56 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:13:56 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:13:56 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:13:56 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:13:56 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:13:56 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance ed9a6a4e-2e7d-443c-82ef-f14f11d32c81 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:13:56 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 36728d4f-925b-46a3-b4b5-17f14b9c99c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:13:56 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance e3fea3d2-6db1-4766-ad5b-9ad1e728ea10 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:13:56 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance fd819060-4388-444d-809e-94f6b2e8f102 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:13:56 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 0db15db5-e8a9-46a8-98cc-99d7fde61508 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:13:56 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 5f2a6f15-e413-47a2-be3e-961dd9ee7deb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:13:56 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 816edb0e-c4fc-470b-8151-f98502e50789 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:13:56 user nova-compute[75245]: DEBUG nova.compute.manager [req-897627d8-cd0c-4b3a-a7a2-aa16c41e70ed req-2d5ba10f-8f2d-4345-8f25-9e5f0babf220 service nova] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Received event network-vif-plugged-f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:13:56 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-897627d8-cd0c-4b3a-a7a2-aa16c41e70ed req-2d5ba10f-8f2d-4345-8f25-9e5f0babf220 service nova] Acquiring lock "816edb0e-c4fc-470b-8151-f98502e50789-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:13:56 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-897627d8-cd0c-4b3a-a7a2-aa16c41e70ed req-2d5ba10f-8f2d-4345-8f25-9e5f0babf220 service nova] Lock "816edb0e-c4fc-470b-8151-f98502e50789-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:13:56 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-897627d8-cd0c-4b3a-a7a2-aa16c41e70ed req-2d5ba10f-8f2d-4345-8f25-9e5f0babf220 service nova] Lock "816edb0e-c4fc-470b-8151-f98502e50789-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:13:56 user nova-compute[75245]: DEBUG nova.compute.manager [req-897627d8-cd0c-4b3a-a7a2-aa16c41e70ed req-2d5ba10f-8f2d-4345-8f25-9e5f0babf220 service nova] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] No waiting events found dispatching network-vif-plugged-f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:13:56 user nova-compute[75245]: WARNING nova.compute.manager [req-897627d8-cd0c-4b3a-a7a2-aa16c41e70ed req-2d5ba10f-8f2d-4345-8f25-9e5f0babf220 service nova] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Received unexpected event network-vif-plugged-f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76 for instance with vm_state building and task_state spawning.
Nov 29 16:13:56 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:13:56 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 29 16:13:56 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 16:13:56 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 16:13:56 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:13:56 user nova-compute[75245]: DEBUG nova.compute.manager [req-7a1200c6-afb9-4f18-b661-780d01713031 req-88746734-edfc-4a22-a6e0-628422721922 service nova] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] Received event network-vif-unplugged-f4303524-45ab-49e7-bdac-5522f5c4b8f5 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:13:56 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-7a1200c6-afb9-4f18-b661-780d01713031 req-88746734-edfc-4a22-a6e0-628422721922 service nova] Acquiring lock "e3fea3d2-6db1-4766-ad5b-9ad1e728ea10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:13:56 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-7a1200c6-afb9-4f18-b661-780d01713031 req-88746734-edfc-4a22-a6e0-628422721922 service nova] Lock "e3fea3d2-6db1-4766-ad5b-9ad1e728ea10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:13:56 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-7a1200c6-afb9-4f18-b661-780d01713031 req-88746734-edfc-4a22-a6e0-628422721922 service nova] Lock "e3fea3d2-6db1-4766-ad5b-9ad1e728ea10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:13:56 user nova-compute[75245]: DEBUG nova.compute.manager [req-7a1200c6-afb9-4f18-b661-780d01713031 req-88746734-edfc-4a22-a6e0-628422721922 service nova] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] No waiting events found dispatching network-vif-unplugged-f4303524-45ab-49e7-bdac-5522f5c4b8f5 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:13:56 user nova-compute[75245]: DEBUG nova.compute.manager [req-7a1200c6-afb9-4f18-b661-780d01713031 req-88746734-edfc-4a22-a6e0-628422721922 service nova] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] Received event network-vif-unplugged-f4303524-45ab-49e7-bdac-5522f5c4b8f5 for instance with task_state deleting. {{(pid=75245) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 16:13:56 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:13:56 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:13:56 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Compute_service record updated for user:user {{(pid=75245) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 16:13:56 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.640s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:13:56 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] Instance destroyed successfully.
Nov 29 16:13:56 user nova-compute[75245]: DEBUG nova.objects.instance [None req-9a477598-a166-479f-b99a-7f8e4dc3141d tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Lazy-loading 'resources' on Instance uuid e3fea3d2-6db1-4766-ad5b-9ad1e728ea10 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:13:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-9a477598-a166-479f-b99a-7f8e4dc3141d tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:10:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2050055971',display_name='tempest-TestVolumeSwap-server-2050055971',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2050055971',id=6,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8NjzG2hsM8G/ri2ftW+HwYTQZ7smSmyh2wLSlCdQnBBsBAyDRFp3AWgVEdhFC65rO5Z9Dt1ULFcfBlhouuM/QedXcROMn894uH16YytoHwQjKSvXvUJbS23vQJm3A/zA==',key_name='tempest-keypair-998706326',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:10:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b6dc8fad291d4894a0906964a18a2ee4',ramdisk_id='',reservation_id='r-f5tgod2r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1406149224',owner_user_name='tempest-TestVolumeSwap-1406149224-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:10:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='388b611697054b0498a3687400168a71',uuid=e3fea3d2-6db1-4766-ad5b-9ad1e728ea10,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f4303524-45ab-49e7-bdac-5522f5c4b8f5", "address": "fa:16:3e:11:8d:50", "network": {"id": "b1ced6f5-b3ca-45c7-b841-353498cf4f5a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-812097196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6dc8fad291d4894a0906964a18a2ee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4303524-45", "ovs_interfaceid": "f4303524-45ab-49e7-bdac-5522f5c4b8f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 16:13:56 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-9a477598-a166-479f-b99a-7f8e4dc3141d tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Converting VIF {"id": "f4303524-45ab-49e7-bdac-5522f5c4b8f5", "address": "fa:16:3e:11:8d:50", "network": {"id": "b1ced6f5-b3ca-45c7-b841-353498cf4f5a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-812097196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6dc8fad291d4894a0906964a18a2ee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4303524-45", "ovs_interfaceid": "f4303524-45ab-49e7-bdac-5522f5c4b8f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:13:56 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-9a477598-a166-479f-b99a-7f8e4dc3141d tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:11:8d:50,bridge_name='br-int',has_traffic_filtering=True,id=f4303524-45ab-49e7-bdac-5522f5c4b8f5,network=Network(b1ced6f5-b3ca-45c7-b841-353498cf4f5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4303524-45') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:13:56 user nova-compute[75245]: DEBUG os_vif [None req-9a477598-a166-479f-b99a-7f8e4dc3141d tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:8d:50,bridge_name='br-int',has_traffic_filtering=True,id=f4303524-45ab-49e7-bdac-5522f5c4b8f5,network=Network(b1ced6f5-b3ca-45c7-b841-353498cf4f5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4303524-45') {{(pid=75245) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 16:13:56 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:13:56 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf4303524-45, bridge=br-int, if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:13:56 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:13:56 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:13:56 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:13:56 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1a5f6c06-e504-4a00-8920-54d6387280c1) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:13:56 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:13:56 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:13:56 user nova-compute[75245]: INFO os_vif [None req-9a477598-a166-479f-b99a-7f8e4dc3141d tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:8d:50,bridge_name='br-int',has_traffic_filtering=True,id=f4303524-45ab-49e7-bdac-5522f5c4b8f5,network=Network(b1ced6f5-b3ca-45c7-b841-353498cf4f5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4303524-45')
Nov 29 16:13:56 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-9a477598-a166-479f-b99a-7f8e4dc3141d tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] Deleting instance files /opt/stack/data/nova/instances/e3fea3d2-6db1-4766-ad5b-9ad1e728ea10_del
Nov 29 16:13:56 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-9a477598-a166-479f-b99a-7f8e4dc3141d tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] Deletion of /opt/stack/data/nova/instances/e3fea3d2-6db1-4766-ad5b-9ad1e728ea10_del complete
Nov 29 16:13:57 user nova-compute[75245]: INFO nova.compute.manager [None req-9a477598-a166-479f-b99a-7f8e4dc3141d tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 29 16:13:57 user nova-compute[75245]: DEBUG oslo.service.loopingcall [None req-9a477598-a166-479f-b99a-7f8e4dc3141d tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75245) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 16:13:57 user nova-compute[75245]: DEBUG nova.compute.manager [-] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] Deallocating network for instance {{(pid=75245) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 16:13:57 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] deallocate_for_instance() {{(pid=75245) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 16:13:57 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:13:57 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:13:57 user nova-compute[75245]: INFO nova.compute.manager [-] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] Took 0.83 seconds to deallocate network for instance.
Nov 29 16:13:57 user nova-compute[75245]: DEBUG nova.compute.manager [req-b0d09019-ab8a-41b2-8146-0259f18f546e req-b21fe190-eb59-40c2-8695-3f637fbbfa0d service nova] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] Received event network-vif-deleted-f4303524-45ab-49e7-bdac-5522f5c4b8f5 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:13:57 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-9a477598-a166-479f-b99a-7f8e4dc3141d tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:13:57 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-9a477598-a166-479f-b99a-7f8e4dc3141d tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:13:58 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-9a477598-a166-479f-b99a-7f8e4dc3141d tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:13:58 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-9a477598-a166-479f-b99a-7f8e4dc3141d tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:13:58 user nova-compute[75245]: DEBUG nova.compute.manager [req-175c5136-3d8b-4a6a-a2dd-ff01e573fe74 req-17f6f731-320c-4384-a01f-849cf513e8b6 service nova] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Received event network-vif-plugged-f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:13:58 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-175c5136-3d8b-4a6a-a2dd-ff01e573fe74 req-17f6f731-320c-4384-a01f-849cf513e8b6 service nova] Acquiring lock "816edb0e-c4fc-470b-8151-f98502e50789-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:13:58 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-175c5136-3d8b-4a6a-a2dd-ff01e573fe74 req-17f6f731-320c-4384-a01f-849cf513e8b6 service nova] Lock "816edb0e-c4fc-470b-8151-f98502e50789-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:13:58 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-175c5136-3d8b-4a6a-a2dd-ff01e573fe74 req-17f6f731-320c-4384-a01f-849cf513e8b6 service nova] Lock "816edb0e-c4fc-470b-8151-f98502e50789-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:13:58 user nova-compute[75245]: DEBUG nova.compute.manager [req-175c5136-3d8b-4a6a-a2dd-ff01e573fe74 req-17f6f731-320c-4384-a01f-849cf513e8b6 service nova] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] No waiting events found dispatching network-vif-plugged-f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:13:58 user nova-compute[75245]: WARNING nova.compute.manager [req-175c5136-3d8b-4a6a-a2dd-ff01e573fe74 req-17f6f731-320c-4384-a01f-849cf513e8b6 service nova] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Received unexpected event network-vif-plugged-f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76 for instance with vm_state building and task_state spawning.
Nov 29 16:13:58 user nova-compute[75245]: DEBUG nova.compute.manager [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Instance event wait completed in 0 seconds for  {{(pid=75245) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 16:13:58 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Guest created on hypervisor {{(pid=75245) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 16:13:58 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-9a477598-a166-479f-b99a-7f8e4dc3141d tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.408s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:13:58 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Instance spawned successfully.
Nov 29 16:13:58 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 16:13:58 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Found default for hw_cdrom_bus of ide {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:13:58 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Found default for hw_disk_bus of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:13:58 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Found default for hw_input_bus of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:13:58 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Found default for hw_pointer_model of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:13:58 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Found default for hw_video_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:13:58 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Found default for hw_vif_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:13:58 user nova-compute[75245]: INFO nova.scheduler.client.report [None req-9a477598-a166-479f-b99a-7f8e4dc3141d tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Deleted allocations for instance e3fea3d2-6db1-4766-ad5b-9ad1e728ea10
Nov 29 16:13:58 user nova-compute[75245]: DEBUG nova.compute.manager [req-b034d9e1-4a2c-4e24-bea1-bfbe22f4baef req-b7eff8b2-fd50-44af-85c6-553d4678f732 service nova] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] Received event network-vif-plugged-f4303524-45ab-49e7-bdac-5522f5c4b8f5 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:13:58 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b034d9e1-4a2c-4e24-bea1-bfbe22f4baef req-b7eff8b2-fd50-44af-85c6-553d4678f732 service nova] Acquiring lock "e3fea3d2-6db1-4766-ad5b-9ad1e728ea10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:13:58 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b034d9e1-4a2c-4e24-bea1-bfbe22f4baef req-b7eff8b2-fd50-44af-85c6-553d4678f732 service nova] Lock "e3fea3d2-6db1-4766-ad5b-9ad1e728ea10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:13:58 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b034d9e1-4a2c-4e24-bea1-bfbe22f4baef req-b7eff8b2-fd50-44af-85c6-553d4678f732 service nova] Lock "e3fea3d2-6db1-4766-ad5b-9ad1e728ea10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:13:58 user nova-compute[75245]: DEBUG nova.compute.manager [req-b034d9e1-4a2c-4e24-bea1-bfbe22f4baef req-b7eff8b2-fd50-44af-85c6-553d4678f732 service nova] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] No waiting events found dispatching network-vif-plugged-f4303524-45ab-49e7-bdac-5522f5c4b8f5 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:13:58 user nova-compute[75245]: WARNING nova.compute.manager [req-b034d9e1-4a2c-4e24-bea1-bfbe22f4baef req-b7eff8b2-fd50-44af-85c6-553d4678f732 service nova] [instance: e3fea3d2-6db1-4766-ad5b-9ad1e728ea10] Received unexpected event network-vif-plugged-f4303524-45ab-49e7-bdac-5522f5c4b8f5 for instance with vm_state deleted and task_state None.
Nov 29 16:13:58 user nova-compute[75245]: INFO nova.compute.manager [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Took 7.14 seconds to spawn the instance on the hypervisor.
Nov 29 16:13:58 user nova-compute[75245]: DEBUG nova.compute.manager [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:13:58 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-9a477598-a166-479f-b99a-7f8e4dc3141d tempest-TestVolumeSwap-1406149224 tempest-TestVolumeSwap-1406149224-project-member] Lock "e3fea3d2-6db1-4766-ad5b-9ad1e728ea10" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.461s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:13:58 user nova-compute[75245]: INFO nova.compute.manager [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Took 7.99 seconds to build instance.
Nov 29 16:13:58 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-9054c3ed-855f-4a24-a7e1-35130e0240dd tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "816edb0e-c4fc-470b-8151-f98502e50789" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.094s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:13:58 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:13:58 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:13:58 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:13:58 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Starting heal instance info cache {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 16:13:58 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Skipping network cache update for instance because it has been migrated to another host. {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9966}}
Nov 29 16:13:59 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "refresh_cache-36728d4f-925b-46a3-b4b5-17f14b9c99c3" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:13:59 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquired lock "refresh_cache-36728d4f-925b-46a3-b4b5-17f14b9c99c3" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:13:59 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] Forcefully refreshing network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 16:14:00 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] Updating instance_info_cache with network_info: [{"id": "507c0cd2-dea3-4352-b2ff-60000cc32053", "address": "fa:16:3e:38:db:1f", "network": {"id": "ae7be65e-9c9f-4836-aee2-9d465d5d28f6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-521099242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a08c8f9089c4291b552c567e010b0c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap507c0cd2-de", "ovs_interfaceid": "507c0cd2-dea3-4352-b2ff-60000cc32053", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:14:00 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Releasing lock "refresh_cache-36728d4f-925b-46a3-b4b5-17f14b9c99c3" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:14:00 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] Updated the network info_cache for instance {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 16:14:00 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:14:00 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:14:00 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:14:00 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:14:00 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:14:00 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75245) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 16:14:01 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:02 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:04 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:14:04 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:14:04 user nova-compute[75245]: DEBUG nova.objects.instance [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lazy-loading 'pci_requests' on Instance uuid 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:14:04 user nova-compute[75245]: DEBUG nova.objects.instance [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lazy-loading 'numa_topology' on Instance uuid 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:14:04 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75245) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 16:14:04 user nova-compute[75245]: INFO nova.compute.claims [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Claim successful on node user
Nov 29 16:14:04 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:14:04 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:14:04 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.521s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:14:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:04 user nova-compute[75245]: INFO nova.network.neutron [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Updating port 0b3a82cf-e1cb-455a-9f59-853505903560 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 29 16:14:05 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Acquiring lock "refresh_cache-3ab9d7cd-79cd-4c9b-8608-c1ef0f333305" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:14:05 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Acquired lock "refresh_cache-3ab9d7cd-79cd-4c9b-8608-c1ef0f333305" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:14:05 user nova-compute[75245]: DEBUG nova.network.neutron [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 16:14:05 user nova-compute[75245]: DEBUG nova.compute.manager [req-4b1f19c0-12b4-4e5c-8c07-c32aa22a83a9 req-00d1c7f8-961e-4f62-86f7-4729d2f8a0ab service nova] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Received event network-changed-0b3a82cf-e1cb-455a-9f59-853505903560 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:14:05 user nova-compute[75245]: DEBUG nova.compute.manager [req-4b1f19c0-12b4-4e5c-8c07-c32aa22a83a9 req-00d1c7f8-961e-4f62-86f7-4729d2f8a0ab service nova] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Refreshing instance network info cache due to event network-changed-0b3a82cf-e1cb-455a-9f59-853505903560. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:14:05 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-4b1f19c0-12b4-4e5c-8c07-c32aa22a83a9 req-00d1c7f8-961e-4f62-86f7-4729d2f8a0ab service nova] Acquiring lock "refresh_cache-3ab9d7cd-79cd-4c9b-8608-c1ef0f333305" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:14:06 user nova-compute[75245]: DEBUG nova.network.neutron [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Updating instance_info_cache with network_info: [{"id": "0b3a82cf-e1cb-455a-9f59-853505903560", "address": "fa:16:3e:72:f8:5e", "network": {"id": "7f978dee-8a5e-4218-b6fc-2d550c0d7b5d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-53637364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd22948fbd074a7c94d8ad7614fbc220", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b3a82cf-e1", "ovs_interfaceid": "0b3a82cf-e1cb-455a-9f59-853505903560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:14:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Releasing lock "refresh_cache-3ab9d7cd-79cd-4c9b-8608-c1ef0f333305" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:14:06 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Creating instance directory {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 16:14:06 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Creating image(s)
Nov 29 16:14:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Acquiring lock "/opt/stack/data/nova/instances/3ab9d7cd-79cd-4c9b-8608-c1ef0f333305/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:14:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lock "/opt/stack/data/nova/instances/3ab9d7cd-79cd-4c9b-8608-c1ef0f333305/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:14:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lock "/opt/stack/data/nova/instances/3ab9d7cd-79cd-4c9b-8608-c1ef0f333305/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:14:06 user nova-compute[75245]: DEBUG nova.objects.instance [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:14:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-4b1f19c0-12b4-4e5c-8c07-c32aa22a83a9 req-00d1c7f8-961e-4f62-86f7-4729d2f8a0ab service nova] Acquired lock "refresh_cache-3ab9d7cd-79cd-4c9b-8608-c1ef0f333305" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:14:06 user nova-compute[75245]: DEBUG nova.network.neutron [req-4b1f19c0-12b4-4e5c-8c07-c32aa22a83a9 req-00d1c7f8-961e-4f62-86f7-4729d2f8a0ab service nova] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Refreshing network info cache for port 0b3a82cf-e1cb-455a-9f59-853505903560 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:14:06 user nova-compute[75245]: DEBUG nova.objects.base [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Object Instance<3ab9d7cd-79cd-4c9b-8608-c1ef0f333305> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75245) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 16:14:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Acquiring lock "ea6da71bbf7123df6b08bb492d82cdcfd59c518b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:14:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lock "ea6da71bbf7123df6b08bb492d82cdcfd59c518b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:14:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea6da71bbf7123df6b08bb492d82cdcfd59c518b.part --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:07 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea6da71bbf7123df6b08bb492d82cdcfd59c518b.part --force-share --output=json" returned: 0 in 0.319s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:07 user nova-compute[75245]: DEBUG nova.virt.images [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] 6ba0ba34-4cf5-43b8-aa8a-7941d541a1cd was qcow2, converting to raw {{(pid=75245) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 16:14:07 user nova-compute[75245]: DEBUG nova.privsep.utils [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75245) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 16:14:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ea6da71bbf7123df6b08bb492d82cdcfd59c518b.part /opt/stack/data/nova/instances/_base/ea6da71bbf7123df6b08bb492d82cdcfd59c518b.converted {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:08 user nova-compute[75245]: DEBUG nova.network.neutron [req-4b1f19c0-12b4-4e5c-8c07-c32aa22a83a9 req-00d1c7f8-961e-4f62-86f7-4729d2f8a0ab service nova] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Updated VIF entry in instance network info cache for port 0b3a82cf-e1cb-455a-9f59-853505903560. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:14:08 user nova-compute[75245]: DEBUG nova.network.neutron [req-4b1f19c0-12b4-4e5c-8c07-c32aa22a83a9 req-00d1c7f8-961e-4f62-86f7-4729d2f8a0ab service nova] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Updating instance_info_cache with network_info: [{"id": "0b3a82cf-e1cb-455a-9f59-853505903560", "address": "fa:16:3e:72:f8:5e", "network": {"id": "7f978dee-8a5e-4218-b6fc-2d550c0d7b5d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-53637364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd22948fbd074a7c94d8ad7614fbc220", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b3a82cf-e1", "ovs_interfaceid": "0b3a82cf-e1cb-455a-9f59-853505903560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:14:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-4b1f19c0-12b4-4e5c-8c07-c32aa22a83a9 req-00d1c7f8-961e-4f62-86f7-4729d2f8a0ab service nova] Releasing lock "refresh_cache-3ab9d7cd-79cd-4c9b-8608-c1ef0f333305" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:14:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ea6da71bbf7123df6b08bb492d82cdcfd59c518b.part /opt/stack/data/nova/instances/_base/ea6da71bbf7123df6b08bb492d82cdcfd59c518b.converted" returned: 0 in 0.284s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea6da71bbf7123df6b08bb492d82cdcfd59c518b.converted --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:08 user nova-compute[75245]: INFO nova.virt.block_device [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Booting with volume 8a14d660-ebcc-4ad9-8cf9-e842d16bbfea at /dev/vdc
Nov 29 16:14:08 user nova-compute[75245]: DEBUG os_brick.utils [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:14:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:08 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31b7f32-34e4-462f-bdf0-1a17aeb5ff43]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:69ed8ed87091\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea6da71bbf7123df6b08bb492d82cdcfd59c518b.converted --force-share --output=json" returned: 0 in 0.206s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lock "ea6da71bbf7123df6b08bb492d82cdcfd59c518b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.137s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:14:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea6da71bbf7123df6b08bb492d82cdcfd59c518b --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:08 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[3828260c-8d54-4e94-90e4-0b1bc787caa4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:08 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ec611b-26d9-4a94-89ec-e656c5a8d962]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:08 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d2049d4-ed09-4d1a-8063-0bdac6859f8e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Running cmd (subprocess): nvme version {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] 'nvme version' failed. Not Retrying. {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:14:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] nvme not present on system {{(pid=75245) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 16:14:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:14:08 user nova-compute[75245]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 16:14:08 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb488f1a-b22c-401b-ba4b-35d44fdf3eb1]: (4, '') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75245) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 16:14:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 16:14:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] LIGHTOS: no hostnqn found. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 16:14:08 user nova-compute[75245]: DEBUG os_brick.utils [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] <== get_connector_properties: return (232ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:69ed8ed87091', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:14:08 user nova-compute[75245]: DEBUG nova.virt.block_device [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Updating existing volume attachment record: 9f2a184b-16f8-4cfb-8e00-08e1307b3805 {{(pid=75245) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 16:14:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea6da71bbf7123df6b08bb492d82cdcfd59c518b --force-share --output=json" returned: 0 in 0.198s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Acquiring lock "ea6da71bbf7123df6b08bb492d82cdcfd59c518b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:14:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lock "ea6da71bbf7123df6b08bb492d82cdcfd59c518b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:14:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea6da71bbf7123df6b08bb492d82cdcfd59c518b --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea6da71bbf7123df6b08bb492d82cdcfd59c518b --force-share --output=json" returned: 0 in 0.181s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ea6da71bbf7123df6b08bb492d82cdcfd59c518b,backing_fmt=raw /opt/stack/data/nova/instances/3ab9d7cd-79cd-4c9b-8608-c1ef0f333305/disk 1073741824 {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ea6da71bbf7123df6b08bb492d82cdcfd59c518b,backing_fmt=raw /opt/stack/data/nova/instances/3ab9d7cd-79cd-4c9b-8608-c1ef0f333305/disk 1073741824" returned: 0 in 0.060s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lock "ea6da71bbf7123df6b08bb492d82cdcfd59c518b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:14:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea6da71bbf7123df6b08bb492d82cdcfd59c518b --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea6da71bbf7123df6b08bb492d82cdcfd59c518b --force-share --output=json" returned: 0 in 0.270s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:09 user nova-compute[75245]: DEBUG nova.objects.instance [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lazy-loading 'migration_context' on Instance uuid 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:14:09 user nova-compute[75245]: DEBUG nova.objects.base [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Object Instance<3ab9d7cd-79cd-4c9b-8608-c1ef0f333305> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75245) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 16:14:09 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Rebasing disk image.
Nov 29 16:14:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.202s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 -F raw /opt/stack/data/nova/instances/3ab9d7cd-79cd-4c9b-8608-c1ef0f333305/disk {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:11 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 -F raw /opt/stack/data/nova/instances/3ab9d7cd-79cd-4c9b-8608-c1ef0f333305/disk" returned: 0 in 2.657s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:11 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Created local disks {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 16:14:11 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Ensure instance console log exists: /opt/stack/data/nova/instances/3ab9d7cd-79cd-4c9b-8608-c1ef0f333305/console.log {{(pid=75245) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 16:14:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:14:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:14:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:14:11 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Start _get_guest_xml network_info=[{"id": "0b3a82cf-e1cb-455a-9f59-853505903560", "address": "fa:16:3e:72:f8:5e", "network": {"id": "7f978dee-8a5e-4218-b6fc-2d550c0d7b5d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-53637364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd22948fbd074a7c94d8ad7614fbc220", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b3a82cf-e1", "ovs_interfaceid": "0b3a82cf-e1cb-455a-9f59-853505903560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b0a620dac07f69ea6dc901ad3b0f0cda',container_format='bare',created_at=2023-11-29T16:12:02Z,direct_url=<?>,disk_format='qcow2',id=6ba0ba34-4cf5-43b8-aa8a-7941d541a1cd,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-723691220-shelved',owner='fd22948fbd074a7c94d8ad7614fbc220',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-29T16:12:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'a291d9c3-be02-4c6c-9649-4b45c5b7f487'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'attachment_id': '866a858a-3093-4cbc-b4d5-a6d3319966dc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zZGCihSU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '3ab9d7cd-79cd-4c9b-8608-c1ef0f333305', 'attached_at': '', 'detached_at': '', 'volume_id': 'a74ae150-7d3d-47ca-80a6-1bc324280bd5', 'serial': 'a74ae150-7d3d-47ca-80a6-1bc324280bd5'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'guest_format': None, 'volume_type': None} {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 16:14:11 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:14:11 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:14:11 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 16:14:11 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] CPU controller missing on host. {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 16:14:11 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 16:14:11 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] CPU controller found on host. {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 16:14:11 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75245) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 16:14:11 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T16:06:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b0a620dac07f69ea6dc901ad3b0f0cda',container_format='bare',created_at=2023-11-29T16:12:02Z,direct_url=<?>,disk_format='qcow2',id=6ba0ba34-4cf5-43b8-aa8a-7941d541a1cd,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-723691220-shelved',owner='fd22948fbd074a7c94d8ad7614fbc220',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-29T16:12:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 16:14:11 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Flavor limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 16:14:11 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Image limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 16:14:11 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Flavor pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 16:14:11 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Image pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 16:14:11 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 16:14:11 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 16:14:11 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 16:14:11 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Got 1 possible topologies {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 16:14:11 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 16:14:11 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 16:14:11 user nova-compute[75245]: DEBUG nova.objects.instance [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:14:12 user nova-compute[75245]: DEBUG nova.objects.base [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Object Instance<3ab9d7cd-79cd-4c9b-8608-c1ef0f333305> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75245) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 16:14:12 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Calling os-brick to attach iSCSI Volume {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 16:14:12 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zZGCihSU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:14:12 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:14:12 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:14:12 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:14:12 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:14:12 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:14:12 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:14:12 user nova-compute[75245]: INFO os_brick.initiator.connectors.iscsi [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 16:14:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5 -p 172.16.0.220:3260 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:12 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d5487ac-3f0d-41c5-b36d-6e51fc9b17e4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:12 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 16:14:12 user nova-compute[75245]:  {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:14:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:12 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[b115d48e-ede6-467a-9631-44aad32edaed]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5] added\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:12 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5] added
Nov 29 16:14:12 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:14:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:12 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c079b12-cc98-46f9-9de8-7029bac25389]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:12 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:14:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.038s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:12 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca3595a-c8ae-4a73-a836-ba598b22577a]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:12 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:14:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zZGCihSU {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zZGCihSU" returned: 0 in 0.113s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:12 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b4042e3-74dd-4176-951a-f1a344bd27b8]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:12 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zZGCihSU'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:14:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:12 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dbb9106-17ca-4f0d-bfbd-77da6c134ab0]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:12 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:14:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:12 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ba1390-78fc-4883-aa37-0498ec7d6d6e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11638f79-445f-4e4f-8652-2cdd87360a08 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:12 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11638f79-445f-4e4f-8652-2cdd87360a08 (non-flash)
Nov 29 16:14:12 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:14:12 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11638f79-445f-4e4f-8652-2cdd87360a08 (non-flash)
Nov 29 16:14:12 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:14:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5 -p 172.16.0.220:3260 --login {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:12 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[95979e99-6280-4e59-9584-f386a9b2a21f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:12 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5, portal: 172.16.0.220,3260]
Nov 29 16:14:12 user nova-compute[75245]: Login to [iface: default, target: iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5, portal: 172.16.0.220,3260] successful.
Nov 29 16:14:12 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:14:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:12 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd4caf11-e3d6-488e-be7b-609988384973]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:12 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:14:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:12 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[e563c0e4-adb2-4c02-917c-8dba0bd606d9]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11638f79-445f-4e4f-8652-2cdd87360a08 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:12 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11638f79-445f-4e4f-8652-2cdd87360a08 (non-flash)
Nov 29 16:14:12 user nova-compute[75245]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5 (non-flash)
Nov 29 16:14:12 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:14:12 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11638f79-445f-4e4f-8652-2cdd87360a08 (non-flash)
Nov 29 16:14:12 user nova-compute[75245]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5 (non-flash)
Nov 29 16:14:12 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:14:12 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.448s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:14:12 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Connected to 172.16.0.220:3260 {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 16:14:12 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] HCTL ('34', '-', '-', 0) found on session 12 with lun 0 {{(pid=75245) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 16:14:12 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75245) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 16:14:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:12 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:12 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[b175bd6d-e8e7-4a50-83e4-d80f3857db60]: (4, ('- - 0', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:12 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Searching for a device in session 12 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75245) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 16:14:12 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zZGCihSU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 16:14:13 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.484s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:14:13 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] <== connect_volume: return (1487ms) {'type': 'block', 'scsi_wwn': '23261353430373930', 'path': '/dev/sdc'} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:14:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23261353430373930', 'path': '/dev/sdc'} {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 16:14:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T16:10:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-723691220',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-723691220',id=4,image_ref='6ba0ba34-4cf5-43b8-aa8a-7941d541a1cd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-353472592',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:10:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='fd22948fbd074a7c94d8ad7614fbc220',ramdisk_id='',reservation_id='r-k0lo301j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1524245296',owner_user_name='tempest-AttachVolumeShelveTestJSON-1524245296-project-member',shelved_at='2023-11-29T16:12:07.347735',shelved_host='user',shelved_image_id='6ba0ba34-4cf5-43b8-aa8a-7941d541a1cd'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:13:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c4942f948584702a8c8b93248694a65',uuid=3ab9d7cd-79cd-4c9b-8608-c1ef0f333305,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "0b3a82cf-e1cb-455a-9f59-853505903560", "address": "fa:16:3e:72:f8:5e", "network": {"id": "7f978dee-8a5e-4218-b6fc-2d550c0d7b5d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-53637364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd22948fbd074a7c94d8ad7614fbc220", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b3a82cf-e1", "ovs_interfaceid": "0b3a82cf-e1cb-455a-9f59-853505903560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:14:13 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Converting VIF {"id": "0b3a82cf-e1cb-455a-9f59-853505903560", "address": "fa:16:3e:72:f8:5e", "network": {"id": "7f978dee-8a5e-4218-b6fc-2d550c0d7b5d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-53637364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd22948fbd074a7c94d8ad7614fbc220", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b3a82cf-e1", "ovs_interfaceid": "0b3a82cf-e1cb-455a-9f59-853505903560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:14:13 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:f8:5e,bridge_name='br-int',has_traffic_filtering=True,id=0b3a82cf-e1cb-455a-9f59-853505903560,network=Network(7f978dee-8a5e-4218-b6fc-2d550c0d7b5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b3a82cf-e1') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:14:13 user nova-compute[75245]: DEBUG nova.objects.instance [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lazy-loading 'pci_devices' on Instance uuid 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:14:13 user nova-compute[75245]: DEBUG nova.objects.base [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Object Instance<3ab9d7cd-79cd-4c9b-8608-c1ef0f333305> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75245) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 16:14:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] End _get_guest_xml xml=<domain type="kvm">
Nov 29 16:14:13 user nova-compute[75245]:   <uuid>3ab9d7cd-79cd-4c9b-8608-c1ef0f333305</uuid>
Nov 29 16:14:13 user nova-compute[75245]:   <name>instance-00000004</name>
Nov 29 16:14:13 user nova-compute[75245]:   <memory>524288</memory>
Nov 29 16:14:13 user nova-compute[75245]:   <vcpu>1</vcpu>
Nov 29 16:14:13 user nova-compute[75245]:   <metadata>
Nov 29 16:14:13 user nova-compute[75245]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 16:14:13 user nova-compute[75245]:       <nova:package version="0.0.0"/>
Nov 29 16:14:13 user nova-compute[75245]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-723691220</nova:name>
Nov 29 16:14:13 user nova-compute[75245]:       <nova:creationTime>2023-11-29 16:14:11</nova:creationTime>
Nov 29 16:14:13 user nova-compute[75245]:       <nova:flavor name="m1.tiny">
Nov 29 16:14:13 user nova-compute[75245]:         <nova:memory>512</nova:memory>
Nov 29 16:14:13 user nova-compute[75245]:         <nova:disk>1</nova:disk>
Nov 29 16:14:13 user nova-compute[75245]:         <nova:swap>0</nova:swap>
Nov 29 16:14:13 user nova-compute[75245]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 16:14:13 user nova-compute[75245]:         <nova:vcpus>1</nova:vcpus>
Nov 29 16:14:13 user nova-compute[75245]:       </nova:flavor>
Nov 29 16:14:13 user nova-compute[75245]:       <nova:owner>
Nov 29 16:14:13 user nova-compute[75245]:         <nova:user uuid="7c4942f948584702a8c8b93248694a65">tempest-AttachVolumeShelveTestJSON-1524245296-project-member</nova:user>
Nov 29 16:14:13 user nova-compute[75245]:         <nova:project uuid="fd22948fbd074a7c94d8ad7614fbc220">tempest-AttachVolumeShelveTestJSON-1524245296</nova:project>
Nov 29 16:14:13 user nova-compute[75245]:       </nova:owner>
Nov 29 16:14:13 user nova-compute[75245]:       <nova:root type="image" uuid="6ba0ba34-4cf5-43b8-aa8a-7941d541a1cd"/>
Nov 29 16:14:13 user nova-compute[75245]:       <nova:ports>
Nov 29 16:14:13 user nova-compute[75245]:         <nova:port uuid="0b3a82cf-e1cb-455a-9f59-853505903560">
Nov 29 16:14:13 user nova-compute[75245]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 29 16:14:13 user nova-compute[75245]:         </nova:port>
Nov 29 16:14:13 user nova-compute[75245]:       </nova:ports>
Nov 29 16:14:13 user nova-compute[75245]:     </nova:instance>
Nov 29 16:14:13 user nova-compute[75245]:   </metadata>
Nov 29 16:14:13 user nova-compute[75245]:   <sysinfo type="smbios">
Nov 29 16:14:13 user nova-compute[75245]:     <system>
Nov 29 16:14:13 user nova-compute[75245]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 16:14:13 user nova-compute[75245]:       <entry name="product">OpenStack Nova</entry>
Nov 29 16:14:13 user nova-compute[75245]:       <entry name="version">0.0.0</entry>
Nov 29 16:14:13 user nova-compute[75245]:       <entry name="serial">3ab9d7cd-79cd-4c9b-8608-c1ef0f333305</entry>
Nov 29 16:14:13 user nova-compute[75245]:       <entry name="uuid">3ab9d7cd-79cd-4c9b-8608-c1ef0f333305</entry>
Nov 29 16:14:13 user nova-compute[75245]:       <entry name="family">Virtual Machine</entry>
Nov 29 16:14:13 user nova-compute[75245]:     </system>
Nov 29 16:14:13 user nova-compute[75245]:   </sysinfo>
Nov 29 16:14:13 user nova-compute[75245]:   <os>
Nov 29 16:14:13 user nova-compute[75245]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 16:14:13 user nova-compute[75245]:     <boot dev="hd"/>
Nov 29 16:14:13 user nova-compute[75245]:     <smbios mode="sysinfo"/>
Nov 29 16:14:13 user nova-compute[75245]:   </os>
Nov 29 16:14:13 user nova-compute[75245]:   <features>
Nov 29 16:14:13 user nova-compute[75245]:     <acpi/>
Nov 29 16:14:13 user nova-compute[75245]:     <apic/>
Nov 29 16:14:13 user nova-compute[75245]:     <vmcoreinfo/>
Nov 29 16:14:13 user nova-compute[75245]:   </features>
Nov 29 16:14:13 user nova-compute[75245]:   <clock offset="utc">
Nov 29 16:14:13 user nova-compute[75245]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 16:14:13 user nova-compute[75245]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 16:14:13 user nova-compute[75245]:     <timer name="hpet" present="no"/>
Nov 29 16:14:13 user nova-compute[75245]:   </clock>
Nov 29 16:14:13 user nova-compute[75245]:   <cpu mode="custom" match="exact">
Nov 29 16:14:13 user nova-compute[75245]:     <model>Nehalem</model>
Nov 29 16:14:13 user nova-compute[75245]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 16:14:13 user nova-compute[75245]:   </cpu>
Nov 29 16:14:13 user nova-compute[75245]:   <devices>
Nov 29 16:14:13 user nova-compute[75245]:     <disk type="file" device="disk">
Nov 29 16:14:13 user nova-compute[75245]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 16:14:13 user nova-compute[75245]:       <source file="/opt/stack/data/nova/instances/3ab9d7cd-79cd-4c9b-8608-c1ef0f333305/disk"/>
Nov 29 16:14:13 user nova-compute[75245]:       <target dev="vda" bus="virtio"/>
Nov 29 16:14:13 user nova-compute[75245]:     </disk>
Nov 29 16:14:13 user nova-compute[75245]:     <disk type="block" device="disk">
Nov 29 16:14:13 user nova-compute[75245]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:14:13 user nova-compute[75245]:       <source dev="/dev/sdc"/>
Nov 29 16:14:13 user nova-compute[75245]:       <target dev="vdc" bus="virtio"/>
Nov 29 16:14:13 user nova-compute[75245]:       <serial>a74ae150-7d3d-47ca-80a6-1bc324280bd5</serial>
Nov 29 16:14:13 user nova-compute[75245]:     </disk>
Nov 29 16:14:13 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 16:14:13 user nova-compute[75245]:       <mac address="fa:16:3e:72:f8:5e"/>
Nov 29 16:14:13 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:14:13 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 16:14:13 user nova-compute[75245]:       <target dev="tap0b3a82cf-e1"/>
Nov 29 16:14:13 user nova-compute[75245]:     </interface>
Nov 29 16:14:13 user nova-compute[75245]:     <serial type="pty">
Nov 29 16:14:13 user nova-compute[75245]:       <log file="/opt/stack/data/nova/instances/3ab9d7cd-79cd-4c9b-8608-c1ef0f333305/console.log" append="off"/>
Nov 29 16:14:13 user nova-compute[75245]:     </serial>
Nov 29 16:14:13 user nova-compute[75245]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 16:14:13 user nova-compute[75245]:     <video>
Nov 29 16:14:13 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:14:13 user nova-compute[75245]:     </video>
Nov 29 16:14:13 user nova-compute[75245]:     <rng model="virtio">
Nov 29 16:14:13 user nova-compute[75245]:       <backend model="random">/dev/urandom</backend>
Nov 29 16:14:13 user nova-compute[75245]:     </rng>
Nov 29 16:14:13 user nova-compute[75245]:     <controller type="usb" index="0" model="none"/>
Nov 29 16:14:13 user nova-compute[75245]:     <memballoon model="virtio">
Nov 29 16:14:13 user nova-compute[75245]:       <stats period="10"/>
Nov 29 16:14:13 user nova-compute[75245]:     </memballoon>
Nov 29 16:14:13 user nova-compute[75245]:   </devices>
Nov 29 16:14:13 user nova-compute[75245]: </domain>
Nov 29 16:14:13 user nova-compute[75245]:  {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 16:14:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T16:10:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-723691220',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-723691220',id=4,image_ref='6ba0ba34-4cf5-43b8-aa8a-7941d541a1cd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-353472592',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:10:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='fd22948fbd074a7c94d8ad7614fbc220',ramdisk_id='',reservation_id='r-k0lo301j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1524245296',owner_user_name='tempest-AttachVolumeShelveTestJSON-1524245296-project-member',shelved_at='2023-11-29T16:12:07.347735',shelved_host='user',shelved_image_id='6ba0ba34-4cf5-43b8-aa8a-7941d541a1cd'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:13:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c4942f948584702a8c8b93248694a65',uuid=3ab9d7cd-79cd-4c9b-8608-c1ef0f333305,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "0b3a82cf-e1cb-455a-9f59-853505903560", "address": "fa:16:3e:72:f8:5e", "network": {"id": "7f978dee-8a5e-4218-b6fc-2d550c0d7b5d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-53637364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd22948fbd074a7c94d8ad7614fbc220", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b3a82cf-e1", "ovs_interfaceid": "0b3a82cf-e1cb-455a-9f59-853505903560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 16:14:13 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Converting VIF {"id": "0b3a82cf-e1cb-455a-9f59-853505903560", "address": "fa:16:3e:72:f8:5e", "network": {"id": "7f978dee-8a5e-4218-b6fc-2d550c0d7b5d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-53637364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd22948fbd074a7c94d8ad7614fbc220", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b3a82cf-e1", "ovs_interfaceid": "0b3a82cf-e1cb-455a-9f59-853505903560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:14:13 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:f8:5e,bridge_name='br-int',has_traffic_filtering=True,id=0b3a82cf-e1cb-455a-9f59-853505903560,network=Network(7f978dee-8a5e-4218-b6fc-2d550c0d7b5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b3a82cf-e1') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:14:13 user nova-compute[75245]: DEBUG os_vif [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:f8:5e,bridge_name='br-int',has_traffic_filtering=True,id=0b3a82cf-e1cb-455a-9f59-853505903560,network=Network(7f978dee-8a5e-4218-b6fc-2d550c0d7b5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b3a82cf-e1') {{(pid=75245) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 16:14:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:14:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 16:14:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a0fcfafe-9b8b-57af-92a3-3ceb5d8de72a', '_type': 'linux-noop'}}, row=False) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:14:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:14:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0b3a82cf-e1, may_exist=True, interface_attrs={}) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:14:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0b3a82cf-e1, col_values=(('qos', UUID('19942116-bbee-495a-88c1-322ac4cee001')),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:14:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0b3a82cf-e1, col_values=(('external_ids', {'iface-id': '0b3a82cf-e1cb-455a-9f59-853505903560', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:f8:5e', 'vm-uuid': '3ab9d7cd-79cd-4c9b-8608-c1ef0f333305'}),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:14:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:14:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:13 user nova-compute[75245]: INFO os_vif [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:f8:5e,bridge_name='br-int',has_traffic_filtering=True,id=0b3a82cf-e1cb-455a-9f59-853505903560,network=Network(7f978dee-8a5e-4218-b6fc-2d550c0d7b5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b3a82cf-e1')
Nov 29 16:14:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:14:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:14:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] No VIF found with MAC fa:16:3e:72:f8:5e, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:14:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:15 user nova-compute[75245]: DEBUG nova.compute.manager [req-945897c6-745e-4a0d-9b16-20ff20f696f4 req-4cc793b7-8448-477b-b783-ed8909233d59 service nova] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Received event network-vif-plugged-0b3a82cf-e1cb-455a-9f59-853505903560 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:14:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-945897c6-745e-4a0d-9b16-20ff20f696f4 req-4cc793b7-8448-477b-b783-ed8909233d59 service nova] Acquiring lock "3ab9d7cd-79cd-4c9b-8608-c1ef0f333305-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:14:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-945897c6-745e-4a0d-9b16-20ff20f696f4 req-4cc793b7-8448-477b-b783-ed8909233d59 service nova] Lock "3ab9d7cd-79cd-4c9b-8608-c1ef0f333305-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:14:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-945897c6-745e-4a0d-9b16-20ff20f696f4 req-4cc793b7-8448-477b-b783-ed8909233d59 service nova] Lock "3ab9d7cd-79cd-4c9b-8608-c1ef0f333305-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:14:15 user nova-compute[75245]: DEBUG nova.compute.manager [req-945897c6-745e-4a0d-9b16-20ff20f696f4 req-4cc793b7-8448-477b-b783-ed8909233d59 service nova] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] No waiting events found dispatching network-vif-plugged-0b3a82cf-e1cb-455a-9f59-853505903560 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:14:15 user nova-compute[75245]: WARNING nova.compute.manager [req-945897c6-745e-4a0d-9b16-20ff20f696f4 req-4cc793b7-8448-477b-b783-ed8909233d59 service nova] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Received unexpected event network-vif-plugged-0b3a82cf-e1cb-455a-9f59-853505903560 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 29 16:14:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG nova.compute.manager [req-d261a920-3562-4ecd-81be-7a3c1277a80d req-b446fe6c-fabe-452c-824e-de1c63cc371e service nova] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Received event network-vif-plugged-0b3a82cf-e1cb-455a-9f59-853505903560 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d261a920-3562-4ecd-81be-7a3c1277a80d req-b446fe6c-fabe-452c-824e-de1c63cc371e service nova] Acquiring lock "3ab9d7cd-79cd-4c9b-8608-c1ef0f333305-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d261a920-3562-4ecd-81be-7a3c1277a80d req-b446fe6c-fabe-452c-824e-de1c63cc371e service nova] Lock "3ab9d7cd-79cd-4c9b-8608-c1ef0f333305-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d261a920-3562-4ecd-81be-7a3c1277a80d req-b446fe6c-fabe-452c-824e-de1c63cc371e service nova] Lock "3ab9d7cd-79cd-4c9b-8608-c1ef0f333305-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG nova.compute.manager [req-d261a920-3562-4ecd-81be-7a3c1277a80d req-b446fe6c-fabe-452c-824e-de1c63cc371e service nova] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] No waiting events found dispatching network-vif-plugged-0b3a82cf-e1cb-455a-9f59-853505903560 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:14:17 user nova-compute[75245]: WARNING nova.compute.manager [req-d261a920-3562-4ecd-81be-7a3c1277a80d req-b446fe6c-fabe-452c-824e-de1c63cc371e service nova] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Received unexpected event network-vif-plugged-0b3a82cf-e1cb-455a-9f59-853505903560 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 29 16:14:17 user nova-compute[75245]: DEBUG nova.compute.manager [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Start spawning the instance on the hypervisor. {{(pid=75245) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Creating instance directory {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 16:14:17 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Creating image(s)
Nov 29 16:14:17 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Did not create local disks {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Ensure instance console log exists: /opt/stack/data/nova/instances/5f2a6f15-e413-47a2-be3e-961dd9ee7deb/console.log {{(pid=75245) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Start _get_guest_xml network_info=[{"id": "e76a4989-a78d-47cf-8df0-b0b71180b60e", "address": "fa:16:3e:76:29:fe", "network": {"id": "0e5af197-7146-4691-9357-c6d470646e65", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1607694636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape76a4989-a7", "ovs_interfaceid": "e76a4989-a78d-47cf-8df0-b0b71180b60e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4dd25469-cfd1-468f-8fa3-a58c5613c96b", "address": "fa:16:3e:16:dd:65", "network": {"id": "33ed6d1c-906e-49c8-9731-a0d23f716434", "bridge": "br-int", "label": "tempest-device-tagging-net1-322196721", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dd25469-cf", "ovs_interfaceid": "4dd25469-cfd1-468f-8fa3-a58c5613c96b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7b6625ae-3097-4e56-bb72-3b67ff4996b6", "address": "fa:16:3e:be:8a:fe", "network": {"id": "33ed6d1c-906e-49c8-9731-a0d23f716434", "bridge": "br-int", "label": "tempest-device-tagging-net1-322196721", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b6625ae-30", "ovs_interfaceid": "7b6625ae-3097-4e56-bb72-3b67ff4996b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "10e71fa4-4f0d-420a-9ea3-502e0a1eb1f7", "address": "fa:16:3e:3a:e0:19", "network": {"id": "33ed6d1c-906e-49c8-9731-a0d23f716434", "bridge": "br-int", "label": "tempest-device-tagging-net1-322196721", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e71fa4-4f", "ovs_interfaceid": "10e71fa4-4f0d-420a-9ea3-502e0a1eb1f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "706111a2-b6f0-4311-ac82-a60a93fa2f51", "address": "fa:16:3e:db:77:11", "network": {"id": "33ed6d1c-906e-49c8-9731-a0d23f716434", "bridge": "br-int", "label": "tempest-device-tagging-net1-322196721", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap706111a2-b6", "ovs_interfaceid": "706111a2-b6f0-4311-ac82-a60a93fa2f51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5e39b868-de11-4bc1-b68a-11621bf7f057", "address": "fa:16:3e:44:89:16", "network": {"id": "c815e5db-bcac-4915-b581-63c2f697d2e5", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132953712", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e39b868-de", "ovs_interfaceid": "5e39b868-de11-4bc1-b68a-11621bf7f057", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "52f4aecd-3b06-4a52-9541-b7bc96acf5d4", "address": "fa:16:3e:f9:b9:5f", "network": {"id": "c815e5db-bcac-4915-b581-63c2f697d2e5", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132953712", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52f4aecd-3b", "ovs_interfaceid": "52f4aecd-3b06-4a52-9541-b7bc96acf5d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': 'f2694a72-2d4b-4c08-9a0d-abcfb6958c02', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EXgeiNxd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5f2a6f15-e413-47a2-be3e-961dd9ee7deb', 'attached_at': '', 'detached_at': '', 'volume_id': '021db3af-a7f2-4f6c-b702-35cec416ee18', 'serial': '021db3af-a7f2-4f6c-b702-35cec416ee18'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'guest_format': None, 'volume_type': None}, {'boot_index': 1, 'attachment_id': '8e7dc227-eab0-4890-8e7e-bf64a4758a8f', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SrTqEnPe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5f2a6f15-e413-47a2-be3e-961dd9ee7deb', 'attached_at': '', 'detached_at': '', 'volume_id': '92465e1e-d975-4701-a213-bc8906dafc49', 'serial': '92465e1e-d975-4701-a213-bc8906dafc49'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'guest_format': None, 'volume_type': None}, {'boot_index': 2, 'attachment_id': '9f2a184b-16f8-4cfb-8e00-08e1307b3805', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hwyFbtaV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5f2a6f15-e413-47a2-be3e-961dd9ee7deb', 'attached_at': '', 'detached_at': '', 'volume_id': '8a14d660-ebcc-4ad9-8cf9-e842d16bbfea', 'serial': '8a14d660-ebcc-4ad9-8cf9-e842d16bbfea'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'guest_format': None, 'volume_type': None} {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 16:14:17 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:14:17 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:14:17 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] CPU controller missing on host. {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] CPU controller found on host. {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75245) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T16:06:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Flavor limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Image limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Flavor pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Image pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Got 1 possible topologies {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Calling os-brick to attach iSCSI Volume {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EXgeiNxd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:14:17 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:14:17 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:14:17 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:14:17 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:14:17 user nova-compute[75245]: INFO os_brick.initiator.connectors.iscsi [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 16:14:17 user nova-compute[75245]: DEBUG nova.compute.manager [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Instance event wait completed in 0 seconds for  {{(pid=75245) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Guest created on hypervisor {{(pid=75245) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18 -p 172.16.0.220:3260 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:17 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Instance spawned successfully.
Nov 29 16:14:17 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[028975b4-1239-4fda-bf08-c365ac112129]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 16:14:17 user nova-compute[75245]:  {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18 -p 172.16.0.220:3260 --interface default --op new {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[d431cb2b-13e5-4030-b314-b9a46c742df3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18] added\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18] added
Nov 29 16:14:17 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1382ca-c010-42c5-a121-8458294eab2d]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f66de8-c28c-4b93-9b7c-535705bdb9eb]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EXgeiNxd {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EXgeiNxd" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd5138b5-073f-4f41-92b3-401c2c9e668d]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EXgeiNxd'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea7d39b-64dc-4a8d-9670-b3652449e76f]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[947bfacb-36fe-469f-af96-9f6fedb8b1e4]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5 (non-flash)
Nov 29 16:14:17 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5 (non-flash)
Nov 29 16:14:17 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18 -p 172.16.0.220:3260 --login {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c7da54b-e176-4f2c-a0c5-2db00f7a05ef]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18, portal: 172.16.0.220,3260]
Nov 29 16:14:17 user nova-compute[75245]: Login to [iface: default, target: iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18, portal: 172.16.0.220,3260] successful.
Nov 29 16:14:17 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[b773b284-763f-4723-9f5d-a4cd3530fe84]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[98390cb9-29dc-4008-b27d-9e0e5861a955]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5 (non-flash)
Nov 29 16:14:17 user nova-compute[75245]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18 (non-flash)
Nov 29 16:14:17 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5 (non-flash)
Nov 29 16:14:17 user nova-compute[75245]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18 (non-flash)
Nov 29 16:14:17 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Connected to 172.16.0.220:3260 {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] HCTL ('33', '-', '-', 0) found on session 13 with lun 0 {{(pid=75245) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75245) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3eb57b-9a87-428a-9344-b8940cd6b3c8]: (4, ('- - 0', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Searching for a device in session 13 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75245) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 16:14:17 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EXgeiNxd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 16:14:18 user nova-compute[75245]: DEBUG nova.compute.manager [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:14:18 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-376ed5e5-6eb2-4bc5-ace3-16087864bb97 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lock "3ab9d7cd-79cd-4c9b-8608-c1ef0f333305" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 23.279s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:14:18 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:18 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:14:18 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '26434323764643339', 'path': '/dev/sdb'} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:14:18 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26434323764643339', 'path': '/dev/sdb'} {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 16:14:19 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Calling os-brick to attach iSCSI Volume {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 16:14:19 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SrTqEnPe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:14:19 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:14:19 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:14:19 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:14:19 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:14:19 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:14:19 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:14:19 user nova-compute[75245]: INFO os_brick.initiator.connectors.iscsi [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 16:14:19 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49 -p 172.16.0.220:3260 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:19 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:19 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f4d3b9-157a-4d4c-bab5-2703b5eacc81]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:19 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 16:14:19 user nova-compute[75245]:  {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:14:19 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49 -p 172.16.0.220:3260 --interface default --op new {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:19 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:19 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[87cd5a63-ac28-4e0a-9446-a87986c453dc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49] added\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:19 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49] added
Nov 29 16:14:19 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:14:19 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:19 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:19 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e08d5d-b928-461d-9a07-a582883be830]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:19 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:14:19 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:19 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:19 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b0783a-2077-40d0-9b4f-c23a18faefa8]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:19 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:14:19 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SrTqEnPe {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:19 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SrTqEnPe" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:19 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[36da162f-f939-4adc-a931-a33b5b3f7f1d]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:19 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SrTqEnPe'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:14:19 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:19 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.045s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:19 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[427adf7a-911b-4005-bd4e-bb24110136f2]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:19 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:14:19 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:19 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:19 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[01cebccb-e519-40bb-b4aa-4f5bd234db6a]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:19 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5 (non-flash)
Nov 29 16:14:19 user nova-compute[75245]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18 (non-flash)
Nov 29 16:14:19 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:14:19 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5 (non-flash)
Nov 29 16:14:19 user nova-compute[75245]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18 (non-flash)
Nov 29 16:14:19 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:14:19 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49 -p 172.16.0.220:3260 --login {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:19 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:19 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ac5977-b9f6-4c8f-afc4-18fb50f5a41e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:19 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49, portal: 172.16.0.220,3260]
Nov 29 16:14:19 user nova-compute[75245]: Login to [iface: default, target: iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49, portal: 172.16.0.220,3260] successful.
Nov 29 16:14:19 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:14:19 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:19 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:19 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa4e3ca2-4231-4c4a-8716-b70a8a9784f0]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:19 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:14:19 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:19 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:19 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[b086afbd-c9a5-442f-be29-5e7473a189ac]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:19 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5 (non-flash)
Nov 29 16:14:19 user nova-compute[75245]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18 (non-flash)
Nov 29 16:14:19 user nova-compute[75245]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49 (non-flash)
Nov 29 16:14:19 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:14:19 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5 (non-flash)
Nov 29 16:14:19 user nova-compute[75245]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18 (non-flash)
Nov 29 16:14:19 user nova-compute[75245]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49 (non-flash)
Nov 29 16:14:19 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:14:19 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.360s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:14:19 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Connected to 172.16.0.220:3260 {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 16:14:19 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] HCTL ('35', '-', '-', 0) found on session 14 with lun 0 {{(pid=75245) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 16:14:19 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75245) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 16:14:19 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:19 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.025s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:19 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f7c478-4787-4131-bdcf-8903f21b9a67]: (4, ('- - 0', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:19 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Searching for a device in session 14 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75245) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 16:14:19 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SrTqEnPe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 16:14:20 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.412s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:14:20 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] <== connect_volume: return (1414ms) {'type': 'block', 'scsi_wwn': '26463363638363436', 'path': '/dev/sdd'} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:14:20 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26463363638363436', 'path': '/dev/sdd'} {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 16:14:20 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Calling os-brick to attach iSCSI Volume {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 16:14:20 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hwyFbtaV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:14:20 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:14:20 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:14:20 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:14:20 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:14:20 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:14:20 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:14:20 user nova-compute[75245]: INFO os_brick.initiator.connectors.iscsi [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 16:14:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea -p 172.16.0.220:3260 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:20 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50775c3-b121-4482-b37b-aaa3fd504c20]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:20 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 16:14:20 user nova-compute[75245]:  {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:14:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea -p 172.16.0.220:3260 --interface default --op new {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:20 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c0f806-a2b2-4e2c-9b40-58c4a4973db7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea] added\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:20 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea] added
Nov 29 16:14:20 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:14:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:20 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f9e6e1-5483-44b0-8b77-b0f4d4798e6a]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:20 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:14:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:20 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[2adcf307-f786-4600-a881-c600cdcc59fc]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:20 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:14:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hwyFbtaV {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hwyFbtaV" returned: 0 in 0.022s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:20 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87e76b2-efa4-4f6a-8fff-93a9e6bfd420]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:20 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hwyFbtaV'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:14:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:20 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2697df7-889a-419d-8858-e8a359d67313]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:20 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:14:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:20 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[adaba0b2-f4f5-43c6-b586-23cc1bdcd4c7]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:20 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5 (non-flash)
Nov 29 16:14:20 user nova-compute[75245]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18 (non-flash)
Nov 29 16:14:20 user nova-compute[75245]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49 (non-flash)
Nov 29 16:14:20 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:14:20 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5 (non-flash)
Nov 29 16:14:20 user nova-compute[75245]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18 (non-flash)
Nov 29 16:14:20 user nova-compute[75245]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49 (non-flash)
Nov 29 16:14:20 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:14:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea -p 172.16.0.220:3260 --login {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:20 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[156cfdba-a2a3-4bf9-9d4a-5a108abbc8d8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:20 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea, portal: 172.16.0.220,3260]
Nov 29 16:14:20 user nova-compute[75245]: Login to [iface: default, target: iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea, portal: 172.16.0.220,3260] successful.
Nov 29 16:14:20 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:14:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:20 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d0151a-f870-4ce4-91f5-8c3078290ab2]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:20 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:14:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:20 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74218b9-982f-4116-a354-29cd8bedaeb5]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:20 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5 (non-flash)
Nov 29 16:14:20 user nova-compute[75245]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18 (non-flash)
Nov 29 16:14:20 user nova-compute[75245]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49 (non-flash)
Nov 29 16:14:20 user nova-compute[75245]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea (non-flash)
Nov 29 16:14:20 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:14:20 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5 (non-flash)
Nov 29 16:14:20 user nova-compute[75245]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18 (non-flash)
Nov 29 16:14:20 user nova-compute[75245]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49 (non-flash)
Nov 29 16:14:20 user nova-compute[75245]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea (non-flash)
Nov 29 16:14:20 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:14:20 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:14:20 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Connected to 172.16.0.220:3260 {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 16:14:20 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] HCTL ('36', '-', '-', 0) found on session 15 with lun 0 {{(pid=75245) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 16:14:20 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75245) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 16:14:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:20 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d3c080-fb6c-4086-8c5c-da914af6c127]: (4, ('- - 0', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:20 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Searching for a device in session 15 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75245) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 16:14:20 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hwyFbtaV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 16:14:21 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:14:21 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '26636623234623462', 'path': '/dev/sde'} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:14:21 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26636623234623462', 'path': '/dev/sde'} {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 16:14:21 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T16:13:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-619452740',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-619452740',id=14,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzzZJWR0Z42IfqvjNBvr3oJ/CWfYOwAc7EPalTBrhytgQ3UhVNR/2RB2aKKzUtCRCIeBQxJaqcrQf6PUVf0KtMurh9Aq+5WKkhWeX/26lsBtPUsQV556q2fdB3O2s3Q8A==',key_name='tempest-keypair-1957550448',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b8f45ede2eb64458870da9d0ca494178',ramdisk_id='',reservation_id='r-1h1cjd03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2077234721',owner_user_name='tempest-TaggedBootDevicesTest_v242-2077234721-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:13:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e9d4764cc9949bdb6fe3df0ca89daed',uuid=5f2a6f15-e413-47a2-be3e-961dd9ee7deb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e76a4989-a78d-47cf-8df0-b0b71180b60e", "address": "fa:16:3e:76:29:fe", "network": {"id": "0e5af197-7146-4691-9357-c6d470646e65", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1607694636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape76a4989-a7", "ovs_interfaceid": "e76a4989-a78d-47cf-8df0-b0b71180b60e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:14:21 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Converting VIF {"id": "e76a4989-a78d-47cf-8df0-b0b71180b60e", "address": "fa:16:3e:76:29:fe", "network": {"id": "0e5af197-7146-4691-9357-c6d470646e65", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1607694636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape76a4989-a7", "ovs_interfaceid": "e76a4989-a78d-47cf-8df0-b0b71180b60e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:14:21 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:29:fe,bridge_name='br-int',has_traffic_filtering=True,id=e76a4989-a78d-47cf-8df0-b0b71180b60e,network=Network(0e5af197-7146-4691-9357-c6d470646e65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape76a4989-a7') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:14:21 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T16:13:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-619452740',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-619452740',id=14,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzzZJWR0Z42IfqvjNBvr3oJ/CWfYOwAc7EPalTBrhytgQ3UhVNR/2RB2aKKzUtCRCIeBQxJaqcrQf6PUVf0KtMurh9Aq+5WKkhWeX/26lsBtPUsQV556q2fdB3O2s3Q8A==',key_name='tempest-keypair-1957550448',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b8f45ede2eb64458870da9d0ca494178',ramdisk_id='',reservation_id='r-1h1cjd03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2077234721',owner_user_name='tempest-TaggedBootDevicesTest_v242-2077234721-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:13:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e9d4764cc9949bdb6fe3df0ca89daed',uuid=5f2a6f15-e413-47a2-be3e-961dd9ee7deb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4dd25469-cfd1-468f-8fa3-a58c5613c96b", "address": "fa:16:3e:16:dd:65", "network": {"id": "33ed6d1c-906e-49c8-9731-a0d23f716434", "bridge": "br-int", "label": "tempest-device-tagging-net1-322196721", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dd25469-cf", "ovs_interfaceid": "4dd25469-cfd1-468f-8fa3-a58c5613c96b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:14:21 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Converting VIF {"id": "4dd25469-cfd1-468f-8fa3-a58c5613c96b", "address": "fa:16:3e:16:dd:65", "network": {"id": "33ed6d1c-906e-49c8-9731-a0d23f716434", "bridge": "br-int", "label": "tempest-device-tagging-net1-322196721", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dd25469-cf", "ovs_interfaceid": "4dd25469-cfd1-468f-8fa3-a58c5613c96b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:14:21 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:dd:65,bridge_name='br-int',has_traffic_filtering=True,id=4dd25469-cfd1-468f-8fa3-a58c5613c96b,network=Network(33ed6d1c-906e-49c8-9731-a0d23f716434),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4dd25469-cf') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:14:21 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T16:13:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-619452740',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-619452740',id=14,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzzZJWR0Z42IfqvjNBvr3oJ/CWfYOwAc7EPalTBrhytgQ3UhVNR/2RB2aKKzUtCRCIeBQxJaqcrQf6PUVf0KtMurh9Aq+5WKkhWeX/26lsBtPUsQV556q2fdB3O2s3Q8A==',key_name='tempest-keypair-1957550448',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b8f45ede2eb64458870da9d0ca494178',ramdisk_id='',reservation_id='r-1h1cjd03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2077234721',owner_user_name='tempest-TaggedBootDevicesTest_v242-2077234721-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:13:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e9d4764cc9949bdb6fe3df0ca89daed',uuid=5f2a6f15-e413-47a2-be3e-961dd9ee7deb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b6625ae-3097-4e56-bb72-3b67ff4996b6", "address": "fa:16:3e:be:8a:fe", "network": {"id": "33ed6d1c-906e-49c8-9731-a0d23f716434", "bridge": "br-int", "label": "tempest-device-tagging-net1-322196721", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b6625ae-30", "ovs_interfaceid": "7b6625ae-3097-4e56-bb72-3b67ff4996b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:14:21 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Converting VIF {"id": "7b6625ae-3097-4e56-bb72-3b67ff4996b6", "address": "fa:16:3e:be:8a:fe", "network": {"id": "33ed6d1c-906e-49c8-9731-a0d23f716434", "bridge": "br-int", "label": "tempest-device-tagging-net1-322196721", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b6625ae-30", "ovs_interfaceid": "7b6625ae-3097-4e56-bb72-3b67ff4996b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:14:21 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:8a:fe,bridge_name='br-int',has_traffic_filtering=True,id=7b6625ae-3097-4e56-bb72-3b67ff4996b6,network=Network(33ed6d1c-906e-49c8-9731-a0d23f716434),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7b6625ae-30') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:14:21 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T16:13:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-619452740',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-619452740',id=14,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzzZJWR0Z42IfqvjNBvr3oJ/CWfYOwAc7EPalTBrhytgQ3UhVNR/2RB2aKKzUtCRCIeBQxJaqcrQf6PUVf0KtMurh9Aq+5WKkhWeX/26lsBtPUsQV556q2fdB3O2s3Q8A==',key_name='tempest-keypair-1957550448',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b8f45ede2eb64458870da9d0ca494178',ramdisk_id='',reservation_id='r-1h1cjd03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2077234721',owner_user_name='tempest-TaggedBootDevicesTest_v242-2077234721-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:13:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e9d4764cc9949bdb6fe3df0ca89daed',uuid=5f2a6f15-e413-47a2-be3e-961dd9ee7deb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "10e71fa4-4f0d-420a-9ea3-502e0a1eb1f7", "address": "fa:16:3e:3a:e0:19", "network": {"id": "33ed6d1c-906e-49c8-9731-a0d23f716434", "bridge": "br-int", "label": "tempest-device-tagging-net1-322196721", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e71fa4-4f", "ovs_interfaceid": "10e71fa4-4f0d-420a-9ea3-502e0a1eb1f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:14:21 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Converting VIF {"id": "10e71fa4-4f0d-420a-9ea3-502e0a1eb1f7", "address": "fa:16:3e:3a:e0:19", "network": {"id": "33ed6d1c-906e-49c8-9731-a0d23f716434", "bridge": "br-int", "label": "tempest-device-tagging-net1-322196721", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e71fa4-4f", "ovs_interfaceid": "10e71fa4-4f0d-420a-9ea3-502e0a1eb1f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:14:21 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:e0:19,bridge_name='br-int',has_traffic_filtering=True,id=10e71fa4-4f0d-420a-9ea3-502e0a1eb1f7,network=Network(33ed6d1c-906e-49c8-9731-a0d23f716434),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10e71fa4-4f') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:14:21 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T16:13:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-619452740',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-619452740',id=14,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzzZJWR0Z42IfqvjNBvr3oJ/CWfYOwAc7EPalTBrhytgQ3UhVNR/2RB2aKKzUtCRCIeBQxJaqcrQf6PUVf0KtMurh9Aq+5WKkhWeX/26lsBtPUsQV556q2fdB3O2s3Q8A==',key_name='tempest-keypair-1957550448',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b8f45ede2eb64458870da9d0ca494178',ramdisk_id='',reservation_id='r-1h1cjd03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2077234721',owner_user_name='tempest-TaggedBootDevicesTest_v242-2077234721-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:13:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e9d4764cc9949bdb6fe3df0ca89daed',uuid=5f2a6f15-e413-47a2-be3e-961dd9ee7deb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "706111a2-b6f0-4311-ac82-a60a93fa2f51", "address": "fa:16:3e:db:77:11", "network": {"id": "33ed6d1c-906e-49c8-9731-a0d23f716434", "bridge": "br-int", "label": "tempest-device-tagging-net1-322196721", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap706111a2-b6", "ovs_interfaceid": "706111a2-b6f0-4311-ac82-a60a93fa2f51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:14:21 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Converting VIF {"id": "706111a2-b6f0-4311-ac82-a60a93fa2f51", "address": "fa:16:3e:db:77:11", "network": {"id": "33ed6d1c-906e-49c8-9731-a0d23f716434", "bridge": "br-int", "label": "tempest-device-tagging-net1-322196721", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap706111a2-b6", "ovs_interfaceid": "706111a2-b6f0-4311-ac82-a60a93fa2f51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:14:21 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:77:11,bridge_name='br-int',has_traffic_filtering=True,id=706111a2-b6f0-4311-ac82-a60a93fa2f51,network=Network(33ed6d1c-906e-49c8-9731-a0d23f716434),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap706111a2-b6') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:14:21 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T16:13:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-619452740',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-619452740',id=14,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzzZJWR0Z42IfqvjNBvr3oJ/CWfYOwAc7EPalTBrhytgQ3UhVNR/2RB2aKKzUtCRCIeBQxJaqcrQf6PUVf0KtMurh9Aq+5WKkhWeX/26lsBtPUsQV556q2fdB3O2s3Q8A==',key_name='tempest-keypair-1957550448',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b8f45ede2eb64458870da9d0ca494178',ramdisk_id='',reservation_id='r-1h1cjd03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2077234721',owner_user_name='tempest-TaggedBootDevicesTest_v242-2077234721-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:13:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e9d4764cc9949bdb6fe3df0ca89daed',uuid=5f2a6f15-e413-47a2-be3e-961dd9ee7deb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e39b868-de11-4bc1-b68a-11621bf7f057", "address": "fa:16:3e:44:89:16", "network": {"id": "c815e5db-bcac-4915-b581-63c2f697d2e5", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132953712", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e39b868-de", "ovs_interfaceid": "5e39b868-de11-4bc1-b68a-11621bf7f057", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:14:21 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Converting VIF {"id": "5e39b868-de11-4bc1-b68a-11621bf7f057", "address": "fa:16:3e:44:89:16", "network": {"id": "c815e5db-bcac-4915-b581-63c2f697d2e5", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132953712", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e39b868-de", "ovs_interfaceid": "5e39b868-de11-4bc1-b68a-11621bf7f057", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:14:21 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:89:16,bridge_name='br-int',has_traffic_filtering=True,id=5e39b868-de11-4bc1-b68a-11621bf7f057,network=Network(c815e5db-bcac-4915-b581-63c2f697d2e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e39b868-de') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:14:21 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T16:13:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-619452740',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-619452740',id=14,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzzZJWR0Z42IfqvjNBvr3oJ/CWfYOwAc7EPalTBrhytgQ3UhVNR/2RB2aKKzUtCRCIeBQxJaqcrQf6PUVf0KtMurh9Aq+5WKkhWeX/26lsBtPUsQV556q2fdB3O2s3Q8A==',key_name='tempest-keypair-1957550448',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b8f45ede2eb64458870da9d0ca494178',ramdisk_id='',reservation_id='r-1h1cjd03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2077234721',owner_user_name='tempest-TaggedBootDevicesTest_v242-2077234721-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:13:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e9d4764cc9949bdb6fe3df0ca89daed',uuid=5f2a6f15-e413-47a2-be3e-961dd9ee7deb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "52f4aecd-3b06-4a52-9541-b7bc96acf5d4", "address": "fa:16:3e:f9:b9:5f", "network": {"id": "c815e5db-bcac-4915-b581-63c2f697d2e5", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132953712", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52f4aecd-3b", "ovs_interfaceid": "52f4aecd-3b06-4a52-9541-b7bc96acf5d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:14:21 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Converting VIF {"id": "52f4aecd-3b06-4a52-9541-b7bc96acf5d4", "address": "fa:16:3e:f9:b9:5f", "network": {"id": "c815e5db-bcac-4915-b581-63c2f697d2e5", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132953712", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52f4aecd-3b", "ovs_interfaceid": "52f4aecd-3b06-4a52-9541-b7bc96acf5d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:14:21 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:b9:5f,bridge_name='br-int',has_traffic_filtering=True,id=52f4aecd-3b06-4a52-9541-b7bc96acf5d4,network=Network(c815e5db-bcac-4915-b581-63c2f697d2e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52f4aecd-3b') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:14:21 user nova-compute[75245]: DEBUG nova.objects.instance [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Lazy-loading 'pci_devices' on Instance uuid 5f2a6f15-e413-47a2-be3e-961dd9ee7deb {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:14:21 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] End _get_guest_xml xml=<domain type="kvm">
Nov 29 16:14:21 user nova-compute[75245]:   <uuid>5f2a6f15-e413-47a2-be3e-961dd9ee7deb</uuid>
Nov 29 16:14:21 user nova-compute[75245]:   <name>instance-0000000e</name>
Nov 29 16:14:21 user nova-compute[75245]:   <memory>524288</memory>
Nov 29 16:14:21 user nova-compute[75245]:   <vcpu>1</vcpu>
Nov 29 16:14:21 user nova-compute[75245]:   <metadata>
Nov 29 16:14:21 user nova-compute[75245]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 16:14:21 user nova-compute[75245]:       <nova:package version="0.0.0"/>
Nov 29 16:14:21 user nova-compute[75245]:       <nova:name>tempest-device-tagging-server-619452740</nova:name>
Nov 29 16:14:21 user nova-compute[75245]:       <nova:creationTime>2023-11-29 16:14:17</nova:creationTime>
Nov 29 16:14:21 user nova-compute[75245]:       <nova:flavor name="m1.tiny">
Nov 29 16:14:21 user nova-compute[75245]:         <nova:memory>512</nova:memory>
Nov 29 16:14:21 user nova-compute[75245]:         <nova:disk>1</nova:disk>
Nov 29 16:14:21 user nova-compute[75245]:         <nova:swap>0</nova:swap>
Nov 29 16:14:21 user nova-compute[75245]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 16:14:21 user nova-compute[75245]:         <nova:vcpus>1</nova:vcpus>
Nov 29 16:14:21 user nova-compute[75245]:       </nova:flavor>
Nov 29 16:14:21 user nova-compute[75245]:       <nova:owner>
Nov 29 16:14:21 user nova-compute[75245]:         <nova:user uuid="8e9d4764cc9949bdb6fe3df0ca89daed">tempest-TaggedBootDevicesTest_v242-2077234721-project-member</nova:user>
Nov 29 16:14:21 user nova-compute[75245]:         <nova:project uuid="b8f45ede2eb64458870da9d0ca494178">tempest-TaggedBootDevicesTest_v242-2077234721</nova:project>
Nov 29 16:14:21 user nova-compute[75245]:       </nova:owner>
Nov 29 16:14:21 user nova-compute[75245]:       <nova:root type="image" uuid="a291d9c3-be02-4c6c-9649-4b45c5b7f487"/>
Nov 29 16:14:21 user nova-compute[75245]:       <nova:ports>
Nov 29 16:14:21 user nova-compute[75245]:         <nova:port uuid="e76a4989-a78d-47cf-8df0-b0b71180b60e">
Nov 29 16:14:21 user nova-compute[75245]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 29 16:14:21 user nova-compute[75245]:         </nova:port>
Nov 29 16:14:21 user nova-compute[75245]:         <nova:port uuid="4dd25469-cfd1-468f-8fa3-a58c5613c96b">
Nov 29 16:14:21 user nova-compute[75245]:           <nova:ip type="fixed" address="10.1.1.91" ipVersion="4"/>
Nov 29 16:14:21 user nova-compute[75245]:         </nova:port>
Nov 29 16:14:21 user nova-compute[75245]:         <nova:port uuid="7b6625ae-3097-4e56-bb72-3b67ff4996b6">
Nov 29 16:14:21 user nova-compute[75245]:           <nova:ip type="fixed" address="10.1.1.201" ipVersion="4"/>
Nov 29 16:14:21 user nova-compute[75245]:         </nova:port>
Nov 29 16:14:21 user nova-compute[75245]:         <nova:port uuid="10e71fa4-4f0d-420a-9ea3-502e0a1eb1f7">
Nov 29 16:14:21 user nova-compute[75245]:           <nova:ip type="fixed" address="10.1.1.71" ipVersion="4"/>
Nov 29 16:14:21 user nova-compute[75245]:         </nova:port>
Nov 29 16:14:21 user nova-compute[75245]:         <nova:port uuid="706111a2-b6f0-4311-ac82-a60a93fa2f51">
Nov 29 16:14:21 user nova-compute[75245]:           <nova:ip type="fixed" address="10.1.1.132" ipVersion="4"/>
Nov 29 16:14:21 user nova-compute[75245]:         </nova:port>
Nov 29 16:14:21 user nova-compute[75245]:         <nova:port uuid="5e39b868-de11-4bc1-b68a-11621bf7f057">
Nov 29 16:14:21 user nova-compute[75245]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 29 16:14:21 user nova-compute[75245]:         </nova:port>
Nov 29 16:14:21 user nova-compute[75245]:         <nova:port uuid="52f4aecd-3b06-4a52-9541-b7bc96acf5d4">
Nov 29 16:14:21 user nova-compute[75245]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 29 16:14:21 user nova-compute[75245]:         </nova:port>
Nov 29 16:14:21 user nova-compute[75245]:       </nova:ports>
Nov 29 16:14:21 user nova-compute[75245]:     </nova:instance>
Nov 29 16:14:21 user nova-compute[75245]:   </metadata>
Nov 29 16:14:21 user nova-compute[75245]:   <sysinfo type="smbios">
Nov 29 16:14:21 user nova-compute[75245]:     <system>
Nov 29 16:14:21 user nova-compute[75245]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 16:14:21 user nova-compute[75245]:       <entry name="product">OpenStack Nova</entry>
Nov 29 16:14:21 user nova-compute[75245]:       <entry name="version">0.0.0</entry>
Nov 29 16:14:21 user nova-compute[75245]:       <entry name="serial">5f2a6f15-e413-47a2-be3e-961dd9ee7deb</entry>
Nov 29 16:14:21 user nova-compute[75245]:       <entry name="uuid">5f2a6f15-e413-47a2-be3e-961dd9ee7deb</entry>
Nov 29 16:14:21 user nova-compute[75245]:       <entry name="family">Virtual Machine</entry>
Nov 29 16:14:21 user nova-compute[75245]:     </system>
Nov 29 16:14:21 user nova-compute[75245]:   </sysinfo>
Nov 29 16:14:21 user nova-compute[75245]:   <os>
Nov 29 16:14:21 user nova-compute[75245]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 16:14:21 user nova-compute[75245]:     <boot dev="hd"/>
Nov 29 16:14:21 user nova-compute[75245]:     <smbios mode="sysinfo"/>
Nov 29 16:14:21 user nova-compute[75245]:   </os>
Nov 29 16:14:21 user nova-compute[75245]:   <features>
Nov 29 16:14:21 user nova-compute[75245]:     <acpi/>
Nov 29 16:14:21 user nova-compute[75245]:     <apic/>
Nov 29 16:14:21 user nova-compute[75245]:     <vmcoreinfo/>
Nov 29 16:14:21 user nova-compute[75245]:   </features>
Nov 29 16:14:21 user nova-compute[75245]:   <clock offset="utc">
Nov 29 16:14:21 user nova-compute[75245]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 16:14:21 user nova-compute[75245]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 16:14:21 user nova-compute[75245]:     <timer name="hpet" present="no"/>
Nov 29 16:14:21 user nova-compute[75245]:   </clock>
Nov 29 16:14:21 user nova-compute[75245]:   <cpu mode="custom" match="exact">
Nov 29 16:14:21 user nova-compute[75245]:     <model>Nehalem</model>
Nov 29 16:14:21 user nova-compute[75245]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 16:14:21 user nova-compute[75245]:   </cpu>
Nov 29 16:14:21 user nova-compute[75245]:   <devices>
Nov 29 16:14:21 user nova-compute[75245]:     <disk type="file" device="cdrom">
Nov 29 16:14:21 user nova-compute[75245]:       <driver name="qemu" type="raw" cache="none"/>
Nov 29 16:14:21 user nova-compute[75245]:       <source file="/opt/stack/data/nova/instances/5f2a6f15-e413-47a2-be3e-961dd9ee7deb/disk.config"/>
Nov 29 16:14:21 user nova-compute[75245]:       <target dev="hda" bus="ide"/>
Nov 29 16:14:21 user nova-compute[75245]:     </disk>
Nov 29 16:14:21 user nova-compute[75245]:     <disk type="block" device="disk">
Nov 29 16:14:21 user nova-compute[75245]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:14:21 user nova-compute[75245]:       <source dev="/dev/sdb"/>
Nov 29 16:14:21 user nova-compute[75245]:       <target dev="vda" bus="virtio"/>
Nov 29 16:14:21 user nova-compute[75245]:       <serial>021db3af-a7f2-4f6c-b702-35cec416ee18</serial>
Nov 29 16:14:21 user nova-compute[75245]:     </disk>
Nov 29 16:14:21 user nova-compute[75245]:     <disk type="block" device="disk">
Nov 29 16:14:21 user nova-compute[75245]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:14:21 user nova-compute[75245]:       <source dev="/dev/sdd"/>
Nov 29 16:14:21 user nova-compute[75245]:       <target dev="vdb" bus="virtio"/>
Nov 29 16:14:21 user nova-compute[75245]:       <serial>92465e1e-d975-4701-a213-bc8906dafc49</serial>
Nov 29 16:14:21 user nova-compute[75245]:     </disk>
Nov 29 16:14:21 user nova-compute[75245]:     <disk type="block" device="disk">
Nov 29 16:14:21 user nova-compute[75245]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:14:21 user nova-compute[75245]:       <source dev="/dev/sde"/>
Nov 29 16:14:21 user nova-compute[75245]:       <target dev="vdc" bus="virtio"/>
Nov 29 16:14:21 user nova-compute[75245]:       <serial>8a14d660-ebcc-4ad9-8cf9-e842d16bbfea</serial>
Nov 29 16:14:21 user nova-compute[75245]:     </disk>
Nov 29 16:14:21 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 16:14:21 user nova-compute[75245]:       <mac address="fa:16:3e:76:29:fe"/>
Nov 29 16:14:21 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:14:21 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 16:14:21 user nova-compute[75245]:       <target dev="tape76a4989-a7"/>
Nov 29 16:14:21 user nova-compute[75245]:     </interface>
Nov 29 16:14:21 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 16:14:21 user nova-compute[75245]:       <mac address="fa:16:3e:16:dd:65"/>
Nov 29 16:14:21 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:14:21 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 16:14:21 user nova-compute[75245]:       <target dev="tap4dd25469-cf"/>
Nov 29 16:14:21 user nova-compute[75245]:     </interface>
Nov 29 16:14:21 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 16:14:21 user nova-compute[75245]:       <mac address="fa:16:3e:be:8a:fe"/>
Nov 29 16:14:21 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:14:21 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 16:14:21 user nova-compute[75245]:       <target dev="tap7b6625ae-30"/>
Nov 29 16:14:21 user nova-compute[75245]:     </interface>
Nov 29 16:14:21 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 16:14:21 user nova-compute[75245]:       <mac address="fa:16:3e:3a:e0:19"/>
Nov 29 16:14:21 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:14:21 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 16:14:21 user nova-compute[75245]:       <target dev="tap10e71fa4-4f"/>
Nov 29 16:14:21 user nova-compute[75245]:     </interface>
Nov 29 16:14:21 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 16:14:21 user nova-compute[75245]:       <mac address="fa:16:3e:db:77:11"/>
Nov 29 16:14:21 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:14:21 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 16:14:21 user nova-compute[75245]:       <target dev="tap706111a2-b6"/>
Nov 29 16:14:21 user nova-compute[75245]:     </interface>
Nov 29 16:14:21 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 16:14:21 user nova-compute[75245]:       <mac address="fa:16:3e:44:89:16"/>
Nov 29 16:14:21 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:14:21 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 16:14:21 user nova-compute[75245]:       <target dev="tap5e39b868-de"/>
Nov 29 16:14:21 user nova-compute[75245]:     </interface>
Nov 29 16:14:21 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 16:14:21 user nova-compute[75245]:       <mac address="fa:16:3e:f9:b9:5f"/>
Nov 29 16:14:21 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:14:21 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 16:14:21 user nova-compute[75245]:       <target dev="tap52f4aecd-3b"/>
Nov 29 16:14:21 user nova-compute[75245]:     </interface>
Nov 29 16:14:21 user nova-compute[75245]:     <serial type="pty">
Nov 29 16:14:21 user nova-compute[75245]:       <log file="/opt/stack/data/nova/instances/5f2a6f15-e413-47a2-be3e-961dd9ee7deb/console.log" append="off"/>
Nov 29 16:14:21 user nova-compute[75245]:     </serial>
Nov 29 16:14:21 user nova-compute[75245]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 16:14:21 user nova-compute[75245]:     <video>
Nov 29 16:14:21 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:14:21 user nova-compute[75245]:     </video>
Nov 29 16:14:21 user nova-compute[75245]:     <rng model="virtio">
Nov 29 16:14:21 user nova-compute[75245]:       <backend model="random">/dev/urandom</backend>
Nov 29 16:14:21 user nova-compute[75245]:     </rng>
Nov 29 16:14:21 user nova-compute[75245]:     <controller type="usb" index="0" model="none"/>
Nov 29 16:14:21 user nova-compute[75245]:     <memballoon model="virtio">
Nov 29 16:14:21 user nova-compute[75245]:       <stats period="10"/>
Nov 29 16:14:21 user nova-compute[75245]:     </memballoon>
Nov 29 16:14:21 user nova-compute[75245]:   </devices>
Nov 29 16:14:21 user nova-compute[75245]: </domain>
Nov 29 16:14:21 user nova-compute[75245]:  {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 16:14:21 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T16:13:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-619452740',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-619452740',id=14,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzzZJWR0Z42IfqvjNBvr3oJ/CWfYOwAc7EPalTBrhytgQ3UhVNR/2RB2aKKzUtCRCIeBQxJaqcrQf6PUVf0KtMurh9Aq+5WKkhWeX/26lsBtPUsQV556q2fdB3O2s3Q8A==',key_name='tempest-keypair-1957550448',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b8f45ede2eb64458870da9d0ca494178',ramdisk_id='',reservation_id='r-1h1cjd03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2077234721',owner_user_name='tempest-TaggedBootDevicesTest_v242-2077234721-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:13:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e9d4764cc9949bdb6fe3df0ca89daed',uuid=5f2a6f15-e413-47a2-be3e-961dd9ee7deb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e76a4989-a78d-47cf-8df0-b0b71180b60e", "address": "fa:16:3e:76:29:fe", "network": {"id": "0e5af197-7146-4691-9357-c6d470646e65", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1607694636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape76a4989-a7", "ovs_interfaceid": "e76a4989-a78d-47cf-8df0-b0b71180b60e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 16:14:21 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Converting VIF {"id": "e76a4989-a78d-47cf-8df0-b0b71180b60e", "address": "fa:16:3e:76:29:fe", "network": {"id": "0e5af197-7146-4691-9357-c6d470646e65", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1607694636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape76a4989-a7", "ovs_interfaceid": "e76a4989-a78d-47cf-8df0-b0b71180b60e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:14:21 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:29:fe,bridge_name='br-int',has_traffic_filtering=True,id=e76a4989-a78d-47cf-8df0-b0b71180b60e,network=Network(0e5af197-7146-4691-9357-c6d470646e65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape76a4989-a7') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:14:21 user nova-compute[75245]: DEBUG os_vif [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:29:fe,bridge_name='br-int',has_traffic_filtering=True,id=e76a4989-a78d-47cf-8df0-b0b71180b60e,network=Network(0e5af197-7146-4691-9357-c6d470646e65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape76a4989-a7') {{(pid=75245) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 16:14:21 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:21 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:14:21 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 16:14:21 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:21 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f6b28a1e-58e9-5d52-8022-2e3662f308d4', '_type': 'linux-noop'}}, row=False) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:14:21 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:21 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:21 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:21 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape76a4989-a7, may_exist=True, interface_attrs={}) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:14:21 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape76a4989-a7, col_values=(('qos', UUID('bce521ae-8644-494b-af78-bf81b4318683')),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:14:21 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape76a4989-a7, col_values=(('external_ids', {'iface-id': 'e76a4989-a78d-47cf-8df0-b0b71180b60e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:29:fe', 'vm-uuid': '5f2a6f15-e413-47a2-be3e-961dd9ee7deb'}),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:14:21 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:21 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:14:21 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:21 user nova-compute[75245]: INFO os_vif [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:29:fe,bridge_name='br-int',has_traffic_filtering=True,id=e76a4989-a78d-47cf-8df0-b0b71180b60e,network=Network(0e5af197-7146-4691-9357-c6d470646e65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape76a4989-a7')
Nov 29 16:14:21 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T16:13:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-619452740',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-619452740',id=14,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzzZJWR0Z42IfqvjNBvr3oJ/CWfYOwAc7EPalTBrhytgQ3UhVNR/2RB2aKKzUtCRCIeBQxJaqcrQf6PUVf0KtMurh9Aq+5WKkhWeX/26lsBtPUsQV556q2fdB3O2s3Q8A==',key_name='tempest-keypair-1957550448',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b8f45ede2eb64458870da9d0ca494178',ramdisk_id='',reservation_id='r-1h1cjd03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2077234721',owner_user_name='tempest-TaggedBootDevicesTest_v242-2077234721-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:13:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e9d4764cc9949bdb6fe3df0ca89daed',uuid=5f2a6f15-e413-47a2-be3e-961dd9ee7deb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4dd25469-cfd1-468f-8fa3-a58c5613c96b", "address": "fa:16:3e:16:dd:65", "network": {"id": "33ed6d1c-906e-49c8-9731-a0d23f716434", "bridge": "br-int", "label": "tempest-device-tagging-net1-322196721", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dd25469-cf", "ovs_interfaceid": "4dd25469-cfd1-468f-8fa3-a58c5613c96b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75245) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 16:14:21 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Converting VIF {"id": "4dd25469-cfd1-468f-8fa3-a58c5613c96b", "address": "fa:16:3e:16:dd:65", "network": {"id": "33ed6d1c-906e-49c8-9731-a0d23f716434", "bridge": "br-int", "label": "tempest-device-tagging-net1-322196721", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dd25469-cf", "ovs_interfaceid": "4dd25469-cfd1-468f-8fa3-a58c5613c96b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:14:21 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:dd:65,bridge_name='br-int',has_traffic_filtering=True,id=4dd25469-cfd1-468f-8fa3-a58c5613c96b,network=Network(33ed6d1c-906e-49c8-9731-a0d23f716434),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4dd25469-cf') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:14:21 user nova-compute[75245]: DEBUG os_vif [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:dd:65,bridge_name='br-int',has_traffic_filtering=True,id=4dd25469-cfd1-468f-8fa3-a58c5613c96b,network=Network(33ed6d1c-906e-49c8-9731-a0d23f716434),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4dd25469-cf') {{(pid=75245) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 16:14:21 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:21 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:14:21 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 16:14:21 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:21 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '35a91719-fbcc-5d42-ab46-f1eb6b972b73', '_type': 'linux-noop'}}, row=False) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:14:21 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:21 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4dd25469-cf, may_exist=True, interface_attrs={}) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4dd25469-cf, col_values=(('qos', UUID('1dcf6c88-6be3-4f97-aaad-484e58c6b9d3')),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4dd25469-cf, col_values=(('external_ids', {'iface-id': '4dd25469-cfd1-468f-8fa3-a58c5613c96b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:dd:65', 'vm-uuid': '5f2a6f15-e413-47a2-be3e-961dd9ee7deb'}),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:22 user nova-compute[75245]: INFO os_vif [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:dd:65,bridge_name='br-int',has_traffic_filtering=True,id=4dd25469-cfd1-468f-8fa3-a58c5613c96b,network=Network(33ed6d1c-906e-49c8-9731-a0d23f716434),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4dd25469-cf')
Nov 29 16:14:22 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T16:13:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-619452740',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-619452740',id=14,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzzZJWR0Z42IfqvjNBvr3oJ/CWfYOwAc7EPalTBrhytgQ3UhVNR/2RB2aKKzUtCRCIeBQxJaqcrQf6PUVf0KtMurh9Aq+5WKkhWeX/26lsBtPUsQV556q2fdB3O2s3Q8A==',key_name='tempest-keypair-1957550448',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b8f45ede2eb64458870da9d0ca494178',ramdisk_id='',reservation_id='r-1h1cjd03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2077234721',owner_user_name='tempest-TaggedBootDevicesTest_v242-2077234721-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:13:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e9d4764cc9949bdb6fe3df0ca89daed',uuid=5f2a6f15-e413-47a2-be3e-961dd9ee7deb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b6625ae-3097-4e56-bb72-3b67ff4996b6", "address": "fa:16:3e:be:8a:fe", "network": {"id": "33ed6d1c-906e-49c8-9731-a0d23f716434", "bridge": "br-int", "label": "tempest-device-tagging-net1-322196721", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b6625ae-30", "ovs_interfaceid": "7b6625ae-3097-4e56-bb72-3b67ff4996b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75245) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Converting VIF {"id": "7b6625ae-3097-4e56-bb72-3b67ff4996b6", "address": "fa:16:3e:be:8a:fe", "network": {"id": "33ed6d1c-906e-49c8-9731-a0d23f716434", "bridge": "br-int", "label": "tempest-device-tagging-net1-322196721", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b6625ae-30", "ovs_interfaceid": "7b6625ae-3097-4e56-bb72-3b67ff4996b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:8a:fe,bridge_name='br-int',has_traffic_filtering=True,id=7b6625ae-3097-4e56-bb72-3b67ff4996b6,network=Network(33ed6d1c-906e-49c8-9731-a0d23f716434),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7b6625ae-30') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG os_vif [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:8a:fe,bridge_name='br-int',has_traffic_filtering=True,id=7b6625ae-3097-4e56-bb72-3b67ff4996b6,network=Network(33ed6d1c-906e-49c8-9731-a0d23f716434),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7b6625ae-30') {{(pid=75245) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '82ce82fe-7818-5721-86d5-85410ded0896', '_type': 'linux-noop'}}, row=False) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7b6625ae-30, may_exist=True, interface_attrs={}) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7b6625ae-30, col_values=(('qos', UUID('7fd917d9-9e3d-43bd-8584-b04958456c05')),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7b6625ae-30, col_values=(('external_ids', {'iface-id': '7b6625ae-3097-4e56-bb72-3b67ff4996b6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:8a:fe', 'vm-uuid': '5f2a6f15-e413-47a2-be3e-961dd9ee7deb'}),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:22 user nova-compute[75245]: INFO os_vif [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:8a:fe,bridge_name='br-int',has_traffic_filtering=True,id=7b6625ae-3097-4e56-bb72-3b67ff4996b6,network=Network(33ed6d1c-906e-49c8-9731-a0d23f716434),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7b6625ae-30')
Nov 29 16:14:22 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T16:13:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-619452740',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-619452740',id=14,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzzZJWR0Z42IfqvjNBvr3oJ/CWfYOwAc7EPalTBrhytgQ3UhVNR/2RB2aKKzUtCRCIeBQxJaqcrQf6PUVf0KtMurh9Aq+5WKkhWeX/26lsBtPUsQV556q2fdB3O2s3Q8A==',key_name='tempest-keypair-1957550448',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b8f45ede2eb64458870da9d0ca494178',ramdisk_id='',reservation_id='r-1h1cjd03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2077234721',owner_user_name='tempest-TaggedBootDevicesTest_v242-2077234721-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:13:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e9d4764cc9949bdb6fe3df0ca89daed',uuid=5f2a6f15-e413-47a2-be3e-961dd9ee7deb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "10e71fa4-4f0d-420a-9ea3-502e0a1eb1f7", "address": "fa:16:3e:3a:e0:19", "network": {"id": "33ed6d1c-906e-49c8-9731-a0d23f716434", "bridge": "br-int", "label": "tempest-device-tagging-net1-322196721", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e71fa4-4f", "ovs_interfaceid": "10e71fa4-4f0d-420a-9ea3-502e0a1eb1f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Converting VIF {"id": "10e71fa4-4f0d-420a-9ea3-502e0a1eb1f7", "address": "fa:16:3e:3a:e0:19", "network": {"id": "33ed6d1c-906e-49c8-9731-a0d23f716434", "bridge": "br-int", "label": "tempest-device-tagging-net1-322196721", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e71fa4-4f", "ovs_interfaceid": "10e71fa4-4f0d-420a-9ea3-502e0a1eb1f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:e0:19,bridge_name='br-int',has_traffic_filtering=True,id=10e71fa4-4f0d-420a-9ea3-502e0a1eb1f7,network=Network(33ed6d1c-906e-49c8-9731-a0d23f716434),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10e71fa4-4f') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG os_vif [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:e0:19,bridge_name='br-int',has_traffic_filtering=True,id=10e71fa4-4f0d-420a-9ea3-502e0a1eb1f7,network=Network(33ed6d1c-906e-49c8-9731-a0d23f716434),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10e71fa4-4f') {{(pid=75245) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '004739f3-25cc-5b7d-97c9-bb134de61944', '_type': 'linux-noop'}}, row=False) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap10e71fa4-4f, may_exist=True, interface_attrs={}) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap10e71fa4-4f, col_values=(('qos', UUID('efb37400-e26a-490c-b0c9-de96bcfe8504')),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap10e71fa4-4f, col_values=(('external_ids', {'iface-id': '10e71fa4-4f0d-420a-9ea3-502e0a1eb1f7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:e0:19', 'vm-uuid': '5f2a6f15-e413-47a2-be3e-961dd9ee7deb'}),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:22 user nova-compute[75245]: INFO os_vif [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:e0:19,bridge_name='br-int',has_traffic_filtering=True,id=10e71fa4-4f0d-420a-9ea3-502e0a1eb1f7,network=Network(33ed6d1c-906e-49c8-9731-a0d23f716434),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10e71fa4-4f')
Nov 29 16:14:22 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T16:13:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-619452740',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-619452740',id=14,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzzZJWR0Z42IfqvjNBvr3oJ/CWfYOwAc7EPalTBrhytgQ3UhVNR/2RB2aKKzUtCRCIeBQxJaqcrQf6PUVf0KtMurh9Aq+5WKkhWeX/26lsBtPUsQV556q2fdB3O2s3Q8A==',key_name='tempest-keypair-1957550448',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b8f45ede2eb64458870da9d0ca494178',ramdisk_id='',reservation_id='r-1h1cjd03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2077234721',owner_user_name='tempest-TaggedBootDevicesTest_v242-2077234721-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:13:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e9d4764cc9949bdb6fe3df0ca89daed',uuid=5f2a6f15-e413-47a2-be3e-961dd9ee7deb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "706111a2-b6f0-4311-ac82-a60a93fa2f51", "address": "fa:16:3e:db:77:11", "network": {"id": "33ed6d1c-906e-49c8-9731-a0d23f716434", "bridge": "br-int", "label": "tempest-device-tagging-net1-322196721", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap706111a2-b6", "ovs_interfaceid": "706111a2-b6f0-4311-ac82-a60a93fa2f51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Converting VIF {"id": "706111a2-b6f0-4311-ac82-a60a93fa2f51", "address": "fa:16:3e:db:77:11", "network": {"id": "33ed6d1c-906e-49c8-9731-a0d23f716434", "bridge": "br-int", "label": "tempest-device-tagging-net1-322196721", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap706111a2-b6", "ovs_interfaceid": "706111a2-b6f0-4311-ac82-a60a93fa2f51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:77:11,bridge_name='br-int',has_traffic_filtering=True,id=706111a2-b6f0-4311-ac82-a60a93fa2f51,network=Network(33ed6d1c-906e-49c8-9731-a0d23f716434),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap706111a2-b6') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG os_vif [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:77:11,bridge_name='br-int',has_traffic_filtering=True,id=706111a2-b6f0-4311-ac82-a60a93fa2f51,network=Network(33ed6d1c-906e-49c8-9731-a0d23f716434),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap706111a2-b6') {{(pid=75245) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '24fade14-2162-5866-b293-06f0772a7ad7', '_type': 'linux-noop'}}, row=False) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap706111a2-b6, may_exist=True, interface_attrs={}) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap706111a2-b6, col_values=(('qos', UUID('5b69d28e-2254-42f4-9b35-6b07e94a6c75')),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap706111a2-b6, col_values=(('external_ids', {'iface-id': '706111a2-b6f0-4311-ac82-a60a93fa2f51', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:77:11', 'vm-uuid': '5f2a6f15-e413-47a2-be3e-961dd9ee7deb'}),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:22 user nova-compute[75245]: INFO os_vif [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:77:11,bridge_name='br-int',has_traffic_filtering=True,id=706111a2-b6f0-4311-ac82-a60a93fa2f51,network=Network(33ed6d1c-906e-49c8-9731-a0d23f716434),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap706111a2-b6')
Nov 29 16:14:22 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T16:13:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-619452740',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-619452740',id=14,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzzZJWR0Z42IfqvjNBvr3oJ/CWfYOwAc7EPalTBrhytgQ3UhVNR/2RB2aKKzUtCRCIeBQxJaqcrQf6PUVf0KtMurh9Aq+5WKkhWeX/26lsBtPUsQV556q2fdB3O2s3Q8A==',key_name='tempest-keypair-1957550448',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b8f45ede2eb64458870da9d0ca494178',ramdisk_id='',reservation_id='r-1h1cjd03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2077234721',owner_user_name='tempest-TaggedBootDevicesTest_v242-2077234721-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:13:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e9d4764cc9949bdb6fe3df0ca89daed',uuid=5f2a6f15-e413-47a2-be3e-961dd9ee7deb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e39b868-de11-4bc1-b68a-11621bf7f057", "address": "fa:16:3e:44:89:16", "network": {"id": "c815e5db-bcac-4915-b581-63c2f697d2e5", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132953712", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e39b868-de", "ovs_interfaceid": "5e39b868-de11-4bc1-b68a-11621bf7f057", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Converting VIF {"id": "5e39b868-de11-4bc1-b68a-11621bf7f057", "address": "fa:16:3e:44:89:16", "network": {"id": "c815e5db-bcac-4915-b581-63c2f697d2e5", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132953712", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e39b868-de", "ovs_interfaceid": "5e39b868-de11-4bc1-b68a-11621bf7f057", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:89:16,bridge_name='br-int',has_traffic_filtering=True,id=5e39b868-de11-4bc1-b68a-11621bf7f057,network=Network(c815e5db-bcac-4915-b581-63c2f697d2e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e39b868-de') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG os_vif [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:89:16,bridge_name='br-int',has_traffic_filtering=True,id=5e39b868-de11-4bc1-b68a-11621bf7f057,network=Network(c815e5db-bcac-4915-b581-63c2f697d2e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e39b868-de') {{(pid=75245) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dfdf9486-c577-5ba6-9f23-0ca9af4a4b88', '_type': 'linux-noop'}}, row=False) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5e39b868-de, may_exist=True, interface_attrs={}) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5e39b868-de, col_values=(('qos', UUID('0db43f34-deda-4d1e-b3cc-44a5d9267412')),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5e39b868-de, col_values=(('external_ids', {'iface-id': '5e39b868-de11-4bc1-b68a-11621bf7f057', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:89:16', 'vm-uuid': '5f2a6f15-e413-47a2-be3e-961dd9ee7deb'}),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:22 user nova-compute[75245]: INFO os_vif [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:89:16,bridge_name='br-int',has_traffic_filtering=True,id=5e39b868-de11-4bc1-b68a-11621bf7f057,network=Network(c815e5db-bcac-4915-b581-63c2f697d2e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e39b868-de')
Nov 29 16:14:22 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T16:13:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-619452740',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-619452740',id=14,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzzZJWR0Z42IfqvjNBvr3oJ/CWfYOwAc7EPalTBrhytgQ3UhVNR/2RB2aKKzUtCRCIeBQxJaqcrQf6PUVf0KtMurh9Aq+5WKkhWeX/26lsBtPUsQV556q2fdB3O2s3Q8A==',key_name='tempest-keypair-1957550448',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b8f45ede2eb64458870da9d0ca494178',ramdisk_id='',reservation_id='r-1h1cjd03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2077234721',owner_user_name='tempest-TaggedBootDevicesTest_v242-2077234721-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:13:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e9d4764cc9949bdb6fe3df0ca89daed',uuid=5f2a6f15-e413-47a2-be3e-961dd9ee7deb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "52f4aecd-3b06-4a52-9541-b7bc96acf5d4", "address": "fa:16:3e:f9:b9:5f", "network": {"id": "c815e5db-bcac-4915-b581-63c2f697d2e5", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132953712", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52f4aecd-3b", "ovs_interfaceid": "52f4aecd-3b06-4a52-9541-b7bc96acf5d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Converting VIF {"id": "52f4aecd-3b06-4a52-9541-b7bc96acf5d4", "address": "fa:16:3e:f9:b9:5f", "network": {"id": "c815e5db-bcac-4915-b581-63c2f697d2e5", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132953712", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52f4aecd-3b", "ovs_interfaceid": "52f4aecd-3b06-4a52-9541-b7bc96acf5d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:b9:5f,bridge_name='br-int',has_traffic_filtering=True,id=52f4aecd-3b06-4a52-9541-b7bc96acf5d4,network=Network(c815e5db-bcac-4915-b581-63c2f697d2e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52f4aecd-3b') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG os_vif [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:b9:5f,bridge_name='br-int',has_traffic_filtering=True,id=52f4aecd-3b06-4a52-9541-b7bc96acf5d4,network=Network(c815e5db-bcac-4915-b581-63c2f697d2e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52f4aecd-3b') {{(pid=75245) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f7919325-3bdd-5933-b283-ca21f0c09186', '_type': 'linux-noop'}}, row=False) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap52f4aecd-3b, may_exist=True, interface_attrs={}) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap52f4aecd-3b, col_values=(('qos', UUID('9d536792-041e-4837-9d2a-bc5770560c9a')),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap52f4aecd-3b, col_values=(('external_ids', {'iface-id': '52f4aecd-3b06-4a52-9541-b7bc96acf5d4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:b9:5f', 'vm-uuid': '5f2a6f15-e413-47a2-be3e-961dd9ee7deb'}),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:22 user nova-compute[75245]: INFO os_vif [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:b9:5f,bridge_name='br-int',has_traffic_filtering=True,id=52f4aecd-3b06-4a52-9541-b7bc96acf5d4,network=Network(c815e5db-bcac-4915-b581-63c2f697d2e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52f4aecd-3b')
Nov 29 16:14:22 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] No BDM found with device name hda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] No VIF found with MAC fa:16:3e:76:29:fe, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] No VIF found with MAC fa:16:3e:db:77:11, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:14:22 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Using config drive
Nov 29 16:14:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:22 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Creating config drive at /opt/stack/data/nova/instances/5f2a6f15-e413-47a2-be3e-961dd9ee7deb/disk.config
Nov 29 16:14:22 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5f2a6f15-e413-47a2-be3e-961dd9ee7deb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmppu7tuvic {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:22 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5f2a6f15-e413-47a2-be3e-961dd9ee7deb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmppu7tuvic" returned: 0 in 0.079s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:24 user nova-compute[75245]: DEBUG nova.compute.manager [req-06527a87-a791-476d-a685-d94aa495b1cb req-6536d9a0-bc4b-4ffc-bf7f-b3ddcf1a4bc3 service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Received event network-vif-plugged-e76a4989-a78d-47cf-8df0-b0b71180b60e {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:14:24 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-06527a87-a791-476d-a685-d94aa495b1cb req-6536d9a0-bc4b-4ffc-bf7f-b3ddcf1a4bc3 service nova] Acquiring lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:14:24 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-06527a87-a791-476d-a685-d94aa495b1cb req-6536d9a0-bc4b-4ffc-bf7f-b3ddcf1a4bc3 service nova] Lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:14:24 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-06527a87-a791-476d-a685-d94aa495b1cb req-6536d9a0-bc4b-4ffc-bf7f-b3ddcf1a4bc3 service nova] Lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:14:24 user nova-compute[75245]: DEBUG nova.compute.manager [req-06527a87-a791-476d-a685-d94aa495b1cb req-6536d9a0-bc4b-4ffc-bf7f-b3ddcf1a4bc3 service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] No waiting events found dispatching network-vif-plugged-e76a4989-a78d-47cf-8df0-b0b71180b60e {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:14:24 user nova-compute[75245]: WARNING nova.compute.manager [req-06527a87-a791-476d-a685-d94aa495b1cb req-6536d9a0-bc4b-4ffc-bf7f-b3ddcf1a4bc3 service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Received unexpected event network-vif-plugged-e76a4989-a78d-47cf-8df0-b0b71180b60e for instance with vm_state building and task_state spawning.
Nov 29 16:14:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:25 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:25 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:25 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:25 user nova-compute[75245]: DEBUG nova.compute.manager [req-43c0b813-a530-4f55-bfd5-393b737e73b5 req-fa3a0d08-bc92-403e-be95-6171ed9807bd service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Received event network-vif-plugged-4dd25469-cfd1-468f-8fa3-a58c5613c96b {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:14:25 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-43c0b813-a530-4f55-bfd5-393b737e73b5 req-fa3a0d08-bc92-403e-be95-6171ed9807bd service nova] Acquiring lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:14:25 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-43c0b813-a530-4f55-bfd5-393b737e73b5 req-fa3a0d08-bc92-403e-be95-6171ed9807bd service nova] Lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:14:25 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-43c0b813-a530-4f55-bfd5-393b737e73b5 req-fa3a0d08-bc92-403e-be95-6171ed9807bd service nova] Lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:14:25 user nova-compute[75245]: DEBUG nova.compute.manager [req-43c0b813-a530-4f55-bfd5-393b737e73b5 req-fa3a0d08-bc92-403e-be95-6171ed9807bd service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] No waiting events found dispatching network-vif-plugged-4dd25469-cfd1-468f-8fa3-a58c5613c96b {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:14:25 user nova-compute[75245]: WARNING nova.compute.manager [req-43c0b813-a530-4f55-bfd5-393b737e73b5 req-fa3a0d08-bc92-403e-be95-6171ed9807bd service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Received unexpected event network-vif-plugged-4dd25469-cfd1-468f-8fa3-a58c5613c96b for instance with vm_state building and task_state spawning.
Nov 29 16:14:25 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:25 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:25 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:25 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:25 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:25 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:25 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:25 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:25 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:26 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:26 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:26 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:26 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:26 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:26 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:26 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:26 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:26 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:26 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:26 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:26 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:26 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:26 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:26 user nova-compute[75245]: DEBUG nova.compute.manager [req-a95e05a6-9be1-4dba-99fe-29d5e53a603f req-a2a6c0bb-93c7-4ec0-979f-4524533c4fde service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Received event network-vif-plugged-e76a4989-a78d-47cf-8df0-b0b71180b60e {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:14:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a95e05a6-9be1-4dba-99fe-29d5e53a603f req-a2a6c0bb-93c7-4ec0-979f-4524533c4fde service nova] Acquiring lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:14:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a95e05a6-9be1-4dba-99fe-29d5e53a603f req-a2a6c0bb-93c7-4ec0-979f-4524533c4fde service nova] Lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:14:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a95e05a6-9be1-4dba-99fe-29d5e53a603f req-a2a6c0bb-93c7-4ec0-979f-4524533c4fde service nova] Lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:14:26 user nova-compute[75245]: DEBUG nova.compute.manager [req-a95e05a6-9be1-4dba-99fe-29d5e53a603f req-a2a6c0bb-93c7-4ec0-979f-4524533c4fde service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] No waiting events found dispatching network-vif-plugged-e76a4989-a78d-47cf-8df0-b0b71180b60e {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:14:26 user nova-compute[75245]: WARNING nova.compute.manager [req-a95e05a6-9be1-4dba-99fe-29d5e53a603f req-a2a6c0bb-93c7-4ec0-979f-4524533c4fde service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Received unexpected event network-vif-plugged-e76a4989-a78d-47cf-8df0-b0b71180b60e for instance with vm_state building and task_state spawning.
Nov 29 16:14:26 user nova-compute[75245]: DEBUG nova.compute.manager [req-a95e05a6-9be1-4dba-99fe-29d5e53a603f req-a2a6c0bb-93c7-4ec0-979f-4524533c4fde service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Received event network-vif-plugged-10e71fa4-4f0d-420a-9ea3-502e0a1eb1f7 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:14:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a95e05a6-9be1-4dba-99fe-29d5e53a603f req-a2a6c0bb-93c7-4ec0-979f-4524533c4fde service nova] Acquiring lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:14:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a95e05a6-9be1-4dba-99fe-29d5e53a603f req-a2a6c0bb-93c7-4ec0-979f-4524533c4fde service nova] Lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:14:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a95e05a6-9be1-4dba-99fe-29d5e53a603f req-a2a6c0bb-93c7-4ec0-979f-4524533c4fde service nova] Lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:14:26 user nova-compute[75245]: DEBUG nova.compute.manager [req-a95e05a6-9be1-4dba-99fe-29d5e53a603f req-a2a6c0bb-93c7-4ec0-979f-4524533c4fde service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] No waiting events found dispatching network-vif-plugged-10e71fa4-4f0d-420a-9ea3-502e0a1eb1f7 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:14:26 user nova-compute[75245]: WARNING nova.compute.manager [req-a95e05a6-9be1-4dba-99fe-29d5e53a603f req-a2a6c0bb-93c7-4ec0-979f-4524533c4fde service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Received unexpected event network-vif-plugged-10e71fa4-4f0d-420a-9ea3-502e0a1eb1f7 for instance with vm_state building and task_state spawning.
Nov 29 16:14:26 user nova-compute[75245]: DEBUG nova.compute.manager [req-a95e05a6-9be1-4dba-99fe-29d5e53a603f req-a2a6c0bb-93c7-4ec0-979f-4524533c4fde service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Received event network-vif-plugged-10e71fa4-4f0d-420a-9ea3-502e0a1eb1f7 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:14:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a95e05a6-9be1-4dba-99fe-29d5e53a603f req-a2a6c0bb-93c7-4ec0-979f-4524533c4fde service nova] Acquiring lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:14:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a95e05a6-9be1-4dba-99fe-29d5e53a603f req-a2a6c0bb-93c7-4ec0-979f-4524533c4fde service nova] Lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:14:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a95e05a6-9be1-4dba-99fe-29d5e53a603f req-a2a6c0bb-93c7-4ec0-979f-4524533c4fde service nova] Lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:14:26 user nova-compute[75245]: DEBUG nova.compute.manager [req-a95e05a6-9be1-4dba-99fe-29d5e53a603f req-a2a6c0bb-93c7-4ec0-979f-4524533c4fde service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] No waiting events found dispatching network-vif-plugged-10e71fa4-4f0d-420a-9ea3-502e0a1eb1f7 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:14:26 user nova-compute[75245]: WARNING nova.compute.manager [req-a95e05a6-9be1-4dba-99fe-29d5e53a603f req-a2a6c0bb-93c7-4ec0-979f-4524533c4fde service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Received unexpected event network-vif-plugged-10e71fa4-4f0d-420a-9ea3-502e0a1eb1f7 for instance with vm_state building and task_state spawning.
Nov 29 16:14:26 user nova-compute[75245]: DEBUG nova.compute.manager [req-a95e05a6-9be1-4dba-99fe-29d5e53a603f req-a2a6c0bb-93c7-4ec0-979f-4524533c4fde service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Received event network-vif-plugged-706111a2-b6f0-4311-ac82-a60a93fa2f51 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:14:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a95e05a6-9be1-4dba-99fe-29d5e53a603f req-a2a6c0bb-93c7-4ec0-979f-4524533c4fde service nova] Acquiring lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:14:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a95e05a6-9be1-4dba-99fe-29d5e53a603f req-a2a6c0bb-93c7-4ec0-979f-4524533c4fde service nova] Lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:14:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a95e05a6-9be1-4dba-99fe-29d5e53a603f req-a2a6c0bb-93c7-4ec0-979f-4524533c4fde service nova] Lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:14:26 user nova-compute[75245]: DEBUG nova.compute.manager [req-a95e05a6-9be1-4dba-99fe-29d5e53a603f req-a2a6c0bb-93c7-4ec0-979f-4524533c4fde service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] No waiting events found dispatching network-vif-plugged-706111a2-b6f0-4311-ac82-a60a93fa2f51 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:14:26 user nova-compute[75245]: WARNING nova.compute.manager [req-a95e05a6-9be1-4dba-99fe-29d5e53a603f req-a2a6c0bb-93c7-4ec0-979f-4524533c4fde service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Received unexpected event network-vif-plugged-706111a2-b6f0-4311-ac82-a60a93fa2f51 for instance with vm_state building and task_state spawning.
Nov 29 16:14:26 user nova-compute[75245]: DEBUG nova.compute.manager [req-a95e05a6-9be1-4dba-99fe-29d5e53a603f req-a2a6c0bb-93c7-4ec0-979f-4524533c4fde service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Received event network-vif-plugged-706111a2-b6f0-4311-ac82-a60a93fa2f51 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:14:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a95e05a6-9be1-4dba-99fe-29d5e53a603f req-a2a6c0bb-93c7-4ec0-979f-4524533c4fde service nova] Acquiring lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:14:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a95e05a6-9be1-4dba-99fe-29d5e53a603f req-a2a6c0bb-93c7-4ec0-979f-4524533c4fde service nova] Lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:14:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a95e05a6-9be1-4dba-99fe-29d5e53a603f req-a2a6c0bb-93c7-4ec0-979f-4524533c4fde service nova] Lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:14:26 user nova-compute[75245]: DEBUG nova.compute.manager [req-a95e05a6-9be1-4dba-99fe-29d5e53a603f req-a2a6c0bb-93c7-4ec0-979f-4524533c4fde service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] No waiting events found dispatching network-vif-plugged-706111a2-b6f0-4311-ac82-a60a93fa2f51 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:14:26 user nova-compute[75245]: WARNING nova.compute.manager [req-a95e05a6-9be1-4dba-99fe-29d5e53a603f req-a2a6c0bb-93c7-4ec0-979f-4524533c4fde service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Received unexpected event network-vif-plugged-706111a2-b6f0-4311-ac82-a60a93fa2f51 for instance with vm_state building and task_state spawning.
Nov 29 16:14:26 user nova-compute[75245]: DEBUG nova.compute.manager [req-a95e05a6-9be1-4dba-99fe-29d5e53a603f req-a2a6c0bb-93c7-4ec0-979f-4524533c4fde service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Received event network-vif-plugged-5e39b868-de11-4bc1-b68a-11621bf7f057 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:14:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a95e05a6-9be1-4dba-99fe-29d5e53a603f req-a2a6c0bb-93c7-4ec0-979f-4524533c4fde service nova] Acquiring lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:14:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a95e05a6-9be1-4dba-99fe-29d5e53a603f req-a2a6c0bb-93c7-4ec0-979f-4524533c4fde service nova] Lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:14:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a95e05a6-9be1-4dba-99fe-29d5e53a603f req-a2a6c0bb-93c7-4ec0-979f-4524533c4fde service nova] Lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:14:26 user nova-compute[75245]: DEBUG nova.compute.manager [req-a95e05a6-9be1-4dba-99fe-29d5e53a603f req-a2a6c0bb-93c7-4ec0-979f-4524533c4fde service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] No waiting events found dispatching network-vif-plugged-5e39b868-de11-4bc1-b68a-11621bf7f057 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:14:26 user nova-compute[75245]: WARNING nova.compute.manager [req-a95e05a6-9be1-4dba-99fe-29d5e53a603f req-a2a6c0bb-93c7-4ec0-979f-4524533c4fde service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Received unexpected event network-vif-plugged-5e39b868-de11-4bc1-b68a-11621bf7f057 for instance with vm_state building and task_state spawning.
Nov 29 16:14:27 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:27 user nova-compute[75245]: DEBUG nova.compute.manager [req-454afabc-8233-4a92-8b87-bbb64a248fde req-ac2f7ec0-a8c0-44c8-bd22-9117ff9bb5ce service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Received event network-vif-plugged-4dd25469-cfd1-468f-8fa3-a58c5613c96b {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:14:27 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-454afabc-8233-4a92-8b87-bbb64a248fde req-ac2f7ec0-a8c0-44c8-bd22-9117ff9bb5ce service nova] Acquiring lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:14:27 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-454afabc-8233-4a92-8b87-bbb64a248fde req-ac2f7ec0-a8c0-44c8-bd22-9117ff9bb5ce service nova] Lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:14:27 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-454afabc-8233-4a92-8b87-bbb64a248fde req-ac2f7ec0-a8c0-44c8-bd22-9117ff9bb5ce service nova] Lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:14:27 user nova-compute[75245]: DEBUG nova.compute.manager [req-454afabc-8233-4a92-8b87-bbb64a248fde req-ac2f7ec0-a8c0-44c8-bd22-9117ff9bb5ce service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] No waiting events found dispatching network-vif-plugged-4dd25469-cfd1-468f-8fa3-a58c5613c96b {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:14:27 user nova-compute[75245]: WARNING nova.compute.manager [req-454afabc-8233-4a92-8b87-bbb64a248fde req-ac2f7ec0-a8c0-44c8-bd22-9117ff9bb5ce service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Received unexpected event network-vif-plugged-4dd25469-cfd1-468f-8fa3-a58c5613c96b for instance with vm_state building and task_state spawning.
Nov 29 16:14:27 user nova-compute[75245]: DEBUG nova.compute.manager [req-454afabc-8233-4a92-8b87-bbb64a248fde req-ac2f7ec0-a8c0-44c8-bd22-9117ff9bb5ce service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Received event network-vif-plugged-7b6625ae-3097-4e56-bb72-3b67ff4996b6 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:14:27 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-454afabc-8233-4a92-8b87-bbb64a248fde req-ac2f7ec0-a8c0-44c8-bd22-9117ff9bb5ce service nova] Acquiring lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:14:27 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-454afabc-8233-4a92-8b87-bbb64a248fde req-ac2f7ec0-a8c0-44c8-bd22-9117ff9bb5ce service nova] Lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:14:27 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-454afabc-8233-4a92-8b87-bbb64a248fde req-ac2f7ec0-a8c0-44c8-bd22-9117ff9bb5ce service nova] Lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:14:27 user nova-compute[75245]: DEBUG nova.compute.manager [req-454afabc-8233-4a92-8b87-bbb64a248fde req-ac2f7ec0-a8c0-44c8-bd22-9117ff9bb5ce service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] No waiting events found dispatching network-vif-plugged-7b6625ae-3097-4e56-bb72-3b67ff4996b6 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:14:27 user nova-compute[75245]: WARNING nova.compute.manager [req-454afabc-8233-4a92-8b87-bbb64a248fde req-ac2f7ec0-a8c0-44c8-bd22-9117ff9bb5ce service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Received unexpected event network-vif-plugged-7b6625ae-3097-4e56-bb72-3b67ff4996b6 for instance with vm_state building and task_state spawning.
Nov 29 16:14:27 user nova-compute[75245]: DEBUG nova.compute.manager [req-454afabc-8233-4a92-8b87-bbb64a248fde req-ac2f7ec0-a8c0-44c8-bd22-9117ff9bb5ce service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Received event network-vif-plugged-7b6625ae-3097-4e56-bb72-3b67ff4996b6 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:14:27 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-454afabc-8233-4a92-8b87-bbb64a248fde req-ac2f7ec0-a8c0-44c8-bd22-9117ff9bb5ce service nova] Acquiring lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:14:27 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-454afabc-8233-4a92-8b87-bbb64a248fde req-ac2f7ec0-a8c0-44c8-bd22-9117ff9bb5ce service nova] Lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:14:27 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-454afabc-8233-4a92-8b87-bbb64a248fde req-ac2f7ec0-a8c0-44c8-bd22-9117ff9bb5ce service nova] Lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:14:27 user nova-compute[75245]: DEBUG nova.compute.manager [req-454afabc-8233-4a92-8b87-bbb64a248fde req-ac2f7ec0-a8c0-44c8-bd22-9117ff9bb5ce service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] No waiting events found dispatching network-vif-plugged-7b6625ae-3097-4e56-bb72-3b67ff4996b6 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:14:27 user nova-compute[75245]: WARNING nova.compute.manager [req-454afabc-8233-4a92-8b87-bbb64a248fde req-ac2f7ec0-a8c0-44c8-bd22-9117ff9bb5ce service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Received unexpected event network-vif-plugged-7b6625ae-3097-4e56-bb72-3b67ff4996b6 for instance with vm_state building and task_state spawning.
Nov 29 16:14:27 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:27 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:27 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:27 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:28 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Acquiring lock "95b96d09-b9df-4e92-a141-f044078e4ce1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:14:28 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Lock "95b96d09-b9df-4e92-a141-f044078e4ce1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:14:28 user nova-compute[75245]: DEBUG nova.compute.manager [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Starting instance... {{(pid=75245) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 16:14:28 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:14:28 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:14:28 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75245) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 16:14:28 user nova-compute[75245]: INFO nova.compute.claims [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Claim successful on node user
Nov 29 16:14:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:28 user nova-compute[75245]: DEBUG nova.compute.manager [req-b77fb0fe-f016-4702-914d-73a4e0a840ae req-51add2cc-c7f9-442a-b511-616d3921c8ed service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Received event network-vif-plugged-5e39b868-de11-4bc1-b68a-11621bf7f057 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:14:28 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b77fb0fe-f016-4702-914d-73a4e0a840ae req-51add2cc-c7f9-442a-b511-616d3921c8ed service nova] Acquiring lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:14:28 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b77fb0fe-f016-4702-914d-73a4e0a840ae req-51add2cc-c7f9-442a-b511-616d3921c8ed service nova] Lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:14:28 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b77fb0fe-f016-4702-914d-73a4e0a840ae req-51add2cc-c7f9-442a-b511-616d3921c8ed service nova] Lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:14:28 user nova-compute[75245]: DEBUG nova.compute.manager [req-b77fb0fe-f016-4702-914d-73a4e0a840ae req-51add2cc-c7f9-442a-b511-616d3921c8ed service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] No waiting events found dispatching network-vif-plugged-5e39b868-de11-4bc1-b68a-11621bf7f057 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:14:28 user nova-compute[75245]: WARNING nova.compute.manager [req-b77fb0fe-f016-4702-914d-73a4e0a840ae req-51add2cc-c7f9-442a-b511-616d3921c8ed service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Received unexpected event network-vif-plugged-5e39b868-de11-4bc1-b68a-11621bf7f057 for instance with vm_state building and task_state spawning.
Nov 29 16:14:28 user nova-compute[75245]: DEBUG nova.compute.manager [req-b77fb0fe-f016-4702-914d-73a4e0a840ae req-51add2cc-c7f9-442a-b511-616d3921c8ed service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Received event network-vif-plugged-52f4aecd-3b06-4a52-9541-b7bc96acf5d4 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:14:28 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b77fb0fe-f016-4702-914d-73a4e0a840ae req-51add2cc-c7f9-442a-b511-616d3921c8ed service nova] Acquiring lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:14:28 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b77fb0fe-f016-4702-914d-73a4e0a840ae req-51add2cc-c7f9-442a-b511-616d3921c8ed service nova] Lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:14:28 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b77fb0fe-f016-4702-914d-73a4e0a840ae req-51add2cc-c7f9-442a-b511-616d3921c8ed service nova] Lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:14:28 user nova-compute[75245]: DEBUG nova.compute.manager [req-b77fb0fe-f016-4702-914d-73a4e0a840ae req-51add2cc-c7f9-442a-b511-616d3921c8ed service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] No waiting events found dispatching network-vif-plugged-52f4aecd-3b06-4a52-9541-b7bc96acf5d4 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:14:28 user nova-compute[75245]: WARNING nova.compute.manager [req-b77fb0fe-f016-4702-914d-73a4e0a840ae req-51add2cc-c7f9-442a-b511-616d3921c8ed service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Received unexpected event network-vif-plugged-52f4aecd-3b06-4a52-9541-b7bc96acf5d4 for instance with vm_state building and task_state spawning.
Nov 29 16:14:28 user nova-compute[75245]: DEBUG nova.compute.manager [req-b77fb0fe-f016-4702-914d-73a4e0a840ae req-51add2cc-c7f9-442a-b511-616d3921c8ed service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Received event network-vif-plugged-52f4aecd-3b06-4a52-9541-b7bc96acf5d4 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:14:28 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b77fb0fe-f016-4702-914d-73a4e0a840ae req-51add2cc-c7f9-442a-b511-616d3921c8ed service nova] Acquiring lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:14:28 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b77fb0fe-f016-4702-914d-73a4e0a840ae req-51add2cc-c7f9-442a-b511-616d3921c8ed service nova] Lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:14:28 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b77fb0fe-f016-4702-914d-73a4e0a840ae req-51add2cc-c7f9-442a-b511-616d3921c8ed service nova] Lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:14:28 user nova-compute[75245]: DEBUG nova.compute.manager [req-b77fb0fe-f016-4702-914d-73a4e0a840ae req-51add2cc-c7f9-442a-b511-616d3921c8ed service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] No waiting events found dispatching network-vif-plugged-52f4aecd-3b06-4a52-9541-b7bc96acf5d4 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:14:28 user nova-compute[75245]: WARNING nova.compute.manager [req-b77fb0fe-f016-4702-914d-73a4e0a840ae req-51add2cc-c7f9-442a-b511-616d3921c8ed service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Received unexpected event network-vif-plugged-52f4aecd-3b06-4a52-9541-b7bc96acf5d4 for instance with vm_state building and task_state spawning.
Nov 29 16:14:29 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:14:29 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:14:29 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.519s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:14:29 user nova-compute[75245]: DEBUG nova.compute.manager [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Start building networks asynchronously for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 16:14:29 user nova-compute[75245]: DEBUG nova.compute.manager [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Allocating IP information in the background. {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 16:14:29 user nova-compute[75245]: DEBUG nova.network.neutron [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] allocate_for_instance() {{(pid=75245) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 16:14:29 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 16:14:29 user nova-compute[75245]: DEBUG nova.compute.manager [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Start building block device mappings for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 16:14:29 user nova-compute[75245]: DEBUG nova.policy [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f6753af2ac6a40d98a2e2ecf8a56c73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd0053203ae489cb4bd097d7815b4e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75245) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 16:14:29 user nova-compute[75245]: INFO nova.virt.block_device [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Booting with volume f2d1dade-8389-4b92-bdd5-e4eeb4df7026 at /dev/vda
Nov 29 16:14:29 user nova-compute[75245]: DEBUG nova.compute.manager [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Instance event wait completed in 0 seconds for  {{(pid=75245) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 16:14:29 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Guest created on hypervisor {{(pid=75245) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 16:14:29 user nova-compute[75245]: DEBUG os_brick.utils [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:14:29 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:29 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Instance spawned successfully.
Nov 29 16:14:29 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 16:14:29 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:29 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[9972dc5d-1337-4cfc-b528-d9cd8cadc77f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:69ed8ed87091\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:29 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:29 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:29 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa30be11-7262-434e-a97e-234e2f0865ad]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:29 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:29 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Found default for hw_cdrom_bus of ide {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:14:29 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Found default for hw_disk_bus of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:14:29 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Found default for hw_input_bus of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:14:29 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Found default for hw_pointer_model of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:14:29 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Found default for hw_video_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:14:29 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Found default for hw_vif_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:14:30 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:30 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[f94ff9f1-02fa-4c51-9eea-fadebe8a21ee]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:30 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e9449f-6027-4c5d-9316-31fa4665cddc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:30 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Running cmd (subprocess): nvme version {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:30 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] 'nvme version' failed. Not Retrying. {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:14:30 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] nvme not present on system {{(pid=75245) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 16:14:30 user nova-compute[75245]: INFO nova.compute.manager [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Took 12.79 seconds to spawn the instance on the hypervisor.
Nov 29 16:14:30 user nova-compute[75245]: DEBUG nova.compute.manager [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:14:30 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:30 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:14:30 user nova-compute[75245]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 16:14:30 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[f021e39a-a7df-4190-8711-fc72dbcd10f6]: (4, '') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:30 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75245) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 16:14:30 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 16:14:30 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] LIGHTOS: no hostnqn found. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 16:14:30 user nova-compute[75245]: DEBUG os_brick.utils [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] <== get_connector_properties: return (662ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:69ed8ed87091', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:14:30 user nova-compute[75245]: DEBUG nova.virt.block_device [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Updating existing volume attachment record: e88cd2d6-5a40-4635-be60-33ce7ac62bfa {{(pid=75245) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 16:14:30 user nova-compute[75245]: INFO nova.compute.manager [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Took 52.64 seconds to build instance.
Nov 29 16:14:30 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2dfdb34e-3dd7-4f46-aae6-58945710d4b1 tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 52.816s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:14:30 user nova-compute[75245]: DEBUG nova.network.neutron [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Successfully created port: 35705f85-434c-481c-be8f-6182fda15267 {{(pid=75245) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 16:14:31 user nova-compute[75245]: DEBUG nova.network.neutron [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Successfully updated port: 35705f85-434c-481c-be8f-6182fda15267 {{(pid=75245) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 16:14:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Acquiring lock "refresh_cache-95b96d09-b9df-4e92-a141-f044078e4ce1" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:14:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Acquired lock "refresh_cache-95b96d09-b9df-4e92-a141-f044078e4ce1" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:14:31 user nova-compute[75245]: DEBUG nova.network.neutron [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 16:14:31 user nova-compute[75245]: DEBUG nova.compute.manager [req-4c442845-f7e0-4e38-995b-3d9d7cc03f3f req-1cf8bcc0-147e-4582-be03-7a5c394d665c service nova] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Received event network-changed-35705f85-434c-481c-be8f-6182fda15267 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:14:31 user nova-compute[75245]: DEBUG nova.compute.manager [req-4c442845-f7e0-4e38-995b-3d9d7cc03f3f req-1cf8bcc0-147e-4582-be03-7a5c394d665c service nova] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Refreshing instance network info cache due to event network-changed-35705f85-434c-481c-be8f-6182fda15267. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:14:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-4c442845-f7e0-4e38-995b-3d9d7cc03f3f req-1cf8bcc0-147e-4582-be03-7a5c394d665c service nova] Acquiring lock "refresh_cache-95b96d09-b9df-4e92-a141-f044078e4ce1" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:14:31 user nova-compute[75245]: DEBUG nova.network.neutron [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Instance cache missing network info. {{(pid=75245) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 16:14:32 user nova-compute[75245]: DEBUG nova.network.neutron [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Updating instance_info_cache with network_info: [{"id": "35705f85-434c-481c-be8f-6182fda15267", "address": "fa:16:3e:64:70:89", "network": {"id": "3e4157dc-b9ba-40de-a00e-6f4c9a3c089b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-448760355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cd0053203ae489cb4bd097d7815b4e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35705f85-43", "ovs_interfaceid": "35705f85-434c-481c-be8f-6182fda15267", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:14:32 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Releasing lock "refresh_cache-95b96d09-b9df-4e92-a141-f044078e4ce1" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:14:32 user nova-compute[75245]: DEBUG nova.compute.manager [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Instance network_info: |[{"id": "35705f85-434c-481c-be8f-6182fda15267", "address": "fa:16:3e:64:70:89", "network": {"id": "3e4157dc-b9ba-40de-a00e-6f4c9a3c089b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-448760355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cd0053203ae489cb4bd097d7815b4e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35705f85-43", "ovs_interfaceid": "35705f85-434c-481c-be8f-6182fda15267", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 16:14:32 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-4c442845-f7e0-4e38-995b-3d9d7cc03f3f req-1cf8bcc0-147e-4582-be03-7a5c394d665c service nova] Acquired lock "refresh_cache-95b96d09-b9df-4e92-a141-f044078e4ce1" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:14:32 user nova-compute[75245]: DEBUG nova.network.neutron [req-4c442845-f7e0-4e38-995b-3d9d7cc03f3f req-1cf8bcc0-147e-4582-be03-7a5c394d665c service nova] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Refreshing network info cache for port 35705f85-434c-481c-be8f-6182fda15267 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:14:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:32 user nova-compute[75245]: DEBUG nova.network.neutron [req-4c442845-f7e0-4e38-995b-3d9d7cc03f3f req-1cf8bcc0-147e-4582-be03-7a5c394d665c service nova] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Updated VIF entry in instance network info cache for port 35705f85-434c-481c-be8f-6182fda15267. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:14:32 user nova-compute[75245]: DEBUG nova.network.neutron [req-4c442845-f7e0-4e38-995b-3d9d7cc03f3f req-1cf8bcc0-147e-4582-be03-7a5c394d665c service nova] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Updating instance_info_cache with network_info: [{"id": "35705f85-434c-481c-be8f-6182fda15267", "address": "fa:16:3e:64:70:89", "network": {"id": "3e4157dc-b9ba-40de-a00e-6f4c9a3c089b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-448760355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cd0053203ae489cb4bd097d7815b4e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35705f85-43", "ovs_interfaceid": "35705f85-434c-481c-be8f-6182fda15267", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:14:32 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-4c442845-f7e0-4e38-995b-3d9d7cc03f3f req-1cf8bcc0-147e-4582-be03-7a5c394d665c service nova] Releasing lock "refresh_cache-95b96d09-b9df-4e92-a141-f044078e4ce1" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:14:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:35 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:37 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:37 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:38 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:39 user nova-compute[75245]: DEBUG nova.compute.manager [req-18347170-a17f-4123-ae06-0f273effdcbb req-e1bb63c4-c980-4e95-adbf-d3cf43a9a7fb service nova] [instance: fd819060-4388-444d-809e-94f6b2e8f102] Received event network-changed-e11ba0cd-c449-4b18-a32e-41d267535482 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:14:39 user nova-compute[75245]: DEBUG nova.compute.manager [req-18347170-a17f-4123-ae06-0f273effdcbb req-e1bb63c4-c980-4e95-adbf-d3cf43a9a7fb service nova] [instance: fd819060-4388-444d-809e-94f6b2e8f102] Refreshing instance network info cache due to event network-changed-e11ba0cd-c449-4b18-a32e-41d267535482. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:14:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-18347170-a17f-4123-ae06-0f273effdcbb req-e1bb63c4-c980-4e95-adbf-d3cf43a9a7fb service nova] Acquiring lock "refresh_cache-fd819060-4388-444d-809e-94f6b2e8f102" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:14:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-18347170-a17f-4123-ae06-0f273effdcbb req-e1bb63c4-c980-4e95-adbf-d3cf43a9a7fb service nova] Acquired lock "refresh_cache-fd819060-4388-444d-809e-94f6b2e8f102" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:14:39 user nova-compute[75245]: DEBUG nova.network.neutron [req-18347170-a17f-4123-ae06-0f273effdcbb req-e1bb63c4-c980-4e95-adbf-d3cf43a9a7fb service nova] [instance: fd819060-4388-444d-809e-94f6b2e8f102] Refreshing network info cache for port e11ba0cd-c449-4b18-a32e-41d267535482 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:14:40 user nova-compute[75245]: DEBUG nova.network.neutron [req-18347170-a17f-4123-ae06-0f273effdcbb req-e1bb63c4-c980-4e95-adbf-d3cf43a9a7fb service nova] [instance: fd819060-4388-444d-809e-94f6b2e8f102] Updated VIF entry in instance network info cache for port e11ba0cd-c449-4b18-a32e-41d267535482. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:14:40 user nova-compute[75245]: DEBUG nova.network.neutron [req-18347170-a17f-4123-ae06-0f273effdcbb req-e1bb63c4-c980-4e95-adbf-d3cf43a9a7fb service nova] [instance: fd819060-4388-444d-809e-94f6b2e8f102] Updating instance_info_cache with network_info: [{"id": "e11ba0cd-c449-4b18-a32e-41d267535482", "address": "fa:16:3e:a4:25:65", "network": {"id": "11119178-094d-4c14-8eea-233947dddfe4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1660525559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0009bdf2ef8f43a59341dd6eea441b02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape11ba0cd-c4", "ovs_interfaceid": "e11ba0cd-c449-4b18-a32e-41d267535482", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:14:40 user nova-compute[75245]: DEBUG nova.compute.manager [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Start spawning the instance on the hypervisor. {{(pid=75245) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 16:14:40 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Creating instance directory {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 16:14:40 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Creating image(s)
Nov 29 16:14:40 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Did not create local disks {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 16:14:40 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Ensure instance console log exists: /opt/stack/data/nova/instances/95b96d09-b9df-4e92-a141-f044078e4ce1/console.log {{(pid=75245) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 16:14:40 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:14:40 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:14:40 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:14:40 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Start _get_guest_xml network_info=[{"id": "35705f85-434c-481c-be8f-6182fda15267", "address": "fa:16:3e:64:70:89", "network": {"id": "3e4157dc-b9ba-40de-a00e-6f4c9a3c089b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-448760355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cd0053203ae489cb4bd097d7815b4e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35705f85-43", "ovs_interfaceid": "35705f85-434c-481c-be8f-6182fda15267", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': 'e88cd2d6-5a40-4635-be60-33ce7ac62bfa', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GHLbXqeE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '95b96d09-b9df-4e92-a141-f044078e4ce1', 'attached_at': '', 'detached_at': '', 'volume_id': 'f2d1dade-8389-4b92-bdd5-e4eeb4df7026', 'serial': 'f2d1dade-8389-4b92-bdd5-e4eeb4df7026'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'guest_format': None, 'volume_type': None} {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 16:14:40 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-18347170-a17f-4123-ae06-0f273effdcbb req-e1bb63c4-c980-4e95-adbf-d3cf43a9a7fb service nova] Releasing lock "refresh_cache-fd819060-4388-444d-809e-94f6b2e8f102" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:14:40 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:14:40 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:14:40 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 16:14:40 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] CPU controller missing on host. {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 16:14:40 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 16:14:40 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] CPU controller found on host. {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 16:14:40 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75245) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 16:14:40 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T16:06:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 16:14:40 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Flavor limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 16:14:40 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Image limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 16:14:40 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Flavor pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 16:14:40 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Image pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 16:14:40 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 16:14:40 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 16:14:40 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 16:14:40 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Got 1 possible topologies {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 16:14:40 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 16:14:40 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 16:14:40 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Calling os-brick to attach iSCSI Volume {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 16:14:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GHLbXqeE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:14:40 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:14:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:14:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:14:40 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:14:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:14:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:14:40 user nova-compute[75245]: INFO os_brick.initiator.connectors.iscsi [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 16:14:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 -p 172.16.0.220:3260 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:40 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[4840cd8b-7ba4-4923-982c-402a6a8f24f3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 16:14:40 user nova-compute[75245]:  {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:14:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 -p 172.16.0.220:3260 --interface default --op new {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:40 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b67f264-98ff-4e41-92b9-7f533fd42819]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026] added\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026] added
Nov 29 16:14:40 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:14:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.061s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:40 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6746c03-e3d8-4c6e-8a4f-4ddd55875040]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:14:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:40 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-f72da685-fa34-4030-8013-a67d94d44123 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Acquiring lock "fd819060-4388-444d-809e-94f6b2e8f102" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:14:40 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-f72da685-fa34-4030-8013-a67d94d44123 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Lock "fd819060-4388-444d-809e-94f6b2e8f102" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:14:40 user nova-compute[75245]: DEBUG nova.objects.instance [None req-f72da685-fa34-4030-8013-a67d94d44123 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Lazy-loading 'flavor' on Instance uuid fd819060-4388-444d-809e-94f6b2e8f102 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:14:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.039s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:40 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e21b95-e05b-46a3-96f4-37c110c09ff3]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:14:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GHLbXqeE {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GHLbXqeE" returned: 0 in 0.025s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:40 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b6e765-0166-42e3-ab73-8e8e5132c892]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GHLbXqeE'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:14:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:40 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-f72da685-fa34-4030-8013-a67d94d44123 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Lock "fd819060-4388-444d-809e-94f6b2e8f102" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.082s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:14:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:40 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb80562-4df1-4b47-bacb-94203cd05afc]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:14:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:40 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[657ca1ce-5954-4e07-8ac7-fff73b2f23e4]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9c6c84-adbe-4ae5-b0b4-e9e697fc6cfe (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5 (non-flash)
Nov 29 16:14:40 user nova-compute[75245]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18 (non-flash)
Nov 29 16:14:40 user nova-compute[75245]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49 (non-flash)
Nov 29 16:14:40 user nova-compute[75245]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea (non-flash)
Nov 29 16:14:40 user nova-compute[75245]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9c6c84-adbe-4ae5-b0b4-e9e697fc6cfe (non-flash)
Nov 29 16:14:40 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:14:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5 (non-flash)
Nov 29 16:14:40 user nova-compute[75245]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18 (non-flash)
Nov 29 16:14:40 user nova-compute[75245]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49 (non-flash)
Nov 29 16:14:40 user nova-compute[75245]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea (non-flash)
Nov 29 16:14:40 user nova-compute[75245]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9c6c84-adbe-4ae5-b0b4-e9e697fc6cfe (non-flash)
Nov 29 16:14:40 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:14:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 -p 172.16.0.220:3260 --login {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:40 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4057fbb-683b-4376-bcef-01ff482d8671]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026, portal: 172.16.0.220,3260]
Nov 29 16:14:40 user nova-compute[75245]: Login to [iface: default, target: iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026, portal: 172.16.0.220,3260] successful.
Nov 29 16:14:40 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:14:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.033s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:40 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[a867ad87-c845-40e8-98c2-dbf6d1f4147e]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:14:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:41 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:41 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ee86fb-adf7-4f9f-acc5-f9ec8ef6257e]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9c6c84-adbe-4ae5-b0b4-e9e697fc6cfe (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:41 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5 (non-flash)
Nov 29 16:14:41 user nova-compute[75245]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18 (non-flash)
Nov 29 16:14:41 user nova-compute[75245]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49 (non-flash)
Nov 29 16:14:41 user nova-compute[75245]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea (non-flash)
Nov 29 16:14:41 user nova-compute[75245]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9c6c84-adbe-4ae5-b0b4-e9e697fc6cfe (non-flash)
Nov 29 16:14:41 user nova-compute[75245]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 (non-flash)
Nov 29 16:14:41 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:14:41 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5 (non-flash)
Nov 29 16:14:41 user nova-compute[75245]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18 (non-flash)
Nov 29 16:14:41 user nova-compute[75245]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49 (non-flash)
Nov 29 16:14:41 user nova-compute[75245]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea (non-flash)
Nov 29 16:14:41 user nova-compute[75245]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9c6c84-adbe-4ae5-b0b4-e9e697fc6cfe (non-flash)
Nov 29 16:14:41 user nova-compute[75245]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 (non-flash)
Nov 29 16:14:41 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:14:41 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.587s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:14:41 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Connected to 172.16.0.220:3260 {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 16:14:41 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] HCTL ('38', '-', '-', 0) found on session 17 with lun 0 {{(pid=75245) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 16:14:41 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75245) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 16:14:41 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:41 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:41 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea92010a-0e20-4f83-bc37-797b2bc6b637]: (4, ('- - 0', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:41 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Searching for a device in session 17 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75245) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 16:14:41 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GHLbXqeE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 16:14:41 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-f72da685-fa34-4030-8013-a67d94d44123 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Acquiring lock "fd819060-4388-444d-809e-94f6b2e8f102" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:14:41 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-f72da685-fa34-4030-8013-a67d94d44123 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Lock "fd819060-4388-444d-809e-94f6b2e8f102" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:14:41 user nova-compute[75245]: INFO nova.compute.manager [None req-f72da685-fa34-4030-8013-a67d94d44123 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] [instance: fd819060-4388-444d-809e-94f6b2e8f102] Attaching volume 6756bb27-a338-4643-9c32-aa6a83de210f to /dev/vdb
Nov 29 16:14:41 user nova-compute[75245]: DEBUG os_brick.utils [None req-f72da685-fa34-4030-8013-a67d94d44123 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:14:41 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:41 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:41 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[5302aacd-cda1-4532-bfa1-b409fa194067]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:69ed8ed87091\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:41 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:41 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:41 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[b145079a-d2a5-49c9-955f-a27f3c3223a4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:41 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:41 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:41 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c1e593-a961-4363-b528-0c09af65c743]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:41 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[df827d8d-3f87-4288-8631-281ae961737c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:41 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-f72da685-fa34-4030-8013-a67d94d44123 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Running cmd (subprocess): nvme version {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:41 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-f72da685-fa34-4030-8013-a67d94d44123 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] 'nvme version' failed. Not Retrying. {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:14:41 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f72da685-fa34-4030-8013-a67d94d44123 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] nvme not present on system {{(pid=75245) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 16:14:41 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:41 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:14:41 user nova-compute[75245]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 16:14:41 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ed2bfd-af24-42fc-a572-a692fe45e591]: (4, '') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:41 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-f72da685-fa34-4030-8013-a67d94d44123 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75245) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 16:14:41 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-f72da685-fa34-4030-8013-a67d94d44123 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 16:14:41 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-f72da685-fa34-4030-8013-a67d94d44123 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] LIGHTOS: no hostnqn found. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 16:14:41 user nova-compute[75245]: DEBUG os_brick.utils [None req-f72da685-fa34-4030-8013-a67d94d44123 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] <== get_connector_properties: return (161ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:69ed8ed87091', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:14:41 user nova-compute[75245]: DEBUG nova.virt.block_device [None req-f72da685-fa34-4030-8013-a67d94d44123 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] [instance: fd819060-4388-444d-809e-94f6b2e8f102] Updating existing volume attachment record: 6cd610ac-b6df-4145-95a8-2d1fee6dffe5 {{(pid=75245) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 16:14:42 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.661s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:14:42 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] <== connect_volume: return (1662ms) {'type': 'block', 'scsi_wwn': '26336616239643538', 'path': '/dev/sdg'} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:14:42 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26336616239643538', 'path': '/dev/sdg'} {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 16:14:42 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:14:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1148731204',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1148731204',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHlR5MzIPbCau2nJtv2utk0O1W1k0aEGcfbcv1sh7yMNFDLP7hs7yhHF8D8CRcgmIp1z1EERmv0wTgIEJhrbP+HwDUzTtl9AyFgANaK56wESe9DOxRAA657EmdA7oyz8OQ==',key_name='tempest-keypair-1816958253',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7cd0053203ae489cb4bd097d7815b4e5',ramdisk_id='',reservation_id='r-if6royoq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-2087197629',owner_user_name='tempest-ServerActionsV293TestJSON-2087197629-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:14:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6753af2ac6a40d98a2e2ecf8a56c73c',uuid=95b96d09-b9df-4e92-a141-f044078e4ce1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "35705f85-434c-481c-be8f-6182fda15267", "address": "fa:16:3e:64:70:89", "network": {"id": "3e4157dc-b9ba-40de-a00e-6f4c9a3c089b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-448760355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cd0053203ae489cb4bd097d7815b4e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35705f85-43", "ovs_interfaceid": "35705f85-434c-481c-be8f-6182fda15267", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:14:42 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Converting VIF {"id": "35705f85-434c-481c-be8f-6182fda15267", "address": "fa:16:3e:64:70:89", "network": {"id": "3e4157dc-b9ba-40de-a00e-6f4c9a3c089b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-448760355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cd0053203ae489cb4bd097d7815b4e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35705f85-43", "ovs_interfaceid": "35705f85-434c-481c-be8f-6182fda15267", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:14:42 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:70:89,bridge_name='br-int',has_traffic_filtering=True,id=35705f85-434c-481c-be8f-6182fda15267,network=Network(3e4157dc-b9ba-40de-a00e-6f4c9a3c089b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35705f85-43') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:14:42 user nova-compute[75245]: DEBUG nova.objects.instance [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Lazy-loading 'pci_devices' on Instance uuid 95b96d09-b9df-4e92-a141-f044078e4ce1 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:14:42 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] End _get_guest_xml xml=<domain type="kvm">
Nov 29 16:14:42 user nova-compute[75245]:   <uuid>95b96d09-b9df-4e92-a141-f044078e4ce1</uuid>
Nov 29 16:14:42 user nova-compute[75245]:   <name>instance-00000010</name>
Nov 29 16:14:42 user nova-compute[75245]:   <memory>524288</memory>
Nov 29 16:14:42 user nova-compute[75245]:   <vcpu>1</vcpu>
Nov 29 16:14:42 user nova-compute[75245]:   <metadata>
Nov 29 16:14:42 user nova-compute[75245]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 16:14:42 user nova-compute[75245]:       <nova:package version="0.0.0"/>
Nov 29 16:14:42 user nova-compute[75245]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1148731204</nova:name>
Nov 29 16:14:42 user nova-compute[75245]:       <nova:creationTime>2023-11-29 16:14:40</nova:creationTime>
Nov 29 16:14:42 user nova-compute[75245]:       <nova:flavor name="m1.tiny">
Nov 29 16:14:42 user nova-compute[75245]:         <nova:memory>512</nova:memory>
Nov 29 16:14:42 user nova-compute[75245]:         <nova:disk>1</nova:disk>
Nov 29 16:14:42 user nova-compute[75245]:         <nova:swap>0</nova:swap>
Nov 29 16:14:42 user nova-compute[75245]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 16:14:42 user nova-compute[75245]:         <nova:vcpus>1</nova:vcpus>
Nov 29 16:14:42 user nova-compute[75245]:       </nova:flavor>
Nov 29 16:14:42 user nova-compute[75245]:       <nova:owner>
Nov 29 16:14:42 user nova-compute[75245]:         <nova:user uuid="f6753af2ac6a40d98a2e2ecf8a56c73c">tempest-ServerActionsV293TestJSON-2087197629-project-member</nova:user>
Nov 29 16:14:42 user nova-compute[75245]:         <nova:project uuid="7cd0053203ae489cb4bd097d7815b4e5">tempest-ServerActionsV293TestJSON-2087197629</nova:project>
Nov 29 16:14:42 user nova-compute[75245]:       </nova:owner>
Nov 29 16:14:42 user nova-compute[75245]:       <nova:ports>
Nov 29 16:14:42 user nova-compute[75245]:         <nova:port uuid="35705f85-434c-481c-be8f-6182fda15267">
Nov 29 16:14:42 user nova-compute[75245]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 29 16:14:42 user nova-compute[75245]:         </nova:port>
Nov 29 16:14:42 user nova-compute[75245]:       </nova:ports>
Nov 29 16:14:42 user nova-compute[75245]:     </nova:instance>
Nov 29 16:14:42 user nova-compute[75245]:   </metadata>
Nov 29 16:14:42 user nova-compute[75245]:   <sysinfo type="smbios">
Nov 29 16:14:42 user nova-compute[75245]:     <system>
Nov 29 16:14:42 user nova-compute[75245]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 16:14:42 user nova-compute[75245]:       <entry name="product">OpenStack Nova</entry>
Nov 29 16:14:42 user nova-compute[75245]:       <entry name="version">0.0.0</entry>
Nov 29 16:14:42 user nova-compute[75245]:       <entry name="serial">95b96d09-b9df-4e92-a141-f044078e4ce1</entry>
Nov 29 16:14:42 user nova-compute[75245]:       <entry name="uuid">95b96d09-b9df-4e92-a141-f044078e4ce1</entry>
Nov 29 16:14:42 user nova-compute[75245]:       <entry name="family">Virtual Machine</entry>
Nov 29 16:14:42 user nova-compute[75245]:     </system>
Nov 29 16:14:42 user nova-compute[75245]:   </sysinfo>
Nov 29 16:14:42 user nova-compute[75245]:   <os>
Nov 29 16:14:42 user nova-compute[75245]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 16:14:42 user nova-compute[75245]:     <boot dev="hd"/>
Nov 29 16:14:42 user nova-compute[75245]:     <smbios mode="sysinfo"/>
Nov 29 16:14:42 user nova-compute[75245]:   </os>
Nov 29 16:14:42 user nova-compute[75245]:   <features>
Nov 29 16:14:42 user nova-compute[75245]:     <acpi/>
Nov 29 16:14:42 user nova-compute[75245]:     <apic/>
Nov 29 16:14:42 user nova-compute[75245]:     <vmcoreinfo/>
Nov 29 16:14:42 user nova-compute[75245]:   </features>
Nov 29 16:14:42 user nova-compute[75245]:   <clock offset="utc">
Nov 29 16:14:42 user nova-compute[75245]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 16:14:42 user nova-compute[75245]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 16:14:42 user nova-compute[75245]:     <timer name="hpet" present="no"/>
Nov 29 16:14:42 user nova-compute[75245]:   </clock>
Nov 29 16:14:42 user nova-compute[75245]:   <cpu mode="custom" match="exact">
Nov 29 16:14:42 user nova-compute[75245]:     <model>Nehalem</model>
Nov 29 16:14:42 user nova-compute[75245]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 16:14:42 user nova-compute[75245]:   </cpu>
Nov 29 16:14:42 user nova-compute[75245]:   <devices>
Nov 29 16:14:42 user nova-compute[75245]:     <disk type="block" device="disk">
Nov 29 16:14:42 user nova-compute[75245]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:14:42 user nova-compute[75245]:       <source dev="/dev/sdg"/>
Nov 29 16:14:42 user nova-compute[75245]:       <target dev="vda" bus="virtio"/>
Nov 29 16:14:42 user nova-compute[75245]:       <serial>f2d1dade-8389-4b92-bdd5-e4eeb4df7026</serial>
Nov 29 16:14:42 user nova-compute[75245]:     </disk>
Nov 29 16:14:42 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 16:14:42 user nova-compute[75245]:       <mac address="fa:16:3e:64:70:89"/>
Nov 29 16:14:42 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:14:42 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 16:14:42 user nova-compute[75245]:       <target dev="tap35705f85-43"/>
Nov 29 16:14:42 user nova-compute[75245]:     </interface>
Nov 29 16:14:42 user nova-compute[75245]:     <serial type="pty">
Nov 29 16:14:42 user nova-compute[75245]:       <log file="/opt/stack/data/nova/instances/95b96d09-b9df-4e92-a141-f044078e4ce1/console.log" append="off"/>
Nov 29 16:14:42 user nova-compute[75245]:     </serial>
Nov 29 16:14:42 user nova-compute[75245]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 16:14:42 user nova-compute[75245]:     <video>
Nov 29 16:14:42 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:14:42 user nova-compute[75245]:     </video>
Nov 29 16:14:42 user nova-compute[75245]:     <rng model="virtio">
Nov 29 16:14:42 user nova-compute[75245]:       <backend model="random">/dev/urandom</backend>
Nov 29 16:14:42 user nova-compute[75245]:     </rng>
Nov 29 16:14:42 user nova-compute[75245]:     <controller type="usb" index="0" model="none"/>
Nov 29 16:14:42 user nova-compute[75245]:     <memballoon model="virtio">
Nov 29 16:14:42 user nova-compute[75245]:       <stats period="10"/>
Nov 29 16:14:42 user nova-compute[75245]:     </memballoon>
Nov 29 16:14:42 user nova-compute[75245]:   </devices>
Nov 29 16:14:42 user nova-compute[75245]: </domain>
Nov 29 16:14:42 user nova-compute[75245]:  {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 16:14:42 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:14:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1148731204',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1148731204',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHlR5MzIPbCau2nJtv2utk0O1W1k0aEGcfbcv1sh7yMNFDLP7hs7yhHF8D8CRcgmIp1z1EERmv0wTgIEJhrbP+HwDUzTtl9AyFgANaK56wESe9DOxRAA657EmdA7oyz8OQ==',key_name='tempest-keypair-1816958253',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7cd0053203ae489cb4bd097d7815b4e5',ramdisk_id='',reservation_id='r-if6royoq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-2087197629',owner_user_name='tempest-ServerActionsV293TestJSON-2087197629-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:14:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6753af2ac6a40d98a2e2ecf8a56c73c',uuid=95b96d09-b9df-4e92-a141-f044078e4ce1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "35705f85-434c-481c-be8f-6182fda15267", "address": "fa:16:3e:64:70:89", "network": {"id": "3e4157dc-b9ba-40de-a00e-6f4c9a3c089b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-448760355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cd0053203ae489cb4bd097d7815b4e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35705f85-43", "ovs_interfaceid": "35705f85-434c-481c-be8f-6182fda15267", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 16:14:42 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Converting VIF {"id": "35705f85-434c-481c-be8f-6182fda15267", "address": "fa:16:3e:64:70:89", "network": {"id": "3e4157dc-b9ba-40de-a00e-6f4c9a3c089b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-448760355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cd0053203ae489cb4bd097d7815b4e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35705f85-43", "ovs_interfaceid": "35705f85-434c-481c-be8f-6182fda15267", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:14:42 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:70:89,bridge_name='br-int',has_traffic_filtering=True,id=35705f85-434c-481c-be8f-6182fda15267,network=Network(3e4157dc-b9ba-40de-a00e-6f4c9a3c089b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35705f85-43') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:14:42 user nova-compute[75245]: DEBUG os_vif [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:70:89,bridge_name='br-int',has_traffic_filtering=True,id=35705f85-434c-481c-be8f-6182fda15267,network=Network(3e4157dc-b9ba-40de-a00e-6f4c9a3c089b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35705f85-43') {{(pid=75245) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 16:14:42 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:42 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:14:42 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 16:14:42 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:42 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f7e53155-031f-569b-a5ca-dd59e7d4c268', '_type': 'linux-noop'}}, row=False) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:14:42 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:42 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:42 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:42 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap35705f85-43, may_exist=True, interface_attrs={}) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:14:42 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap35705f85-43, col_values=(('qos', UUID('b70fc2e5-327f-4773-b2bc-eaf0a3c6d4b1')),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:14:42 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap35705f85-43, col_values=(('external_ids', {'iface-id': '35705f85-434c-481c-be8f-6182fda15267', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:70:89', 'vm-uuid': '95b96d09-b9df-4e92-a141-f044078e4ce1'}),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:14:42 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:14:42 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:42 user nova-compute[75245]: INFO os_vif [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:70:89,bridge_name='br-int',has_traffic_filtering=True,id=35705f85-434c-481c-be8f-6182fda15267,network=Network(3e4157dc-b9ba-40de-a00e-6f4c9a3c089b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35705f85-43')
Nov 29 16:14:42 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:14:42 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] No VIF found with MAC fa:16:3e:64:70:89, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:14:42 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:43 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:43 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:43 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:43 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:43 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:43 user nova-compute[75245]: DEBUG nova.compute.manager [req-dc9947d5-8eb5-43b7-8f49-64bbe0e46d86 req-f81fea83-af58-4a4c-86ca-2d0a20a250e5 service nova] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Received event network-vif-plugged-35705f85-434c-481c-be8f-6182fda15267 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:14:43 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-dc9947d5-8eb5-43b7-8f49-64bbe0e46d86 req-f81fea83-af58-4a4c-86ca-2d0a20a250e5 service nova] Acquiring lock "95b96d09-b9df-4e92-a141-f044078e4ce1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:14:43 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-dc9947d5-8eb5-43b7-8f49-64bbe0e46d86 req-f81fea83-af58-4a4c-86ca-2d0a20a250e5 service nova] Lock "95b96d09-b9df-4e92-a141-f044078e4ce1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:14:43 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-dc9947d5-8eb5-43b7-8f49-64bbe0e46d86 req-f81fea83-af58-4a4c-86ca-2d0a20a250e5 service nova] Lock "95b96d09-b9df-4e92-a141-f044078e4ce1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:14:43 user nova-compute[75245]: DEBUG nova.compute.manager [req-dc9947d5-8eb5-43b7-8f49-64bbe0e46d86 req-f81fea83-af58-4a4c-86ca-2d0a20a250e5 service nova] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] No waiting events found dispatching network-vif-plugged-35705f85-434c-481c-be8f-6182fda15267 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:14:43 user nova-compute[75245]: WARNING nova.compute.manager [req-dc9947d5-8eb5-43b7-8f49-64bbe0e46d86 req-f81fea83-af58-4a4c-86ca-2d0a20a250e5 service nova] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Received unexpected event network-vif-plugged-35705f85-434c-481c-be8f-6182fda15267 for instance with vm_state building and task_state spawning.
Nov 29 16:14:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:45 user nova-compute[75245]: DEBUG nova.compute.manager [req-aa2fa057-0d42-4aa4-8786-07dc75a8a39e req-aed04880-7055-4c18-bbbb-e2df65fae159 service nova] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Received event network-vif-plugged-35705f85-434c-481c-be8f-6182fda15267 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:14:46 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-aa2fa057-0d42-4aa4-8786-07dc75a8a39e req-aed04880-7055-4c18-bbbb-e2df65fae159 service nova] Acquiring lock "95b96d09-b9df-4e92-a141-f044078e4ce1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:14:46 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-aa2fa057-0d42-4aa4-8786-07dc75a8a39e req-aed04880-7055-4c18-bbbb-e2df65fae159 service nova] Lock "95b96d09-b9df-4e92-a141-f044078e4ce1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:14:46 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-aa2fa057-0d42-4aa4-8786-07dc75a8a39e req-aed04880-7055-4c18-bbbb-e2df65fae159 service nova] Lock "95b96d09-b9df-4e92-a141-f044078e4ce1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:14:46 user nova-compute[75245]: DEBUG nova.compute.manager [req-aa2fa057-0d42-4aa4-8786-07dc75a8a39e req-aed04880-7055-4c18-bbbb-e2df65fae159 service nova] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] No waiting events found dispatching network-vif-plugged-35705f85-434c-481c-be8f-6182fda15267 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:14:46 user nova-compute[75245]: WARNING nova.compute.manager [req-aa2fa057-0d42-4aa4-8786-07dc75a8a39e req-aed04880-7055-4c18-bbbb-e2df65fae159 service nova] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Received unexpected event network-vif-plugged-35705f85-434c-481c-be8f-6182fda15267 for instance with vm_state building and task_state spawning.
Nov 29 16:14:46 user nova-compute[75245]: DEBUG nova.compute.manager [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Instance event wait completed in 0 seconds for  {{(pid=75245) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 16:14:46 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Guest created on hypervisor {{(pid=75245) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 16:14:46 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Instance spawned successfully.
Nov 29 16:14:46 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 16:14:46 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Found default for hw_cdrom_bus of ide {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:14:46 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Found default for hw_disk_bus of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:14:46 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Found default for hw_input_bus of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:14:46 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Found default for hw_pointer_model of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:14:46 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Found default for hw_video_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:14:46 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Found default for hw_vif_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:14:46 user nova-compute[75245]: INFO nova.compute.manager [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Took 6.09 seconds to spawn the instance on the hypervisor.
Nov 29 16:14:46 user nova-compute[75245]: DEBUG nova.compute.manager [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:14:46 user nova-compute[75245]: INFO nova.compute.manager [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Took 17.68 seconds to build instance.
Nov 29 16:14:46 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-5ccc29f8-a3f4-4e28-b045-a1a2c8eee700 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Lock "95b96d09-b9df-4e92-a141-f044078e4ce1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.815s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:14:47 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:47 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:50 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f72da685-fa34-4030-8013-a67d94d44123 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] [instance: fd819060-4388-444d-809e-94f6b2e8f102] Calling os-brick to attach iSCSI Volume {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 16:14:50 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72da685-fa34-4030-8013-a67d94d44123 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IpewjSOb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:14:50 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-f72da685-fa34-4030-8013-a67d94d44123 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:14:50 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-f72da685-fa34-4030-8013-a67d94d44123 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:14:50 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-f72da685-fa34-4030-8013-a67d94d44123 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:14:50 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-f72da685-fa34-4030-8013-a67d94d44123 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:14:50 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-f72da685-fa34-4030-8013-a67d94d44123 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:14:50 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-f72da685-fa34-4030-8013-a67d94d44123 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:14:50 user nova-compute[75245]: INFO os_brick.initiator.connectors.iscsi [None req-f72da685-fa34-4030-8013-a67d94d44123 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 16:14:50 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f -p 172.16.0.220:3260 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:50 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f -p 172.16.0.220:3260" returned: 21 in 0.034s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:50 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[1832b021-4256-4cec-9651-a97575da4343]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:50 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72da685-fa34-4030-8013-a67d94d44123 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 16:14:50 user nova-compute[75245]:  {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:14:50 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f -p 172.16.0.220:3260 --interface default --op new {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:50 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:50 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31dd904-607a-415e-8962-253b27d25fad]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f] added\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:50 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72da685-fa34-4030-8013-a67d94d44123 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f] added
Nov 29 16:14:50 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:14:50 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:50 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:50 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d06122-f071-4aad-973c-8228161820ae]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:50 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72da685-fa34-4030-8013-a67d94d44123 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:14:50 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:50 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:50 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[1257736b-c09b-4d26-ab0d-fde452c9f93b]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:50 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72da685-fa34-4030-8013-a67d94d44123 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:14:50 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IpewjSOb {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:50 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IpewjSOb" returned: 0 in 0.023s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:50 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bab8a4f-0397-4afc-8822-cd81364c3451]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:50 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72da685-fa34-4030-8013-a67d94d44123 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IpewjSOb'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:14:50 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:50 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.043s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:50 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a3e221a-4181-4df9-983f-8373a549e2b6]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:50 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72da685-fa34-4030-8013-a67d94d44123 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:14:50 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:50 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:50 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[edab0d72-123b-49b9-ae4e-62e30b318fdf]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9c6c84-adbe-4ae5-b0b4-e9e697fc6cfe (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d0b28e9-a522-4c24-ad90-e86497030c36 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:50 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72da685-fa34-4030-8013-a67d94d44123 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5 (non-flash)
Nov 29 16:14:50 user nova-compute[75245]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18 (non-flash)
Nov 29 16:14:50 user nova-compute[75245]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49 (non-flash)
Nov 29 16:14:50 user nova-compute[75245]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea (non-flash)
Nov 29 16:14:50 user nova-compute[75245]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9c6c84-adbe-4ae5-b0b4-e9e697fc6cfe (non-flash)
Nov 29 16:14:50 user nova-compute[75245]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 (non-flash)
Nov 29 16:14:50 user nova-compute[75245]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d0b28e9-a522-4c24-ad90-e86497030c36 (non-flash)
Nov 29 16:14:50 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:14:50 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72da685-fa34-4030-8013-a67d94d44123 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5 (non-flash)
Nov 29 16:14:50 user nova-compute[75245]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18 (non-flash)
Nov 29 16:14:50 user nova-compute[75245]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49 (non-flash)
Nov 29 16:14:50 user nova-compute[75245]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea (non-flash)
Nov 29 16:14:50 user nova-compute[75245]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9c6c84-adbe-4ae5-b0b4-e9e697fc6cfe (non-flash)
Nov 29 16:14:50 user nova-compute[75245]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 (non-flash)
Nov 29 16:14:50 user nova-compute[75245]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d0b28e9-a522-4c24-ad90-e86497030c36 (non-flash)
Nov 29 16:14:50 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:14:50 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f -p 172.16.0.220:3260 --login {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f -p 172.16.0.220:3260 --login" returned: 0 in 1.223s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:51 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a89bacb-89d0-45b0-bdc6-e8a2da386a8c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:51 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72da685-fa34-4030-8013-a67d94d44123 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f, portal: 172.16.0.220,3260]
Nov 29 16:14:51 user nova-compute[75245]: Login to [iface: default, target: iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f, portal: 172.16.0.220,3260] successful.
Nov 29 16:14:51 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:14:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:51 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d367c5-ce18-427f-bb1a-f8b4722999c1]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:51 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72da685-fa34-4030-8013-a67d94d44123 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:14:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:51 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18e844a-3ff8-4ab7-82e8-0d736e0c80a8]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9c6c84-adbe-4ae5-b0b4-e9e697fc6cfe (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d0b28e9-a522-4c24-ad90-e86497030c36 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:51 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72da685-fa34-4030-8013-a67d94d44123 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5 (non-flash)
Nov 29 16:14:51 user nova-compute[75245]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18 (non-flash)
Nov 29 16:14:51 user nova-compute[75245]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49 (non-flash)
Nov 29 16:14:51 user nova-compute[75245]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea (non-flash)
Nov 29 16:14:51 user nova-compute[75245]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9c6c84-adbe-4ae5-b0b4-e9e697fc6cfe (non-flash)
Nov 29 16:14:51 user nova-compute[75245]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 (non-flash)
Nov 29 16:14:51 user nova-compute[75245]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d0b28e9-a522-4c24-ad90-e86497030c36 (non-flash)
Nov 29 16:14:51 user nova-compute[75245]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f (non-flash)
Nov 29 16:14:51 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:14:51 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72da685-fa34-4030-8013-a67d94d44123 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5 (non-flash)
Nov 29 16:14:51 user nova-compute[75245]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18 (non-flash)
Nov 29 16:14:51 user nova-compute[75245]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49 (non-flash)
Nov 29 16:14:51 user nova-compute[75245]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea (non-flash)
Nov 29 16:14:51 user nova-compute[75245]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9c6c84-adbe-4ae5-b0b4-e9e697fc6cfe (non-flash)
Nov 29 16:14:51 user nova-compute[75245]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 (non-flash)
Nov 29 16:14:51 user nova-compute[75245]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d0b28e9-a522-4c24-ad90-e86497030c36 (non-flash)
Nov 29 16:14:51 user nova-compute[75245]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f (non-flash)
Nov 29 16:14:51 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:14:51 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-f72da685-fa34-4030-8013-a67d94d44123 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.537s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:14:51 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72da685-fa34-4030-8013-a67d94d44123 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Connected to 172.16.0.220:3260 {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 16:14:51 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-f72da685-fa34-4030-8013-a67d94d44123 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] HCTL ('40', '-', '-', 0) found on session 19 with lun 0 {{(pid=75245) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 16:14:51 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-f72da685-fa34-4030-8013-a67d94d44123 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75245) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 16:14:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:51 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af015b9-daaa-4dbc-9430-e64ff990afce]: (4, ('- - 0', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:14:52 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-f72da685-fa34-4030-8013-a67d94d44123 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Searching for a device in session 19 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75245) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 16:14:52 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72da685-fa34-4030-8013-a67d94d44123 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IpewjSOb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 16:14:52 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:52 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:53 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-f72da685-fa34-4030-8013-a67d94d44123 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.597s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:14:53 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72da685-fa34-4030-8013-a67d94d44123 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] <== connect_volume: return (2602ms) {'type': 'block', 'scsi_wwn': '26332343465373931', 'path': '/dev/sdi'} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:14:53 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f72da685-fa34-4030-8013-a67d94d44123 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] [instance: fd819060-4388-444d-809e-94f6b2e8f102] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26332343465373931', 'path': '/dev/sdi'} {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 16:14:53 user nova-compute[75245]: DEBUG nova.objects.instance [None req-f72da685-fa34-4030-8013-a67d94d44123 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Lazy-loading 'flavor' on Instance uuid fd819060-4388-444d-809e-94f6b2e8f102 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:14:53 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-f72da685-fa34-4030-8013-a67d94d44123 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 16:14:53 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:14:53 user nova-compute[75245]:   <source dev="/dev/sdi"/>
Nov 29 16:14:53 user nova-compute[75245]:   <target dev="vdb" bus="virtio"/>
Nov 29 16:14:53 user nova-compute[75245]:   <serial>6756bb27-a338-4643-9c32-aa6a83de210f</serial>
Nov 29 16:14:53 user nova-compute[75245]: </disk>
Nov 29 16:14:53 user nova-compute[75245]:  {{(pid=75245) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 16:14:53 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:14:53 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-f72da685-fa34-4030-8013-a67d94d44123 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:14:53 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-f72da685-fa34-4030-8013-a67d94d44123 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:14:53 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-f72da685-fa34-4030-8013-a67d94d44123 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] No VIF found with MAC fa:16:3e:a4:25:65, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:14:53 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-f72da685-fa34-4030-8013-a67d94d44123 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Lock "fd819060-4388-444d-809e-94f6b2e8f102" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.508s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:14:54 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:14:54 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Starting heal instance info cache {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 16:14:54 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Didn't find any instances for network info cache update. {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 16:14:54 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:14:54 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:14:54 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:14:54 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:14:54 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:14:54 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75245) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 16:14:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/816edb0e-c4fc-470b-8151-f98502e50789/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/816edb0e-c4fc-470b-8151-f98502e50789/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/816edb0e-c4fc-470b-8151-f98502e50789/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/816edb0e-c4fc-470b-8151-f98502e50789/disk --force-share --output=json" returned: 0 in 0.301s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd819060-4388-444d-809e-94f6b2e8f102/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd819060-4388-444d-809e-94f6b2e8f102/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd819060-4388-444d-809e-94f6b2e8f102/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd819060-4388-444d-809e-94f6b2e8f102/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:14:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ab9d7cd-79cd-4c9b-8608-c1ef0f333305/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ab9d7cd-79cd-4c9b-8608-c1ef0f333305/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ab9d7cd-79cd-4c9b-8608-c1ef0f333305/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ab9d7cd-79cd-4c9b-8608-c1ef0f333305/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:14:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:57 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:57 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:14:57 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:14:57 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:14:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:57 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:57 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:14:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0db15db5-e8a9-46a8-98cc-99d7fde61508/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0db15db5-e8a9-46a8-98cc-99d7fde61508/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0db15db5-e8a9-46a8-98cc-99d7fde61508/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0db15db5-e8a9-46a8-98cc-99d7fde61508/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36728d4f-925b-46a3-b4b5-17f14b9c99c3/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36728d4f-925b-46a3-b4b5-17f14b9c99c3/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36728d4f-925b-46a3-b4b5-17f14b9c99c3/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:14:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36728d4f-925b-46a3-b4b5-17f14b9c99c3/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:14:59 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-e5956a27-4674-47ae-83be-eb24a1640941 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Acquiring lock "fd819060-4388-444d-809e-94f6b2e8f102" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:14:59 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-e5956a27-4674-47ae-83be-eb24a1640941 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Lock "fd819060-4388-444d-809e-94f6b2e8f102" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:14:59 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:14:59 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:14:59 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Hypervisor/Node resource view: name=user free_ram=7581MB free_disk=25.52005386352539GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75245) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 16:14:59 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:14:59 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:14:59 user nova-compute[75245]: DEBUG nova.objects.instance [None req-e5956a27-4674-47ae-83be-eb24a1640941 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Lazy-loading 'flavor' on Instance uuid fd819060-4388-444d-809e-94f6b2e8f102 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:14:59 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-e5956a27-4674-47ae-83be-eb24a1640941 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Lock "fd819060-4388-444d-809e-94f6b2e8f102" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.109s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:14:59 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:14:59 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:14:59 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance ed9a6a4e-2e7d-443c-82ef-f14f11d32c81 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:14:59 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 36728d4f-925b-46a3-b4b5-17f14b9c99c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:14:59 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance fd819060-4388-444d-809e-94f6b2e8f102 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:14:59 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 0db15db5-e8a9-46a8-98cc-99d7fde61508 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:14:59 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 5f2a6f15-e413-47a2-be3e-961dd9ee7deb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:14:59 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 816edb0e-c4fc-470b-8151-f98502e50789 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:14:59 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:14:59 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 95b96d09-b9df-4e92-a141-f044078e4ce1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:14:59 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 16:14:59 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 16:14:59 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-e5956a27-4674-47ae-83be-eb24a1640941 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Acquiring lock "fd819060-4388-444d-809e-94f6b2e8f102" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:14:59 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-e5956a27-4674-47ae-83be-eb24a1640941 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Lock "fd819060-4388-444d-809e-94f6b2e8f102" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:14:59 user nova-compute[75245]: INFO nova.compute.manager [None req-e5956a27-4674-47ae-83be-eb24a1640941 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] [instance: fd819060-4388-444d-809e-94f6b2e8f102] Attaching volume 54800bf9-7ede-4c92-881b-a6419c02b434 to /dev/vdc
Nov 29 16:15:00 user nova-compute[75245]: DEBUG os_brick.utils [None req-e5956a27-4674-47ae-83be-eb24a1640941 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:15:00 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:15:00 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:15:00 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2ced00-3446-4132-a659-055c38765107]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:69ed8ed87091\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:15:00 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:15:00 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.030s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:15:00 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[a57ee142-59b2-4097-a4e2-815cf573a845]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:15:00 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:15:00 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:15:00 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[03054477-7429-4656-9e98-624a91769816]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:15:00 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[741075d5-d259-4b4e-a202-184e44e47b04]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:15:00 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-e5956a27-4674-47ae-83be-eb24a1640941 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Running cmd (subprocess): nvme version {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:15:00 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-e5956a27-4674-47ae-83be-eb24a1640941 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] 'nvme version' failed. Not Retrying. {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:15:00 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e5956a27-4674-47ae-83be-eb24a1640941 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] nvme not present on system {{(pid=75245) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 16:15:00 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:15:00 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:15:00 user nova-compute[75245]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 16:15:00 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe30355-2c73-48f7-aabe-b16aed0483e7]: (4, '') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:15:00 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-e5956a27-4674-47ae-83be-eb24a1640941 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75245) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 16:15:00 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-e5956a27-4674-47ae-83be-eb24a1640941 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 16:15:00 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-e5956a27-4674-47ae-83be-eb24a1640941 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] LIGHTOS: no hostnqn found. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 16:15:00 user nova-compute[75245]: DEBUG os_brick.utils [None req-e5956a27-4674-47ae-83be-eb24a1640941 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] <== get_connector_properties: return (179ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:69ed8ed87091', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:15:00 user nova-compute[75245]: DEBUG nova.virt.block_device [None req-e5956a27-4674-47ae-83be-eb24a1640941 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] [instance: fd819060-4388-444d-809e-94f6b2e8f102] Updating existing volume attachment record: f544d37a-7b9d-4a87-a2df-de1629198e7c {{(pid=75245) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 16:15:00 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:15:00 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:15:00 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Compute_service record updated for user:user {{(pid=75245) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 16:15:00 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.806s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:15:00 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:15:01 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:15:01 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:15:01 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:15:01 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:15:01 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:15:01 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75245) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 16:15:02 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:15:02 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:15:05 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:15:06 user nova-compute[75245]: ERROR nova.volume.cinder [None req-e5956a27-4674-47ae-83be-eb24a1640941 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Update attachment failed for attachment f544d37a-7b9d-4a87-a2df-de1629198e7c. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-243c7752-d940-4496-a9e8-8044c061ef3f) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-243c7752-d940-4496-a9e8-8044c061ef3f)
Nov 29 16:15:06 user nova-compute[75245]: ERROR nova.compute.manager [None req-e5956a27-4674-47ae-83be-eb24a1640941 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] [instance: fd819060-4388-444d-809e-94f6b2e8f102] Failed to attach 54800bf9-7ede-4c92-881b-a6419c02b434 at /dev/vdc: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-243c7752-d940-4496-a9e8-8044c061ef3f)
Nov 29 16:15:06 user nova-compute[75245]: ERROR nova.compute.manager [instance: fd819060-4388-444d-809e-94f6b2e8f102] Traceback (most recent call last):
Nov 29 16:15:06 user nova-compute[75245]: ERROR nova.compute.manager [instance: fd819060-4388-444d-809e-94f6b2e8f102]   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 29 16:15:06 user nova-compute[75245]: ERROR nova.compute.manager [instance: fd819060-4388-444d-809e-94f6b2e8f102]     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 29 16:15:06 user nova-compute[75245]: ERROR nova.compute.manager [instance: fd819060-4388-444d-809e-94f6b2e8f102]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 29 16:15:06 user nova-compute[75245]: ERROR nova.compute.manager [instance: fd819060-4388-444d-809e-94f6b2e8f102]     ret_val = method(obj, context, *args, **kwargs)
Nov 29 16:15:06 user nova-compute[75245]: ERROR nova.compute.manager [instance: fd819060-4388-444d-809e-94f6b2e8f102]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 29 16:15:06 user nova-compute[75245]: ERROR nova.compute.manager [instance: fd819060-4388-444d-809e-94f6b2e8f102]     self._do_attach(context, instance, volume, volume_api,
Nov 29 16:15:06 user nova-compute[75245]: ERROR nova.compute.manager [instance: fd819060-4388-444d-809e-94f6b2e8f102]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 29 16:15:06 user nova-compute[75245]: ERROR nova.compute.manager [instance: fd819060-4388-444d-809e-94f6b2e8f102]     self._volume_attach(context, volume, connector, instance,
Nov 29 16:15:06 user nova-compute[75245]: ERROR nova.compute.manager [instance: fd819060-4388-444d-809e-94f6b2e8f102]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 29 16:15:06 user nova-compute[75245]: ERROR nova.compute.manager [instance: fd819060-4388-444d-809e-94f6b2e8f102]     connection_info = volume_api.attachment_update(
Nov 29 16:15:06 user nova-compute[75245]: ERROR nova.compute.manager [instance: fd819060-4388-444d-809e-94f6b2e8f102]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 29 16:15:06 user nova-compute[75245]: ERROR nova.compute.manager [instance: fd819060-4388-444d-809e-94f6b2e8f102]     res = method(self, ctx, *args, **kwargs)
Nov 29 16:15:06 user nova-compute[75245]: ERROR nova.compute.manager [instance: fd819060-4388-444d-809e-94f6b2e8f102]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 29 16:15:06 user nova-compute[75245]: ERROR nova.compute.manager [instance: fd819060-4388-444d-809e-94f6b2e8f102]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 29 16:15:06 user nova-compute[75245]: ERROR nova.compute.manager [instance: fd819060-4388-444d-809e-94f6b2e8f102]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 29 16:15:06 user nova-compute[75245]: ERROR nova.compute.manager [instance: fd819060-4388-444d-809e-94f6b2e8f102]     with excutils.save_and_reraise_exception():
Nov 29 16:15:06 user nova-compute[75245]: ERROR nova.compute.manager [instance: fd819060-4388-444d-809e-94f6b2e8f102]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 16:15:06 user nova-compute[75245]: ERROR nova.compute.manager [instance: fd819060-4388-444d-809e-94f6b2e8f102]     self.force_reraise()
Nov 29 16:15:06 user nova-compute[75245]: ERROR nova.compute.manager [instance: fd819060-4388-444d-809e-94f6b2e8f102]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 16:15:06 user nova-compute[75245]: ERROR nova.compute.manager [instance: fd819060-4388-444d-809e-94f6b2e8f102]     raise self.value
Nov 29 16:15:06 user nova-compute[75245]: ERROR nova.compute.manager [instance: fd819060-4388-444d-809e-94f6b2e8f102]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 29 16:15:06 user nova-compute[75245]: ERROR nova.compute.manager [instance: fd819060-4388-444d-809e-94f6b2e8f102]     context, '3.44', skip_version_check=True).attachments.update(
Nov 29 16:15:06 user nova-compute[75245]: ERROR nova.compute.manager [instance: fd819060-4388-444d-809e-94f6b2e8f102]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 29 16:15:06 user nova-compute[75245]: ERROR nova.compute.manager [instance: fd819060-4388-444d-809e-94f6b2e8f102]     return method.func(obj, *args, **kwargs)
Nov 29 16:15:06 user nova-compute[75245]: ERROR nova.compute.manager [instance: fd819060-4388-444d-809e-94f6b2e8f102]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 29 16:15:06 user nova-compute[75245]: ERROR nova.compute.manager [instance: fd819060-4388-444d-809e-94f6b2e8f102]     resp = self._update('/attachments/%s' % id, body)
Nov 29 16:15:06 user nova-compute[75245]: ERROR nova.compute.manager [instance: fd819060-4388-444d-809e-94f6b2e8f102]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 29 16:15:06 user nova-compute[75245]: ERROR nova.compute.manager [instance: fd819060-4388-444d-809e-94f6b2e8f102]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 29 16:15:06 user nova-compute[75245]: ERROR nova.compute.manager [instance: fd819060-4388-444d-809e-94f6b2e8f102]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 29 16:15:06 user nova-compute[75245]: ERROR nova.compute.manager [instance: fd819060-4388-444d-809e-94f6b2e8f102]     return self._cs_request(url, 'PUT', **kwargs)
Nov 29 16:15:06 user nova-compute[75245]: ERROR nova.compute.manager [instance: fd819060-4388-444d-809e-94f6b2e8f102]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 29 16:15:06 user nova-compute[75245]: ERROR nova.compute.manager [instance: fd819060-4388-444d-809e-94f6b2e8f102]     return self.request(url, method, **kwargs)
Nov 29 16:15:06 user nova-compute[75245]: ERROR nova.compute.manager [instance: fd819060-4388-444d-809e-94f6b2e8f102]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 29 16:15:06 user nova-compute[75245]: ERROR nova.compute.manager [instance: fd819060-4388-444d-809e-94f6b2e8f102]     raise exceptions.from_response(resp, body)
Nov 29 16:15:06 user nova-compute[75245]: ERROR nova.compute.manager [instance: fd819060-4388-444d-809e-94f6b2e8f102] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-243c7752-d940-4496-a9e8-8044c061ef3f)
Nov 29 16:15:06 user nova-compute[75245]: ERROR nova.compute.manager [instance: fd819060-4388-444d-809e-94f6b2e8f102] 
Nov 29 16:15:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-e5956a27-4674-47ae-83be-eb24a1640941 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Lock "fd819060-4388-444d-809e-94f6b2e8f102" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.792s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server [None req-e5956a27-4674-47ae-83be-eb24a1640941 tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-243c7752-d940-4496-a9e8-8044c061ef3f)
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7553, in attach_volume
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7550, in do_attach_volume
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7548, in do_attach_volume
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7570, in _attach_volume
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-243c7752-d940-4496-a9e8-8044c061ef3f)
Nov 29 16:15:06 user nova-compute[75245]: ERROR oslo_messaging.rpc.server 
Nov 29 16:15:07 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:15:07 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:15:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Acquiring lock "b99c5e50-a98b-45a2-b170-664c93109897" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:15:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Lock "b99c5e50-a98b-45a2-b170-664c93109897" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:15:09 user nova-compute[75245]: DEBUG nova.compute.manager [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] [instance: b99c5e50-a98b-45a2-b170-664c93109897] Starting instance... {{(pid=75245) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 16:15:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:15:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:15:09 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75245) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 16:15:09 user nova-compute[75245]: INFO nova.compute.claims [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] [instance: b99c5e50-a98b-45a2-b170-664c93109897] Claim successful on node user
Nov 29 16:15:10 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:15:10 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:15:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.440s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:15:10 user nova-compute[75245]: DEBUG nova.compute.manager [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] [instance: b99c5e50-a98b-45a2-b170-664c93109897] Start building networks asynchronously for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 16:15:10 user nova-compute[75245]: DEBUG nova.compute.manager [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] [instance: b99c5e50-a98b-45a2-b170-664c93109897] Allocating IP information in the background. {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 16:15:10 user nova-compute[75245]: DEBUG nova.network.neutron [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] [instance: b99c5e50-a98b-45a2-b170-664c93109897] allocate_for_instance() {{(pid=75245) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 16:15:10 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] [instance: b99c5e50-a98b-45a2-b170-664c93109897] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 29 16:15:10 user nova-compute[75245]: DEBUG nova.compute.manager [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] [instance: b99c5e50-a98b-45a2-b170-664c93109897] Start building block device mappings for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 16:15:10 user nova-compute[75245]: DEBUG nova.policy [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cc3579c7a7b54cf592cbdf7df55e2d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94b9aa8ead849878a724d3e77c2cf83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75245) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 16:15:10 user nova-compute[75245]: DEBUG nova.compute.manager [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] [instance: b99c5e50-a98b-45a2-b170-664c93109897] Start spawning the instance on the hypervisor. {{(pid=75245) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 16:15:10 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] [instance: b99c5e50-a98b-45a2-b170-664c93109897] Creating instance directory {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 16:15:10 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] [instance: b99c5e50-a98b-45a2-b170-664c93109897] Creating image(s)
Nov 29 16:15:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Acquiring lock "/opt/stack/data/nova/instances/b99c5e50-a98b-45a2-b170-664c93109897/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:15:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Lock "/opt/stack/data/nova/instances/b99c5e50-a98b-45a2-b170-664c93109897/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:15:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Lock "/opt/stack/data/nova/instances/b99c5e50-a98b-45a2-b170-664c93109897/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:15:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Acquiring lock "dc6624775858b84e292a573852ec5a2d0c0d13bc" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:15:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Lock "dc6624775858b84e292a573852ec5a2d0c0d13bc" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:15:11 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dc6624775858b84e292a573852ec5a2d0c0d13bc.part --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:15:11 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dc6624775858b84e292a573852ec5a2d0c0d13bc.part --force-share --output=json" returned: 0 in 0.360s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:15:11 user nova-compute[75245]: DEBUG nova.virt.images [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] 6ccaa852-1bd2-402f-9049-f4756a98a62d was qcow2, converting to raw {{(pid=75245) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 16:15:11 user nova-compute[75245]: DEBUG nova.privsep.utils [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75245) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 16:15:11 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dc6624775858b84e292a573852ec5a2d0c0d13bc.part /opt/stack/data/nova/instances/_base/dc6624775858b84e292a573852ec5a2d0c0d13bc.converted {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:15:11 user nova-compute[75245]: DEBUG nova.network.neutron [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] [instance: b99c5e50-a98b-45a2-b170-664c93109897] Successfully created port: e9647e37-1ab6-40fb-8874-a626692dd676 {{(pid=75245) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 16:15:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dc6624775858b84e292a573852ec5a2d0c0d13bc.part /opt/stack/data/nova/instances/_base/dc6624775858b84e292a573852ec5a2d0c0d13bc.converted" returned: 0 in 0.193s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:15:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dc6624775858b84e292a573852ec5a2d0c0d13bc.converted --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:15:12 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:15:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dc6624775858b84e292a573852ec5a2d0c0d13bc.converted --force-share --output=json" returned: 0 in 0.250s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:15:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Lock "dc6624775858b84e292a573852ec5a2d0c0d13bc" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.830s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:15:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dc6624775858b84e292a573852ec5a2d0c0d13bc --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:15:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dc6624775858b84e292a573852ec5a2d0c0d13bc --force-share --output=json" returned: 0 in 0.197s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:15:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Acquiring lock "dc6624775858b84e292a573852ec5a2d0c0d13bc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:15:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Lock "dc6624775858b84e292a573852ec5a2d0c0d13bc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:15:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dc6624775858b84e292a573852ec5a2d0c0d13bc --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:15:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dc6624775858b84e292a573852ec5a2d0c0d13bc --force-share --output=json" returned: 0 in 0.210s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:15:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dc6624775858b84e292a573852ec5a2d0c0d13bc,backing_fmt=raw /opt/stack/data/nova/instances/b99c5e50-a98b-45a2-b170-664c93109897/disk 1073741824 {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:15:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dc6624775858b84e292a573852ec5a2d0c0d13bc,backing_fmt=raw /opt/stack/data/nova/instances/b99c5e50-a98b-45a2-b170-664c93109897/disk 1073741824" returned: 0 in 0.051s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:15:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Lock "dc6624775858b84e292a573852ec5a2d0c0d13bc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:15:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dc6624775858b84e292a573852ec5a2d0c0d13bc --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:15:12 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:15:12 user nova-compute[75245]: DEBUG nova.network.neutron [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] [instance: b99c5e50-a98b-45a2-b170-664c93109897] Successfully updated port: e9647e37-1ab6-40fb-8874-a626692dd676 {{(pid=75245) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 16:15:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Acquiring lock "refresh_cache-b99c5e50-a98b-45a2-b170-664c93109897" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:15:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Acquired lock "refresh_cache-b99c5e50-a98b-45a2-b170-664c93109897" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:15:12 user nova-compute[75245]: DEBUG nova.network.neutron [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] [instance: b99c5e50-a98b-45a2-b170-664c93109897] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 16:15:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dc6624775858b84e292a573852ec5a2d0c0d13bc --force-share --output=json" returned: 0 in 0.207s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:15:12 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b99c5e50-a98b-45a2-b170-664c93109897/disk. size=1073741824 {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 16:15:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b99c5e50-a98b-45a2-b170-664c93109897/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:15:13 user nova-compute[75245]: DEBUG nova.network.neutron [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] [instance: b99c5e50-a98b-45a2-b170-664c93109897] Instance cache missing network info. {{(pid=75245) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 16:15:13 user nova-compute[75245]: DEBUG nova.compute.manager [req-d817d930-c232-4f50-9eff-4f6913f511ad req-f253d208-0699-4cdb-ad8e-568a00f42988 service nova] [instance: b99c5e50-a98b-45a2-b170-664c93109897] Received event network-changed-e9647e37-1ab6-40fb-8874-a626692dd676 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:15:13 user nova-compute[75245]: DEBUG nova.compute.manager [req-d817d930-c232-4f50-9eff-4f6913f511ad req-f253d208-0699-4cdb-ad8e-568a00f42988 service nova] [instance: b99c5e50-a98b-45a2-b170-664c93109897] Refreshing instance network info cache due to event network-changed-e9647e37-1ab6-40fb-8874-a626692dd676. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:15:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d817d930-c232-4f50-9eff-4f6913f511ad req-f253d208-0699-4cdb-ad8e-568a00f42988 service nova] Acquiring lock "refresh_cache-b99c5e50-a98b-45a2-b170-664c93109897" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:15:13 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b99c5e50-a98b-45a2-b170-664c93109897/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:15:13 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Cannot resize image /opt/stack/data/nova/instances/b99c5e50-a98b-45a2-b170-664c93109897/disk to a smaller size. {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 16:15:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] [instance: b99c5e50-a98b-45a2-b170-664c93109897] Created local disks {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 16:15:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] [instance: b99c5e50-a98b-45a2-b170-664c93109897] Ensure instance console log exists: /opt/stack/data/nova/instances/b99c5e50-a98b-45a2-b170-664c93109897/console.log {{(pid=75245) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 16:15:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:15:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:15:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:15:13 user nova-compute[75245]: DEBUG nova.network.neutron [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] [instance: b99c5e50-a98b-45a2-b170-664c93109897] Updating instance_info_cache with network_info: [{"id": "e9647e37-1ab6-40fb-8874-a626692dd676", "address": "fa:16:3e:12:85:81", "network": {"id": "161e15da-e083-48c0-82ad-b2326e4dc33b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1831426097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c94b9aa8ead849878a724d3e77c2cf83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9647e37-1a", "ovs_interfaceid": "e9647e37-1ab6-40fb-8874-a626692dd676", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:15:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Releasing lock "refresh_cache-b99c5e50-a98b-45a2-b170-664c93109897" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:15:13 user nova-compute[75245]: DEBUG nova.compute.manager [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] [instance: b99c5e50-a98b-45a2-b170-664c93109897] Instance network_info: |[{"id": "e9647e37-1ab6-40fb-8874-a626692dd676", "address": "fa:16:3e:12:85:81", "network": {"id": "161e15da-e083-48c0-82ad-b2326e4dc33b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1831426097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c94b9aa8ead849878a724d3e77c2cf83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9647e37-1a", "ovs_interfaceid": "e9647e37-1ab6-40fb-8874-a626692dd676", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 16:15:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d817d930-c232-4f50-9eff-4f6913f511ad req-f253d208-0699-4cdb-ad8e-568a00f42988 service nova] Acquired lock "refresh_cache-b99c5e50-a98b-45a2-b170-664c93109897" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:15:13 user nova-compute[75245]: DEBUG nova.network.neutron [req-d817d930-c232-4f50-9eff-4f6913f511ad req-f253d208-0699-4cdb-ad8e-568a00f42988 service nova] [instance: b99c5e50-a98b-45a2-b170-664c93109897] Refreshing network info cache for port e9647e37-1ab6-40fb-8874-a626692dd676 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:15:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] [instance: b99c5e50-a98b-45a2-b170-664c93109897] Start _get_guest_xml network_info=[{"id": "e9647e37-1ab6-40fb-8874-a626692dd676", "address": "fa:16:3e:12:85:81", "network": {"id": "161e15da-e083-48c0-82ad-b2326e4dc33b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1831426097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c94b9aa8ead849878a724d3e77c2cf83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9647e37-1a", "ovs_interfaceid": "e9647e37-1ab6-40fb-8874-a626692dd676", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:15:04Z,direct_url=<?>,disk_format='qcow2',id=6ccaa852-1bd2-402f-9049-f4756a98a62d,min_disk=0,min_ram=0,name='',owner='97773a84172f4cd39376a31bc258f5f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:15:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'disk_bus': 'scsi', 'device_type': 'disk', 'device_name': '/dev/sda', 'guest_format': None, 'image_id': '6ccaa852-1bd2-402f-9049-f4756a98a62d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 16:15:13 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:15:13 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:15:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 16:15:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] CPU controller missing on host. {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 16:15:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 16:15:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] CPU controller found on host. {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 16:15:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75245) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 16:15:13 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T16:06:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:15:04Z,direct_url=<?>,disk_format='qcow2',id=6ccaa852-1bd2-402f-9049-f4756a98a62d,min_disk=0,min_ram=0,name='',owner='97773a84172f4cd39376a31bc258f5f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:15:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 16:15:13 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Flavor limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 16:15:13 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Image limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 16:15:13 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Flavor pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 16:15:13 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Image pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 16:15:13 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 16:15:13 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 16:15:13 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 16:15:13 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Got 1 possible topologies {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 16:15:13 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 16:15:13 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 16:15:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T16:15:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-674037423',display_name='tempest-AttachSCSIVolumeTestJSON-server-674037423',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-674037423',id=17,image_ref='6ccaa852-1bd2-402f-9049-f4756a98a62d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIpbMVJBSu/Ho+4zKgopCd5vpQe24yBq2pRAbQj56Fjeu3rEN8WLJ/OnuC/3M5/73jIWk4qKKgJeSYC72pnvhZ2F5SminNo1Wjy4vZjuBEckasGfduEk4ayj5vlBID6mRw==',key_name='tempest-keypair-881689391',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c94b9aa8ead849878a724d3e77c2cf83',ramdisk_id='',reservation_id='r-tirig9ki',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ccaa852-1bd2-402f-9049-f4756a98a62d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1036962361',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1036962361-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:15:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc3579c7a7b54cf592cbdf7df55e2d0e',uuid=b99c5e50-a98b-45a2-b170-664c93109897,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9647e37-1ab6-40fb-8874-a626692dd676", "address": "fa:16:3e:12:85:81", "network": {"id": "161e15da-e083-48c0-82ad-b2326e4dc33b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1831426097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c94b9aa8ead849878a724d3e77c2cf83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9647e37-1a", "ovs_interfaceid": "e9647e37-1ab6-40fb-8874-a626692dd676", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:15:13 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Converting VIF {"id": "e9647e37-1ab6-40fb-8874-a626692dd676", "address": "fa:16:3e:12:85:81", "network": {"id": "161e15da-e083-48c0-82ad-b2326e4dc33b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1831426097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c94b9aa8ead849878a724d3e77c2cf83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9647e37-1a", "ovs_interfaceid": "e9647e37-1ab6-40fb-8874-a626692dd676", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:15:13 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:85:81,bridge_name='br-int',has_traffic_filtering=True,id=e9647e37-1ab6-40fb-8874-a626692dd676,network=Network(161e15da-e083-48c0-82ad-b2326e4dc33b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9647e37-1a') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:15:13 user nova-compute[75245]: DEBUG nova.objects.instance [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Lazy-loading 'pci_devices' on Instance uuid b99c5e50-a98b-45a2-b170-664c93109897 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:15:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] [instance: b99c5e50-a98b-45a2-b170-664c93109897] End _get_guest_xml xml=<domain type="kvm">
Nov 29 16:15:13 user nova-compute[75245]:   <uuid>b99c5e50-a98b-45a2-b170-664c93109897</uuid>
Nov 29 16:15:13 user nova-compute[75245]:   <name>instance-00000011</name>
Nov 29 16:15:13 user nova-compute[75245]:   <memory>524288</memory>
Nov 29 16:15:13 user nova-compute[75245]:   <vcpu>1</vcpu>
Nov 29 16:15:13 user nova-compute[75245]:   <metadata>
Nov 29 16:15:13 user nova-compute[75245]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 16:15:13 user nova-compute[75245]:       <nova:package version="0.0.0"/>
Nov 29 16:15:13 user nova-compute[75245]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-674037423</nova:name>
Nov 29 16:15:13 user nova-compute[75245]:       <nova:creationTime>2023-11-29 16:15:13</nova:creationTime>
Nov 29 16:15:13 user nova-compute[75245]:       <nova:flavor name="m1.tiny">
Nov 29 16:15:13 user nova-compute[75245]:         <nova:memory>512</nova:memory>
Nov 29 16:15:13 user nova-compute[75245]:         <nova:disk>1</nova:disk>
Nov 29 16:15:13 user nova-compute[75245]:         <nova:swap>0</nova:swap>
Nov 29 16:15:13 user nova-compute[75245]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 16:15:13 user nova-compute[75245]:         <nova:vcpus>1</nova:vcpus>
Nov 29 16:15:13 user nova-compute[75245]:       </nova:flavor>
Nov 29 16:15:13 user nova-compute[75245]:       <nova:owner>
Nov 29 16:15:13 user nova-compute[75245]:         <nova:user uuid="cc3579c7a7b54cf592cbdf7df55e2d0e">tempest-AttachSCSIVolumeTestJSON-1036962361-project-member</nova:user>
Nov 29 16:15:13 user nova-compute[75245]:         <nova:project uuid="c94b9aa8ead849878a724d3e77c2cf83">tempest-AttachSCSIVolumeTestJSON-1036962361</nova:project>
Nov 29 16:15:13 user nova-compute[75245]:       </nova:owner>
Nov 29 16:15:13 user nova-compute[75245]:       <nova:root type="image" uuid="6ccaa852-1bd2-402f-9049-f4756a98a62d"/>
Nov 29 16:15:13 user nova-compute[75245]:       <nova:ports>
Nov 29 16:15:13 user nova-compute[75245]:         <nova:port uuid="e9647e37-1ab6-40fb-8874-a626692dd676">
Nov 29 16:15:13 user nova-compute[75245]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 29 16:15:13 user nova-compute[75245]:         </nova:port>
Nov 29 16:15:13 user nova-compute[75245]:       </nova:ports>
Nov 29 16:15:13 user nova-compute[75245]:     </nova:instance>
Nov 29 16:15:13 user nova-compute[75245]:   </metadata>
Nov 29 16:15:13 user nova-compute[75245]:   <sysinfo type="smbios">
Nov 29 16:15:13 user nova-compute[75245]:     <system>
Nov 29 16:15:13 user nova-compute[75245]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 16:15:13 user nova-compute[75245]:       <entry name="product">OpenStack Nova</entry>
Nov 29 16:15:13 user nova-compute[75245]:       <entry name="version">0.0.0</entry>
Nov 29 16:15:13 user nova-compute[75245]:       <entry name="serial">b99c5e50-a98b-45a2-b170-664c93109897</entry>
Nov 29 16:15:13 user nova-compute[75245]:       <entry name="uuid">b99c5e50-a98b-45a2-b170-664c93109897</entry>
Nov 29 16:15:13 user nova-compute[75245]:       <entry name="family">Virtual Machine</entry>
Nov 29 16:15:13 user nova-compute[75245]:     </system>
Nov 29 16:15:13 user nova-compute[75245]:   </sysinfo>
Nov 29 16:15:13 user nova-compute[75245]:   <os>
Nov 29 16:15:13 user nova-compute[75245]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 16:15:13 user nova-compute[75245]:     <boot dev="hd"/>
Nov 29 16:15:13 user nova-compute[75245]:     <smbios mode="sysinfo"/>
Nov 29 16:15:13 user nova-compute[75245]:   </os>
Nov 29 16:15:13 user nova-compute[75245]:   <features>
Nov 29 16:15:13 user nova-compute[75245]:     <acpi/>
Nov 29 16:15:13 user nova-compute[75245]:     <apic/>
Nov 29 16:15:13 user nova-compute[75245]:     <vmcoreinfo/>
Nov 29 16:15:13 user nova-compute[75245]:   </features>
Nov 29 16:15:13 user nova-compute[75245]:   <clock offset="utc">
Nov 29 16:15:13 user nova-compute[75245]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 16:15:13 user nova-compute[75245]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 16:15:13 user nova-compute[75245]:     <timer name="hpet" present="no"/>
Nov 29 16:15:13 user nova-compute[75245]:   </clock>
Nov 29 16:15:13 user nova-compute[75245]:   <cpu mode="custom" match="exact">
Nov 29 16:15:13 user nova-compute[75245]:     <model>Nehalem</model>
Nov 29 16:15:13 user nova-compute[75245]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 16:15:13 user nova-compute[75245]:   </cpu>
Nov 29 16:15:13 user nova-compute[75245]:   <devices>
Nov 29 16:15:13 user nova-compute[75245]:     <disk type="file" device="disk">
Nov 29 16:15:13 user nova-compute[75245]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 16:15:13 user nova-compute[75245]:       <source file="/opt/stack/data/nova/instances/b99c5e50-a98b-45a2-b170-664c93109897/disk"/>
Nov 29 16:15:13 user nova-compute[75245]:       <target dev="sda" bus="scsi"/>
Nov 29 16:15:13 user nova-compute[75245]:       <address type="drive" controller="0" unit="0"/>
Nov 29 16:15:13 user nova-compute[75245]:     </disk>
Nov 29 16:15:13 user nova-compute[75245]:     <disk type="file" device="cdrom">
Nov 29 16:15:13 user nova-compute[75245]:       <driver name="qemu" type="raw" cache="none"/>
Nov 29 16:15:13 user nova-compute[75245]:       <source file="/opt/stack/data/nova/instances/b99c5e50-a98b-45a2-b170-664c93109897/disk.config"/>
Nov 29 16:15:13 user nova-compute[75245]:       <target dev="sdb" bus="scsi"/>
Nov 29 16:15:13 user nova-compute[75245]:       <address type="drive" controller="0" unit="1"/>
Nov 29 16:15:13 user nova-compute[75245]:     </disk>
Nov 29 16:15:13 user nova-compute[75245]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 29 16:15:13 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 16:15:13 user nova-compute[75245]:       <mac address="fa:16:3e:12:85:81"/>
Nov 29 16:15:13 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:15:13 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 16:15:13 user nova-compute[75245]:       <target dev="tape9647e37-1a"/>
Nov 29 16:15:13 user nova-compute[75245]:     </interface>
Nov 29 16:15:13 user nova-compute[75245]:     <serial type="pty">
Nov 29 16:15:13 user nova-compute[75245]:       <log file="/opt/stack/data/nova/instances/b99c5e50-a98b-45a2-b170-664c93109897/console.log" append="off"/>
Nov 29 16:15:13 user nova-compute[75245]:     </serial>
Nov 29 16:15:13 user nova-compute[75245]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 16:15:13 user nova-compute[75245]:     <video>
Nov 29 16:15:13 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:15:13 user nova-compute[75245]:     </video>
Nov 29 16:15:13 user nova-compute[75245]:     <rng model="virtio">
Nov 29 16:15:13 user nova-compute[75245]:       <backend model="random">/dev/urandom</backend>
Nov 29 16:15:13 user nova-compute[75245]:     </rng>
Nov 29 16:15:13 user nova-compute[75245]:     <controller type="usb" index="0" model="none"/>
Nov 29 16:15:13 user nova-compute[75245]:     <memballoon model="virtio">
Nov 29 16:15:13 user nova-compute[75245]:       <stats period="10"/>
Nov 29 16:15:13 user nova-compute[75245]:     </memballoon>
Nov 29 16:15:13 user nova-compute[75245]:   </devices>
Nov 29 16:15:13 user nova-compute[75245]: </domain>
Nov 29 16:15:13 user nova-compute[75245]:  {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 16:15:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T16:15:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-674037423',display_name='tempest-AttachSCSIVolumeTestJSON-server-674037423',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-674037423',id=17,image_ref='6ccaa852-1bd2-402f-9049-f4756a98a62d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIpbMVJBSu/Ho+4zKgopCd5vpQe24yBq2pRAbQj56Fjeu3rEN8WLJ/OnuC/3M5/73jIWk4qKKgJeSYC72pnvhZ2F5SminNo1Wjy4vZjuBEckasGfduEk4ayj5vlBID6mRw==',key_name='tempest-keypair-881689391',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c94b9aa8ead849878a724d3e77c2cf83',ramdisk_id='',reservation_id='r-tirig9ki',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ccaa852-1bd2-402f-9049-f4756a98a62d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1036962361',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1036962361-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:15:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc3579c7a7b54cf592cbdf7df55e2d0e',uuid=b99c5e50-a98b-45a2-b170-664c93109897,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9647e37-1ab6-40fb-8874-a626692dd676", "address": "fa:16:3e:12:85:81", "network": {"id": "161e15da-e083-48c0-82ad-b2326e4dc33b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1831426097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c94b9aa8ead849878a724d3e77c2cf83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9647e37-1a", "ovs_interfaceid": "e9647e37-1ab6-40fb-8874-a626692dd676", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 16:15:13 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Converting VIF {"id": "e9647e37-1ab6-40fb-8874-a626692dd676", "address": "fa:16:3e:12:85:81", "network": {"id": "161e15da-e083-48c0-82ad-b2326e4dc33b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1831426097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c94b9aa8ead849878a724d3e77c2cf83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9647e37-1a", "ovs_interfaceid": "e9647e37-1ab6-40fb-8874-a626692dd676", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:15:13 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:85:81,bridge_name='br-int',has_traffic_filtering=True,id=e9647e37-1ab6-40fb-8874-a626692dd676,network=Network(161e15da-e083-48c0-82ad-b2326e4dc33b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9647e37-1a') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:15:13 user nova-compute[75245]: DEBUG os_vif [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:85:81,bridge_name='br-int',has_traffic_filtering=True,id=e9647e37-1ab6-40fb-8874-a626692dd676,network=Network(161e15da-e083-48c0-82ad-b2326e4dc33b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9647e37-1a') {{(pid=75245) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 16:15:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:15:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:15:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 16:15:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:15:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '486137e2-f049-55eb-a7c6-49079070117b', '_type': 'linux-noop'}}, row=False) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:15:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:15:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:15:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:15:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape9647e37-1a, may_exist=True, interface_attrs={}) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:15:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape9647e37-1a, col_values=(('qos', UUID('38496aa3-c8f0-4444-9639-74dec538863a')),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:15:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape9647e37-1a, col_values=(('external_ids', {'iface-id': 'e9647e37-1ab6-40fb-8874-a626692dd676', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:85:81', 'vm-uuid': 'b99c5e50-a98b-45a2-b170-664c93109897'}),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:15:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:15:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:15:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:15:13 user nova-compute[75245]: INFO os_vif [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:85:81,bridge_name='br-int',has_traffic_filtering=True,id=e9647e37-1ab6-40fb-8874-a626692dd676,network=Network(161e15da-e083-48c0-82ad-b2326e4dc33b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9647e37-1a')
Nov 29 16:15:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] No BDM found with device name sda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:15:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:15:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] No VIF found with MAC fa:16:3e:12:85:81, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:15:13 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] [instance: b99c5e50-a98b-45a2-b170-664c93109897] Using config drive
Nov 29 16:15:13 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] [instance: b99c5e50-a98b-45a2-b170-664c93109897] Creating config drive at /opt/stack/data/nova/instances/b99c5e50-a98b-45a2-b170-664c93109897/disk.config
Nov 29 16:15:13 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b99c5e50-a98b-45a2-b170-664c93109897/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp18ehg1w1 {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:15:13 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b99c5e50-a98b-45a2-b170-664c93109897/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp18ehg1w1" returned: 0 in 0.074s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:15:13 user nova-compute[75245]: DEBUG nova.network.neutron [req-d817d930-c232-4f50-9eff-4f6913f511ad req-f253d208-0699-4cdb-ad8e-568a00f42988 service nova] [instance: b99c5e50-a98b-45a2-b170-664c93109897] Updated VIF entry in instance network info cache for port e9647e37-1ab6-40fb-8874-a626692dd676. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:15:13 user nova-compute[75245]: DEBUG nova.network.neutron [req-d817d930-c232-4f50-9eff-4f6913f511ad req-f253d208-0699-4cdb-ad8e-568a00f42988 service nova] [instance: b99c5e50-a98b-45a2-b170-664c93109897] Updating instance_info_cache with network_info: [{"id": "e9647e37-1ab6-40fb-8874-a626692dd676", "address": "fa:16:3e:12:85:81", "network": {"id": "161e15da-e083-48c0-82ad-b2326e4dc33b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1831426097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c94b9aa8ead849878a724d3e77c2cf83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9647e37-1a", "ovs_interfaceid": "e9647e37-1ab6-40fb-8874-a626692dd676", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:15:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d817d930-c232-4f50-9eff-4f6913f511ad req-f253d208-0699-4cdb-ad8e-568a00f42988 service nova] Releasing lock "refresh_cache-b99c5e50-a98b-45a2-b170-664c93109897" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:15:14 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-db6bff6a-3d74-48a1-a6c2-ef1fa33586be tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Acquiring lock "0db15db5-e8a9-46a8-98cc-99d7fde61508" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:15:14 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-db6bff6a-3d74-48a1-a6c2-ef1fa33586be tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Lock "0db15db5-e8a9-46a8-98cc-99d7fde61508" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:15:14 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-db6bff6a-3d74-48a1-a6c2-ef1fa33586be tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Acquiring lock "0db15db5-e8a9-46a8-98cc-99d7fde61508-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:15:14 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-db6bff6a-3d74-48a1-a6c2-ef1fa33586be tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Lock "0db15db5-e8a9-46a8-98cc-99d7fde61508-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:15:14 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-db6bff6a-3d74-48a1-a6c2-ef1fa33586be tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Lock "0db15db5-e8a9-46a8-98cc-99d7fde61508-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:15:14 user nova-compute[75245]: INFO nova.compute.manager [None req-db6bff6a-3d74-48a1-a6c2-ef1fa33586be tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 0db15db5-e8a9-46a8-98cc-99d7fde61508] Terminating instance
Nov 29 16:15:14 user nova-compute[75245]: DEBUG nova.compute.manager [None req-db6bff6a-3d74-48a1-a6c2-ef1fa33586be tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 0db15db5-e8a9-46a8-98cc-99d7fde61508] Start destroying the instance on the hypervisor. {{(pid=75245) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 16:15:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:15:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:15:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:15:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:15:15 user nova-compute[75245]: DEBUG nova.compute.manager [req-d94c8f18-4293-4af9-8b91-f81dc123ace6 req-0dd19a78-7131-4300-9f76-ee7baa7e6f37 service nova] [instance: 0db15db5-e8a9-46a8-98cc-99d7fde61508] Received event network-vif-unplugged-769ef353-e386-451b-b882-d7d1b0deeb52 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:15:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d94c8f18-4293-4af9-8b91-f81dc123ace6 req-0dd19a78-7131-4300-9f76-ee7baa7e6f37 service nova] Acquiring lock "0db15db5-e8a9-46a8-98cc-99d7fde61508-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:15:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d94c8f18-4293-4af9-8b91-f81dc123ace6 req-0dd19a78-7131-4300-9f76-ee7baa7e6f37 service nova] Lock "0db15db5-e8a9-46a8-98cc-99d7fde61508-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:15:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d94c8f18-4293-4af9-8b91-f81dc123ace6 req-0dd19a78-7131-4300-9f76-ee7baa7e6f37 service nova] Lock "0db15db5-e8a9-46a8-98cc-99d7fde61508-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:15:15 user nova-compute[75245]: DEBUG nova.compute.manager [req-d94c8f18-4293-4af9-8b91-f81dc123ace6 req-0dd19a78-7131-4300-9f76-ee7baa7e6f37 service nova] [instance: 0db15db5-e8a9-46a8-98cc-99d7fde61508] No waiting events found dispatching network-vif-unplugged-769ef353-e386-451b-b882-d7d1b0deeb52 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:15:15 user nova-compute[75245]: DEBUG nova.compute.manager [req-d94c8f18-4293-4af9-8b91-f81dc123ace6 req-0dd19a78-7131-4300-9f76-ee7baa7e6f37 service nova] [instance: 0db15db5-e8a9-46a8-98cc-99d7fde61508] Received event network-vif-unplugged-769ef353-e386-451b-b882-d7d1b0deeb52 for instance with task_state deleting. {{(pid=75245) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 16:15:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:15:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:15:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:15:15 user nova-compute[75245]: DEBUG nova.compute.manager [req-52d703a6-5f81-4467-95bd-46e8e03224b5 req-b929e990-c7a5-4a10-bb20-61c8622f7645 service nova] [instance: b99c5e50-a98b-45a2-b170-664c93109897] Received event network-vif-plugged-e9647e37-1ab6-40fb-8874-a626692dd676 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:15:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-52d703a6-5f81-4467-95bd-46e8e03224b5 req-b929e990-c7a5-4a10-bb20-61c8622f7645 service nova] Acquiring lock "b99c5e50-a98b-45a2-b170-664c93109897-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:15:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-52d703a6-5f81-4467-95bd-46e8e03224b5 req-b929e990-c7a5-4a10-bb20-61c8622f7645 service nova] Lock "b99c5e50-a98b-45a2-b170-664c93109897-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:15:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-52d703a6-5f81-4467-95bd-46e8e03224b5 req-b929e990-c7a5-4a10-bb20-61c8622f7645 service nova] Lock "b99c5e50-a98b-45a2-b170-664c93109897-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:15:15 user nova-compute[75245]: DEBUG nova.compute.manager [req-52d703a6-5f81-4467-95bd-46e8e03224b5 req-b929e990-c7a5-4a10-bb20-61c8622f7645 service nova] [instance: b99c5e50-a98b-45a2-b170-664c93109897] No waiting events found dispatching network-vif-plugged-e9647e37-1ab6-40fb-8874-a626692dd676 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:15:15 user nova-compute[75245]: WARNING nova.compute.manager [req-52d703a6-5f81-4467-95bd-46e8e03224b5 req-b929e990-c7a5-4a10-bb20-61c8622f7645 service nova] [instance: b99c5e50-a98b-45a2-b170-664c93109897] Received unexpected event network-vif-plugged-e9647e37-1ab6-40fb-8874-a626692dd676 for instance with vm_state building and task_state spawning.
Nov 29 16:15:15 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 0db15db5-e8a9-46a8-98cc-99d7fde61508] Instance destroyed successfully.
Nov 29 16:15:15 user nova-compute[75245]: DEBUG nova.objects.instance [None req-db6bff6a-3d74-48a1-a6c2-ef1fa33586be tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Lazy-loading 'resources' on Instance uuid 0db15db5-e8a9-46a8-98cc-99d7fde61508 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:15:15 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-db6bff6a-3d74-48a1-a6c2-ef1fa33586be tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:13:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1557265249',display_name='tempest-VolumesAdminNegativeTest-server-1557265249',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1557265249',id=13,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:13:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2a08c8f9089c4291b552c567e010b0c5',ramdisk_id='',reservation_id='r-bdyslm7k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-193480502',owner_user_name='tempest-VolumesAdminNegativeTest-193480502-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:13:20Z,user_data=None,user_id='39676e279e7f4fea9383dacfb0ea7875',uuid=0db15db5-e8a9-46a8-98cc-99d7fde61508,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "769ef353-e386-451b-b882-d7d1b0deeb52", "address": "fa:16:3e:57:53:dc", "network": {"id": "ae7be65e-9c9f-4836-aee2-9d465d5d28f6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-521099242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a08c8f9089c4291b552c567e010b0c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap769ef353-e3", "ovs_interfaceid": "769ef353-e386-451b-b882-d7d1b0deeb52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 16:15:15 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-db6bff6a-3d74-48a1-a6c2-ef1fa33586be tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Converting VIF {"id": "769ef353-e386-451b-b882-d7d1b0deeb52", "address": "fa:16:3e:57:53:dc", "network": {"id": "ae7be65e-9c9f-4836-aee2-9d465d5d28f6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-521099242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a08c8f9089c4291b552c567e010b0c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap769ef353-e3", "ovs_interfaceid": "769ef353-e386-451b-b882-d7d1b0deeb52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:15:15 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-db6bff6a-3d74-48a1-a6c2-ef1fa33586be tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:53:dc,bridge_name='br-int',has_traffic_filtering=True,id=769ef353-e386-451b-b882-d7d1b0deeb52,network=Network(ae7be65e-9c9f-4836-aee2-9d465d5d28f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap769ef353-e3') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:15:15 user nova-compute[75245]: DEBUG os_vif [None req-db6bff6a-3d74-48a1-a6c2-ef1fa33586be tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:53:dc,bridge_name='br-int',has_traffic_filtering=True,id=769ef353-e386-451b-b882-d7d1b0deeb52,network=Network(ae7be65e-9c9f-4836-aee2-9d465d5d28f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap769ef353-e3') {{(pid=75245) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 16:15:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:15:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap769ef353-e3, bridge=br-int, if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:15:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:15:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:15:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:15:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d5ef2272-8b07-4aa4-bf16-3c2c2cd9a52f) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:15:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:15:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:15:15 user nova-compute[75245]: INFO os_vif [None req-db6bff6a-3d74-48a1-a6c2-ef1fa33586be tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:53:dc,bridge_name='br-int',has_traffic_filtering=True,id=769ef353-e386-451b-b882-d7d1b0deeb52,network=Network(ae7be65e-9c9f-4836-aee2-9d465d5d28f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap769ef353-e3')
Nov 29 16:15:15 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-db6bff6a-3d74-48a1-a6c2-ef1fa33586be tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 0db15db5-e8a9-46a8-98cc-99d7fde61508] Deleting instance files /opt/stack/data/nova/instances/0db15db5-e8a9-46a8-98cc-99d7fde61508_del
Nov 29 16:15:15 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-db6bff6a-3d74-48a1-a6c2-ef1fa33586be tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 0db15db5-e8a9-46a8-98cc-99d7fde61508] Deletion of /opt/stack/data/nova/instances/0db15db5-e8a9-46a8-98cc-99d7fde61508_del complete
Nov 29 16:15:15 user nova-compute[75245]: INFO nova.compute.manager [None req-db6bff6a-3d74-48a1-a6c2-ef1fa33586be tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 0db15db5-e8a9-46a8-98cc-99d7fde61508] Took 1.15 seconds to destroy the instance on the hypervisor.
Nov 29 16:15:15 user nova-compute[75245]: DEBUG oslo.service.loopingcall [None req-db6bff6a-3d74-48a1-a6c2-ef1fa33586be tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75245) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 16:15:15 user nova-compute[75245]: DEBUG nova.compute.manager [-] [instance: 0db15db5-e8a9-46a8-98cc-99d7fde61508] Deallocating network for instance {{(pid=75245) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 16:15:15 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: 0db15db5-e8a9-46a8-98cc-99d7fde61508] deallocate_for_instance() {{(pid=75245) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 16:15:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:15:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:15:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:15:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:15:16 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: 0db15db5-e8a9-46a8-98cc-99d7fde61508] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:15:16 user nova-compute[75245]: INFO nova.compute.manager [-] [instance: 0db15db5-e8a9-46a8-98cc-99d7fde61508] Took 0.50 seconds to deallocate network for instance.
Nov 29 16:15:16 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-db6bff6a-3d74-48a1-a6c2-ef1fa33586be tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:15:16 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-db6bff6a-3d74-48a1-a6c2-ef1fa33586be tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:15:16 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-db6bff6a-3d74-48a1-a6c2-ef1fa33586be tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:15:16 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-db6bff6a-3d74-48a1-a6c2-ef1fa33586be tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:15:16 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-db6bff6a-3d74-48a1-a6c2-ef1fa33586be tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.350s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:15:16 user nova-compute[75245]: INFO nova.scheduler.client.report [None req-db6bff6a-3d74-48a1-a6c2-ef1fa33586be tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Deleted allocations for instance 0db15db5-e8a9-46a8-98cc-99d7fde61508
Nov 29 16:15:16 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-db6bff6a-3d74-48a1-a6c2-ef1fa33586be tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Lock "0db15db5-e8a9-46a8-98cc-99d7fde61508" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.188s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:15:17 user nova-compute[75245]: DEBUG nova.compute.manager [req-7a8e9949-2656-4067-9cc1-fc2be70ba0d1 req-7d1ec63e-9313-422d-8c9b-5226cfe1998a service nova] [instance: 0db15db5-e8a9-46a8-98cc-99d7fde61508] Received event network-vif-plugged-769ef353-e386-451b-b882-d7d1b0deeb52 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:15:17 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-7a8e9949-2656-4067-9cc1-fc2be70ba0d1 req-7d1ec63e-9313-422d-8c9b-5226cfe1998a service nova] Acquiring lock "0db15db5-e8a9-46a8-98cc-99d7fde61508-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:15:17 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-7a8e9949-2656-4067-9cc1-fc2be70ba0d1 req-7d1ec63e-9313-422d-8c9b-5226cfe1998a service nova] Lock "0db15db5-e8a9-46a8-98cc-99d7fde61508-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:15:17 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-7a8e9949-2656-4067-9cc1-fc2be70ba0d1 req-7d1ec63e-9313-422d-8c9b-5226cfe1998a service nova] Lock "0db15db5-e8a9-46a8-98cc-99d7fde61508-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:15:17 user nova-compute[75245]: DEBUG nova.compute.manager [req-7a8e9949-2656-4067-9cc1-fc2be70ba0d1 req-7d1ec63e-9313-422d-8c9b-5226cfe1998a service nova] [instance: 0db15db5-e8a9-46a8-98cc-99d7fde61508] No waiting events found dispatching network-vif-plugged-769ef353-e386-451b-b882-d7d1b0deeb52 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:15:17 user nova-compute[75245]: WARNING nova.compute.manager [req-7a8e9949-2656-4067-9cc1-fc2be70ba0d1 req-7d1ec63e-9313-422d-8c9b-5226cfe1998a service nova] [instance: 0db15db5-e8a9-46a8-98cc-99d7fde61508] Received unexpected event network-vif-plugged-769ef353-e386-451b-b882-d7d1b0deeb52 for instance with vm_state deleted and task_state None.
Nov 29 16:15:17 user nova-compute[75245]: DEBUG nova.compute.manager [req-7a8e9949-2656-4067-9cc1-fc2be70ba0d1 req-7d1ec63e-9313-422d-8c9b-5226cfe1998a service nova] [instance: 0db15db5-e8a9-46a8-98cc-99d7fde61508] Received event network-vif-deleted-769ef353-e386-451b-b882-d7d1b0deeb52 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:15:17 user nova-compute[75245]: DEBUG nova.compute.manager [req-001c2724-d5b5-4409-8013-9fb7d2767775 req-a8815a90-246c-482e-950e-c485d635c929 service nova] [instance: b99c5e50-a98b-45a2-b170-664c93109897] Received event network-vif-plugged-e9647e37-1ab6-40fb-8874-a626692dd676 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:15:17 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-001c2724-d5b5-4409-8013-9fb7d2767775 req-a8815a90-246c-482e-950e-c485d635c929 service nova] Acquiring lock "b99c5e50-a98b-45a2-b170-664c93109897-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:15:17 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-001c2724-d5b5-4409-8013-9fb7d2767775 req-a8815a90-246c-482e-950e-c485d635c929 service nova] Lock "b99c5e50-a98b-45a2-b170-664c93109897-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:15:17 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-001c2724-d5b5-4409-8013-9fb7d2767775 req-a8815a90-246c-482e-950e-c485d635c929 service nova] Lock "b99c5e50-a98b-45a2-b170-664c93109897-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:15:17 user nova-compute[75245]: DEBUG nova.compute.manager [req-001c2724-d5b5-4409-8013-9fb7d2767775 req-a8815a90-246c-482e-950e-c485d635c929 service nova] [instance: b99c5e50-a98b-45a2-b170-664c93109897] No waiting events found dispatching network-vif-plugged-e9647e37-1ab6-40fb-8874-a626692dd676 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:15:17 user nova-compute[75245]: WARNING nova.compute.manager [req-001c2724-d5b5-4409-8013-9fb7d2767775 req-a8815a90-246c-482e-950e-c485d635c929 service nova] [instance: b99c5e50-a98b-45a2-b170-664c93109897] Received unexpected event network-vif-plugged-e9647e37-1ab6-40fb-8874-a626692dd676 for instance with vm_state building and task_state spawning.
Nov 29 16:15:17 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:15:18 user nova-compute[75245]: DEBUG nova.compute.manager [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] [instance: b99c5e50-a98b-45a2-b170-664c93109897] Instance event wait completed in 0 seconds for  {{(pid=75245) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 16:15:18 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] [instance: b99c5e50-a98b-45a2-b170-664c93109897] Guest created on hypervisor {{(pid=75245) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 16:15:18 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: b99c5e50-a98b-45a2-b170-664c93109897] Instance spawned successfully.
Nov 29 16:15:18 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] [instance: b99c5e50-a98b-45a2-b170-664c93109897] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 16:15:18 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] [instance: b99c5e50-a98b-45a2-b170-664c93109897] Found default for hw_input_bus of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:15:18 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] [instance: b99c5e50-a98b-45a2-b170-664c93109897] Found default for hw_pointer_model of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:15:18 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] [instance: b99c5e50-a98b-45a2-b170-664c93109897] Found default for hw_video_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:15:18 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] [instance: b99c5e50-a98b-45a2-b170-664c93109897] Found default for hw_vif_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:15:18 user nova-compute[75245]: INFO nova.compute.manager [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] [instance: b99c5e50-a98b-45a2-b170-664c93109897] Took 8.01 seconds to spawn the instance on the hypervisor.
Nov 29 16:15:18 user nova-compute[75245]: DEBUG nova.compute.manager [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] [instance: b99c5e50-a98b-45a2-b170-664c93109897] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:15:18 user nova-compute[75245]: INFO nova.compute.manager [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] [instance: b99c5e50-a98b-45a2-b170-664c93109897] Took 8.89 seconds to build instance.
Nov 29 16:15:18 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-306d0d09-63f2-49ad-87d2-992ee9d61131 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Lock "b99c5e50-a98b-45a2-b170-664c93109897" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.005s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:15:20 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:15:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:15:25 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:15:30 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:15:30 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:15:30 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75245) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 16:15:30 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:15:30 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:15:30 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:15:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:15:35 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:15:37 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:15:40 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:15:42 user nova-compute[75245]: DEBUG nova.compute.manager [req-614f35e1-d1b6-4a69-b600-3b3c190cedb7 req-5622da55-0c5b-4ebb-a080-505e138bd6b7 service nova] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Received event network-changed-f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:15:42 user nova-compute[75245]: DEBUG nova.compute.manager [req-614f35e1-d1b6-4a69-b600-3b3c190cedb7 req-5622da55-0c5b-4ebb-a080-505e138bd6b7 service nova] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Refreshing instance network info cache due to event network-changed-f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:15:42 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-614f35e1-d1b6-4a69-b600-3b3c190cedb7 req-5622da55-0c5b-4ebb-a080-505e138bd6b7 service nova] Acquiring lock "refresh_cache-816edb0e-c4fc-470b-8151-f98502e50789" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:15:42 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-614f35e1-d1b6-4a69-b600-3b3c190cedb7 req-5622da55-0c5b-4ebb-a080-505e138bd6b7 service nova] Acquired lock "refresh_cache-816edb0e-c4fc-470b-8151-f98502e50789" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:15:42 user nova-compute[75245]: DEBUG nova.network.neutron [req-614f35e1-d1b6-4a69-b600-3b3c190cedb7 req-5622da55-0c5b-4ebb-a080-505e138bd6b7 service nova] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Refreshing network info cache for port f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:15:42 user nova-compute[75245]: DEBUG nova.network.neutron [req-614f35e1-d1b6-4a69-b600-3b3c190cedb7 req-5622da55-0c5b-4ebb-a080-505e138bd6b7 service nova] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Updated VIF entry in instance network info cache for port f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:15:42 user nova-compute[75245]: DEBUG nova.network.neutron [req-614f35e1-d1b6-4a69-b600-3b3c190cedb7 req-5622da55-0c5b-4ebb-a080-505e138bd6b7 service nova] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Updating instance_info_cache with network_info: [{"id": "f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76", "address": "fa:16:3e:f9:3e:bc", "network": {"id": "f1fac2f4-e789-443e-b6a5-1a3f829bc302", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1199431077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6b87e18ef1f48d19a6907b28cb54f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf038ddf7-a5", "ovs_interfaceid": "f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:15:42 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-7148c757-7920-405a-836d-7d7e7c588616 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Acquiring lock "816edb0e-c4fc-470b-8151-f98502e50789" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:15:42 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-7148c757-7920-405a-836d-7d7e7c588616 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "816edb0e-c4fc-470b-8151-f98502e50789" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:15:42 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-614f35e1-d1b6-4a69-b600-3b3c190cedb7 req-5622da55-0c5b-4ebb-a080-505e138bd6b7 service nova] Releasing lock "refresh_cache-816edb0e-c4fc-470b-8151-f98502e50789" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:15:42 user nova-compute[75245]: DEBUG nova.objects.instance [None req-7148c757-7920-405a-836d-7d7e7c588616 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lazy-loading 'flavor' on Instance uuid 816edb0e-c4fc-470b-8151-f98502e50789 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:15:42 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:15:42 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-7148c757-7920-405a-836d-7d7e7c588616 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "816edb0e-c4fc-470b-8151-f98502e50789" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.082s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:15:43 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-7148c757-7920-405a-836d-7d7e7c588616 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Acquiring lock "816edb0e-c4fc-470b-8151-f98502e50789" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:15:43 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-7148c757-7920-405a-836d-7d7e7c588616 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "816edb0e-c4fc-470b-8151-f98502e50789" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:15:43 user nova-compute[75245]: INFO nova.compute.manager [None req-7148c757-7920-405a-836d-7d7e7c588616 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Attaching volume 6a84dd1c-3444-4e5d-ae8f-654a1901737c to /dev/vdb
Nov 29 16:15:43 user nova-compute[75245]: DEBUG os_brick.utils [None req-7148c757-7920-405a-836d-7d7e7c588616 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:15:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:15:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:15:43 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[972f72ed-5ebe-4247-a936-1acf2cf3eb04]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:69ed8ed87091\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:15:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:15:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:15:43 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0de6dd-b698-4e7b-81dd-aa229241fb75]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:15:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:15:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:15:43 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb8d259-c168-4262-9a7c-7ab885744422]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:15:43 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[edecc839-0731-46bd-ad6f-ec72a05177c0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:15:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-7148c757-7920-405a-836d-7d7e7c588616 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Running cmd (subprocess): nvme version {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:15:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-7148c757-7920-405a-836d-7d7e7c588616 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] 'nvme version' failed. Not Retrying. {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:15:43 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7148c757-7920-405a-836d-7d7e7c588616 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] nvme not present on system {{(pid=75245) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 16:15:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:15:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:15:43 user nova-compute[75245]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 16:15:43 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[f751615e-19b2-41bb-a93a-e55a1e20f06a]: (4, '') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:15:43 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-7148c757-7920-405a-836d-7d7e7c588616 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75245) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 16:15:43 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-7148c757-7920-405a-836d-7d7e7c588616 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 16:15:43 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-7148c757-7920-405a-836d-7d7e7c588616 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] LIGHTOS: no hostnqn found. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 16:15:43 user nova-compute[75245]: DEBUG os_brick.utils [None req-7148c757-7920-405a-836d-7d7e7c588616 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:69ed8ed87091', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:15:43 user nova-compute[75245]: DEBUG nova.virt.block_device [None req-7148c757-7920-405a-836d-7d7e7c588616 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Updating existing volume attachment record: 90d66834-a290-4fa3-af25-7468fe06eff6 {{(pid=75245) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 16:15:45 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-5d3e8e05-3d11-4cd4-9eec-00ec93aa2696 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Acquiring lock "3ab9d7cd-79cd-4c9b-8608-c1ef0f333305" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:15:45 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-5d3e8e05-3d11-4cd4-9eec-00ec93aa2696 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lock "3ab9d7cd-79cd-4c9b-8608-c1ef0f333305" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:15:45 user nova-compute[75245]: INFO nova.compute.manager [None req-5d3e8e05-3d11-4cd4-9eec-00ec93aa2696 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Detaching volume a74ae150-7d3d-47ca-80a6-1bc324280bd5
Nov 29 16:15:45 user nova-compute[75245]: INFO nova.virt.block_device [None req-5d3e8e05-3d11-4cd4-9eec-00ec93aa2696 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Attempting to driver detach volume a74ae150-7d3d-47ca-80a6-1bc324280bd5 from mountpoint /dev/vdc
Nov 29 16:15:45 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-5d3e8e05-3d11-4cd4-9eec-00ec93aa2696 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Attempting to detach device vdc from instance 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305 from the persistent domain config. {{(pid=75245) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 16:15:45 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-5d3e8e05-3d11-4cd4-9eec-00ec93aa2696 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 16:15:45 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:15:45 user nova-compute[75245]:   <source dev="/dev/sdc"/>
Nov 29 16:15:45 user nova-compute[75245]:   <target dev="vdc" bus="virtio"/>
Nov 29 16:15:45 user nova-compute[75245]:   <serial>a74ae150-7d3d-47ca-80a6-1bc324280bd5</serial>
Nov 29 16:15:45 user nova-compute[75245]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 16:15:45 user nova-compute[75245]: </disk>
Nov 29 16:15:45 user nova-compute[75245]:  {{(pid=75245) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 16:15:45 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-5d3e8e05-3d11-4cd4-9eec-00ec93aa2696 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Successfully detached device vdc from instance 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305 from the persistent domain config.
Nov 29 16:15:45 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-5d3e8e05-3d11-4cd4-9eec-00ec93aa2696 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305 from the live domain config. {{(pid=75245) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 16:15:45 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-5d3e8e05-3d11-4cd4-9eec-00ec93aa2696 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 16:15:45 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:15:45 user nova-compute[75245]:   <source dev="/dev/sdc"/>
Nov 29 16:15:45 user nova-compute[75245]:   <target dev="vdc" bus="virtio"/>
Nov 29 16:15:45 user nova-compute[75245]:   <serial>a74ae150-7d3d-47ca-80a6-1bc324280bd5</serial>
Nov 29 16:15:45 user nova-compute[75245]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 16:15:45 user nova-compute[75245]: </disk>
Nov 29 16:15:45 user nova-compute[75245]:  {{(pid=75245) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 16:15:45 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-5d3e8e05-3d11-4cd4-9eec-00ec93aa2696 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305 {{(pid=75245) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 16:15:45 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:15:47 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:15:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:15:51 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:15:51 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75245) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 16:15:51 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7148c757-7920-405a-836d-7d7e7c588616 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Calling os-brick to attach iSCSI Volume {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 16:15:51 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-7148c757-7920-405a-836d-7d7e7c588616 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sPFkjprb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:15:51 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-7148c757-7920-405a-836d-7d7e7c588616 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:15:51 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-7148c757-7920-405a-836d-7d7e7c588616 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:15:51 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-7148c757-7920-405a-836d-7d7e7c588616 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:15:51 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-7148c757-7920-405a-836d-7d7e7c588616 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:15:51 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-7148c757-7920-405a-836d-7d7e7c588616 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:15:51 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-7148c757-7920-405a-836d-7d7e7c588616 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:15:51 user nova-compute[75245]: INFO os_brick.initiator.connectors.iscsi [None req-7148c757-7920-405a-836d-7d7e7c588616 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 16:15:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c -p 172.16.0.220:3260 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:15:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:15:51 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15fe907-4df2-4e3c-9093-243e56d8f176]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:15:51 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-7148c757-7920-405a-836d-7d7e7c588616 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 16:15:51 user nova-compute[75245]:  {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:15:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c -p 172.16.0.220:3260 --interface default --op new {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:15:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:15:51 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd290f06-6e7e-479d-b4ca-1f56c64fc84d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c] added\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:15:51 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-7148c757-7920-405a-836d-7d7e7c588616 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c] added
Nov 29 16:15:51 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:15:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:15:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:15:51 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3ec852-dec8-4e01-827e-bb6c6ea0f6c4]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:15:51 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-7148c757-7920-405a-836d-7d7e7c588616 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:15:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:15:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:15:51 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[16017899-f6b5-4fa9-97ba-4783a3175f8e]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:15:51 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-7148c757-7920-405a-836d-7d7e7c588616 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:15:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sPFkjprb {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:15:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sPFkjprb" returned: 0 in 0.022s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:15:51 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[23473f1c-ba88-4144-b4fb-1af2770a3a6d]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:15:51 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-7148c757-7920-405a-836d-7d7e7c588616 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sPFkjprb'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:15:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:15:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:15:51 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[343c199b-eaa9-4893-b150-9b4baab5dab6]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:15:51 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-7148c757-7920-405a-836d-7d7e7c588616 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:15:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:15:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:15:51 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[265b4b79-86ed-4de7-8cec-7de99248ca29]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:15:51 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-7148c757-7920-405a-836d-7d7e7c588616 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5 (non-flash)
Nov 29 16:15:51 user nova-compute[75245]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18 (non-flash)
Nov 29 16:15:51 user nova-compute[75245]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49 (non-flash)
Nov 29 16:15:51 user nova-compute[75245]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea (non-flash)
Nov 29 16:15:51 user nova-compute[75245]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 (non-flash)
Nov 29 16:15:51 user nova-compute[75245]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f (non-flash)
Nov 29 16:15:51 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:15:51 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-7148c757-7920-405a-836d-7d7e7c588616 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5 (non-flash)
Nov 29 16:15:51 user nova-compute[75245]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18 (non-flash)
Nov 29 16:15:51 user nova-compute[75245]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49 (non-flash)
Nov 29 16:15:51 user nova-compute[75245]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea (non-flash)
Nov 29 16:15:51 user nova-compute[75245]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 (non-flash)
Nov 29 16:15:51 user nova-compute[75245]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f (non-flash)
Nov 29 16:15:51 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:15:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c -p 172.16.0.220:3260 --login {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:15:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:15:51 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c12586-b36c-4e19-8769-378cd56163a6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:15:51 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-7148c757-7920-405a-836d-7d7e7c588616 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c, portal: 172.16.0.220,3260]
Nov 29 16:15:51 user nova-compute[75245]: Login to [iface: default, target: iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c, portal: 172.16.0.220,3260] successful.
Nov 29 16:15:51 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:15:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:15:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:15:51 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[e69a4932-7cb9-42df-bca0-9ed2861cec62]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:15:51 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-7148c757-7920-405a-836d-7d7e7c588616 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:15:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:15:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:15:51 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d0e7bde-c4bd-4a68-9c2e-abb634efba28]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:15:51 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-7148c757-7920-405a-836d-7d7e7c588616 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5 (non-flash)
Nov 29 16:15:51 user nova-compute[75245]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18 (non-flash)
Nov 29 16:15:51 user nova-compute[75245]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49 (non-flash)
Nov 29 16:15:51 user nova-compute[75245]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea (non-flash)
Nov 29 16:15:51 user nova-compute[75245]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 (non-flash)
Nov 29 16:15:51 user nova-compute[75245]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f (non-flash)
Nov 29 16:15:51 user nova-compute[75245]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c (non-flash)
Nov 29 16:15:51 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:15:51 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-7148c757-7920-405a-836d-7d7e7c588616 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5 (non-flash)
Nov 29 16:15:51 user nova-compute[75245]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18 (non-flash)
Nov 29 16:15:51 user nova-compute[75245]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49 (non-flash)
Nov 29 16:15:51 user nova-compute[75245]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea (non-flash)
Nov 29 16:15:51 user nova-compute[75245]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 (non-flash)
Nov 29 16:15:51 user nova-compute[75245]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f (non-flash)
Nov 29 16:15:51 user nova-compute[75245]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c (non-flash)
Nov 29 16:15:51 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:15:51 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-7148c757-7920-405a-836d-7d7e7c588616 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:15:51 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-7148c757-7920-405a-836d-7d7e7c588616 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Connected to 172.16.0.220:3260 {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 16:15:51 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-7148c757-7920-405a-836d-7d7e7c588616 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] HCTL ('37', '-', '-', 0) found on session 20 with lun 0 {{(pid=75245) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 16:15:51 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-7148c757-7920-405a-836d-7d7e7c588616 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75245) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 16:15:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:15:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:15:51 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[d429bff7-a934-4cac-b128-1a9a551429c2]: (4, ('- - 0', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:15:51 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-7148c757-7920-405a-836d-7d7e7c588616 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Searching for a device in session 20 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75245) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 16:15:51 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-7148c757-7920-405a-836d-7d7e7c588616 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sPFkjprb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 16:15:52 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:15:52 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-7148c757-7920-405a-836d-7d7e7c588616 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:15:52 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-7148c757-7920-405a-836d-7d7e7c588616 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '26438326333303066', 'path': '/dev/sdf'} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:15:52 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7148c757-7920-405a-836d-7d7e7c588616 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26438326333303066', 'path': '/dev/sdf'} {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 16:15:52 user nova-compute[75245]: DEBUG nova.objects.instance [None req-7148c757-7920-405a-836d-7d7e7c588616 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lazy-loading 'flavor' on Instance uuid 816edb0e-c4fc-470b-8151-f98502e50789 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:15:52 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-7148c757-7920-405a-836d-7d7e7c588616 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 16:15:52 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:15:52 user nova-compute[75245]:   <source dev="/dev/sdf"/>
Nov 29 16:15:52 user nova-compute[75245]:   <target dev="vdb" bus="virtio"/>
Nov 29 16:15:52 user nova-compute[75245]:   <serial>6a84dd1c-3444-4e5d-ae8f-654a1901737c</serial>
Nov 29 16:15:52 user nova-compute[75245]: </disk>
Nov 29 16:15:52 user nova-compute[75245]:  {{(pid=75245) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 16:15:53 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-7148c757-7920-405a-836d-7d7e7c588616 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:15:53 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-7148c757-7920-405a-836d-7d7e7c588616 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:15:53 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-7148c757-7920-405a-836d-7d7e7c588616 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] No VIF found with MAC fa:16:3e:f9:3e:bc, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:15:53 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:15:53 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-7148c757-7920-405a-836d-7d7e7c588616 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "816edb0e-c4fc-470b-8151-f98502e50789" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.518s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:15:54 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:15:54 user nova-compute[75245]: INFO nova.compute.manager [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Rebuilding instance
Nov 29 16:15:54 user nova-compute[75245]: DEBUG nova.compute.manager [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:15:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:15:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:15:55 user nova-compute[75245]: DEBUG nova.compute.manager [req-f64c482c-ac2f-4ef4-a9e7-14f822ab54bb req-07cd3f47-adea-4ab1-ad68-74b682035ac8 service nova] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Received event network-vif-unplugged-f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:15:55 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-f64c482c-ac2f-4ef4-a9e7-14f822ab54bb req-07cd3f47-adea-4ab1-ad68-74b682035ac8 service nova] Acquiring lock "816edb0e-c4fc-470b-8151-f98502e50789-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:15:55 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-f64c482c-ac2f-4ef4-a9e7-14f822ab54bb req-07cd3f47-adea-4ab1-ad68-74b682035ac8 service nova] Lock "816edb0e-c4fc-470b-8151-f98502e50789-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:15:55 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-f64c482c-ac2f-4ef4-a9e7-14f822ab54bb req-07cd3f47-adea-4ab1-ad68-74b682035ac8 service nova] Lock "816edb0e-c4fc-470b-8151-f98502e50789-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:15:55 user nova-compute[75245]: DEBUG nova.compute.manager [req-f64c482c-ac2f-4ef4-a9e7-14f822ab54bb req-07cd3f47-adea-4ab1-ad68-74b682035ac8 service nova] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] No waiting events found dispatching network-vif-unplugged-f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:15:55 user nova-compute[75245]: WARNING nova.compute.manager [req-f64c482c-ac2f-4ef4-a9e7-14f822ab54bb req-07cd3f47-adea-4ab1-ad68-74b682035ac8 service nova] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Received unexpected event network-vif-unplugged-f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76 for instance with vm_state active and task_state rebuilding.
Nov 29 16:15:55 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:15:55 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:15:55 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:15:55 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Instance destroyed successfully.
Nov 29 16:15:55 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:15:55 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:15:55 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:15:55 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:15:55 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75245) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 16:15:55 user nova-compute[75245]: INFO nova.compute.manager [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Detaching volume 6a84dd1c-3444-4e5d-ae8f-654a1901737c
Nov 29 16:15:55 user nova-compute[75245]: INFO nova.virt.block_device [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Attempting to driver detach volume 6a84dd1c-3444-4e5d-ae8f-654a1901737c from mountpoint /dev/vdb
Nov 29 16:15:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/816edb0e-c4fc-470b-8151-f98502e50789/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:15:55 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Attempting to detach device vdb from instance 816edb0e-c4fc-470b-8151-f98502e50789 from the persistent domain config. {{(pid=75245) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 16:15:55 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 16:15:55 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:15:55 user nova-compute[75245]:   <source dev="/dev/sdf"/>
Nov 29 16:15:55 user nova-compute[75245]:   <target dev="vdb" bus="virtio"/>
Nov 29 16:15:55 user nova-compute[75245]:   <serial>6a84dd1c-3444-4e5d-ae8f-654a1901737c</serial>
Nov 29 16:15:55 user nova-compute[75245]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 16:15:55 user nova-compute[75245]: </disk>
Nov 29 16:15:55 user nova-compute[75245]:  {{(pid=75245) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 16:15:55 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Successfully detached device vdb from instance 816edb0e-c4fc-470b-8151-f98502e50789 from the persistent domain config.
Nov 29 16:15:55 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] calling os-brick to detach iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 16:15:55 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, {'target_iqn': 'iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sPFkjprb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:15:55 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 29 16:15:55 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:15:55 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:15:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:15:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:15:55 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[d621abd8-5fe9-41fb-95b3-e805223dbdd3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:15:55 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 16:15:55 user nova-compute[75245]: No targets found.
Nov 29 16:15:55 user nova-compute[75245]: iSNS:
Nov 29 16:15:55 user nova-compute[75245]: No targets found.
Nov 29 16:15:55 user nova-compute[75245]: STATIC:
Nov 29 16:15:55 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49
Nov 29 16:15:55 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:15:55 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:15:55 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026
Nov 29 16:15:55 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:15:55 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:15:55 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c
Nov 29 16:15:55 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:15:55 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:15:55 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5
Nov 29 16:15:55 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:15:55 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:15:55 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18
Nov 29 16:15:55 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:15:55 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:15:55 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea
Nov 29 16:15:55 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:15:55 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:15:55 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f
Nov 29 16:15:55 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:15:55 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:15:55 user nova-compute[75245]: FIRMWARE:
Nov 29 16:15:55 user nova-compute[75245]: No targets found.
Nov 29 16:15:55 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:15:55 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 16:15:55 user nova-compute[75245]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 16:15:55 user nova-compute[75245]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75245) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 16:15:55 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c', 0)] {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 16:15:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:15:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:15:55 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c4037f-5626-4927-96fd-b70ff6aedcea]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:15:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:15:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:15:55 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d8d808-8166-42f1-95f0-047a6e6d2814]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:15:55 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5 (non-flash)
Nov 29 16:15:55 user nova-compute[75245]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18 (non-flash)
Nov 29 16:15:55 user nova-compute[75245]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49 (non-flash)
Nov 29 16:15:55 user nova-compute[75245]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea (non-flash)
Nov 29 16:15:55 user nova-compute[75245]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 (non-flash)
Nov 29 16:15:55 user nova-compute[75245]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f (non-flash)
Nov 29 16:15:55 user nova-compute[75245]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c (non-flash)
Nov 29 16:15:55 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:15:55 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5 (non-flash)
Nov 29 16:15:55 user nova-compute[75245]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18 (non-flash)
Nov 29 16:15:55 user nova-compute[75245]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49 (non-flash)
Nov 29 16:15:55 user nova-compute[75245]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea (non-flash)
Nov 29 16:15:55 user nova-compute[75245]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 (non-flash)
Nov 29 16:15:55 user nova-compute[75245]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f (non-flash)
Nov 29 16:15:55 user nova-compute[75245]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c (non-flash)
Nov 29 16:15:55 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:15:55 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0d20777e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c'): ({'sdf'}, set())}) {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 16:15:55 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Removing single pathed devices sdf {{(pid=75245) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 16:15:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:15:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/816edb0e-c4fc-470b-8151-f98502e50789/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:15:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/816edb0e-c4fc-470b-8151-f98502e50789/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:15:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:15:55 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c257870-c694-425f-b6e2-10e9345d5cbe]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:15:55 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:15:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:15:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.025s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:15:55 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef1bc5d6-5bae-4536-934c-b17c3e1882b9]: (4, ('ok\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:15:55 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Flushing IO for device /dev/sdf {{(pid=75245) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 16:15:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:15:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:15:55 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada82c46-5c1c-46ce-b528-0e6cc956d6a9]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:15:55 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75245) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 16:15:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:15:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.055s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:15:55 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa6ee9b-7ea7-4d61-9586-fad4c12918b4]: (4, ('1', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:15:55 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 16:15:55 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] SCSI volumes sdf have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 16:15:55 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c')] {{(pid=75245) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 16:15:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:15:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:15:56 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4eafb73-d560-4dd8-9eb9-7724ada1677e]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:15:56 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:15:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c -p 172.16.0.220:3260 --logout {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:15:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/816edb0e-c4fc-470b-8151-f98502e50789/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:15:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:15:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd819060-4388-444d-809e-94f6b2e8f102/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:15:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:15:56 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[56fc264d-61a8-4926-bc1d-1db61437d5c9]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:15:56 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c, portal: 172.16.0.220,3260]
Nov 29 16:15:56 user nova-compute[75245]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c, portal: 172.16.0.220,3260] successful.
Nov 29 16:15:56 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:15:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c -p 172.16.0.220:3260 --op delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:15:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:15:56 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a7a515d-6758-4d6d-8449-3d810d3cc5fb]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:15:56 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:15:56 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.410s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:15:56 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] <== disconnect_volume: return (413ms) None {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:15:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Disconnected iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 16:15:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd819060-4388-444d-809e-94f6b2e8f102/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:15:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd819060-4388-444d-809e-94f6b2e8f102/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:15:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd819060-4388-444d-809e-94f6b2e8f102/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:15:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:15:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ab9d7cd-79cd-4c9b-8608-c1ef0f333305/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:15:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ab9d7cd-79cd-4c9b-8608-c1ef0f333305/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:15:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ab9d7cd-79cd-4c9b-8608-c1ef0f333305/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:15:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ab9d7cd-79cd-4c9b-8608-c1ef0f333305/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:15:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b99c5e50-a98b-45a2-b170-664c93109897/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:15:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b99c5e50-a98b-45a2-b170-664c93109897/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:15:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b99c5e50-a98b-45a2-b170-664c93109897/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:15:57 user nova-compute[75245]: DEBUG nova.compute.manager [req-f5b32732-fd4d-43c0-a21a-1d479d5138a8 req-d5b54291-26ae-442b-81bb-bd5556643b12 service nova] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Received event network-vif-plugged-f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:15:57 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-f5b32732-fd4d-43c0-a21a-1d479d5138a8 req-d5b54291-26ae-442b-81bb-bd5556643b12 service nova] Acquiring lock "816edb0e-c4fc-470b-8151-f98502e50789-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:15:57 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-f5b32732-fd4d-43c0-a21a-1d479d5138a8 req-d5b54291-26ae-442b-81bb-bd5556643b12 service nova] Lock "816edb0e-c4fc-470b-8151-f98502e50789-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:15:57 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-f5b32732-fd4d-43c0-a21a-1d479d5138a8 req-d5b54291-26ae-442b-81bb-bd5556643b12 service nova] Lock "816edb0e-c4fc-470b-8151-f98502e50789-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:15:57 user nova-compute[75245]: DEBUG nova.compute.manager [req-f5b32732-fd4d-43c0-a21a-1d479d5138a8 req-d5b54291-26ae-442b-81bb-bd5556643b12 service nova] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] No waiting events found dispatching network-vif-plugged-f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:15:57 user nova-compute[75245]: WARNING nova.compute.manager [req-f5b32732-fd4d-43c0-a21a-1d479d5138a8 req-d5b54291-26ae-442b-81bb-bd5556643b12 service nova] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Received unexpected event network-vif-plugged-f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76 for instance with vm_state active and task_state rebuilding.
Nov 29 16:15:57 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Instance destroyed successfully.
Nov 29 16:15:57 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:13:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1242011736',display_name='tempest-ServerActionsTestOtherA-server-627394806',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1242011736',id=15,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqtiPWs7C4RKGy4yNsp7JTc2XDL0TwaTur5f1RRj6K0Rb6+sFA2CPy5UHpa1YR4wGjwq9AoHpMqOkkk3stctHMw5fDz8nndvq/jbvNk3M28JEwy6jco6tcwC+4eKQq8uQ==',key_name='tempest-keypair-1228788968',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:13:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c6b87e18ef1f48d19a6907b28cb54f04',ramdisk_id='',reservation_id='r-zsz4hlok',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1840344781',owner_user_name='tempest-ServerActionsTestOtherA-1840344781-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:15:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be595c3f7084413180f2ab86e9c56a64',uuid=816edb0e-c4fc-470b-8151-f98502e50789,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76", "address": "fa:16:3e:f9:3e:bc", "network": {"id": "f1fac2f4-e789-443e-b6a5-1a3f829bc302", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1199431077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6b87e18ef1f48d19a6907b28cb54f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf038ddf7-a5", "ovs_interfaceid": "f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 16:15:57 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Converting VIF {"id": "f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76", "address": "fa:16:3e:f9:3e:bc", "network": {"id": "f1fac2f4-e789-443e-b6a5-1a3f829bc302", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1199431077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6b87e18ef1f48d19a6907b28cb54f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf038ddf7-a5", "ovs_interfaceid": "f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:15:57 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:3e:bc,bridge_name='br-int',has_traffic_filtering=True,id=f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76,network=Network(f1fac2f4-e789-443e-b6a5-1a3f829bc302),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf038ddf7-a5') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:15:57 user nova-compute[75245]: DEBUG os_vif [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:3e:bc,bridge_name='br-int',has_traffic_filtering=True,id=f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76,network=Network(f1fac2f4-e789-443e-b6a5-1a3f829bc302),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf038ddf7-a5') {{(pid=75245) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 16:15:57 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:15:57 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf038ddf7-a5, bridge=br-int, if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:15:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b99c5e50-a98b-45a2-b170-664c93109897/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:15:57 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:15:57 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:15:57 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:15:57 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6565fa6f-32aa-41a4-9723-2583f4d4987d) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:15:57 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:15:57 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:15:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:15:57 user nova-compute[75245]: INFO os_vif [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:3e:bc,bridge_name='br-int',has_traffic_filtering=True,id=f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76,network=Network(f1fac2f4-e789-443e-b6a5-1a3f829bc302),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf038ddf7-a5')
Nov 29 16:15:57 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] calling os-brick to detach iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 16:15:57 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, {'target_iqn': 'iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sPFkjprb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:15:57 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 29 16:15:57 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:15:57 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:15:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:15:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:15:57 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[d87ecfae-83aa-4752-ba18-6bb223841947]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:15:57 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 16:15:57 user nova-compute[75245]: No targets found.
Nov 29 16:15:57 user nova-compute[75245]: iSNS:
Nov 29 16:15:57 user nova-compute[75245]: No targets found.
Nov 29 16:15:57 user nova-compute[75245]: STATIC:
Nov 29 16:15:57 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49
Nov 29 16:15:57 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:15:57 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:15:57 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026
Nov 29 16:15:57 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:15:57 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:15:57 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5
Nov 29 16:15:57 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:15:57 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:15:57 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18
Nov 29 16:15:57 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:15:57 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:15:57 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea
Nov 29 16:15:57 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:15:57 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:15:57 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f
Nov 29 16:15:57 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:15:57 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:15:57 user nova-compute[75245]: FIRMWARE:
Nov 29 16:15:57 user nova-compute[75245]: No targets found.
Nov 29 16:15:57 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:15:57 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 16:15:57 user nova-compute[75245]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 16:15:57 user nova-compute[75245]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75245) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 16:15:57 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c', 0)] {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 16:15:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:15:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:15:57 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[269b5fa7-c79b-4936-8f5e-1335f50872e7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:15:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:15:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:15:57 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a4f49c7-734f-4afc-920f-f52d0fe5283f]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:15:57 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5 (non-flash)
Nov 29 16:15:57 user nova-compute[75245]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18 (non-flash)
Nov 29 16:15:57 user nova-compute[75245]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49 (non-flash)
Nov 29 16:15:57 user nova-compute[75245]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea (non-flash)
Nov 29 16:15:57 user nova-compute[75245]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 (non-flash)
Nov 29 16:15:57 user nova-compute[75245]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f (non-flash)
Nov 29 16:15:57 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:15:57 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5 (non-flash)
Nov 29 16:15:57 user nova-compute[75245]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18 (non-flash)
Nov 29 16:15:57 user nova-compute[75245]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49 (non-flash)
Nov 29 16:15:57 user nova-compute[75245]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea (non-flash)
Nov 29 16:15:57 user nova-compute[75245]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 (non-flash)
Nov 29 16:15:57 user nova-compute[75245]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f (non-flash)
Nov 29 16:15:57 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:15:57 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0d20777880>, {}) {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 16:15:57 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Disconnecting from: [] {{(pid=75245) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 16:15:57 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.083s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:15:57 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] <== disconnect_volume: return (86ms) None {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:15:57 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Disconnected iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 16:15:57 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Deleting instance files /opt/stack/data/nova/instances/816edb0e-c4fc-470b-8151-f98502e50789_del
Nov 29 16:15:57 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Deletion of /opt/stack/data/nova/instances/816edb0e-c4fc-470b-8151-f98502e50789_del complete
Nov 29 16:15:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7/disk --force-share --output=json" returned: 0 in 0.297s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:15:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:15:57 user nova-compute[75245]: INFO nova.virt.block_device [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Booting with volume 6a84dd1c-3444-4e5d-ae8f-654a1901737c at /dev/vdb
Nov 29 16:15:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:15:57 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:15:57 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:15:57 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:15:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:15:57 user nova-compute[75245]: DEBUG os_brick.utils [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:15:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:15:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:15:57 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f597c92-17cf-4638-82e2-4ed3ed2d2af7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:69ed8ed87091\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:15:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:15:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:15:57 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b59a92-cd8a-447a-8047-0b45ae1ca4eb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:15:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:15:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:15:57 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f06130-62f6-4aae-9fcb-9c1d541883f9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:15:57 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e4b532-cde1-4218-bc5b-fb34e4873ede]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:15:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Running cmd (subprocess): nvme version {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:15:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] 'nvme version' failed. Not Retrying. {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:15:57 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:15:57 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] nvme not present on system {{(pid=75245) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 16:15:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:15:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:15:57 user nova-compute[75245]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 16:15:57 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c018dea-a465-4ed8-8439-0dc103f07af0]: (4, '') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:15:57 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75245) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 16:15:57 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 16:15:57 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] LIGHTOS: no hostnqn found. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 16:15:57 user nova-compute[75245]: DEBUG os_brick.utils [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:69ed8ed87091', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:15:57 user nova-compute[75245]: DEBUG nova.virt.block_device [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Updating existing volume attachment record: 03f015ff-7edf-462f-b5b7-cf34f1e1380a {{(pid=75245) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 16:15:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:15:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:15:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:15:58 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:15:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36728d4f-925b-46a3-b4b5-17f14b9c99c3/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:15:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36728d4f-925b-46a3-b4b5-17f14b9c99c3/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:15:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36728d4f-925b-46a3-b4b5-17f14b9c99c3/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:15:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36728d4f-925b-46a3-b4b5-17f14b9c99c3/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:15:59 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:15:59 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:15:59 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Hypervisor/Node resource view: name=user free_ram=7678MB free_disk=25.452205657958984GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75245) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 16:15:59 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:15:59 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:15:59 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:15:59 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance ed9a6a4e-2e7d-443c-82ef-f14f11d32c81 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:15:59 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 36728d4f-925b-46a3-b4b5-17f14b9c99c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:15:59 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance fd819060-4388-444d-809e-94f6b2e8f102 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:15:59 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 5f2a6f15-e413-47a2-be3e-961dd9ee7deb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:15:59 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 816edb0e-c4fc-470b-8151-f98502e50789 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:15:59 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:15:59 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 95b96d09-b9df-4e92-a141-f044078e4ce1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:15:59 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance b99c5e50-a98b-45a2-b170-664c93109897 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:15:59 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 16:15:59 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 16:15:59 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Refreshing inventories for resource provider dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 16:15:59 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Updating ProviderTree inventory for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 16:15:59 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Updating inventory in ProviderTree for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 16:15:59 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Refreshing aggregate associations for resource provider dcc0ed27-167e-4f3a-a0de-183bb144a50c, aggregates: None {{(pid=75245) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 16:15:59 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Refreshing trait associations for resource provider dcc0ed27-167e-4f3a-a0de-183bb144a50c, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG {{(pid=75245) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 16:15:59 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:15:59 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:15:59 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Compute_service record updated for user:user {{(pid=75245) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 16:15:59 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.824s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:16:00 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:16:00 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:16:00 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Starting heal instance info cache {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 16:16:00 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Rebuilding the list of instances to heal {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 16:16:00 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "refresh_cache-6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:16:00 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquired lock "refresh_cache-6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:16:00 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7] Forcefully refreshing network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 16:16:00 user nova-compute[75245]: DEBUG nova.objects.instance [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lazy-loading 'info_cache' on Instance uuid 6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:16:01 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7] Updating instance_info_cache with network_info: [{"id": "de56e47e-57ae-4e15-9d07-57eca8971e14", "address": "fa:16:3e:cc:b6:56", "network": {"id": "04f30281-e256-4d60-82d2-89004740b1b8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-649945802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17fcceabdcb74404971adda76fd4e48d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde56e47e-57", "ovs_interfaceid": "de56e47e-57ae-4e15-9d07-57eca8971e14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:16:01 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Releasing lock "refresh_cache-6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:16:01 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7] Updated the network info_cache for instance {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 16:16:01 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:16:01 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:16:01 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:16:01 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:16:01 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75245) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 16:16:02 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:16:02 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:02 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:16:02 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Cleaning up deleted instances {{(pid=75245) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 16:16:02 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] There are 0 instances to clean {{(pid=75245) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 16:16:02 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:16:05 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-5d3e8e05-3d11-4cd4-9eec-00ec93aa2696 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305 is timed out.
Nov 29 16:16:05 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-5d3e8e05-3d11-4cd4-9eec-00ec93aa2696 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Successfully detached device vdc from instance 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305 from the live domain config.
Nov 29 16:16:05 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d3e8e05-3d11-4cd4-9eec-00ec93aa2696 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] calling os-brick to detach iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 16:16:05 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d3e8e05-3d11-4cd4-9eec-00ec93aa2696 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, {'target_iqn': 'iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zZGCihSU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:16:05 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-5d3e8e05-3d11-4cd4-9eec-00ec93aa2696 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:16:05 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-5d3e8e05-3d11-4cd4-9eec-00ec93aa2696 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:16:05 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-5d3e8e05-3d11-4cd4-9eec-00ec93aa2696 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:16:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:05 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f409068-8be5-4af0-9704-5adba54d9b52]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:05 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d3e8e05-3d11-4cd4-9eec-00ec93aa2696 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 16:16:05 user nova-compute[75245]: No targets found.
Nov 29 16:16:05 user nova-compute[75245]: iSNS:
Nov 29 16:16:05 user nova-compute[75245]: No targets found.
Nov 29 16:16:05 user nova-compute[75245]: STATIC:
Nov 29 16:16:05 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49
Nov 29 16:16:05 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:16:05 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:16:05 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026
Nov 29 16:16:05 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:16:05 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:16:05 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5
Nov 29 16:16:05 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:16:05 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:16:05 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18
Nov 29 16:16:05 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:16:05 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:16:05 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea
Nov 29 16:16:05 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:16:05 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:16:05 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f
Nov 29 16:16:05 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:16:05 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:16:05 user nova-compute[75245]: FIRMWARE:
Nov 29 16:16:05 user nova-compute[75245]: No targets found.
Nov 29 16:16:05 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:16:05 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d3e8e05-3d11-4cd4-9eec-00ec93aa2696 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 16:16:05 user nova-compute[75245]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 16:16:05 user nova-compute[75245]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75245) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 16:16:05 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d3e8e05-3d11-4cd4-9eec-00ec93aa2696 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5', 0)] {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 16:16:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:05 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db85b6d-e27f-481a-ac6d-f9e15c5a1f82]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:05 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa3f793-8514-4568-9172-e8a9bea595f3]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:05 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d3e8e05-3d11-4cd4-9eec-00ec93aa2696 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5 (non-flash)
Nov 29 16:16:05 user nova-compute[75245]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18 (non-flash)
Nov 29 16:16:05 user nova-compute[75245]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49 (non-flash)
Nov 29 16:16:05 user nova-compute[75245]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea (non-flash)
Nov 29 16:16:05 user nova-compute[75245]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 (non-flash)
Nov 29 16:16:05 user nova-compute[75245]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f (non-flash)
Nov 29 16:16:05 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:16:05 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d3e8e05-3d11-4cd4-9eec-00ec93aa2696 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5 (non-flash)
Nov 29 16:16:05 user nova-compute[75245]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18 (non-flash)
Nov 29 16:16:05 user nova-compute[75245]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49 (non-flash)
Nov 29 16:16:05 user nova-compute[75245]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea (non-flash)
Nov 29 16:16:05 user nova-compute[75245]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 (non-flash)
Nov 29 16:16:05 user nova-compute[75245]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f (non-flash)
Nov 29 16:16:05 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:16:05 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d3e8e05-3d11-4cd4-9eec-00ec93aa2696 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0d4416f370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5'): ({'sdc'}, set())}) {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 16:16:05 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-5d3e8e05-3d11-4cd4-9eec-00ec93aa2696 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Removing single pathed devices sdc {{(pid=75245) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 16:16:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:05 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[251de66e-8e99-4d19-a15f-ef27661671b3]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:05 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9bb8718-45e2-47b7-9473-ac830ed5b48b]: (4, ('ok\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:05 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-5d3e8e05-3d11-4cd4-9eec-00ec93aa2696 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Flushing IO for device /dev/sdc {{(pid=75245) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 16:16:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:05 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db77821-bdec-4876-94c1-5736999d4258]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:05 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-5d3e8e05-3d11-4cd4-9eec-00ec93aa2696 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75245) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 16:16:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:06 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[caaa2bb9-35ac-48a3-ad03-b998813b7f17]: (4, ('1', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:06 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-5d3e8e05-3d11-4cd4-9eec-00ec93aa2696 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 16:16:06 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-5d3e8e05-3d11-4cd4-9eec-00ec93aa2696 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] SCSI volumes sdc have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 16:16:06 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d3e8e05-3d11-4cd4-9eec-00ec93aa2696 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5')] {{(pid=75245) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 16:16:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:06 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[39139a42-787f-429d-b338-a94aa90493dc]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:06 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d3e8e05-3d11-4cd4-9eec-00ec93aa2696 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:16:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5 -p 172.16.0.220:3260 --logout {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.086s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:06 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2187ee-68ee-44ad-b078-488a9aaeeb53]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:06 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d3e8e05-3d11-4cd4-9eec-00ec93aa2696 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5, portal: 172.16.0.220,3260]
Nov 29 16:16:06 user nova-compute[75245]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5, portal: 172.16.0.220,3260] successful.
Nov 29 16:16:06 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:16:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5 -p 172.16.0.220:3260 --op delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a74ae150-7d3d-47ca-80a6-1bc324280bd5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:06 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e517c6-ec53-447d-b89c-120e9ed73a38]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:06 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d3e8e05-3d11-4cd4-9eec-00ec93aa2696 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:16:06 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-5d3e8e05-3d11-4cd4-9eec-00ec93aa2696 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.365s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:16:06 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d3e8e05-3d11-4cd4-9eec-00ec93aa2696 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] <== disconnect_volume: return (367ms) None {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:16:06 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d3e8e05-3d11-4cd4-9eec-00ec93aa2696 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Disconnected iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 16:16:06 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Creating instance directory {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 16:16:06 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Creating image(s)
Nov 29 16:16:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Acquiring lock "/opt/stack/data/nova/instances/816edb0e-c4fc-470b-8151-f98502e50789/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:16:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "/opt/stack/data/nova/instances/816edb0e-c4fc-470b-8151-f98502e50789/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:16:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "/opt/stack/data/nova/instances/816edb0e-c4fc-470b-8151-f98502e50789/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:16:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.215s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Acquiring lock "d654f7206043e05d3525550b0fc885556eb999f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:16:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:16:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.178s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/816edb0e-c4fc-470b-8151-f98502e50789/disk 1073741824 {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/816edb0e-c4fc-470b-8151-f98502e50789/disk 1073741824" returned: 0 in 0.052s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:16:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.172s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:06 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Checking if we can resize image /opt/stack/data/nova/instances/816edb0e-c4fc-470b-8151-f98502e50789/disk. size=1073741824 {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 16:16:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/816edb0e-c4fc-470b-8151-f98502e50789/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/816edb0e-c4fc-470b-8151-f98502e50789/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Cannot resize image /opt/stack/data/nova/instances/816edb0e-c4fc-470b-8151-f98502e50789/disk to a smaller size. {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Created local disks {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Ensure instance console log exists: /opt/stack/data/nova/instances/816edb0e-c4fc-470b-8151-f98502e50789/console.log {{(pid=75245) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Start _get_guest_xml network_info=[{"id": "f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76", "address": "fa:16:3e:f9:3e:bc", "network": {"id": "f1fac2f4-e789-443e-b6a5-1a3f829bc302", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1199431077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6b87e18ef1f48d19a6907b28cb54f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf038ddf7-a5", "ovs_interfaceid": "f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'a291d9c3-be02-4c6c-9649-4b45c5b7f487'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'attachment_id': '03f015ff-7edf-462f-b5b7-cf34f1e1380a', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sPFkjprb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '816edb0e-c4fc-470b-8151-f98502e50789', 'attached_at': '', 'detached_at': '', 'volume_id': '6a84dd1c-3444-4e5d-ae8f-654a1901737c', 'serial': '6a84dd1c-3444-4e5d-ae8f-654a1901737c'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'guest_format': None, 'volume_type': None} {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG nova.objects.instance [None req-5d3e8e05-3d11-4cd4-9eec-00ec93aa2696 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lazy-loading 'flavor' on Instance uuid 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:16:07 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 29 16:16:07 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 29 16:16:07 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] CPU controller missing on host. {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] CPU controller found on host. {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75245) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T16:06:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Flavor limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Image limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Flavor pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Image pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Got 1 possible topologies {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG nova.objects.instance [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lazy-loading 'vcpu_model' on Instance uuid 816edb0e-c4fc-470b-8151-f98502e50789 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Calling os-brick to attach iSCSI Volume {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sPFkjprb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:16:07 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 29 16:16:07 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:16:07 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 29 16:16:07 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:16:07 user nova-compute[75245]: INFO os_brick.initiator.connectors.iscsi [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 16:16:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c -p 172.16.0.220:3260 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0debb31-6ce8-4d14-9cc6-9165b48ffb6c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 16:16:07 user nova-compute[75245]:  {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c -p 172.16.0.220:3260 --interface default --op new {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-5d3e8e05-3d11-4cd4-9eec-00ec93aa2696 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lock "3ab9d7cd-79cd-4c9b-8608-c1ef0f333305" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.980s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd70ea94-0ac1-4c43-ba65-c6ed3d41b299]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c] added\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c] added
Nov 29 16:16:07 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[191a8232-0c35-411a-9f22-63c998e1241d]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[68cbcd4a-e606-48f6-af1c-14eda243ddb6]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sPFkjprb {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sPFkjprb" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef7bc223-b597-4e1a-94bf-d10b639dc1e2]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sPFkjprb'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[036c800e-7254-452e-b8db-5bbf2290025d]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c37d61a-c3c7-4b4c-ab0d-7d03b393600b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18 (non-flash)
Nov 29 16:16:07 user nova-compute[75245]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49 (non-flash)
Nov 29 16:16:07 user nova-compute[75245]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea (non-flash)
Nov 29 16:16:07 user nova-compute[75245]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 (non-flash)
Nov 29 16:16:07 user nova-compute[75245]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f (non-flash)
Nov 29 16:16:07 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18 (non-flash)
Nov 29 16:16:07 user nova-compute[75245]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49 (non-flash)
Nov 29 16:16:07 user nova-compute[75245]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea (non-flash)
Nov 29 16:16:07 user nova-compute[75245]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 (non-flash)
Nov 29 16:16:07 user nova-compute[75245]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f (non-flash)
Nov 29 16:16:07 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c -p 172.16.0.220:3260 --login {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb8c23f-f13f-4dab-9be7-2d6cb1d707b7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c, portal: 172.16.0.220,3260]
Nov 29 16:16:07 user nova-compute[75245]: Login to [iface: default, target: iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c, portal: 172.16.0.220,3260] successful.
Nov 29 16:16:07 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff58adb-918c-40ef-8d40-e5cf2248fd94]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b58da9-b543-4efa-b167-333dd8047ffe]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18 (non-flash)
Nov 29 16:16:07 user nova-compute[75245]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49 (non-flash)
Nov 29 16:16:07 user nova-compute[75245]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea (non-flash)
Nov 29 16:16:07 user nova-compute[75245]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 (non-flash)
Nov 29 16:16:07 user nova-compute[75245]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f (non-flash)
Nov 29 16:16:07 user nova-compute[75245]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c (non-flash)
Nov 29 16:16:07 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18 (non-flash)
Nov 29 16:16:07 user nova-compute[75245]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49 (non-flash)
Nov 29 16:16:07 user nova-compute[75245]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea (non-flash)
Nov 29 16:16:07 user nova-compute[75245]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 (non-flash)
Nov 29 16:16:07 user nova-compute[75245]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f (non-flash)
Nov 29 16:16:07 user nova-compute[75245]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c (non-flash)
Nov 29 16:16:07 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.341s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Connected to 172.16.0.220:3260 {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] HCTL ('34', '-', '-', 0) found on session 21 with lun 0 {{(pid=75245) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75245) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce8c1e49-827c-4ccb-af25-de446dc2c564]: (4, ('- - 0', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Searching for a device in session 21 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75245) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 16:16:07 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sPFkjprb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 16:16:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.382s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:16:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] <== connect_volume: return (1384ms) {'type': 'block', 'scsi_wwn': '26438326333303066', 'path': '/dev/sdc'} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:16:08 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26438326333303066', 'path': '/dev/sdc'} {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 16:16:08 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T16:13:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1242011736',display_name='tempest-ServerActionsTestOtherA-server-627394806',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1242011736',id=15,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqtiPWs7C4RKGy4yNsp7JTc2XDL0TwaTur5f1RRj6K0Rb6+sFA2CPy5UHpa1YR4wGjwq9AoHpMqOkkk3stctHMw5fDz8nndvq/jbvNk3M28JEwy6jco6tcwC+4eKQq8uQ==',key_name='tempest-keypair-1228788968',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:13:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c6b87e18ef1f48d19a6907b28cb54f04',ramdisk_id='',reservation_id='r-zsz4hlok',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1840344781',owner_user_name='tempest-ServerActionsTestOtherA-1840344781-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:15:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be595c3f7084413180f2ab86e9c56a64',uuid=816edb0e-c4fc-470b-8151-f98502e50789,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76", "address": "fa:16:3e:f9:3e:bc", "network": {"id": "f1fac2f4-e789-443e-b6a5-1a3f829bc302", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1199431077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6b87e18ef1f48d19a6907b28cb54f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf038ddf7-a5", "ovs_interfaceid": "f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:16:08 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Converting VIF {"id": "f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76", "address": "fa:16:3e:f9:3e:bc", "network": {"id": "f1fac2f4-e789-443e-b6a5-1a3f829bc302", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1199431077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6b87e18ef1f48d19a6907b28cb54f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf038ddf7-a5", "ovs_interfaceid": "f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:16:08 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:3e:bc,bridge_name='br-int',has_traffic_filtering=True,id=f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76,network=Network(f1fac2f4-e789-443e-b6a5-1a3f829bc302),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf038ddf7-a5') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:16:08 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] End _get_guest_xml xml=<domain type="kvm">
Nov 29 16:16:08 user nova-compute[75245]:   <uuid>816edb0e-c4fc-470b-8151-f98502e50789</uuid>
Nov 29 16:16:08 user nova-compute[75245]:   <name>instance-0000000f</name>
Nov 29 16:16:08 user nova-compute[75245]:   <memory>524288</memory>
Nov 29 16:16:08 user nova-compute[75245]:   <vcpu>1</vcpu>
Nov 29 16:16:08 user nova-compute[75245]:   <metadata>
Nov 29 16:16:08 user nova-compute[75245]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 16:16:08 user nova-compute[75245]:       <nova:package version="0.0.0"/>
Nov 29 16:16:08 user nova-compute[75245]:       <nova:name>tempest-ServerActionsTestOtherA-server-627394806</nova:name>
Nov 29 16:16:08 user nova-compute[75245]:       <nova:creationTime>2023-11-29 16:16:07</nova:creationTime>
Nov 29 16:16:08 user nova-compute[75245]:       <nova:flavor name="m1.tiny">
Nov 29 16:16:08 user nova-compute[75245]:         <nova:memory>512</nova:memory>
Nov 29 16:16:08 user nova-compute[75245]:         <nova:disk>1</nova:disk>
Nov 29 16:16:08 user nova-compute[75245]:         <nova:swap>0</nova:swap>
Nov 29 16:16:08 user nova-compute[75245]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 16:16:08 user nova-compute[75245]:         <nova:vcpus>1</nova:vcpus>
Nov 29 16:16:08 user nova-compute[75245]:       </nova:flavor>
Nov 29 16:16:08 user nova-compute[75245]:       <nova:owner>
Nov 29 16:16:08 user nova-compute[75245]:         <nova:user uuid="be595c3f7084413180f2ab86e9c56a64">tempest-ServerActionsTestOtherA-1840344781-project-member</nova:user>
Nov 29 16:16:08 user nova-compute[75245]:         <nova:project uuid="c6b87e18ef1f48d19a6907b28cb54f04">tempest-ServerActionsTestOtherA-1840344781</nova:project>
Nov 29 16:16:08 user nova-compute[75245]:       </nova:owner>
Nov 29 16:16:08 user nova-compute[75245]:       <nova:root type="image" uuid="a291d9c3-be02-4c6c-9649-4b45c5b7f487"/>
Nov 29 16:16:08 user nova-compute[75245]:       <nova:ports>
Nov 29 16:16:08 user nova-compute[75245]:         <nova:port uuid="f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76">
Nov 29 16:16:08 user nova-compute[75245]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 29 16:16:08 user nova-compute[75245]:         </nova:port>
Nov 29 16:16:08 user nova-compute[75245]:       </nova:ports>
Nov 29 16:16:08 user nova-compute[75245]:     </nova:instance>
Nov 29 16:16:08 user nova-compute[75245]:   </metadata>
Nov 29 16:16:08 user nova-compute[75245]:   <sysinfo type="smbios">
Nov 29 16:16:08 user nova-compute[75245]:     <system>
Nov 29 16:16:08 user nova-compute[75245]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 16:16:08 user nova-compute[75245]:       <entry name="product">OpenStack Nova</entry>
Nov 29 16:16:08 user nova-compute[75245]:       <entry name="version">0.0.0</entry>
Nov 29 16:16:08 user nova-compute[75245]:       <entry name="serial">816edb0e-c4fc-470b-8151-f98502e50789</entry>
Nov 29 16:16:08 user nova-compute[75245]:       <entry name="uuid">816edb0e-c4fc-470b-8151-f98502e50789</entry>
Nov 29 16:16:08 user nova-compute[75245]:       <entry name="family">Virtual Machine</entry>
Nov 29 16:16:08 user nova-compute[75245]:     </system>
Nov 29 16:16:08 user nova-compute[75245]:   </sysinfo>
Nov 29 16:16:08 user nova-compute[75245]:   <os>
Nov 29 16:16:08 user nova-compute[75245]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 16:16:08 user nova-compute[75245]:     <boot dev="hd"/>
Nov 29 16:16:08 user nova-compute[75245]:     <smbios mode="sysinfo"/>
Nov 29 16:16:08 user nova-compute[75245]:   </os>
Nov 29 16:16:08 user nova-compute[75245]:   <features>
Nov 29 16:16:08 user nova-compute[75245]:     <acpi/>
Nov 29 16:16:08 user nova-compute[75245]:     <apic/>
Nov 29 16:16:08 user nova-compute[75245]:     <vmcoreinfo/>
Nov 29 16:16:08 user nova-compute[75245]:   </features>
Nov 29 16:16:08 user nova-compute[75245]:   <clock offset="utc">
Nov 29 16:16:08 user nova-compute[75245]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 16:16:08 user nova-compute[75245]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 16:16:08 user nova-compute[75245]:     <timer name="hpet" present="no"/>
Nov 29 16:16:08 user nova-compute[75245]:   </clock>
Nov 29 16:16:08 user nova-compute[75245]:   <cpu mode="custom" match="exact">
Nov 29 16:16:08 user nova-compute[75245]:     <model>Nehalem</model>
Nov 29 16:16:08 user nova-compute[75245]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 16:16:08 user nova-compute[75245]:   </cpu>
Nov 29 16:16:08 user nova-compute[75245]:   <devices>
Nov 29 16:16:08 user nova-compute[75245]:     <disk type="file" device="disk">
Nov 29 16:16:08 user nova-compute[75245]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 16:16:08 user nova-compute[75245]:       <source file="/opt/stack/data/nova/instances/816edb0e-c4fc-470b-8151-f98502e50789/disk"/>
Nov 29 16:16:08 user nova-compute[75245]:       <target dev="vda" bus="virtio"/>
Nov 29 16:16:08 user nova-compute[75245]:     </disk>
Nov 29 16:16:08 user nova-compute[75245]:     <disk type="block" device="disk">
Nov 29 16:16:08 user nova-compute[75245]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:16:08 user nova-compute[75245]:       <source dev="/dev/sdc"/>
Nov 29 16:16:08 user nova-compute[75245]:       <target dev="vdb" bus="virtio"/>
Nov 29 16:16:08 user nova-compute[75245]:       <serial>6a84dd1c-3444-4e5d-ae8f-654a1901737c</serial>
Nov 29 16:16:08 user nova-compute[75245]:     </disk>
Nov 29 16:16:08 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 16:16:08 user nova-compute[75245]:       <mac address="fa:16:3e:f9:3e:bc"/>
Nov 29 16:16:08 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:16:08 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 16:16:08 user nova-compute[75245]:       <target dev="tapf038ddf7-a5"/>
Nov 29 16:16:08 user nova-compute[75245]:     </interface>
Nov 29 16:16:08 user nova-compute[75245]:     <serial type="pty">
Nov 29 16:16:08 user nova-compute[75245]:       <log file="/opt/stack/data/nova/instances/816edb0e-c4fc-470b-8151-f98502e50789/console.log" append="off"/>
Nov 29 16:16:08 user nova-compute[75245]:     </serial>
Nov 29 16:16:08 user nova-compute[75245]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 16:16:08 user nova-compute[75245]:     <video>
Nov 29 16:16:08 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:16:08 user nova-compute[75245]:     </video>
Nov 29 16:16:08 user nova-compute[75245]:     <rng model="virtio">
Nov 29 16:16:08 user nova-compute[75245]:       <backend model="random">/dev/urandom</backend>
Nov 29 16:16:08 user nova-compute[75245]:     </rng>
Nov 29 16:16:08 user nova-compute[75245]:     <controller type="usb" index="0" model="none"/>
Nov 29 16:16:08 user nova-compute[75245]:     <memballoon model="virtio">
Nov 29 16:16:08 user nova-compute[75245]:       <stats period="10"/>
Nov 29 16:16:08 user nova-compute[75245]:     </memballoon>
Nov 29 16:16:08 user nova-compute[75245]:   </devices>
Nov 29 16:16:08 user nova-compute[75245]: </domain>
Nov 29 16:16:08 user nova-compute[75245]:  {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 16:16:08 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T16:13:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1242011736',display_name='tempest-ServerActionsTestOtherA-server-627394806',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1242011736',id=15,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqtiPWs7C4RKGy4yNsp7JTc2XDL0TwaTur5f1RRj6K0Rb6+sFA2CPy5UHpa1YR4wGjwq9AoHpMqOkkk3stctHMw5fDz8nndvq/jbvNk3M28JEwy6jco6tcwC+4eKQq8uQ==',key_name='tempest-keypair-1228788968',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:13:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c6b87e18ef1f48d19a6907b28cb54f04',ramdisk_id='',reservation_id='r-zsz4hlok',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1840344781',owner_user_name='tempest-ServerActionsTestOtherA-1840344781-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:15:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be595c3f7084413180f2ab86e9c56a64',uuid=816edb0e-c4fc-470b-8151-f98502e50789,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76", "address": "fa:16:3e:f9:3e:bc", "network": {"id": "f1fac2f4-e789-443e-b6a5-1a3f829bc302", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1199431077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6b87e18ef1f48d19a6907b28cb54f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf038ddf7-a5", "ovs_interfaceid": "f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 16:16:08 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Converting VIF {"id": "f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76", "address": "fa:16:3e:f9:3e:bc", "network": {"id": "f1fac2f4-e789-443e-b6a5-1a3f829bc302", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1199431077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6b87e18ef1f48d19a6907b28cb54f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf038ddf7-a5", "ovs_interfaceid": "f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:16:08 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:3e:bc,bridge_name='br-int',has_traffic_filtering=True,id=f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76,network=Network(f1fac2f4-e789-443e-b6a5-1a3f829bc302),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf038ddf7-a5') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:16:08 user nova-compute[75245]: DEBUG os_vif [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:3e:bc,bridge_name='br-int',has_traffic_filtering=True,id=f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76,network=Network(f1fac2f4-e789-443e-b6a5-1a3f829bc302),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf038ddf7-a5') {{(pid=75245) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 16:16:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:16:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 16:16:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '784e6b5a-54ad-51bf-a850-a20ece090785', '_type': 'linux-noop'}}, row=False) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:16:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:16:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf038ddf7-a5, may_exist=True, interface_attrs={}) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:16:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf038ddf7-a5, col_values=(('qos', UUID('8c82a80f-4fca-4679-a455-8d18fb0846e9')),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:16:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf038ddf7-a5, col_values=(('external_ids', {'iface-id': 'f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:3e:bc', 'vm-uuid': '816edb0e-c4fc-470b-8151-f98502e50789'}),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:16:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:16:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:08 user nova-compute[75245]: INFO os_vif [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:3e:bc,bridge_name='br-int',has_traffic_filtering=True,id=f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76,network=Network(f1fac2f4-e789-443e-b6a5-1a3f829bc302),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf038ddf7-a5')
Nov 29 16:16:08 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:16:08 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:16:08 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] No VIF found with MAC fa:16:3e:f9:3e:bc, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:16:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-8ed99b7d-eb02-44b6-ad61-f5f2aa7e47d0 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Acquiring lock "36728d4f-925b-46a3-b4b5-17f14b9c99c3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:16:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-8ed99b7d-eb02-44b6-ad61-f5f2aa7e47d0 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Lock "36728d4f-925b-46a3-b4b5-17f14b9c99c3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:16:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-8ed99b7d-eb02-44b6-ad61-f5f2aa7e47d0 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Acquiring lock "36728d4f-925b-46a3-b4b5-17f14b9c99c3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:16:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-8ed99b7d-eb02-44b6-ad61-f5f2aa7e47d0 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Lock "36728d4f-925b-46a3-b4b5-17f14b9c99c3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:16:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-8ed99b7d-eb02-44b6-ad61-f5f2aa7e47d0 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Lock "36728d4f-925b-46a3-b4b5-17f14b9c99c3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:16:09 user nova-compute[75245]: INFO nova.compute.manager [None req-8ed99b7d-eb02-44b6-ad61-f5f2aa7e47d0 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] Terminating instance
Nov 29 16:16:09 user nova-compute[75245]: DEBUG nova.compute.manager [None req-8ed99b7d-eb02-44b6-ad61-f5f2aa7e47d0 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] Start destroying the instance on the hypervisor. {{(pid=75245) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 16:16:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:10 user nova-compute[75245]: DEBUG nova.compute.manager [req-d787c1e5-c991-42a0-bbca-ffd62987181e req-01e8e5c4-a41a-4387-8248-6a425438af10 service nova] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Received event network-vif-plugged-f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:16:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d787c1e5-c991-42a0-bbca-ffd62987181e req-01e8e5c4-a41a-4387-8248-6a425438af10 service nova] Acquiring lock "816edb0e-c4fc-470b-8151-f98502e50789-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:16:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d787c1e5-c991-42a0-bbca-ffd62987181e req-01e8e5c4-a41a-4387-8248-6a425438af10 service nova] Lock "816edb0e-c4fc-470b-8151-f98502e50789-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:16:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d787c1e5-c991-42a0-bbca-ffd62987181e req-01e8e5c4-a41a-4387-8248-6a425438af10 service nova] Lock "816edb0e-c4fc-470b-8151-f98502e50789-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:16:10 user nova-compute[75245]: DEBUG nova.compute.manager [req-d787c1e5-c991-42a0-bbca-ffd62987181e req-01e8e5c4-a41a-4387-8248-6a425438af10 service nova] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] No waiting events found dispatching network-vif-plugged-f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:16:10 user nova-compute[75245]: WARNING nova.compute.manager [req-d787c1e5-c991-42a0-bbca-ffd62987181e req-01e8e5c4-a41a-4387-8248-6a425438af10 service nova] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Received unexpected event network-vif-plugged-f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76 for instance with vm_state active and task_state rebuild_spawning.
Nov 29 16:16:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:10 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] Instance destroyed successfully.
Nov 29 16:16:10 user nova-compute[75245]: DEBUG nova.objects.instance [None req-8ed99b7d-eb02-44b6-ad61-f5f2aa7e47d0 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Lazy-loading 'resources' on Instance uuid 36728d4f-925b-46a3-b4b5-17f14b9c99c3 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:16:10 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-8ed99b7d-eb02-44b6-ad61-f5f2aa7e47d0 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:10:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-818220928',display_name='tempest-VolumesAdminNegativeTest-server-818220928',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-818220928',id=5,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMsoqDWltj7rvgiBX8ECAYks2BcP4PLhpyN5x750ZqkhEcfFwh31RewYo0OLNrTg37grVSv5Xt4BkyPjIznL8iWLBiyEX80bNiks13LwL4vdsTtHfE2hr/JOJlqEqGDvOQ==',key_name='tempest-keypair-610425310',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:10:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2a08c8f9089c4291b552c567e010b0c5',ramdisk_id='',reservation_id='r-0tspe1kf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-193480502',owner_user_name='tempest-VolumesAdminNegativeTest-193480502-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:10:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39676e279e7f4fea9383dacfb0ea7875',uuid=36728d4f-925b-46a3-b4b5-17f14b9c99c3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "507c0cd2-dea3-4352-b2ff-60000cc32053", "address": "fa:16:3e:38:db:1f", "network": {"id": "ae7be65e-9c9f-4836-aee2-9d465d5d28f6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-521099242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a08c8f9089c4291b552c567e010b0c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap507c0cd2-de", "ovs_interfaceid": "507c0cd2-dea3-4352-b2ff-60000cc32053", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 16:16:10 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-8ed99b7d-eb02-44b6-ad61-f5f2aa7e47d0 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Converting VIF {"id": "507c0cd2-dea3-4352-b2ff-60000cc32053", "address": "fa:16:3e:38:db:1f", "network": {"id": "ae7be65e-9c9f-4836-aee2-9d465d5d28f6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-521099242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a08c8f9089c4291b552c567e010b0c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap507c0cd2-de", "ovs_interfaceid": "507c0cd2-dea3-4352-b2ff-60000cc32053", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:16:10 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-8ed99b7d-eb02-44b6-ad61-f5f2aa7e47d0 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:38:db:1f,bridge_name='br-int',has_traffic_filtering=True,id=507c0cd2-dea3-4352-b2ff-60000cc32053,network=Network(ae7be65e-9c9f-4836-aee2-9d465d5d28f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap507c0cd2-de') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:16:10 user nova-compute[75245]: DEBUG os_vif [None req-8ed99b7d-eb02-44b6-ad61-f5f2aa7e47d0 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:db:1f,bridge_name='br-int',has_traffic_filtering=True,id=507c0cd2-dea3-4352-b2ff-60000cc32053,network=Network(ae7be65e-9c9f-4836-aee2-9d465d5d28f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap507c0cd2-de') {{(pid=75245) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 16:16:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap507c0cd2-de, bridge=br-int, if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:16:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:16:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c9c7a39e-93dc-44f1-9a5e-ff021a8882c6) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:16:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:16:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:10 user nova-compute[75245]: INFO os_vif [None req-8ed99b7d-eb02-44b6-ad61-f5f2aa7e47d0 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:db:1f,bridge_name='br-int',has_traffic_filtering=True,id=507c0cd2-dea3-4352-b2ff-60000cc32053,network=Network(ae7be65e-9c9f-4836-aee2-9d465d5d28f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap507c0cd2-de')
Nov 29 16:16:10 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-8ed99b7d-eb02-44b6-ad61-f5f2aa7e47d0 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] Deleting instance files /opt/stack/data/nova/instances/36728d4f-925b-46a3-b4b5-17f14b9c99c3_del
Nov 29 16:16:10 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-8ed99b7d-eb02-44b6-ad61-f5f2aa7e47d0 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] Deletion of /opt/stack/data/nova/instances/36728d4f-925b-46a3-b4b5-17f14b9c99c3_del complete
Nov 29 16:16:10 user nova-compute[75245]: INFO nova.compute.manager [None req-8ed99b7d-eb02-44b6-ad61-f5f2aa7e47d0 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] Took 1.05 seconds to destroy the instance on the hypervisor.
Nov 29 16:16:10 user nova-compute[75245]: DEBUG oslo.service.loopingcall [None req-8ed99b7d-eb02-44b6-ad61-f5f2aa7e47d0 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75245) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 16:16:10 user nova-compute[75245]: DEBUG nova.compute.manager [-] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] Deallocating network for instance {{(pid=75245) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 16:16:10 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] deallocate_for_instance() {{(pid=75245) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 16:16:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:11 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:16:11 user nova-compute[75245]: INFO nova.compute.manager [-] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] Took 0.80 seconds to deallocate network for instance.
Nov 29 16:16:11 user nova-compute[75245]: DEBUG nova.compute.manager [req-3d1ad605-ac4a-4273-8b62-a7e8f1dbe676 req-8669dc89-b2ec-4372-af95-3abb66a950a4 service nova] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] Received event network-vif-deleted-507c0cd2-dea3-4352-b2ff-60000cc32053 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:16:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-8ed99b7d-eb02-44b6-ad61-f5f2aa7e47d0 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:16:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-8ed99b7d-eb02-44b6-ad61-f5f2aa7e47d0 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:16:12 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-8ed99b7d-eb02-44b6-ad61-f5f2aa7e47d0 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:16:12 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-8ed99b7d-eb02-44b6-ad61-f5f2aa7e47d0 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:16:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-8ed99b7d-eb02-44b6-ad61-f5f2aa7e47d0 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.298s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:16:12 user nova-compute[75245]: INFO nova.scheduler.client.report [None req-8ed99b7d-eb02-44b6-ad61-f5f2aa7e47d0 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Deleted allocations for instance 36728d4f-925b-46a3-b4b5-17f14b9c99c3
Nov 29 16:16:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-8ed99b7d-eb02-44b6-ad61-f5f2aa7e47d0 tempest-VolumesAdminNegativeTest-193480502 tempest-VolumesAdminNegativeTest-193480502-project-member] Lock "36728d4f-925b-46a3-b4b5-17f14b9c99c3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.378s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:16:12 user nova-compute[75245]: DEBUG nova.compute.manager [req-b274041f-e41b-403d-8932-d463c56a2464 req-e1c16639-f705-4562-8295-fc6071004a20 service nova] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Received event network-vif-plugged-f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:16:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b274041f-e41b-403d-8932-d463c56a2464 req-e1c16639-f705-4562-8295-fc6071004a20 service nova] Acquiring lock "816edb0e-c4fc-470b-8151-f98502e50789-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:16:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b274041f-e41b-403d-8932-d463c56a2464 req-e1c16639-f705-4562-8295-fc6071004a20 service nova] Lock "816edb0e-c4fc-470b-8151-f98502e50789-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:16:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b274041f-e41b-403d-8932-d463c56a2464 req-e1c16639-f705-4562-8295-fc6071004a20 service nova] Lock "816edb0e-c4fc-470b-8151-f98502e50789-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:16:12 user nova-compute[75245]: DEBUG nova.compute.manager [req-b274041f-e41b-403d-8932-d463c56a2464 req-e1c16639-f705-4562-8295-fc6071004a20 service nova] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] No waiting events found dispatching network-vif-plugged-f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:16:12 user nova-compute[75245]: WARNING nova.compute.manager [req-b274041f-e41b-403d-8932-d463c56a2464 req-e1c16639-f705-4562-8295-fc6071004a20 service nova] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Received unexpected event network-vif-plugged-f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76 for instance with vm_state active and task_state rebuild_spawning.
Nov 29 16:16:12 user nova-compute[75245]: DEBUG nova.compute.manager [req-b274041f-e41b-403d-8932-d463c56a2464 req-e1c16639-f705-4562-8295-fc6071004a20 service nova] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] Received event network-vif-unplugged-507c0cd2-dea3-4352-b2ff-60000cc32053 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:16:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b274041f-e41b-403d-8932-d463c56a2464 req-e1c16639-f705-4562-8295-fc6071004a20 service nova] Acquiring lock "36728d4f-925b-46a3-b4b5-17f14b9c99c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:16:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b274041f-e41b-403d-8932-d463c56a2464 req-e1c16639-f705-4562-8295-fc6071004a20 service nova] Lock "36728d4f-925b-46a3-b4b5-17f14b9c99c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:16:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b274041f-e41b-403d-8932-d463c56a2464 req-e1c16639-f705-4562-8295-fc6071004a20 service nova] Lock "36728d4f-925b-46a3-b4b5-17f14b9c99c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:16:12 user nova-compute[75245]: DEBUG nova.compute.manager [req-b274041f-e41b-403d-8932-d463c56a2464 req-e1c16639-f705-4562-8295-fc6071004a20 service nova] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] No waiting events found dispatching network-vif-unplugged-507c0cd2-dea3-4352-b2ff-60000cc32053 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:16:12 user nova-compute[75245]: WARNING nova.compute.manager [req-b274041f-e41b-403d-8932-d463c56a2464 req-e1c16639-f705-4562-8295-fc6071004a20 service nova] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] Received unexpected event network-vif-unplugged-507c0cd2-dea3-4352-b2ff-60000cc32053 for instance with vm_state deleted and task_state None.
Nov 29 16:16:12 user nova-compute[75245]: DEBUG nova.compute.manager [req-b274041f-e41b-403d-8932-d463c56a2464 req-e1c16639-f705-4562-8295-fc6071004a20 service nova] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] Received event network-vif-plugged-507c0cd2-dea3-4352-b2ff-60000cc32053 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:16:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b274041f-e41b-403d-8932-d463c56a2464 req-e1c16639-f705-4562-8295-fc6071004a20 service nova] Acquiring lock "36728d4f-925b-46a3-b4b5-17f14b9c99c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:16:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b274041f-e41b-403d-8932-d463c56a2464 req-e1c16639-f705-4562-8295-fc6071004a20 service nova] Lock "36728d4f-925b-46a3-b4b5-17f14b9c99c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:16:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b274041f-e41b-403d-8932-d463c56a2464 req-e1c16639-f705-4562-8295-fc6071004a20 service nova] Lock "36728d4f-925b-46a3-b4b5-17f14b9c99c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:16:12 user nova-compute[75245]: DEBUG nova.compute.manager [req-b274041f-e41b-403d-8932-d463c56a2464 req-e1c16639-f705-4562-8295-fc6071004a20 service nova] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] No waiting events found dispatching network-vif-plugged-507c0cd2-dea3-4352-b2ff-60000cc32053 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:16:12 user nova-compute[75245]: WARNING nova.compute.manager [req-b274041f-e41b-403d-8932-d463c56a2464 req-e1c16639-f705-4562-8295-fc6071004a20 service nova] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] Received unexpected event network-vif-plugged-507c0cd2-dea3-4352-b2ff-60000cc32053 for instance with vm_state deleted and task_state None.
Nov 29 16:16:12 user nova-compute[75245]: DEBUG nova.compute.manager [req-b274041f-e41b-403d-8932-d463c56a2464 req-e1c16639-f705-4562-8295-fc6071004a20 service nova] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] Received event network-vif-plugged-507c0cd2-dea3-4352-b2ff-60000cc32053 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:16:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b274041f-e41b-403d-8932-d463c56a2464 req-e1c16639-f705-4562-8295-fc6071004a20 service nova] Acquiring lock "36728d4f-925b-46a3-b4b5-17f14b9c99c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:16:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b274041f-e41b-403d-8932-d463c56a2464 req-e1c16639-f705-4562-8295-fc6071004a20 service nova] Lock "36728d4f-925b-46a3-b4b5-17f14b9c99c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:16:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b274041f-e41b-403d-8932-d463c56a2464 req-e1c16639-f705-4562-8295-fc6071004a20 service nova] Lock "36728d4f-925b-46a3-b4b5-17f14b9c99c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:16:12 user nova-compute[75245]: DEBUG nova.compute.manager [req-b274041f-e41b-403d-8932-d463c56a2464 req-e1c16639-f705-4562-8295-fc6071004a20 service nova] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] No waiting events found dispatching network-vif-plugged-507c0cd2-dea3-4352-b2ff-60000cc32053 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:16:12 user nova-compute[75245]: WARNING nova.compute.manager [req-b274041f-e41b-403d-8932-d463c56a2464 req-e1c16639-f705-4562-8295-fc6071004a20 service nova] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] Received unexpected event network-vif-plugged-507c0cd2-dea3-4352-b2ff-60000cc32053 for instance with vm_state deleted and task_state None.
Nov 29 16:16:12 user nova-compute[75245]: DEBUG nova.compute.manager [req-b274041f-e41b-403d-8932-d463c56a2464 req-e1c16639-f705-4562-8295-fc6071004a20 service nova] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] Received event network-vif-plugged-507c0cd2-dea3-4352-b2ff-60000cc32053 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:16:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b274041f-e41b-403d-8932-d463c56a2464 req-e1c16639-f705-4562-8295-fc6071004a20 service nova] Acquiring lock "36728d4f-925b-46a3-b4b5-17f14b9c99c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:16:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b274041f-e41b-403d-8932-d463c56a2464 req-e1c16639-f705-4562-8295-fc6071004a20 service nova] Lock "36728d4f-925b-46a3-b4b5-17f14b9c99c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:16:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b274041f-e41b-403d-8932-d463c56a2464 req-e1c16639-f705-4562-8295-fc6071004a20 service nova] Lock "36728d4f-925b-46a3-b4b5-17f14b9c99c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:16:12 user nova-compute[75245]: DEBUG nova.compute.manager [req-b274041f-e41b-403d-8932-d463c56a2464 req-e1c16639-f705-4562-8295-fc6071004a20 service nova] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] No waiting events found dispatching network-vif-plugged-507c0cd2-dea3-4352-b2ff-60000cc32053 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:16:12 user nova-compute[75245]: WARNING nova.compute.manager [req-b274041f-e41b-403d-8932-d463c56a2464 req-e1c16639-f705-4562-8295-fc6071004a20 service nova] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] Received unexpected event network-vif-plugged-507c0cd2-dea3-4352-b2ff-60000cc32053 for instance with vm_state deleted and task_state None.
Nov 29 16:16:12 user nova-compute[75245]: DEBUG nova.compute.manager [req-b274041f-e41b-403d-8932-d463c56a2464 req-e1c16639-f705-4562-8295-fc6071004a20 service nova] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] Received event network-vif-unplugged-507c0cd2-dea3-4352-b2ff-60000cc32053 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:16:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b274041f-e41b-403d-8932-d463c56a2464 req-e1c16639-f705-4562-8295-fc6071004a20 service nova] Acquiring lock "36728d4f-925b-46a3-b4b5-17f14b9c99c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:16:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b274041f-e41b-403d-8932-d463c56a2464 req-e1c16639-f705-4562-8295-fc6071004a20 service nova] Lock "36728d4f-925b-46a3-b4b5-17f14b9c99c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:16:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b274041f-e41b-403d-8932-d463c56a2464 req-e1c16639-f705-4562-8295-fc6071004a20 service nova] Lock "36728d4f-925b-46a3-b4b5-17f14b9c99c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:16:12 user nova-compute[75245]: DEBUG nova.compute.manager [req-b274041f-e41b-403d-8932-d463c56a2464 req-e1c16639-f705-4562-8295-fc6071004a20 service nova] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] No waiting events found dispatching network-vif-unplugged-507c0cd2-dea3-4352-b2ff-60000cc32053 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:16:12 user nova-compute[75245]: WARNING nova.compute.manager [req-b274041f-e41b-403d-8932-d463c56a2464 req-e1c16639-f705-4562-8295-fc6071004a20 service nova] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] Received unexpected event network-vif-unplugged-507c0cd2-dea3-4352-b2ff-60000cc32053 for instance with vm_state deleted and task_state None.
Nov 29 16:16:12 user nova-compute[75245]: DEBUG nova.compute.manager [req-b274041f-e41b-403d-8932-d463c56a2464 req-e1c16639-f705-4562-8295-fc6071004a20 service nova] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] Received event network-vif-plugged-507c0cd2-dea3-4352-b2ff-60000cc32053 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:16:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b274041f-e41b-403d-8932-d463c56a2464 req-e1c16639-f705-4562-8295-fc6071004a20 service nova] Acquiring lock "36728d4f-925b-46a3-b4b5-17f14b9c99c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:16:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b274041f-e41b-403d-8932-d463c56a2464 req-e1c16639-f705-4562-8295-fc6071004a20 service nova] Lock "36728d4f-925b-46a3-b4b5-17f14b9c99c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:16:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b274041f-e41b-403d-8932-d463c56a2464 req-e1c16639-f705-4562-8295-fc6071004a20 service nova] Lock "36728d4f-925b-46a3-b4b5-17f14b9c99c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:16:12 user nova-compute[75245]: DEBUG nova.compute.manager [req-b274041f-e41b-403d-8932-d463c56a2464 req-e1c16639-f705-4562-8295-fc6071004a20 service nova] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] No waiting events found dispatching network-vif-plugged-507c0cd2-dea3-4352-b2ff-60000cc32053 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:16:12 user nova-compute[75245]: WARNING nova.compute.manager [req-b274041f-e41b-403d-8932-d463c56a2464 req-e1c16639-f705-4562-8295-fc6071004a20 service nova] [instance: 36728d4f-925b-46a3-b4b5-17f14b9c99c3] Received unexpected event network-vif-plugged-507c0cd2-dea3-4352-b2ff-60000cc32053 for instance with vm_state deleted and task_state None.
Nov 29 16:16:12 user nova-compute[75245]: DEBUG nova.compute.manager [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Instance event wait completed in 0 seconds for  {{(pid=75245) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 16:16:12 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Guest created on hypervisor {{(pid=75245) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 16:16:12 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Instance spawned successfully.
Nov 29 16:16:12 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 16:16:12 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Found default for hw_cdrom_bus of ide {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:16:12 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Found default for hw_disk_bus of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:16:12 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Found default for hw_input_bus of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:16:12 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Found default for hw_pointer_model of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:16:12 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Found default for hw_video_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:16:12 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Found default for hw_vif_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:16:12 user nova-compute[75245]: DEBUG nova.compute.manager [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:16:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:16:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:16:12 user nova-compute[75245]: DEBUG nova.objects.instance [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75245) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 29 16:16:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-6b012f85-571d-4359-887c-4e530978a2b4 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.070s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:16:12 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:17 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:19 user nova-compute[75245]: DEBUG nova.compute.manager [req-24f729dc-1ef0-4895-94d5-47c02b938191 req-9a39745b-4460-4be5-9dfa-c77b40e84b1b service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Received event network-changed-e76a4989-a78d-47cf-8df0-b0b71180b60e {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:16:19 user nova-compute[75245]: DEBUG nova.compute.manager [req-24f729dc-1ef0-4895-94d5-47c02b938191 req-9a39745b-4460-4be5-9dfa-c77b40e84b1b service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Refreshing instance network info cache due to event network-changed-e76a4989-a78d-47cf-8df0-b0b71180b60e. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:16:19 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-24f729dc-1ef0-4895-94d5-47c02b938191 req-9a39745b-4460-4be5-9dfa-c77b40e84b1b service nova] Acquiring lock "refresh_cache-5f2a6f15-e413-47a2-be3e-961dd9ee7deb" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:16:19 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-24f729dc-1ef0-4895-94d5-47c02b938191 req-9a39745b-4460-4be5-9dfa-c77b40e84b1b service nova] Acquired lock "refresh_cache-5f2a6f15-e413-47a2-be3e-961dd9ee7deb" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:16:19 user nova-compute[75245]: DEBUG nova.network.neutron [req-24f729dc-1ef0-4895-94d5-47c02b938191 req-9a39745b-4460-4be5-9dfa-c77b40e84b1b service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Refreshing network info cache for port e76a4989-a78d-47cf-8df0-b0b71180b60e {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:16:20 user nova-compute[75245]: DEBUG nova.network.neutron [req-24f729dc-1ef0-4895-94d5-47c02b938191 req-9a39745b-4460-4be5-9dfa-c77b40e84b1b service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Updated VIF entry in instance network info cache for port e76a4989-a78d-47cf-8df0-b0b71180b60e. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:16:20 user nova-compute[75245]: DEBUG nova.network.neutron [req-24f729dc-1ef0-4895-94d5-47c02b938191 req-9a39745b-4460-4be5-9dfa-c77b40e84b1b service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Updating instance_info_cache with network_info: [{"id": "e76a4989-a78d-47cf-8df0-b0b71180b60e", "address": "fa:16:3e:76:29:fe", "network": {"id": "0e5af197-7146-4691-9357-c6d470646e65", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1607694636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape76a4989-a7", "ovs_interfaceid": "e76a4989-a78d-47cf-8df0-b0b71180b60e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4dd25469-cfd1-468f-8fa3-a58c5613c96b", "address": "fa:16:3e:16:dd:65", "network": {"id": "33ed6d1c-906e-49c8-9731-a0d23f716434", "bridge": "br-int", "label": "tempest-device-tagging-net1-322196721", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dd25469-cf", "ovs_interfaceid": "4dd25469-cfd1-468f-8fa3-a58c5613c96b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7b6625ae-3097-4e56-bb72-3b67ff4996b6", "address": "fa:16:3e:be:8a:fe", "network": {"id": "33ed6d1c-906e-49c8-9731-a0d23f716434", "bridge": "br-int", "label": "tempest-device-tagging-net1-322196721", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b6625ae-30", "ovs_interfaceid": "7b6625ae-3097-4e56-bb72-3b67ff4996b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "10e71fa4-4f0d-420a-9ea3-502e0a1eb1f7", "address": "fa:16:3e:3a:e0:19", "network": {"id": "33ed6d1c-906e-49c8-9731-a0d23f716434", "bridge": "br-int", "label": "tempest-device-tagging-net1-322196721", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e71fa4-4f", "ovs_interfaceid": "10e71fa4-4f0d-420a-9ea3-502e0a1eb1f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "706111a2-b6f0-4311-ac82-a60a93fa2f51", "address": "fa:16:3e:db:77:11", "network": {"id": "33ed6d1c-906e-49c8-9731-a0d23f716434", "bridge": "br-int", "label": "tempest-device-tagging-net1-322196721", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap706111a2-b6", "ovs_interfaceid": "706111a2-b6f0-4311-ac82-a60a93fa2f51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5e39b868-de11-4bc1-b68a-11621bf7f057", "address": "fa:16:3e:44:89:16", "network": {"id": "c815e5db-bcac-4915-b581-63c2f697d2e5", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132953712", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e39b868-de", "ovs_interfaceid": "5e39b868-de11-4bc1-b68a-11621bf7f057", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "52f4aecd-3b06-4a52-9541-b7bc96acf5d4", "address": "fa:16:3e:f9:b9:5f", "network": {"id": "c815e5db-bcac-4915-b581-63c2f697d2e5", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132953712", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52f4aecd-3b", "ovs_interfaceid": "52f4aecd-3b06-4a52-9541-b7bc96acf5d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:16:20 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-24f729dc-1ef0-4895-94d5-47c02b938191 req-9a39745b-4460-4be5-9dfa-c77b40e84b1b service nova] Releasing lock "refresh_cache-5f2a6f15-e413-47a2-be3e-961dd9ee7deb" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:16:20 user nova-compute[75245]: DEBUG nova.compute.manager [req-88af5706-f763-4c85-a213-d6bedc3d32f2 req-9fbb6ad1-40d9-4cae-a730-f0847ccd0ff6 service nova] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Received event network-changed-35705f85-434c-481c-be8f-6182fda15267 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:16:20 user nova-compute[75245]: DEBUG nova.compute.manager [req-88af5706-f763-4c85-a213-d6bedc3d32f2 req-9fbb6ad1-40d9-4cae-a730-f0847ccd0ff6 service nova] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Refreshing instance network info cache due to event network-changed-35705f85-434c-481c-be8f-6182fda15267. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:16:20 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-88af5706-f763-4c85-a213-d6bedc3d32f2 req-9fbb6ad1-40d9-4cae-a730-f0847ccd0ff6 service nova] Acquiring lock "refresh_cache-95b96d09-b9df-4e92-a141-f044078e4ce1" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:16:20 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-88af5706-f763-4c85-a213-d6bedc3d32f2 req-9fbb6ad1-40d9-4cae-a730-f0847ccd0ff6 service nova] Acquired lock "refresh_cache-95b96d09-b9df-4e92-a141-f044078e4ce1" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:16:20 user nova-compute[75245]: DEBUG nova.network.neutron [req-88af5706-f763-4c85-a213-d6bedc3d32f2 req-9fbb6ad1-40d9-4cae-a730-f0847ccd0ff6 service nova] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Refreshing network info cache for port 35705f85-434c-481c-be8f-6182fda15267 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:16:20 user nova-compute[75245]: DEBUG nova.network.neutron [req-88af5706-f763-4c85-a213-d6bedc3d32f2 req-9fbb6ad1-40d9-4cae-a730-f0847ccd0ff6 service nova] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Updated VIF entry in instance network info cache for port 35705f85-434c-481c-be8f-6182fda15267. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:16:20 user nova-compute[75245]: DEBUG nova.network.neutron [req-88af5706-f763-4c85-a213-d6bedc3d32f2 req-9fbb6ad1-40d9-4cae-a730-f0847ccd0ff6 service nova] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Updating instance_info_cache with network_info: [{"id": "35705f85-434c-481c-be8f-6182fda15267", "address": "fa:16:3e:64:70:89", "network": {"id": "3e4157dc-b9ba-40de-a00e-6f4c9a3c089b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-448760355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cd0053203ae489cb4bd097d7815b4e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35705f85-43", "ovs_interfaceid": "35705f85-434c-481c-be8f-6182fda15267", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:16:20 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-88af5706-f763-4c85-a213-d6bedc3d32f2 req-9fbb6ad1-40d9-4cae-a730-f0847ccd0ff6 service nova] Releasing lock "refresh_cache-95b96d09-b9df-4e92-a141-f044078e4ce1" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:16:20 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:21 user nova-compute[75245]: INFO nova.compute.manager [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Rebuilding instance
Nov 29 16:16:21 user nova-compute[75245]: DEBUG nova.compute.manager [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:16:21 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:21 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:21 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:21 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Acquiring lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:16:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:16:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Acquiring lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:16:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:16:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:16:21 user nova-compute[75245]: INFO nova.compute.manager [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Terminating instance
Nov 29 16:16:21 user nova-compute[75245]: DEBUG nova.compute.manager [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Start destroying the instance on the hypervisor. {{(pid=75245) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:22 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Instance destroyed successfully.
Nov 29 16:16:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:22 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Instance destroyed successfully.
Nov 29 16:16:22 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:14:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-909618067',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1148731204',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHlR5MzIPbCau2nJtv2utk0O1W1k0aEGcfbcv1sh7yMNFDLP7hs7yhHF8D8CRcgmIp1z1EERmv0wTgIEJhrbP+HwDUzTtl9AyFgANaK56wESe9DOxRAA657EmdA7oyz8OQ==',key_name='tempest-keypair-1816958253',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:14:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7cd0053203ae489cb4bd097d7815b4e5',ramdisk_id='',reservation_id='r-if6royoq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-2087197629',owner_user_name='tempest-ServerActionsV293TestJSON-2087197629-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:16:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6753af2ac6a40d98a2e2ecf8a56c73c',uuid=95b96d09-b9df-4e92-a141-f044078e4ce1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "35705f85-434c-481c-be8f-6182fda15267", "address": "fa:16:3e:64:70:89", "network": {"id": "3e4157dc-b9ba-40de-a00e-6f4c9a3c089b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-448760355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cd0053203ae489cb4bd097d7815b4e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35705f85-43", "ovs_interfaceid": "35705f85-434c-481c-be8f-6182fda15267", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Converting VIF {"id": "35705f85-434c-481c-be8f-6182fda15267", "address": "fa:16:3e:64:70:89", "network": {"id": "3e4157dc-b9ba-40de-a00e-6f4c9a3c089b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-448760355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cd0053203ae489cb4bd097d7815b4e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35705f85-43", "ovs_interfaceid": "35705f85-434c-481c-be8f-6182fda15267", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:64:70:89,bridge_name='br-int',has_traffic_filtering=True,id=35705f85-434c-481c-be8f-6182fda15267,network=Network(3e4157dc-b9ba-40de-a00e-6f4c9a3c089b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35705f85-43') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG os_vif [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:70:89,bridge_name='br-int',has_traffic_filtering=True,id=35705f85-434c-481c-be8f-6182fda15267,network=Network(3e4157dc-b9ba-40de-a00e-6f4c9a3c089b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35705f85-43') {{(pid=75245) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap35705f85-43, bridge=br-int, if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG nova.compute.manager [req-6d04e313-60e1-4c78-8a3e-e16f0c4e6a7d req-b6c224db-6f21-4e1a-8c1f-39ca490ea7db service nova] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Received event network-vif-unplugged-35705f85-434c-481c-be8f-6182fda15267 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-6d04e313-60e1-4c78-8a3e-e16f0c4e6a7d req-b6c224db-6f21-4e1a-8c1f-39ca490ea7db service nova] Acquiring lock "95b96d09-b9df-4e92-a141-f044078e4ce1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-6d04e313-60e1-4c78-8a3e-e16f0c4e6a7d req-b6c224db-6f21-4e1a-8c1f-39ca490ea7db service nova] Lock "95b96d09-b9df-4e92-a141-f044078e4ce1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-6d04e313-60e1-4c78-8a3e-e16f0c4e6a7d req-b6c224db-6f21-4e1a-8c1f-39ca490ea7db service nova] Lock "95b96d09-b9df-4e92-a141-f044078e4ce1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG nova.compute.manager [req-6d04e313-60e1-4c78-8a3e-e16f0c4e6a7d req-b6c224db-6f21-4e1a-8c1f-39ca490ea7db service nova] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] No waiting events found dispatching network-vif-unplugged-35705f85-434c-481c-be8f-6182fda15267 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:16:22 user nova-compute[75245]: WARNING nova.compute.manager [req-6d04e313-60e1-4c78-8a3e-e16f0c4e6a7d req-b6c224db-6f21-4e1a-8c1f-39ca490ea7db service nova] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Received unexpected event network-vif-unplugged-35705f85-434c-481c-be8f-6182fda15267 for instance with vm_state active and task_state rebuilding.
Nov 29 16:16:22 user nova-compute[75245]: DEBUG nova.compute.manager [req-6d04e313-60e1-4c78-8a3e-e16f0c4e6a7d req-b6c224db-6f21-4e1a-8c1f-39ca490ea7db service nova] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Received event network-vif-plugged-35705f85-434c-481c-be8f-6182fda15267 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-6d04e313-60e1-4c78-8a3e-e16f0c4e6a7d req-b6c224db-6f21-4e1a-8c1f-39ca490ea7db service nova] Acquiring lock "95b96d09-b9df-4e92-a141-f044078e4ce1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-6d04e313-60e1-4c78-8a3e-e16f0c4e6a7d req-b6c224db-6f21-4e1a-8c1f-39ca490ea7db service nova] Lock "95b96d09-b9df-4e92-a141-f044078e4ce1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-6d04e313-60e1-4c78-8a3e-e16f0c4e6a7d req-b6c224db-6f21-4e1a-8c1f-39ca490ea7db service nova] Lock "95b96d09-b9df-4e92-a141-f044078e4ce1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG nova.compute.manager [req-6d04e313-60e1-4c78-8a3e-e16f0c4e6a7d req-b6c224db-6f21-4e1a-8c1f-39ca490ea7db service nova] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] No waiting events found dispatching network-vif-plugged-35705f85-434c-481c-be8f-6182fda15267 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:16:22 user nova-compute[75245]: WARNING nova.compute.manager [req-6d04e313-60e1-4c78-8a3e-e16f0c4e6a7d req-b6c224db-6f21-4e1a-8c1f-39ca490ea7db service nova] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Received unexpected event network-vif-plugged-35705f85-434c-481c-be8f-6182fda15267 for instance with vm_state active and task_state rebuilding.
Nov 29 16:16:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG nova.compute.manager [req-48c85db5-9229-4bb5-abd2-3e890ffe51ed req-fd9915cd-3d7b-4bc0-a20c-d11f22778b93 service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Received event network-vif-unplugged-e76a4989-a78d-47cf-8df0-b0b71180b60e {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-48c85db5-9229-4bb5-abd2-3e890ffe51ed req-fd9915cd-3d7b-4bc0-a20c-d11f22778b93 service nova] Acquiring lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-48c85db5-9229-4bb5-abd2-3e890ffe51ed req-fd9915cd-3d7b-4bc0-a20c-d11f22778b93 service nova] Lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-48c85db5-9229-4bb5-abd2-3e890ffe51ed req-fd9915cd-3d7b-4bc0-a20c-d11f22778b93 service nova] Lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG nova.compute.manager [req-48c85db5-9229-4bb5-abd2-3e890ffe51ed req-fd9915cd-3d7b-4bc0-a20c-d11f22778b93 service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] No waiting events found dispatching network-vif-unplugged-e76a4989-a78d-47cf-8df0-b0b71180b60e {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG nova.compute.manager [req-48c85db5-9229-4bb5-abd2-3e890ffe51ed req-fd9915cd-3d7b-4bc0-a20c-d11f22778b93 service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Received event network-vif-unplugged-e76a4989-a78d-47cf-8df0-b0b71180b60e for instance with task_state deleting. {{(pid=75245) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b70fc2e5-327f-4773-b2bc-eaf0a3c6d4b1) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG nova.compute.manager [req-b1dacc1f-e399-4841-8ede-9c0e2f57e988 req-5201d2ab-3f5d-4461-be74-0286a2b0985e service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Received event network-vif-unplugged-4dd25469-cfd1-468f-8fa3-a58c5613c96b {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b1dacc1f-e399-4841-8ede-9c0e2f57e988 req-5201d2ab-3f5d-4461-be74-0286a2b0985e service nova] Acquiring lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b1dacc1f-e399-4841-8ede-9c0e2f57e988 req-5201d2ab-3f5d-4461-be74-0286a2b0985e service nova] Lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b1dacc1f-e399-4841-8ede-9c0e2f57e988 req-5201d2ab-3f5d-4461-be74-0286a2b0985e service nova] Lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG nova.compute.manager [req-b1dacc1f-e399-4841-8ede-9c0e2f57e988 req-5201d2ab-3f5d-4461-be74-0286a2b0985e service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] No waiting events found dispatching network-vif-unplugged-4dd25469-cfd1-468f-8fa3-a58c5613c96b {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG nova.compute.manager [req-b1dacc1f-e399-4841-8ede-9c0e2f57e988 req-5201d2ab-3f5d-4461-be74-0286a2b0985e service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Received event network-vif-unplugged-4dd25469-cfd1-468f-8fa3-a58c5613c96b for instance with task_state deleting. {{(pid=75245) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:22 user nova-compute[75245]: INFO os_vif [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:70:89,bridge_name='br-int',has_traffic_filtering=True,id=35705f85-434c-481c-be8f-6182fda15267,network=Network(3e4157dc-b9ba-40de-a00e-6f4c9a3c089b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35705f85-43')
Nov 29 16:16:22 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] calling os-brick to detach iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, {'target_iqn': 'iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GHLbXqeE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:16:22 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 29 16:16:22 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91d88d2-eaed-4f48-a914-f6cb18f6f09c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 16:16:22 user nova-compute[75245]: No targets found.
Nov 29 16:16:22 user nova-compute[75245]: iSNS:
Nov 29 16:16:22 user nova-compute[75245]: No targets found.
Nov 29 16:16:22 user nova-compute[75245]: STATIC:
Nov 29 16:16:22 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49
Nov 29 16:16:22 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:16:22 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:16:22 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026
Nov 29 16:16:22 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:16:22 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:16:22 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c
Nov 29 16:16:22 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:16:22 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:16:22 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18
Nov 29 16:16:22 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:16:22 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:16:22 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea
Nov 29 16:16:22 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:16:22 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:16:22 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f
Nov 29 16:16:22 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:16:22 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:16:22 user nova-compute[75245]: FIRMWARE:
Nov 29 16:16:22 user nova-compute[75245]: No targets found.
Nov 29 16:16:22 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 16:16:22 user nova-compute[75245]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 16:16:22 user nova-compute[75245]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75245) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026', 0)] {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.032s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[65556a51-7c89-41e1-aefe-6c381575763e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d9c6d0f-141a-4da4-910d-89f924e27722]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18 (non-flash)
Nov 29 16:16:22 user nova-compute[75245]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49 (non-flash)
Nov 29 16:16:22 user nova-compute[75245]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea (non-flash)
Nov 29 16:16:22 user nova-compute[75245]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 (non-flash)
Nov 29 16:16:22 user nova-compute[75245]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f (non-flash)
Nov 29 16:16:22 user nova-compute[75245]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c (non-flash)
Nov 29 16:16:22 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18 (non-flash)
Nov 29 16:16:22 user nova-compute[75245]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49 (non-flash)
Nov 29 16:16:22 user nova-compute[75245]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea (non-flash)
Nov 29 16:16:22 user nova-compute[75245]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 (non-flash)
Nov 29 16:16:22 user nova-compute[75245]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f (non-flash)
Nov 29 16:16:22 user nova-compute[75245]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c (non-flash)
Nov 29 16:16:22 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0d4c368dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026'): ({'sdg'}, set())}) {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Removing single pathed devices sdg {{(pid=75245) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de3c7f6-2a18-443c-839b-292759645903]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.025s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[958a57d0-ebd3-4600-b1c6-44f4a07430c8]: (4, ('ok\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Flushing IO for device /dev/sdg {{(pid=75245) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f51ece5-1732-4997-a6d8-f9963a2bd522]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75245) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:23 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.064s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:23 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c224d7b-9992-475e-b41e-cff88ee1a1ca]: (4, ('1', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:23 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 16:16:23 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] SCSI volumes sdg have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 16:16:23 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026')] {{(pid=75245) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 16:16:23 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:23 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:23 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b06386-06fd-4b57-afc6-d7c7174cc874]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:23 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:16:23 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 -p 172.16.0.220:3260 --logout {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:23 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 -p 172.16.0.220:3260 --logout" returned: 0 in 0.134s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:23 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f356a9-9a56-48ea-be59-5b6a96901d68]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:23 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026, portal: 172.16.0.220,3260]
Nov 29 16:16:23 user nova-compute[75245]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026, portal: 172.16.0.220,3260] successful.
Nov 29 16:16:23 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:16:23 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 -p 172.16.0.220:3260 --op delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:23 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.055s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:23 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[692e25f9-2b65-46d2-9aea-55fecd44916e]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:23 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:16:23 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.527s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:16:23 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] <== disconnect_volume: return (529ms) None {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:16:23 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Disconnected iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 16:16:23 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Deleting instance files /opt/stack/data/nova/instances/95b96d09-b9df-4e92-a141-f044078e4ce1_del
Nov 29 16:16:23 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Deletion of /opt/stack/data/nova/instances/95b96d09-b9df-4e92-a141-f044078e4ce1_del complete
Nov 29 16:16:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:23 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 95b96d09-b9df-4e92-a141-f044078e4ce1 could not be found.
Nov 29 16:16:23 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] calling os-brick to detach iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 16:16:23 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, {'target_iqn': 'iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GHLbXqeE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:16:23 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 29 16:16:23 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:16:23 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:16:23 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:23 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Instance destroyed successfully.
Nov 29 16:16:23 user nova-compute[75245]: DEBUG nova.objects.instance [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Lazy-loading 'resources' on Instance uuid 5f2a6f15-e413-47a2-be3e-961dd9ee7deb {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:16:23 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T16:13:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-619452740',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-619452740',id=14,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzzZJWR0Z42IfqvjNBvr3oJ/CWfYOwAc7EPalTBrhytgQ3UhVNR/2RB2aKKzUtCRCIeBQxJaqcrQf6PUVf0KtMurh9Aq+5WKkhWeX/26lsBtPUsQV556q2fdB3O2s3Q8A==',key_name='tempest-keypair-1957550448',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:14:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b8f45ede2eb64458870da9d0ca494178',ramdisk_id='',reservation_id='r-1h1cjd03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2077234721',owner_user_name='tempest-TaggedBootDevicesTest_v242-2077234721-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:14:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e9d4764cc9949bdb6fe3df0ca89daed',uuid=5f2a6f15-e413-47a2-be3e-961dd9ee7deb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e76a4989-a78d-47cf-8df0-b0b71180b60e", "address": "fa:16:3e:76:29:fe", "network": {"id": "0e5af197-7146-4691-9357-c6d470646e65", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1607694636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape76a4989-a7", "ovs_interfaceid": "e76a4989-a78d-47cf-8df0-b0b71180b60e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 16:16:23 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Converting VIF {"id": "e76a4989-a78d-47cf-8df0-b0b71180b60e", "address": "fa:16:3e:76:29:fe", "network": {"id": "0e5af197-7146-4691-9357-c6d470646e65", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1607694636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape76a4989-a7", "ovs_interfaceid": "e76a4989-a78d-47cf-8df0-b0b71180b60e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:16:23 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:29:fe,bridge_name='br-int',has_traffic_filtering=True,id=e76a4989-a78d-47cf-8df0-b0b71180b60e,network=Network(0e5af197-7146-4691-9357-c6d470646e65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape76a4989-a7') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:16:23 user nova-compute[75245]: DEBUG os_vif [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:29:fe,bridge_name='br-int',has_traffic_filtering=True,id=e76a4989-a78d-47cf-8df0-b0b71180b60e,network=Network(0e5af197-7146-4691-9357-c6d470646e65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape76a4989-a7') {{(pid=75245) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 16:16:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape76a4989-a7, bridge=br-int, if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:16:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:23 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.035s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:23 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c2febd-678f-498e-8348-7998b624ab28]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:23 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 16:16:23 user nova-compute[75245]: No targets found.
Nov 29 16:16:23 user nova-compute[75245]: iSNS:
Nov 29 16:16:23 user nova-compute[75245]: No targets found.
Nov 29 16:16:23 user nova-compute[75245]: STATIC:
Nov 29 16:16:23 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49
Nov 29 16:16:23 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:16:23 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:16:23 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c
Nov 29 16:16:23 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:16:23 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:16:23 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18
Nov 29 16:16:23 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:16:23 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:16:23 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea
Nov 29 16:16:23 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:16:23 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:16:23 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f
Nov 29 16:16:23 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:16:23 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:16:23 user nova-compute[75245]: FIRMWARE:
Nov 29 16:16:23 user nova-compute[75245]: No targets found.
Nov 29 16:16:23 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:16:23 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 16:16:23 user nova-compute[75245]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 16:16:23 user nova-compute[75245]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75245) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 16:16:23 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026', 0)] {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 16:16:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:16:23 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:23 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:23 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[e90b16e4-9010-40dd-9ebb-0af896ab5217]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:23 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bce521ae-8644-494b-af78-bf81b4318683) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:16:23 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:23 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b936bb-10c4-4e27-8d76-3e359dd333fd]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:23 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18 (non-flash)
Nov 29 16:16:23 user nova-compute[75245]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49 (non-flash)
Nov 29 16:16:23 user nova-compute[75245]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea (non-flash)
Nov 29 16:16:23 user nova-compute[75245]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f (non-flash)
Nov 29 16:16:23 user nova-compute[75245]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c (non-flash)
Nov 29 16:16:23 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:16:23 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18 (non-flash)
Nov 29 16:16:23 user nova-compute[75245]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49 (non-flash)
Nov 29 16:16:23 user nova-compute[75245]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea (non-flash)
Nov 29 16:16:23 user nova-compute[75245]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f (non-flash)
Nov 29 16:16:23 user nova-compute[75245]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c (non-flash)
Nov 29 16:16:23 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:16:23 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0d441cf9a0>, {}) {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 16:16:23 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Disconnecting from: [] {{(pid=75245) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 16:16:23 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.110s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:16:23 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] <== disconnect_volume: return (113ms) None {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:16:23 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Disconnected iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 16:16:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:16:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:23 user nova-compute[75245]: INFO os_vif [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:29:fe,bridge_name='br-int',has_traffic_filtering=True,id=e76a4989-a78d-47cf-8df0-b0b71180b60e,network=Network(0e5af197-7146-4691-9357-c6d470646e65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape76a4989-a7')
Nov 29 16:16:23 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T16:13:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-619452740',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-619452740',id=14,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzzZJWR0Z42IfqvjNBvr3oJ/CWfYOwAc7EPalTBrhytgQ3UhVNR/2RB2aKKzUtCRCIeBQxJaqcrQf6PUVf0KtMurh9Aq+5WKkhWeX/26lsBtPUsQV556q2fdB3O2s3Q8A==',key_name='tempest-keypair-1957550448',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:14:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b8f45ede2eb64458870da9d0ca494178',ramdisk_id='',reservation_id='r-1h1cjd03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2077234721',owner_user_name='tempest-TaggedBootDevicesTest_v242-2077234721-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:14:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e9d4764cc9949bdb6fe3df0ca89daed',uuid=5f2a6f15-e413-47a2-be3e-961dd9ee7deb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4dd25469-cfd1-468f-8fa3-a58c5613c96b", "address": "fa:16:3e:16:dd:65", "network": {"id": "33ed6d1c-906e-49c8-9731-a0d23f716434", "bridge": "br-int", "label": "tempest-device-tagging-net1-322196721", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dd25469-cf", "ovs_interfaceid": "4dd25469-cfd1-468f-8fa3-a58c5613c96b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75245) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 16:16:23 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Converting VIF {"id": "4dd25469-cfd1-468f-8fa3-a58c5613c96b", "address": "fa:16:3e:16:dd:65", "network": {"id": "33ed6d1c-906e-49c8-9731-a0d23f716434", "bridge": "br-int", "label": "tempest-device-tagging-net1-322196721", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dd25469-cf", "ovs_interfaceid": "4dd25469-cfd1-468f-8fa3-a58c5613c96b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:16:23 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:dd:65,bridge_name='br-int',has_traffic_filtering=True,id=4dd25469-cfd1-468f-8fa3-a58c5613c96b,network=Network(33ed6d1c-906e-49c8-9731-a0d23f716434),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4dd25469-cf') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:16:23 user nova-compute[75245]: DEBUG os_vif [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:dd:65,bridge_name='br-int',has_traffic_filtering=True,id=4dd25469-cfd1-468f-8fa3-a58c5613c96b,network=Network(33ed6d1c-906e-49c8-9731-a0d23f716434),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4dd25469-cf') {{(pid=75245) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 16:16:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4dd25469-cf, bridge=br-int, if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:16:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:16:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1dcf6c88-6be3-4f97-aaad-484e58c6b9d3) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:16:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:16:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:23 user nova-compute[75245]: INFO os_vif [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:dd:65,bridge_name='br-int',has_traffic_filtering=True,id=4dd25469-cfd1-468f-8fa3-a58c5613c96b,network=Network(33ed6d1c-906e-49c8-9731-a0d23f716434),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4dd25469-cf')
Nov 29 16:16:23 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T16:13:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-619452740',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-619452740',id=14,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzzZJWR0Z42IfqvjNBvr3oJ/CWfYOwAc7EPalTBrhytgQ3UhVNR/2RB2aKKzUtCRCIeBQxJaqcrQf6PUVf0KtMurh9Aq+5WKkhWeX/26lsBtPUsQV556q2fdB3O2s3Q8A==',key_name='tempest-keypair-1957550448',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:14:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b8f45ede2eb64458870da9d0ca494178',ramdisk_id='',reservation_id='r-1h1cjd03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2077234721',owner_user_name='tempest-TaggedBootDevicesTest_v242-2077234721-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:14:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e9d4764cc9949bdb6fe3df0ca89daed',uuid=5f2a6f15-e413-47a2-be3e-961dd9ee7deb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7b6625ae-3097-4e56-bb72-3b67ff4996b6", "address": "fa:16:3e:be:8a:fe", "network": {"id": "33ed6d1c-906e-49c8-9731-a0d23f716434", "bridge": "br-int", "label": "tempest-device-tagging-net1-322196721", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b6625ae-30", "ovs_interfaceid": "7b6625ae-3097-4e56-bb72-3b67ff4996b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75245) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 16:16:23 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Converting VIF {"id": "7b6625ae-3097-4e56-bb72-3b67ff4996b6", "address": "fa:16:3e:be:8a:fe", "network": {"id": "33ed6d1c-906e-49c8-9731-a0d23f716434", "bridge": "br-int", "label": "tempest-device-tagging-net1-322196721", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b6625ae-30", "ovs_interfaceid": "7b6625ae-3097-4e56-bb72-3b67ff4996b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:16:23 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:8a:fe,bridge_name='br-int',has_traffic_filtering=True,id=7b6625ae-3097-4e56-bb72-3b67ff4996b6,network=Network(33ed6d1c-906e-49c8-9731-a0d23f716434),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7b6625ae-30') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:16:23 user nova-compute[75245]: DEBUG os_vif [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:8a:fe,bridge_name='br-int',has_traffic_filtering=True,id=7b6625ae-3097-4e56-bb72-3b67ff4996b6,network=Network(33ed6d1c-906e-49c8-9731-a0d23f716434),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7b6625ae-30') {{(pid=75245) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 16:16:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7b6625ae-30, bridge=br-int, if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:16:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7fd917d9-9e3d-43bd-8584-b04958456c05) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:24 user nova-compute[75245]: INFO os_vif [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:8a:fe,bridge_name='br-int',has_traffic_filtering=True,id=7b6625ae-3097-4e56-bb72-3b67ff4996b6,network=Network(33ed6d1c-906e-49c8-9731-a0d23f716434),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7b6625ae-30')
Nov 29 16:16:24 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T16:13:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-619452740',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-619452740',id=14,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzzZJWR0Z42IfqvjNBvr3oJ/CWfYOwAc7EPalTBrhytgQ3UhVNR/2RB2aKKzUtCRCIeBQxJaqcrQf6PUVf0KtMurh9Aq+5WKkhWeX/26lsBtPUsQV556q2fdB3O2s3Q8A==',key_name='tempest-keypair-1957550448',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:14:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b8f45ede2eb64458870da9d0ca494178',ramdisk_id='',reservation_id='r-1h1cjd03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2077234721',owner_user_name='tempest-TaggedBootDevicesTest_v242-2077234721-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:14:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e9d4764cc9949bdb6fe3df0ca89daed',uuid=5f2a6f15-e413-47a2-be3e-961dd9ee7deb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "10e71fa4-4f0d-420a-9ea3-502e0a1eb1f7", "address": "fa:16:3e:3a:e0:19", "network": {"id": "33ed6d1c-906e-49c8-9731-a0d23f716434", "bridge": "br-int", "label": "tempest-device-tagging-net1-322196721", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e71fa4-4f", "ovs_interfaceid": "10e71fa4-4f0d-420a-9ea3-502e0a1eb1f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Converting VIF {"id": "10e71fa4-4f0d-420a-9ea3-502e0a1eb1f7", "address": "fa:16:3e:3a:e0:19", "network": {"id": "33ed6d1c-906e-49c8-9731-a0d23f716434", "bridge": "br-int", "label": "tempest-device-tagging-net1-322196721", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e71fa4-4f", "ovs_interfaceid": "10e71fa4-4f0d-420a-9ea3-502e0a1eb1f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:e0:19,bridge_name='br-int',has_traffic_filtering=True,id=10e71fa4-4f0d-420a-9ea3-502e0a1eb1f7,network=Network(33ed6d1c-906e-49c8-9731-a0d23f716434),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10e71fa4-4f') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG os_vif [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:e0:19,bridge_name='br-int',has_traffic_filtering=True,id=10e71fa4-4f0d-420a-9ea3-502e0a1eb1f7,network=Network(33ed6d1c-906e-49c8-9731-a0d23f716434),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10e71fa4-4f') {{(pid=75245) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap10e71fa4-4f, bridge=br-int, if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=efb37400-e26a-490c-b0c9-de96bcfe8504) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:24 user nova-compute[75245]: INFO os_vif [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:e0:19,bridge_name='br-int',has_traffic_filtering=True,id=10e71fa4-4f0d-420a-9ea3-502e0a1eb1f7,network=Network(33ed6d1c-906e-49c8-9731-a0d23f716434),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10e71fa4-4f')
Nov 29 16:16:24 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T16:13:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-619452740',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-619452740',id=14,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzzZJWR0Z42IfqvjNBvr3oJ/CWfYOwAc7EPalTBrhytgQ3UhVNR/2RB2aKKzUtCRCIeBQxJaqcrQf6PUVf0KtMurh9Aq+5WKkhWeX/26lsBtPUsQV556q2fdB3O2s3Q8A==',key_name='tempest-keypair-1957550448',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:14:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b8f45ede2eb64458870da9d0ca494178',ramdisk_id='',reservation_id='r-1h1cjd03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2077234721',owner_user_name='tempest-TaggedBootDevicesTest_v242-2077234721-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:14:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e9d4764cc9949bdb6fe3df0ca89daed',uuid=5f2a6f15-e413-47a2-be3e-961dd9ee7deb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "706111a2-b6f0-4311-ac82-a60a93fa2f51", "address": "fa:16:3e:db:77:11", "network": {"id": "33ed6d1c-906e-49c8-9731-a0d23f716434", "bridge": "br-int", "label": "tempest-device-tagging-net1-322196721", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap706111a2-b6", "ovs_interfaceid": "706111a2-b6f0-4311-ac82-a60a93fa2f51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Converting VIF {"id": "706111a2-b6f0-4311-ac82-a60a93fa2f51", "address": "fa:16:3e:db:77:11", "network": {"id": "33ed6d1c-906e-49c8-9731-a0d23f716434", "bridge": "br-int", "label": "tempest-device-tagging-net1-322196721", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap706111a2-b6", "ovs_interfaceid": "706111a2-b6f0-4311-ac82-a60a93fa2f51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:77:11,bridge_name='br-int',has_traffic_filtering=True,id=706111a2-b6f0-4311-ac82-a60a93fa2f51,network=Network(33ed6d1c-906e-49c8-9731-a0d23f716434),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap706111a2-b6') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG os_vif [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:77:11,bridge_name='br-int',has_traffic_filtering=True,id=706111a2-b6f0-4311-ac82-a60a93fa2f51,network=Network(33ed6d1c-906e-49c8-9731-a0d23f716434),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap706111a2-b6') {{(pid=75245) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap706111a2-b6, bridge=br-int, if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5b69d28e-2254-42f4-9b35-6b07e94a6c75) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:24 user nova-compute[75245]: INFO os_vif [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:77:11,bridge_name='br-int',has_traffic_filtering=True,id=706111a2-b6f0-4311-ac82-a60a93fa2f51,network=Network(33ed6d1c-906e-49c8-9731-a0d23f716434),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap706111a2-b6')
Nov 29 16:16:24 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T16:13:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-619452740',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-619452740',id=14,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzzZJWR0Z42IfqvjNBvr3oJ/CWfYOwAc7EPalTBrhytgQ3UhVNR/2RB2aKKzUtCRCIeBQxJaqcrQf6PUVf0KtMurh9Aq+5WKkhWeX/26lsBtPUsQV556q2fdB3O2s3Q8A==',key_name='tempest-keypair-1957550448',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:14:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b8f45ede2eb64458870da9d0ca494178',ramdisk_id='',reservation_id='r-1h1cjd03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2077234721',owner_user_name='tempest-TaggedBootDevicesTest_v242-2077234721-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:14:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e9d4764cc9949bdb6fe3df0ca89daed',uuid=5f2a6f15-e413-47a2-be3e-961dd9ee7deb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5e39b868-de11-4bc1-b68a-11621bf7f057", "address": "fa:16:3e:44:89:16", "network": {"id": "c815e5db-bcac-4915-b581-63c2f697d2e5", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132953712", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e39b868-de", "ovs_interfaceid": "5e39b868-de11-4bc1-b68a-11621bf7f057", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Converting VIF {"id": "5e39b868-de11-4bc1-b68a-11621bf7f057", "address": "fa:16:3e:44:89:16", "network": {"id": "c815e5db-bcac-4915-b581-63c2f697d2e5", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132953712", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e39b868-de", "ovs_interfaceid": "5e39b868-de11-4bc1-b68a-11621bf7f057", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:89:16,bridge_name='br-int',has_traffic_filtering=True,id=5e39b868-de11-4bc1-b68a-11621bf7f057,network=Network(c815e5db-bcac-4915-b581-63c2f697d2e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e39b868-de') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG os_vif [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:89:16,bridge_name='br-int',has_traffic_filtering=True,id=5e39b868-de11-4bc1-b68a-11621bf7f057,network=Network(c815e5db-bcac-4915-b581-63c2f697d2e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e39b868-de') {{(pid=75245) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5e39b868-de, bridge=br-int, if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0db43f34-deda-4d1e-b3cc-44a5d9267412) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:24 user nova-compute[75245]: INFO os_vif [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:89:16,bridge_name='br-int',has_traffic_filtering=True,id=5e39b868-de11-4bc1-b68a-11621bf7f057,network=Network(c815e5db-bcac-4915-b581-63c2f697d2e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e39b868-de')
Nov 29 16:16:24 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T16:13:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-619452740',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-619452740',id=14,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzzZJWR0Z42IfqvjNBvr3oJ/CWfYOwAc7EPalTBrhytgQ3UhVNR/2RB2aKKzUtCRCIeBQxJaqcrQf6PUVf0KtMurh9Aq+5WKkhWeX/26lsBtPUsQV556q2fdB3O2s3Q8A==',key_name='tempest-keypair-1957550448',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:14:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b8f45ede2eb64458870da9d0ca494178',ramdisk_id='',reservation_id='r-1h1cjd03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2077234721',owner_user_name='tempest-TaggedBootDevicesTest_v242-2077234721-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:14:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e9d4764cc9949bdb6fe3df0ca89daed',uuid=5f2a6f15-e413-47a2-be3e-961dd9ee7deb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "52f4aecd-3b06-4a52-9541-b7bc96acf5d4", "address": "fa:16:3e:f9:b9:5f", "network": {"id": "c815e5db-bcac-4915-b581-63c2f697d2e5", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132953712", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52f4aecd-3b", "ovs_interfaceid": "52f4aecd-3b06-4a52-9541-b7bc96acf5d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Converting VIF {"id": "52f4aecd-3b06-4a52-9541-b7bc96acf5d4", "address": "fa:16:3e:f9:b9:5f", "network": {"id": "c815e5db-bcac-4915-b581-63c2f697d2e5", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132953712", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52f4aecd-3b", "ovs_interfaceid": "52f4aecd-3b06-4a52-9541-b7bc96acf5d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:b9:5f,bridge_name='br-int',has_traffic_filtering=True,id=52f4aecd-3b06-4a52-9541-b7bc96acf5d4,network=Network(c815e5db-bcac-4915-b581-63c2f697d2e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52f4aecd-3b') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG os_vif [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:b9:5f,bridge_name='br-int',has_traffic_filtering=True,id=52f4aecd-3b06-4a52-9541-b7bc96acf5d4,network=Network(c815e5db-bcac-4915-b581-63c2f697d2e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52f4aecd-3b') {{(pid=75245) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap52f4aecd-3b, bridge=br-int, if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9d536792-041e-4837-9d2a-bc5770560c9a) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:24 user nova-compute[75245]: INFO os_vif [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:b9:5f,bridge_name='br-int',has_traffic_filtering=True,id=52f4aecd-3b06-4a52-9541-b7bc96acf5d4,network=Network(c815e5db-bcac-4915-b581-63c2f697d2e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52f4aecd-3b')
Nov 29 16:16:24 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] calling os-brick to detach iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, {'target_iqn': 'iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EXgeiNxd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:16:24 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:16:24 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa5b37e-4330-44ef-b659-75b923a5d190]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 16:16:24 user nova-compute[75245]: No targets found.
Nov 29 16:16:24 user nova-compute[75245]: iSNS:
Nov 29 16:16:24 user nova-compute[75245]: No targets found.
Nov 29 16:16:24 user nova-compute[75245]: STATIC:
Nov 29 16:16:24 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49
Nov 29 16:16:24 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:16:24 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:16:24 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c
Nov 29 16:16:24 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:16:24 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:16:24 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18
Nov 29 16:16:24 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:16:24 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:16:24 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea
Nov 29 16:16:24 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:16:24 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:16:24 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f
Nov 29 16:16:24 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:16:24 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:16:24 user nova-compute[75245]: FIRMWARE:
Nov 29 16:16:24 user nova-compute[75245]: No targets found.
Nov 29 16:16:24 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 16:16:24 user nova-compute[75245]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 16:16:24 user nova-compute[75245]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75245) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18', 0)] {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced74053-8979-4ae8-8d8e-3542d6d98762]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec36cb16-4d11-4223-9794-6c395a4a484a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18 (non-flash)
Nov 29 16:16:24 user nova-compute[75245]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49 (non-flash)
Nov 29 16:16:24 user nova-compute[75245]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea (non-flash)
Nov 29 16:16:24 user nova-compute[75245]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f (non-flash)
Nov 29 16:16:24 user nova-compute[75245]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c (non-flash)
Nov 29 16:16:24 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18 (non-flash)
Nov 29 16:16:24 user nova-compute[75245]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49 (non-flash)
Nov 29 16:16:24 user nova-compute[75245]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea (non-flash)
Nov 29 16:16:24 user nova-compute[75245]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f (non-flash)
Nov 29 16:16:24 user nova-compute[75245]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c (non-flash)
Nov 29 16:16:24 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0d44186440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18'): ({'sdb'}, set())}) {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Removing single pathed devices sdb {{(pid=75245) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26ffabb-171b-4a1c-9ba2-67d7ac9b9d58]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[79577d70-8e61-40e7-b641-6e58ebb30ce9]: (4, ('ok\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Flushing IO for device /dev/sdb {{(pid=75245) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[598252ec-c8a6-49cd-be49-45ea1bb85e21]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75245) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.068s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[484b138e-e6ec-4006-9f38-914f76da9c24]: (4, ('1', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] SCSI volumes sdb have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18')] {{(pid=75245) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b563531-47d3-4f82-9fc7-eac805260573]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18 -p 172.16.0.220:3260 --logout {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG nova.compute.manager [req-d61d334b-b90f-49c3-8a79-55d7099b506c req-57e40c5d-79fa-4383-aa4f-1e571096d88e service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Received event network-vif-plugged-e76a4989-a78d-47cf-8df0-b0b71180b60e {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d61d334b-b90f-49c3-8a79-55d7099b506c req-57e40c5d-79fa-4383-aa4f-1e571096d88e service nova] Acquiring lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d61d334b-b90f-49c3-8a79-55d7099b506c req-57e40c5d-79fa-4383-aa4f-1e571096d88e service nova] Lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d61d334b-b90f-49c3-8a79-55d7099b506c req-57e40c5d-79fa-4383-aa4f-1e571096d88e service nova] Lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG nova.compute.manager [req-d61d334b-b90f-49c3-8a79-55d7099b506c req-57e40c5d-79fa-4383-aa4f-1e571096d88e service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] No waiting events found dispatching network-vif-plugged-e76a4989-a78d-47cf-8df0-b0b71180b60e {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:16:24 user nova-compute[75245]: WARNING nova.compute.manager [req-d61d334b-b90f-49c3-8a79-55d7099b506c req-57e40c5d-79fa-4383-aa4f-1e571096d88e service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Received unexpected event network-vif-plugged-e76a4989-a78d-47cf-8df0-b0b71180b60e for instance with vm_state active and task_state deleting.
Nov 29 16:16:24 user nova-compute[75245]: DEBUG nova.compute.manager [req-d61d334b-b90f-49c3-8a79-55d7099b506c req-57e40c5d-79fa-4383-aa4f-1e571096d88e service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Received event network-vif-unplugged-10e71fa4-4f0d-420a-9ea3-502e0a1eb1f7 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d61d334b-b90f-49c3-8a79-55d7099b506c req-57e40c5d-79fa-4383-aa4f-1e571096d88e service nova] Acquiring lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d61d334b-b90f-49c3-8a79-55d7099b506c req-57e40c5d-79fa-4383-aa4f-1e571096d88e service nova] Lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d61d334b-b90f-49c3-8a79-55d7099b506c req-57e40c5d-79fa-4383-aa4f-1e571096d88e service nova] Lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG nova.compute.manager [req-d61d334b-b90f-49c3-8a79-55d7099b506c req-57e40c5d-79fa-4383-aa4f-1e571096d88e service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] No waiting events found dispatching network-vif-unplugged-10e71fa4-4f0d-420a-9ea3-502e0a1eb1f7 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG nova.compute.manager [req-d61d334b-b90f-49c3-8a79-55d7099b506c req-57e40c5d-79fa-4383-aa4f-1e571096d88e service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Received event network-vif-unplugged-10e71fa4-4f0d-420a-9ea3-502e0a1eb1f7 for instance with task_state deleting. {{(pid=75245) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG nova.compute.manager [req-d61d334b-b90f-49c3-8a79-55d7099b506c req-57e40c5d-79fa-4383-aa4f-1e571096d88e service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Received event network-vif-plugged-10e71fa4-4f0d-420a-9ea3-502e0a1eb1f7 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d61d334b-b90f-49c3-8a79-55d7099b506c req-57e40c5d-79fa-4383-aa4f-1e571096d88e service nova] Acquiring lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d61d334b-b90f-49c3-8a79-55d7099b506c req-57e40c5d-79fa-4383-aa4f-1e571096d88e service nova] Lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d61d334b-b90f-49c3-8a79-55d7099b506c req-57e40c5d-79fa-4383-aa4f-1e571096d88e service nova] Lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG nova.compute.manager [req-d61d334b-b90f-49c3-8a79-55d7099b506c req-57e40c5d-79fa-4383-aa4f-1e571096d88e service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] No waiting events found dispatching network-vif-plugged-10e71fa4-4f0d-420a-9ea3-502e0a1eb1f7 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:16:24 user nova-compute[75245]: WARNING nova.compute.manager [req-d61d334b-b90f-49c3-8a79-55d7099b506c req-57e40c5d-79fa-4383-aa4f-1e571096d88e service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Received unexpected event network-vif-plugged-10e71fa4-4f0d-420a-9ea3-502e0a1eb1f7 for instance with vm_state active and task_state deleting.
Nov 29 16:16:24 user nova-compute[75245]: DEBUG nova.compute.manager [req-d61d334b-b90f-49c3-8a79-55d7099b506c req-57e40c5d-79fa-4383-aa4f-1e571096d88e service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Received event network-vif-unplugged-706111a2-b6f0-4311-ac82-a60a93fa2f51 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d61d334b-b90f-49c3-8a79-55d7099b506c req-57e40c5d-79fa-4383-aa4f-1e571096d88e service nova] Acquiring lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d61d334b-b90f-49c3-8a79-55d7099b506c req-57e40c5d-79fa-4383-aa4f-1e571096d88e service nova] Lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d61d334b-b90f-49c3-8a79-55d7099b506c req-57e40c5d-79fa-4383-aa4f-1e571096d88e service nova] Lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG nova.compute.manager [req-d61d334b-b90f-49c3-8a79-55d7099b506c req-57e40c5d-79fa-4383-aa4f-1e571096d88e service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] No waiting events found dispatching network-vif-unplugged-706111a2-b6f0-4311-ac82-a60a93fa2f51 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG nova.compute.manager [req-d61d334b-b90f-49c3-8a79-55d7099b506c req-57e40c5d-79fa-4383-aa4f-1e571096d88e service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Received event network-vif-unplugged-706111a2-b6f0-4311-ac82-a60a93fa2f51 for instance with task_state deleting. {{(pid=75245) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG nova.compute.manager [req-d61d334b-b90f-49c3-8a79-55d7099b506c req-57e40c5d-79fa-4383-aa4f-1e571096d88e service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Received event network-vif-plugged-706111a2-b6f0-4311-ac82-a60a93fa2f51 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d61d334b-b90f-49c3-8a79-55d7099b506c req-57e40c5d-79fa-4383-aa4f-1e571096d88e service nova] Acquiring lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d61d334b-b90f-49c3-8a79-55d7099b506c req-57e40c5d-79fa-4383-aa4f-1e571096d88e service nova] Lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d61d334b-b90f-49c3-8a79-55d7099b506c req-57e40c5d-79fa-4383-aa4f-1e571096d88e service nova] Lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG nova.compute.manager [req-d61d334b-b90f-49c3-8a79-55d7099b506c req-57e40c5d-79fa-4383-aa4f-1e571096d88e service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] No waiting events found dispatching network-vif-plugged-706111a2-b6f0-4311-ac82-a60a93fa2f51 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:16:24 user nova-compute[75245]: WARNING nova.compute.manager [req-d61d334b-b90f-49c3-8a79-55d7099b506c req-57e40c5d-79fa-4383-aa4f-1e571096d88e service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Received unexpected event network-vif-plugged-706111a2-b6f0-4311-ac82-a60a93fa2f51 for instance with vm_state active and task_state deleting.
Nov 29 16:16:24 user nova-compute[75245]: DEBUG nova.compute.manager [req-d61d334b-b90f-49c3-8a79-55d7099b506c req-57e40c5d-79fa-4383-aa4f-1e571096d88e service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Received event network-vif-unplugged-5e39b868-de11-4bc1-b68a-11621bf7f057 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d61d334b-b90f-49c3-8a79-55d7099b506c req-57e40c5d-79fa-4383-aa4f-1e571096d88e service nova] Acquiring lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d61d334b-b90f-49c3-8a79-55d7099b506c req-57e40c5d-79fa-4383-aa4f-1e571096d88e service nova] Lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d61d334b-b90f-49c3-8a79-55d7099b506c req-57e40c5d-79fa-4383-aa4f-1e571096d88e service nova] Lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG nova.compute.manager [req-d61d334b-b90f-49c3-8a79-55d7099b506c req-57e40c5d-79fa-4383-aa4f-1e571096d88e service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] No waiting events found dispatching network-vif-unplugged-5e39b868-de11-4bc1-b68a-11621bf7f057 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG nova.compute.manager [req-d61d334b-b90f-49c3-8a79-55d7099b506c req-57e40c5d-79fa-4383-aa4f-1e571096d88e service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Received event network-vif-unplugged-5e39b868-de11-4bc1-b68a-11621bf7f057 for instance with task_state deleting. {{(pid=75245) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG nova.compute.manager [req-d61d334b-b90f-49c3-8a79-55d7099b506c req-57e40c5d-79fa-4383-aa4f-1e571096d88e service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Received event network-vif-plugged-5e39b868-de11-4bc1-b68a-11621bf7f057 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d61d334b-b90f-49c3-8a79-55d7099b506c req-57e40c5d-79fa-4383-aa4f-1e571096d88e service nova] Acquiring lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d61d334b-b90f-49c3-8a79-55d7099b506c req-57e40c5d-79fa-4383-aa4f-1e571096d88e service nova] Lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d61d334b-b90f-49c3-8a79-55d7099b506c req-57e40c5d-79fa-4383-aa4f-1e571096d88e service nova] Lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG nova.compute.manager [req-d61d334b-b90f-49c3-8a79-55d7099b506c req-57e40c5d-79fa-4383-aa4f-1e571096d88e service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] No waiting events found dispatching network-vif-plugged-5e39b868-de11-4bc1-b68a-11621bf7f057 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:16:24 user nova-compute[75245]: WARNING nova.compute.manager [req-d61d334b-b90f-49c3-8a79-55d7099b506c req-57e40c5d-79fa-4383-aa4f-1e571096d88e service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Received unexpected event network-vif-plugged-5e39b868-de11-4bc1-b68a-11621bf7f057 for instance with vm_state active and task_state deleting.
Nov 29 16:16:24 user nova-compute[75245]: DEBUG nova.compute.manager [req-d61d334b-b90f-49c3-8a79-55d7099b506c req-57e40c5d-79fa-4383-aa4f-1e571096d88e service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Received event network-vif-unplugged-52f4aecd-3b06-4a52-9541-b7bc96acf5d4 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d61d334b-b90f-49c3-8a79-55d7099b506c req-57e40c5d-79fa-4383-aa4f-1e571096d88e service nova] Acquiring lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d61d334b-b90f-49c3-8a79-55d7099b506c req-57e40c5d-79fa-4383-aa4f-1e571096d88e service nova] Lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d61d334b-b90f-49c3-8a79-55d7099b506c req-57e40c5d-79fa-4383-aa4f-1e571096d88e service nova] Lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG nova.compute.manager [req-d61d334b-b90f-49c3-8a79-55d7099b506c req-57e40c5d-79fa-4383-aa4f-1e571096d88e service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] No waiting events found dispatching network-vif-unplugged-52f4aecd-3b06-4a52-9541-b7bc96acf5d4 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG nova.compute.manager [req-d61d334b-b90f-49c3-8a79-55d7099b506c req-57e40c5d-79fa-4383-aa4f-1e571096d88e service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Received event network-vif-unplugged-52f4aecd-3b06-4a52-9541-b7bc96acf5d4 for instance with task_state deleting. {{(pid=75245) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG nova.compute.manager [req-d61d334b-b90f-49c3-8a79-55d7099b506c req-57e40c5d-79fa-4383-aa4f-1e571096d88e service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Received event network-vif-plugged-52f4aecd-3b06-4a52-9541-b7bc96acf5d4 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d61d334b-b90f-49c3-8a79-55d7099b506c req-57e40c5d-79fa-4383-aa4f-1e571096d88e service nova] Acquiring lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d61d334b-b90f-49c3-8a79-55d7099b506c req-57e40c5d-79fa-4383-aa4f-1e571096d88e service nova] Lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d61d334b-b90f-49c3-8a79-55d7099b506c req-57e40c5d-79fa-4383-aa4f-1e571096d88e service nova] Lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG nova.compute.manager [req-d61d334b-b90f-49c3-8a79-55d7099b506c req-57e40c5d-79fa-4383-aa4f-1e571096d88e service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] No waiting events found dispatching network-vif-plugged-52f4aecd-3b06-4a52-9541-b7bc96acf5d4 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:16:24 user nova-compute[75245]: WARNING nova.compute.manager [req-d61d334b-b90f-49c3-8a79-55d7099b506c req-57e40c5d-79fa-4383-aa4f-1e571096d88e service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Received unexpected event network-vif-plugged-52f4aecd-3b06-4a52-9541-b7bc96acf5d4 for instance with vm_state active and task_state deleting.
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18 -p 172.16.0.220:3260 --logout" returned: 0 in 0.094s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[5332b56b-4dff-46f0-a2ca-ff33481df782]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG nova.compute.manager [req-2cc01d23-ac6e-4187-832a-04e5ec26e0d1 req-08fd541c-11f9-4402-a10f-6643ba0a5c00 service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Received event network-vif-plugged-4dd25469-cfd1-468f-8fa3-a58c5613c96b {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-2cc01d23-ac6e-4187-832a-04e5ec26e0d1 req-08fd541c-11f9-4402-a10f-6643ba0a5c00 service nova] Acquiring lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-2cc01d23-ac6e-4187-832a-04e5ec26e0d1 req-08fd541c-11f9-4402-a10f-6643ba0a5c00 service nova] Lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-2cc01d23-ac6e-4187-832a-04e5ec26e0d1 req-08fd541c-11f9-4402-a10f-6643ba0a5c00 service nova] Lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG nova.compute.manager [req-2cc01d23-ac6e-4187-832a-04e5ec26e0d1 req-08fd541c-11f9-4402-a10f-6643ba0a5c00 service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] No waiting events found dispatching network-vif-plugged-4dd25469-cfd1-468f-8fa3-a58c5613c96b {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:16:24 user nova-compute[75245]: WARNING nova.compute.manager [req-2cc01d23-ac6e-4187-832a-04e5ec26e0d1 req-08fd541c-11f9-4402-a10f-6643ba0a5c00 service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Received unexpected event network-vif-plugged-4dd25469-cfd1-468f-8fa3-a58c5613c96b for instance with vm_state active and task_state deleting.
Nov 29 16:16:24 user nova-compute[75245]: DEBUG nova.compute.manager [req-2cc01d23-ac6e-4187-832a-04e5ec26e0d1 req-08fd541c-11f9-4402-a10f-6643ba0a5c00 service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Received event network-vif-unplugged-7b6625ae-3097-4e56-bb72-3b67ff4996b6 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-2cc01d23-ac6e-4187-832a-04e5ec26e0d1 req-08fd541c-11f9-4402-a10f-6643ba0a5c00 service nova] Acquiring lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-2cc01d23-ac6e-4187-832a-04e5ec26e0d1 req-08fd541c-11f9-4402-a10f-6643ba0a5c00 service nova] Lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-2cc01d23-ac6e-4187-832a-04e5ec26e0d1 req-08fd541c-11f9-4402-a10f-6643ba0a5c00 service nova] Lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG nova.compute.manager [req-2cc01d23-ac6e-4187-832a-04e5ec26e0d1 req-08fd541c-11f9-4402-a10f-6643ba0a5c00 service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] No waiting events found dispatching network-vif-unplugged-7b6625ae-3097-4e56-bb72-3b67ff4996b6 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG nova.compute.manager [req-2cc01d23-ac6e-4187-832a-04e5ec26e0d1 req-08fd541c-11f9-4402-a10f-6643ba0a5c00 service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Received event network-vif-unplugged-7b6625ae-3097-4e56-bb72-3b67ff4996b6 for instance with task_state deleting. {{(pid=75245) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG nova.compute.manager [req-2cc01d23-ac6e-4187-832a-04e5ec26e0d1 req-08fd541c-11f9-4402-a10f-6643ba0a5c00 service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Received event network-vif-plugged-7b6625ae-3097-4e56-bb72-3b67ff4996b6 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-2cc01d23-ac6e-4187-832a-04e5ec26e0d1 req-08fd541c-11f9-4402-a10f-6643ba0a5c00 service nova] Acquiring lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-2cc01d23-ac6e-4187-832a-04e5ec26e0d1 req-08fd541c-11f9-4402-a10f-6643ba0a5c00 service nova] Lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-2cc01d23-ac6e-4187-832a-04e5ec26e0d1 req-08fd541c-11f9-4402-a10f-6643ba0a5c00 service nova] Lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG nova.compute.manager [req-2cc01d23-ac6e-4187-832a-04e5ec26e0d1 req-08fd541c-11f9-4402-a10f-6643ba0a5c00 service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] No waiting events found dispatching network-vif-plugged-7b6625ae-3097-4e56-bb72-3b67ff4996b6 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:16:24 user nova-compute[75245]: WARNING nova.compute.manager [req-2cc01d23-ac6e-4187-832a-04e5ec26e0d1 req-08fd541c-11f9-4402-a10f-6643ba0a5c00 service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Received unexpected event network-vif-plugged-7b6625ae-3097-4e56-bb72-3b67ff4996b6 for instance with vm_state active and task_state deleting.
Nov 29 16:16:24 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18, portal: 172.16.0.220,3260]
Nov 29 16:16:24 user nova-compute[75245]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18, portal: 172.16.0.220,3260] successful.
Nov 29 16:16:24 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18 -p 172.16.0.220:3260 --op delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:021db3af-a7f2-4f6c-b702-35cec416ee18 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[580d5283-f633-4e2b-8504-7aa261fe1984]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.414s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] <== disconnect_volume: return (415ms) None {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Disconnected iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] calling os-brick to detach iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, {'target_iqn': 'iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hwyFbtaV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:16:24 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:16:24 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6362aa-0927-4e66-987c-42c65155967e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 16:16:24 user nova-compute[75245]: No targets found.
Nov 29 16:16:24 user nova-compute[75245]: iSNS:
Nov 29 16:16:24 user nova-compute[75245]: No targets found.
Nov 29 16:16:24 user nova-compute[75245]: STATIC:
Nov 29 16:16:24 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49
Nov 29 16:16:24 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:16:24 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:16:24 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c
Nov 29 16:16:24 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:16:24 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:16:24 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea
Nov 29 16:16:24 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:16:24 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:16:24 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f
Nov 29 16:16:24 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:16:24 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:16:24 user nova-compute[75245]: FIRMWARE:
Nov 29 16:16:24 user nova-compute[75245]: No targets found.
Nov 29 16:16:24 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 16:16:24 user nova-compute[75245]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 16:16:24 user nova-compute[75245]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75245) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea', 0)] {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf36cee-4f2b-4b2d-9e3a-8fcc82102149]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG nova.compute.manager [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Preparing to wait for external event volume-reimaged-f2d1dade-8389-4b92-bdd5-e4eeb4df7026 {{(pid=75245) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Acquiring lock "95b96d09-b9df-4e92-a141-f044078e4ce1-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Lock "95b96d09-b9df-4e92-a141-f044078e4ce1-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Lock "95b96d09-b9df-4e92-a141-f044078e4ce1-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[811320e9-0b70-4a77-9d42-5bc6f52622ab]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49 (non-flash)
Nov 29 16:16:24 user nova-compute[75245]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea (non-flash)
Nov 29 16:16:24 user nova-compute[75245]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f (non-flash)
Nov 29 16:16:24 user nova-compute[75245]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c (non-flash)
Nov 29 16:16:24 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49 (non-flash)
Nov 29 16:16:24 user nova-compute[75245]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea (non-flash)
Nov 29 16:16:24 user nova-compute[75245]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f (non-flash)
Nov 29 16:16:24 user nova-compute[75245]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c (non-flash)
Nov 29 16:16:24 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0d4c369d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea'): ({'sde'}, set())}) {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Removing single pathed devices sde {{(pid=75245) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[57bfd8c8-b699-4135-b86f-3e0bcb400290]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f76cf1-9ef1-4b1d-91ac-1921e5da4604]: (4, ('ok\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Flushing IO for device /dev/sde {{(pid=75245) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[56cf8d58-bdaa-48a4-9a19-d7eb695bbbbf]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75245) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.051s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7913f58-8c97-4337-a685-826e1ba67cde]: (4, ('1', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] SCSI volumes sde have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea')] {{(pid=75245) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.074s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54c3fa3-0fcb-4c76-847d-c8ae4e52ea9e]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:16:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea -p 172.16.0.220:3260 --logout {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:25 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c07d71-b106-47c3-82c9-c853e58a098a]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:25 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea, portal: 172.16.0.220,3260]
Nov 29 16:16:25 user nova-compute[75245]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea, portal: 172.16.0.220,3260] successful.
Nov 29 16:16:25 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:16:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea -p 172.16.0.220:3260 --op delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a14d660-ebcc-4ad9-8cf9-e842d16bbfea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:25 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[db3df591-d152-49c1-8dac-6e2e8cdd0c7f]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:25 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:16:25 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.381s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:16:25 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] <== disconnect_volume: return (383ms) None {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:16:25 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Disconnected iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 16:16:25 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] calling os-brick to detach iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 16:16:25 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, {'target_iqn': 'iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SrTqEnPe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:16:25 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:16:25 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:16:25 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:16:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:25 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[a01cd6cb-a5bf-41b8-be1d-567ee2a6467c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:25 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 16:16:25 user nova-compute[75245]: No targets found.
Nov 29 16:16:25 user nova-compute[75245]: iSNS:
Nov 29 16:16:25 user nova-compute[75245]: No targets found.
Nov 29 16:16:25 user nova-compute[75245]: STATIC:
Nov 29 16:16:25 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49
Nov 29 16:16:25 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:16:25 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:16:25 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c
Nov 29 16:16:25 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:16:25 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:16:25 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f
Nov 29 16:16:25 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:16:25 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:16:25 user nova-compute[75245]: FIRMWARE:
Nov 29 16:16:25 user nova-compute[75245]: No targets found.
Nov 29 16:16:25 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:16:25 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 16:16:25 user nova-compute[75245]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 16:16:25 user nova-compute[75245]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75245) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 16:16:25 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49', 0)] {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 16:16:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:25 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ca6438-709d-422d-b7b1-e2988ea0e3d4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:25 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa40afa-8de5-449c-b3f4-21a328d09e11]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:25 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49 (non-flash)
Nov 29 16:16:25 user nova-compute[75245]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f (non-flash)
Nov 29 16:16:25 user nova-compute[75245]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c (non-flash)
Nov 29 16:16:25 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:16:25 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49 (non-flash)
Nov 29 16:16:25 user nova-compute[75245]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f (non-flash)
Nov 29 16:16:25 user nova-compute[75245]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c (non-flash)
Nov 29 16:16:25 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:16:25 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0d44460040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49'): ({'sdd'}, set())}) {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 16:16:25 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Removing single pathed devices sdd {{(pid=75245) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 16:16:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:25 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e4cbee-7698-4f77-8fcc-08667486c68c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:25 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3074007-d172-4a5b-8764-467b49a0d4bd]: (4, ('ok\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:25 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Flushing IO for device /dev/sdd {{(pid=75245) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 16:16:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.023s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:25 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5bb9f3-ef0f-4fc2-bb60-13ad145cf091]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:25 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75245) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 16:16:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:25 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7eea487-95cb-46ca-9480-226a7dfe3541]: (4, ('1', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:25 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 16:16:25 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] SCSI volumes sdd have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 16:16:25 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49')] {{(pid=75245) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 16:16:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:25 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[f051dd95-4a48-4556-8048-e0b123faba8a]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:25 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:16:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49 -p 172.16.0.220:3260 --logout {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:25 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d894b74-d06b-48b5-b8ac-e627c4307314]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:25 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49, portal: 172.16.0.220,3260]
Nov 29 16:16:25 user nova-compute[75245]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49, portal: 172.16.0.220,3260] successful.
Nov 29 16:16:25 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:16:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49 -p 172.16.0.220:3260 --op delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92465e1e-d975-4701-a213-bc8906dafc49 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:25 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[3650e951-d4c8-4f7a-a279-90063117d305]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:25 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:16:25 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:16:25 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] <== disconnect_volume: return (312ms) None {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:16:25 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Disconnected iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 16:16:25 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Deleting instance files /opt/stack/data/nova/instances/5f2a6f15-e413-47a2-be3e-961dd9ee7deb_del
Nov 29 16:16:25 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Deletion of /opt/stack/data/nova/instances/5f2a6f15-e413-47a2-be3e-961dd9ee7deb_del complete
Nov 29 16:16:25 user nova-compute[75245]: INFO nova.compute.manager [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Took 3.50 seconds to destroy the instance on the hypervisor.
Nov 29 16:16:25 user nova-compute[75245]: DEBUG oslo.service.loopingcall [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75245) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 16:16:25 user nova-compute[75245]: DEBUG nova.compute.manager [-] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Deallocating network for instance {{(pid=75245) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 16:16:25 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] deallocate_for_instance() {{(pid=75245) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 16:16:27 user nova-compute[75245]: DEBUG nova.compute.manager [req-8bd88254-2601-4f1a-b7d6-224d95b823d8 req-c6755ee8-8986-4588-afe8-b8cba5b9769e service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Received event network-vif-deleted-e76a4989-a78d-47cf-8df0-b0b71180b60e {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:16:27 user nova-compute[75245]: INFO nova.compute.manager [req-8bd88254-2601-4f1a-b7d6-224d95b823d8 req-c6755ee8-8986-4588-afe8-b8cba5b9769e service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Neutron deleted interface e76a4989-a78d-47cf-8df0-b0b71180b60e; detaching it from the instance and deleting it from the info cache
Nov 29 16:16:27 user nova-compute[75245]: DEBUG nova.network.neutron [req-8bd88254-2601-4f1a-b7d6-224d95b823d8 req-c6755ee8-8986-4588-afe8-b8cba5b9769e service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Updating instance_info_cache with network_info: [{"id": "4dd25469-cfd1-468f-8fa3-a58c5613c96b", "address": "fa:16:3e:16:dd:65", "network": {"id": "33ed6d1c-906e-49c8-9731-a0d23f716434", "bridge": "br-int", "label": "tempest-device-tagging-net1-322196721", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dd25469-cf", "ovs_interfaceid": "4dd25469-cfd1-468f-8fa3-a58c5613c96b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7b6625ae-3097-4e56-bb72-3b67ff4996b6", "address": "fa:16:3e:be:8a:fe", "network": {"id": "33ed6d1c-906e-49c8-9731-a0d23f716434", "bridge": "br-int", "label": "tempest-device-tagging-net1-322196721", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b6625ae-30", "ovs_interfaceid": "7b6625ae-3097-4e56-bb72-3b67ff4996b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "10e71fa4-4f0d-420a-9ea3-502e0a1eb1f7", "address": "fa:16:3e:3a:e0:19", "network": {"id": "33ed6d1c-906e-49c8-9731-a0d23f716434", "bridge": "br-int", "label": "tempest-device-tagging-net1-322196721", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e71fa4-4f", "ovs_interfaceid": "10e71fa4-4f0d-420a-9ea3-502e0a1eb1f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "706111a2-b6f0-4311-ac82-a60a93fa2f51", "address": "fa:16:3e:db:77:11", "network": {"id": "33ed6d1c-906e-49c8-9731-a0d23f716434", "bridge": "br-int", "label": "tempest-device-tagging-net1-322196721", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap706111a2-b6", "ovs_interfaceid": "706111a2-b6f0-4311-ac82-a60a93fa2f51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5e39b868-de11-4bc1-b68a-11621bf7f057", "address": "fa:16:3e:44:89:16", "network": {"id": "c815e5db-bcac-4915-b581-63c2f697d2e5", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132953712", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e39b868-de", "ovs_interfaceid": "5e39b868-de11-4bc1-b68a-11621bf7f057", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "52f4aecd-3b06-4a52-9541-b7bc96acf5d4", "address": "fa:16:3e:f9:b9:5f", "network": {"id": "c815e5db-bcac-4915-b581-63c2f697d2e5", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132953712", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b8f45ede2eb64458870da9d0ca494178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52f4aecd-3b", "ovs_interfaceid": "52f4aecd-3b06-4a52-9541-b7bc96acf5d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:16:27 user nova-compute[75245]: DEBUG nova.compute.manager [req-8bd88254-2601-4f1a-b7d6-224d95b823d8 req-c6755ee8-8986-4588-afe8-b8cba5b9769e service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Detach interface failed, port_id=e76a4989-a78d-47cf-8df0-b0b71180b60e, reason: Instance 5f2a6f15-e413-47a2-be3e-961dd9ee7deb could not be found. {{(pid=75245) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 16:16:27 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:28 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:16:28 user nova-compute[75245]: INFO nova.compute.manager [-] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Took 3.22 seconds to deallocate network for instance.
Nov 29 16:16:29 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:29 user nova-compute[75245]: DEBUG nova.compute.manager [req-83cd2290-48c8-4c21-a2ee-27b66d4f3352 req-e7f57ca5-0faf-4861-b724-c23d90702a56 service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Received event network-vif-deleted-52f4aecd-3b06-4a52-9541-b7bc96acf5d4 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:16:29 user nova-compute[75245]: DEBUG nova.compute.manager [req-83cd2290-48c8-4c21-a2ee-27b66d4f3352 req-e7f57ca5-0faf-4861-b724-c23d90702a56 service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Received event network-vif-deleted-706111a2-b6f0-4311-ac82-a60a93fa2f51 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:16:29 user nova-compute[75245]: DEBUG nova.compute.manager [req-83cd2290-48c8-4c21-a2ee-27b66d4f3352 req-e7f57ca5-0faf-4861-b724-c23d90702a56 service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Received event network-vif-deleted-10e71fa4-4f0d-420a-9ea3-502e0a1eb1f7 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:16:29 user nova-compute[75245]: DEBUG nova.compute.manager [req-83cd2290-48c8-4c21-a2ee-27b66d4f3352 req-e7f57ca5-0faf-4861-b724-c23d90702a56 service nova] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Received event network-vif-deleted-5e39b868-de11-4bc1-b68a-11621bf7f057 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:16:31 user nova-compute[75245]: INFO nova.compute.manager [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] [instance: 5f2a6f15-e413-47a2-be3e-961dd9ee7deb] Took 2.38 seconds to detach 3 volumes for instance.
Nov 29 16:16:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:16:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:16:31 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:16:31 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:16:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.281s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:16:31 user nova-compute[75245]: INFO nova.scheduler.client.report [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Deleted allocations for instance 5f2a6f15-e413-47a2-be3e-961dd9ee7deb
Nov 29 16:16:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-8d527c30-3421-4e13-be93-6b1ff1043c1d tempest-TaggedBootDevicesTest_v242-2077234721 tempest-TaggedBootDevicesTest_v242-2077234721-project-member] Lock "5f2a6f15-e413-47a2-be3e-961dd9ee7deb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.580s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:16:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:35 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-f48f761b-eef8-494b-ba86-32a7950ec24c tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Acquiring lock "3ab9d7cd-79cd-4c9b-8608-c1ef0f333305" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:16:35 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-f48f761b-eef8-494b-ba86-32a7950ec24c tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lock "3ab9d7cd-79cd-4c9b-8608-c1ef0f333305" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:16:35 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-f48f761b-eef8-494b-ba86-32a7950ec24c tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Acquiring lock "3ab9d7cd-79cd-4c9b-8608-c1ef0f333305-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:16:35 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-f48f761b-eef8-494b-ba86-32a7950ec24c tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lock "3ab9d7cd-79cd-4c9b-8608-c1ef0f333305-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:16:35 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-f48f761b-eef8-494b-ba86-32a7950ec24c tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lock "3ab9d7cd-79cd-4c9b-8608-c1ef0f333305-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:16:35 user nova-compute[75245]: INFO nova.compute.manager [None req-f48f761b-eef8-494b-ba86-32a7950ec24c tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Terminating instance
Nov 29 16:16:35 user nova-compute[75245]: DEBUG nova.compute.manager [None req-f48f761b-eef8-494b-ba86-32a7950ec24c tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Start destroying the instance on the hypervisor. {{(pid=75245) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 16:16:35 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:35 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:35 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:35 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:35 user nova-compute[75245]: DEBUG nova.compute.manager [req-a5850089-ed53-4e3f-a428-27f9c5b97d3e req-17eb7db1-b623-4ed3-b472-2ea9830bd3d8 service nova] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Received event network-vif-unplugged-0b3a82cf-e1cb-455a-9f59-853505903560 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:16:35 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a5850089-ed53-4e3f-a428-27f9c5b97d3e req-17eb7db1-b623-4ed3-b472-2ea9830bd3d8 service nova] Acquiring lock "3ab9d7cd-79cd-4c9b-8608-c1ef0f333305-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:16:35 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a5850089-ed53-4e3f-a428-27f9c5b97d3e req-17eb7db1-b623-4ed3-b472-2ea9830bd3d8 service nova] Lock "3ab9d7cd-79cd-4c9b-8608-c1ef0f333305-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:16:35 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a5850089-ed53-4e3f-a428-27f9c5b97d3e req-17eb7db1-b623-4ed3-b472-2ea9830bd3d8 service nova] Lock "3ab9d7cd-79cd-4c9b-8608-c1ef0f333305-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:16:35 user nova-compute[75245]: DEBUG nova.compute.manager [req-a5850089-ed53-4e3f-a428-27f9c5b97d3e req-17eb7db1-b623-4ed3-b472-2ea9830bd3d8 service nova] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] No waiting events found dispatching network-vif-unplugged-0b3a82cf-e1cb-455a-9f59-853505903560 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:16:35 user nova-compute[75245]: DEBUG nova.compute.manager [req-a5850089-ed53-4e3f-a428-27f9c5b97d3e req-17eb7db1-b623-4ed3-b472-2ea9830bd3d8 service nova] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Received event network-vif-unplugged-0b3a82cf-e1cb-455a-9f59-853505903560 for instance with task_state deleting. {{(pid=75245) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 16:16:36 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Instance destroyed successfully.
Nov 29 16:16:36 user nova-compute[75245]: DEBUG nova.objects.instance [None req-f48f761b-eef8-494b-ba86-32a7950ec24c tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lazy-loading 'resources' on Instance uuid 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:16:36 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-f48f761b-eef8-494b-ba86-32a7950ec24c tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T16:10:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-723691220',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-723691220',id=4,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEoMJZt+VqMN0mavu3vY5Kvut5aAyigJQLII/9twNBGC/SlV5jkUl2w3ylxxIBa5TyZWx/7AEPJj5EkYaLXE+xUAT6uZbyatxvBvA6jxLyD3SeE/POApEcydBOMofkwZ3w==',key_name='tempest-keypair-353472592',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:14:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fd22948fbd074a7c94d8ad7614fbc220',ramdisk_id='',reservation_id='r-k0lo301j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1524245296',owner_user_name='tempest-AttachVolumeShelveTestJSON-1524245296-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:14:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c4942f948584702a8c8b93248694a65',uuid=3ab9d7cd-79cd-4c9b-8608-c1ef0f333305,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0b3a82cf-e1cb-455a-9f59-853505903560", "address": "fa:16:3e:72:f8:5e", "network": {"id": "7f978dee-8a5e-4218-b6fc-2d550c0d7b5d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-53637364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd22948fbd074a7c94d8ad7614fbc220", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b3a82cf-e1", "ovs_interfaceid": "0b3a82cf-e1cb-455a-9f59-853505903560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 16:16:36 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-f48f761b-eef8-494b-ba86-32a7950ec24c tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Converting VIF {"id": "0b3a82cf-e1cb-455a-9f59-853505903560", "address": "fa:16:3e:72:f8:5e", "network": {"id": "7f978dee-8a5e-4218-b6fc-2d550c0d7b5d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-53637364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd22948fbd074a7c94d8ad7614fbc220", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b3a82cf-e1", "ovs_interfaceid": "0b3a82cf-e1cb-455a-9f59-853505903560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:16:36 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-f48f761b-eef8-494b-ba86-32a7950ec24c tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:f8:5e,bridge_name='br-int',has_traffic_filtering=True,id=0b3a82cf-e1cb-455a-9f59-853505903560,network=Network(7f978dee-8a5e-4218-b6fc-2d550c0d7b5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b3a82cf-e1') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:16:36 user nova-compute[75245]: DEBUG os_vif [None req-f48f761b-eef8-494b-ba86-32a7950ec24c tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:f8:5e,bridge_name='br-int',has_traffic_filtering=True,id=0b3a82cf-e1cb-455a-9f59-853505903560,network=Network(7f978dee-8a5e-4218-b6fc-2d550c0d7b5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b3a82cf-e1') {{(pid=75245) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 16:16:36 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:36 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0b3a82cf-e1, bridge=br-int, if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:16:36 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:36 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:16:36 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:36 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=19942116-bbee-495a-88c1-322ac4cee001) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:16:36 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:36 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:16:36 user nova-compute[75245]: INFO os_vif [None req-f48f761b-eef8-494b-ba86-32a7950ec24c tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:f8:5e,bridge_name='br-int',has_traffic_filtering=True,id=0b3a82cf-e1cb-455a-9f59-853505903560,network=Network(7f978dee-8a5e-4218-b6fc-2d550c0d7b5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b3a82cf-e1')
Nov 29 16:16:36 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-f48f761b-eef8-494b-ba86-32a7950ec24c tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Deleting instance files /opt/stack/data/nova/instances/3ab9d7cd-79cd-4c9b-8608-c1ef0f333305_del
Nov 29 16:16:36 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-f48f761b-eef8-494b-ba86-32a7950ec24c tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Deletion of /opt/stack/data/nova/instances/3ab9d7cd-79cd-4c9b-8608-c1ef0f333305_del complete
Nov 29 16:16:36 user nova-compute[75245]: INFO nova.compute.manager [None req-f48f761b-eef8-494b-ba86-32a7950ec24c tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Took 1.04 seconds to destroy the instance on the hypervisor.
Nov 29 16:16:36 user nova-compute[75245]: DEBUG oslo.service.loopingcall [None req-f48f761b-eef8-494b-ba86-32a7950ec24c tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75245) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 16:16:36 user nova-compute[75245]: DEBUG nova.compute.manager [-] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Deallocating network for instance {{(pid=75245) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 16:16:36 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] deallocate_for_instance() {{(pid=75245) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 16:16:37 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:16:37 user nova-compute[75245]: INFO nova.compute.manager [-] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Took 1.28 seconds to deallocate network for instance.
Nov 29 16:16:37 user nova-compute[75245]: DEBUG nova.compute.manager [req-47a2dfd6-3066-4002-87a1-0a4c76fedeb8 req-d5c0be41-64c0-4193-a244-efbf5f83942f service nova] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Received event network-vif-deleted-0b3a82cf-e1cb-455a-9f59-853505903560 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:16:37 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:37 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-f48f761b-eef8-494b-ba86-32a7950ec24c tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:16:37 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-f48f761b-eef8-494b-ba86-32a7950ec24c tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:16:38 user nova-compute[75245]: DEBUG nova.compute.manager [req-c9b09fc7-c6ff-46e1-9762-885fe28754f2 req-72bf48c9-6b1c-4771-8638-3a897080d476 service nova] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Received event network-vif-plugged-0b3a82cf-e1cb-455a-9f59-853505903560 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:16:38 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-c9b09fc7-c6ff-46e1-9762-885fe28754f2 req-72bf48c9-6b1c-4771-8638-3a897080d476 service nova] Acquiring lock "3ab9d7cd-79cd-4c9b-8608-c1ef0f333305-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:16:38 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-c9b09fc7-c6ff-46e1-9762-885fe28754f2 req-72bf48c9-6b1c-4771-8638-3a897080d476 service nova] Lock "3ab9d7cd-79cd-4c9b-8608-c1ef0f333305-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:16:38 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-c9b09fc7-c6ff-46e1-9762-885fe28754f2 req-72bf48c9-6b1c-4771-8638-3a897080d476 service nova] Lock "3ab9d7cd-79cd-4c9b-8608-c1ef0f333305-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:16:38 user nova-compute[75245]: DEBUG nova.compute.manager [req-c9b09fc7-c6ff-46e1-9762-885fe28754f2 req-72bf48c9-6b1c-4771-8638-3a897080d476 service nova] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] No waiting events found dispatching network-vif-plugged-0b3a82cf-e1cb-455a-9f59-853505903560 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:16:38 user nova-compute[75245]: WARNING nova.compute.manager [req-c9b09fc7-c6ff-46e1-9762-885fe28754f2 req-72bf48c9-6b1c-4771-8638-3a897080d476 service nova] [instance: 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305] Received unexpected event network-vif-plugged-0b3a82cf-e1cb-455a-9f59-853505903560 for instance with vm_state deleted and task_state None.
Nov 29 16:16:38 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-f48f761b-eef8-494b-ba86-32a7950ec24c tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:16:38 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-f48f761b-eef8-494b-ba86-32a7950ec24c tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:16:38 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-f48f761b-eef8-494b-ba86-32a7950ec24c tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.277s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:16:38 user nova-compute[75245]: INFO nova.scheduler.client.report [None req-f48f761b-eef8-494b-ba86-32a7950ec24c tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Deleted allocations for instance 3ab9d7cd-79cd-4c9b-8608-c1ef0f333305
Nov 29 16:16:38 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-f48f761b-eef8-494b-ba86-32a7950ec24c tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lock "3ab9d7cd-79cd-4c9b-8608-c1ef0f333305" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.817s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:16:41 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:41 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:16:41 user nova-compute[75245]: WARNING nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] While synchronizing instance power states, found 6 instances in the database and 5 instances on the hypervisor.
Nov 29 16:16:41 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Triggering sync for uuid 6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7 {{(pid=75245) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 16:16:41 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Triggering sync for uuid ed9a6a4e-2e7d-443c-82ef-f14f11d32c81 {{(pid=75245) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 16:16:41 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Triggering sync for uuid fd819060-4388-444d-809e-94f6b2e8f102 {{(pid=75245) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 16:16:41 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Triggering sync for uuid 816edb0e-c4fc-470b-8151-f98502e50789 {{(pid=75245) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 16:16:41 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Triggering sync for uuid 95b96d09-b9df-4e92-a141-f044078e4ce1 {{(pid=75245) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 16:16:41 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Triggering sync for uuid b99c5e50-a98b-45a2-b170-664c93109897 {{(pid=75245) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 16:16:41 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:16:41 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:16:41 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "ed9a6a4e-2e7d-443c-82ef-f14f11d32c81" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:16:41 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "ed9a6a4e-2e7d-443c-82ef-f14f11d32c81" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:16:41 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "fd819060-4388-444d-809e-94f6b2e8f102" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:16:41 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "fd819060-4388-444d-809e-94f6b2e8f102" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:16:41 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "816edb0e-c4fc-470b-8151-f98502e50789" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:16:41 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "816edb0e-c4fc-470b-8151-f98502e50789" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:16:41 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "95b96d09-b9df-4e92-a141-f044078e4ce1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:16:41 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "95b96d09-b9df-4e92-a141-f044078e4ce1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:16:41 user nova-compute[75245]: INFO nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] During sync_power_state the instance has a pending task (rebuilding). Skip.
Nov 29 16:16:41 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "95b96d09-b9df-4e92-a141-f044078e4ce1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:16:41 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "b99c5e50-a98b-45a2-b170-664c93109897" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:16:41 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "b99c5e50-a98b-45a2-b170-664c93109897" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:16:41 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "fd819060-4388-444d-809e-94f6b2e8f102" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.059s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:16:41 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "816edb0e-c4fc-470b-8151-f98502e50789" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.060s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:16:41 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "ed9a6a4e-2e7d-443c-82ef-f14f11d32c81" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:16:41 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.068s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:16:41 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "b99c5e50-a98b-45a2-b170-664c93109897" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.071s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:16:42 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:46 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:47 user nova-compute[75245]: DEBUG nova.compute.manager [req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 req-563009a3-4d08-4aa7-8ad1-26a0a1eb6bad service nova] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Received event volume-reimaged-f2d1dade-8389-4b92-bdd5-e4eeb4df7026 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:16:47 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 req-563009a3-4d08-4aa7-8ad1-26a0a1eb6bad service nova] Acquiring lock "95b96d09-b9df-4e92-a141-f044078e4ce1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:16:47 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 req-563009a3-4d08-4aa7-8ad1-26a0a1eb6bad service nova] Lock "95b96d09-b9df-4e92-a141-f044078e4ce1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:16:47 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 req-563009a3-4d08-4aa7-8ad1-26a0a1eb6bad service nova] Lock "95b96d09-b9df-4e92-a141-f044078e4ce1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:16:47 user nova-compute[75245]: DEBUG nova.compute.manager [req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 req-563009a3-4d08-4aa7-8ad1-26a0a1eb6bad service nova] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Processing event volume-reimaged-f2d1dade-8389-4b92-bdd5-e4eeb4df7026 {{(pid=75245) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 29 16:16:47 user nova-compute[75245]: DEBUG nova.compute.manager [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Instance event wait completed in 22 seconds for volume-reimaged {{(pid=75245) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 16:16:47 user nova-compute[75245]: INFO nova.virt.block_device [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Booting with volume f2d1dade-8389-4b92-bdd5-e4eeb4df7026 at /dev/vda
Nov 29 16:16:47 user nova-compute[75245]: DEBUG os_brick.utils [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:16:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:47 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c1ea60-0684-4cac-8a2a-0060a39a60cb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:69ed8ed87091\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:47 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[6219cdc1-cd27-4572-9e2a-a88eecbe9f3b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:47 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d244d7-9277-4331-a10d-52c65b2b4a75]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:47 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[a51e51b7-b9ac-49d9-9734-80ba7a638a50]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Running cmd (subprocess): nvme version {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] 'nvme version' failed. Not Retrying. {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:16:47 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] nvme not present on system {{(pid=75245) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 16:16:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:16:47 user nova-compute[75245]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 16:16:47 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a56a44-ea45-4c79-877e-9b289cdbc4dd]: (4, '') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:47 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75245) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 16:16:47 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 16:16:47 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] LIGHTOS: no hostnqn found. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 16:16:47 user nova-compute[75245]: DEBUG os_brick.utils [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:69ed8ed87091', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:16:47 user nova-compute[75245]: DEBUG nova.virt.block_device [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Updating existing volume attachment record: 854c2e39-8b0c-44f4-9c7b-1e6d1fab2b08 {{(pid=75245) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 16:16:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:52 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Creating instance directory {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 16:16:55 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Creating image(s)
Nov 29 16:16:55 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Did not create local disks {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Ensure instance console log exists: /opt/stack/data/nova/instances/95b96d09-b9df-4e92-a141-f044078e4ce1/console.log {{(pid=75245) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Start _get_guest_xml network_info=[{"id": "35705f85-434c-481c-be8f-6182fda15267", "address": "fa:16:3e:64:70:89", "network": {"id": "3e4157dc-b9ba-40de-a00e-6f4c9a3c089b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-448760355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cd0053203ae489cb4bd097d7815b4e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35705f85-43", "ovs_interfaceid": "35705f85-434c-481c-be8f-6182fda15267", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '854c2e39-8b0c-44f4-9c7b-1e6d1fab2b08', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GHLbXqeE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '95b96d09-b9df-4e92-a141-f044078e4ce1', 'attached_at': '', 'detached_at': '', 'volume_id': 'f2d1dade-8389-4b92-bdd5-e4eeb4df7026', 'serial': 'f2d1dade-8389-4b92-bdd5-e4eeb4df7026'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'guest_format': None, 'volume_type': None} {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 16:16:55 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 29 16:16:55 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 29 16:16:55 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] CPU controller missing on host. {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] CPU controller found on host. {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75245) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T16:06:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Flavor limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Image limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Flavor pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Image pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Got 1 possible topologies {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG nova.objects.instance [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Lazy-loading 'vcpu_model' on Instance uuid 95b96d09-b9df-4e92-a141-f044078e4ce1 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Calling os-brick to attach iSCSI Volume {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GHLbXqeE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:16:55 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 29 16:16:55 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:16:55 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 29 16:16:55 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:16:55 user nova-compute[75245]: INFO os_brick.initiator.connectors.iscsi [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 16:16:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 -p 172.16.0.220:3260 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3410a26-e40b-4405-a07b-b386bb7fda51]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 16:16:55 user nova-compute[75245]:  {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 -p 172.16.0.220:3260 --interface default --op new {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75245) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc5e2bc3-57e4-4a71-9509-75c63eb93dc5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026] added\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026] added
Nov 29 16:16:55 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e8d785c-3c0e-4aac-946b-5d6d440b49aa]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[2049f0bf-0d94-4486-ac1e-59d352c09eb8]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GHLbXqeE {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GHLbXqeE" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[124af126-e7da-4ebb-94aa-cfc3f8aec886]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GHLbXqeE'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/816edb0e-c4fc-470b-8151-f98502e50789/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3e3077-7c5d-4d4f-81c2-a73f46cc88b2]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c3220a-bce8-4a9f-b296-7183145ace50]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f (non-flash)
Nov 29 16:16:55 user nova-compute[75245]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c (non-flash)
Nov 29 16:16:55 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f (non-flash)
Nov 29 16:16:55 user nova-compute[75245]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c (non-flash)
Nov 29 16:16:55 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 -p 172.16.0.220:3260 --login {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c8bee3-3f3a-459d-b946-b056b981756e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026, portal: 172.16.0.220,3260]
Nov 29 16:16:55 user nova-compute[75245]: Login to [iface: default, target: iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026, portal: 172.16.0.220,3260] successful.
Nov 29 16:16:55 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[b281ae29-1327-4eca-a1dd-d4100fef154b]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d911fc-7b99-4323-8b95-ea6f831cf047]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f (non-flash)
Nov 29 16:16:55 user nova-compute[75245]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c (non-flash)
Nov 29 16:16:55 user nova-compute[75245]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 (non-flash)
Nov 29 16:16:55 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f (non-flash)
Nov 29 16:16:55 user nova-compute[75245]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c (non-flash)
Nov 29 16:16:55 user nova-compute[75245]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 (non-flash)
Nov 29 16:16:55 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Connected to 172.16.0.220:3260 {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] HCTL ('33', '-', '-', 0) found on session 23 with lun 0 {{(pid=75245) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75245) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/816edb0e-c4fc-470b-8151-f98502e50789/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/816edb0e-c4fc-470b-8151-f98502e50789/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c05d84-8182-4df5-990f-4a7e5ee7d01c]: (4, ('- - 0', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Searching for a device in session 23 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75245) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 16:16:55 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GHLbXqeE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 16:16:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/816edb0e-c4fc-470b-8151-f98502e50789/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:16:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd819060-4388-444d-809e-94f6b2e8f102/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd819060-4388-444d-809e-94f6b2e8f102/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd819060-4388-444d-809e-94f6b2e8f102/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd819060-4388-444d-809e-94f6b2e8f102/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:16:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b99c5e50-a98b-45a2-b170-664c93109897/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:56 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b99c5e50-a98b-45a2-b170-664c93109897/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b99c5e50-a98b-45a2-b170-664c93109897/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b99c5e50-a98b-45a2-b170-664c93109897/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:56 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.382s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:16:56 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] <== connect_volume: return (1385ms) {'type': 'block', 'scsi_wwn': '26336616239643538', 'path': '/dev/sdb'} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:16:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26336616239643538', 'path': '/dev/sdb'} {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 16:16:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T16:14:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-909618067',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1148731204',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHlR5MzIPbCau2nJtv2utk0O1W1k0aEGcfbcv1sh7yMNFDLP7hs7yhHF8D8CRcgmIp1z1EERmv0wTgIEJhrbP+HwDUzTtl9AyFgANaK56wESe9DOxRAA657EmdA7oyz8OQ==',key_name='tempest-keypair-1816958253',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:14:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7cd0053203ae489cb4bd097d7815b4e5',ramdisk_id='',reservation_id='r-if6royoq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-2087197629',owner_user_name='tempest-ServerActionsV293TestJSON-2087197629-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:16:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6753af2ac6a40d98a2e2ecf8a56c73c',uuid=95b96d09-b9df-4e92-a141-f044078e4ce1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "35705f85-434c-481c-be8f-6182fda15267", "address": "fa:16:3e:64:70:89", "network": {"id": "3e4157dc-b9ba-40de-a00e-6f4c9a3c089b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-448760355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cd0053203ae489cb4bd097d7815b4e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35705f85-43", "ovs_interfaceid": "35705f85-434c-481c-be8f-6182fda15267", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:16:56 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Converting VIF {"id": "35705f85-434c-481c-be8f-6182fda15267", "address": "fa:16:3e:64:70:89", "network": {"id": "3e4157dc-b9ba-40de-a00e-6f4c9a3c089b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-448760355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cd0053203ae489cb4bd097d7815b4e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35705f85-43", "ovs_interfaceid": "35705f85-434c-481c-be8f-6182fda15267", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:16:56 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:64:70:89,bridge_name='br-int',has_traffic_filtering=True,id=35705f85-434c-481c-be8f-6182fda15267,network=Network(3e4157dc-b9ba-40de-a00e-6f4c9a3c089b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35705f85-43') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:16:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] End _get_guest_xml xml=<domain type="kvm">
Nov 29 16:16:56 user nova-compute[75245]:   <uuid>95b96d09-b9df-4e92-a141-f044078e4ce1</uuid>
Nov 29 16:16:56 user nova-compute[75245]:   <name>instance-00000010</name>
Nov 29 16:16:56 user nova-compute[75245]:   <memory>524288</memory>
Nov 29 16:16:56 user nova-compute[75245]:   <vcpu>1</vcpu>
Nov 29 16:16:56 user nova-compute[75245]:   <metadata>
Nov 29 16:16:56 user nova-compute[75245]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 16:16:56 user nova-compute[75245]:       <nova:package version="0.0.0"/>
Nov 29 16:16:56 user nova-compute[75245]:       <nova:name>tempest-ServerActionsV293TestJSON-server-909618067</nova:name>
Nov 29 16:16:56 user nova-compute[75245]:       <nova:creationTime>2023-11-29 16:16:55</nova:creationTime>
Nov 29 16:16:56 user nova-compute[75245]:       <nova:flavor name="m1.tiny">
Nov 29 16:16:56 user nova-compute[75245]:         <nova:memory>512</nova:memory>
Nov 29 16:16:56 user nova-compute[75245]:         <nova:disk>1</nova:disk>
Nov 29 16:16:56 user nova-compute[75245]:         <nova:swap>0</nova:swap>
Nov 29 16:16:56 user nova-compute[75245]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 16:16:56 user nova-compute[75245]:         <nova:vcpus>1</nova:vcpus>
Nov 29 16:16:56 user nova-compute[75245]:       </nova:flavor>
Nov 29 16:16:56 user nova-compute[75245]:       <nova:owner>
Nov 29 16:16:56 user nova-compute[75245]:         <nova:user uuid="f6753af2ac6a40d98a2e2ecf8a56c73c">tempest-ServerActionsV293TestJSON-2087197629-project-member</nova:user>
Nov 29 16:16:56 user nova-compute[75245]:         <nova:project uuid="7cd0053203ae489cb4bd097d7815b4e5">tempest-ServerActionsV293TestJSON-2087197629</nova:project>
Nov 29 16:16:56 user nova-compute[75245]:       </nova:owner>
Nov 29 16:16:56 user nova-compute[75245]:       <nova:ports>
Nov 29 16:16:56 user nova-compute[75245]:         <nova:port uuid="35705f85-434c-481c-be8f-6182fda15267">
Nov 29 16:16:56 user nova-compute[75245]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 29 16:16:56 user nova-compute[75245]:         </nova:port>
Nov 29 16:16:56 user nova-compute[75245]:       </nova:ports>
Nov 29 16:16:56 user nova-compute[75245]:     </nova:instance>
Nov 29 16:16:56 user nova-compute[75245]:   </metadata>
Nov 29 16:16:56 user nova-compute[75245]:   <sysinfo type="smbios">
Nov 29 16:16:56 user nova-compute[75245]:     <system>
Nov 29 16:16:56 user nova-compute[75245]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 16:16:56 user nova-compute[75245]:       <entry name="product">OpenStack Nova</entry>
Nov 29 16:16:56 user nova-compute[75245]:       <entry name="version">0.0.0</entry>
Nov 29 16:16:56 user nova-compute[75245]:       <entry name="serial">95b96d09-b9df-4e92-a141-f044078e4ce1</entry>
Nov 29 16:16:56 user nova-compute[75245]:       <entry name="uuid">95b96d09-b9df-4e92-a141-f044078e4ce1</entry>
Nov 29 16:16:56 user nova-compute[75245]:       <entry name="family">Virtual Machine</entry>
Nov 29 16:16:56 user nova-compute[75245]:     </system>
Nov 29 16:16:56 user nova-compute[75245]:   </sysinfo>
Nov 29 16:16:56 user nova-compute[75245]:   <os>
Nov 29 16:16:56 user nova-compute[75245]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 16:16:56 user nova-compute[75245]:     <boot dev="hd"/>
Nov 29 16:16:56 user nova-compute[75245]:     <smbios mode="sysinfo"/>
Nov 29 16:16:56 user nova-compute[75245]:   </os>
Nov 29 16:16:56 user nova-compute[75245]:   <features>
Nov 29 16:16:56 user nova-compute[75245]:     <acpi/>
Nov 29 16:16:56 user nova-compute[75245]:     <apic/>
Nov 29 16:16:56 user nova-compute[75245]:     <vmcoreinfo/>
Nov 29 16:16:56 user nova-compute[75245]:   </features>
Nov 29 16:16:56 user nova-compute[75245]:   <clock offset="utc">
Nov 29 16:16:56 user nova-compute[75245]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 16:16:56 user nova-compute[75245]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 16:16:56 user nova-compute[75245]:     <timer name="hpet" present="no"/>
Nov 29 16:16:56 user nova-compute[75245]:   </clock>
Nov 29 16:16:56 user nova-compute[75245]:   <cpu mode="custom" match="exact">
Nov 29 16:16:56 user nova-compute[75245]:     <model>Nehalem</model>
Nov 29 16:16:56 user nova-compute[75245]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 16:16:56 user nova-compute[75245]:   </cpu>
Nov 29 16:16:56 user nova-compute[75245]:   <devices>
Nov 29 16:16:56 user nova-compute[75245]:     <disk type="block" device="disk">
Nov 29 16:16:56 user nova-compute[75245]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:16:56 user nova-compute[75245]:       <source dev="/dev/sdb"/>
Nov 29 16:16:56 user nova-compute[75245]:       <target dev="vda" bus="virtio"/>
Nov 29 16:16:56 user nova-compute[75245]:       <serial>f2d1dade-8389-4b92-bdd5-e4eeb4df7026</serial>
Nov 29 16:16:56 user nova-compute[75245]:     </disk>
Nov 29 16:16:56 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 16:16:56 user nova-compute[75245]:       <mac address="fa:16:3e:64:70:89"/>
Nov 29 16:16:56 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:16:56 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 16:16:56 user nova-compute[75245]:       <target dev="tap35705f85-43"/>
Nov 29 16:16:56 user nova-compute[75245]:     </interface>
Nov 29 16:16:56 user nova-compute[75245]:     <serial type="pty">
Nov 29 16:16:56 user nova-compute[75245]:       <log file="/opt/stack/data/nova/instances/95b96d09-b9df-4e92-a141-f044078e4ce1/console.log" append="off"/>
Nov 29 16:16:56 user nova-compute[75245]:     </serial>
Nov 29 16:16:56 user nova-compute[75245]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 16:16:56 user nova-compute[75245]:     <video>
Nov 29 16:16:56 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:16:56 user nova-compute[75245]:     </video>
Nov 29 16:16:56 user nova-compute[75245]:     <rng model="virtio">
Nov 29 16:16:56 user nova-compute[75245]:       <backend model="random">/dev/urandom</backend>
Nov 29 16:16:56 user nova-compute[75245]:     </rng>
Nov 29 16:16:56 user nova-compute[75245]:     <controller type="usb" index="0" model="none"/>
Nov 29 16:16:56 user nova-compute[75245]:     <memballoon model="virtio">
Nov 29 16:16:56 user nova-compute[75245]:       <stats period="10"/>
Nov 29 16:16:56 user nova-compute[75245]:     </memballoon>
Nov 29 16:16:56 user nova-compute[75245]:   </devices>
Nov 29 16:16:56 user nova-compute[75245]: </domain>
Nov 29 16:16:56 user nova-compute[75245]:  {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 16:16:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T16:14:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-909618067',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1148731204',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHlR5MzIPbCau2nJtv2utk0O1W1k0aEGcfbcv1sh7yMNFDLP7hs7yhHF8D8CRcgmIp1z1EERmv0wTgIEJhrbP+HwDUzTtl9AyFgANaK56wESe9DOxRAA657EmdA7oyz8OQ==',key_name='tempest-keypair-1816958253',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:14:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7cd0053203ae489cb4bd097d7815b4e5',ramdisk_id='',reservation_id='r-if6royoq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-2087197629',owner_user_name='tempest-ServerActionsV293TestJSON-2087197629-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:16:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6753af2ac6a40d98a2e2ecf8a56c73c',uuid=95b96d09-b9df-4e92-a141-f044078e4ce1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "35705f85-434c-481c-be8f-6182fda15267", "address": "fa:16:3e:64:70:89", "network": {"id": "3e4157dc-b9ba-40de-a00e-6f4c9a3c089b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-448760355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cd0053203ae489cb4bd097d7815b4e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35705f85-43", "ovs_interfaceid": "35705f85-434c-481c-be8f-6182fda15267", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 16:16:56 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Converting VIF {"id": "35705f85-434c-481c-be8f-6182fda15267", "address": "fa:16:3e:64:70:89", "network": {"id": "3e4157dc-b9ba-40de-a00e-6f4c9a3c089b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-448760355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cd0053203ae489cb4bd097d7815b4e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35705f85-43", "ovs_interfaceid": "35705f85-434c-481c-be8f-6182fda15267", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:16:56 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:64:70:89,bridge_name='br-int',has_traffic_filtering=True,id=35705f85-434c-481c-be8f-6182fda15267,network=Network(3e4157dc-b9ba-40de-a00e-6f4c9a3c089b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35705f85-43') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:16:56 user nova-compute[75245]: DEBUG os_vif [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:70:89,bridge_name='br-int',has_traffic_filtering=True,id=35705f85-434c-481c-be8f-6182fda15267,network=Network(3e4157dc-b9ba-40de-a00e-6f4c9a3c089b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35705f85-43') {{(pid=75245) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 16:16:56 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:56 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:16:56 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 16:16:56 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:56 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f7e53155-031f-569b-a5ca-dd59e7d4c268', '_type': 'linux-noop'}}, row=False) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:16:56 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:56 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:16:56 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:56 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap35705f85-43, may_exist=True, interface_attrs={}) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:16:56 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap35705f85-43, col_values=(('qos', UUID('b8287d0b-be48-46a1-919a-8a391b314377')),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:16:56 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap35705f85-43, col_values=(('external_ids', {'iface-id': '35705f85-434c-481c-be8f-6182fda15267', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:70:89', 'vm-uuid': '95b96d09-b9df-4e92-a141-f044078e4ce1'}),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:16:56 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:56 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:16:56 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:56 user nova-compute[75245]: INFO os_vif [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:70:89,bridge_name='br-int',has_traffic_filtering=True,id=35705f85-434c-481c-be8f-6182fda15267,network=Network(3e4157dc-b9ba-40de-a00e-6f4c9a3c089b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35705f85-43')
Nov 29 16:16:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:57 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:16:57 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] No VIF found with MAC fa:16:3e:64:70:89, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:16:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:16:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:16:58 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:16:58 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:16:58 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Hypervisor/Node resource view: name=user free_ram=8189MB free_disk=25.479717254638672GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75245) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 16:16:58 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:16:58 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:16:58 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:16:58 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance ed9a6a4e-2e7d-443c-82ef-f14f11d32c81 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:16:58 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance fd819060-4388-444d-809e-94f6b2e8f102 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:16:58 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 816edb0e-c4fc-470b-8151-f98502e50789 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:16:58 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 95b96d09-b9df-4e92-a141-f044078e4ce1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:16:58 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance b99c5e50-a98b-45a2-b170-664c93109897 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:16:58 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 16:16:58 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 16:16:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:58 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:16:58 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:16:58 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Compute_service record updated for user:user {{(pid=75245) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 16:16:58 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.401s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:16:58 user nova-compute[75245]: DEBUG nova.compute.manager [req-1f866a77-db59-4767-847b-aab9bf66ec13 req-dabbb514-7db2-49c9-92bb-45a5cf1523f8 service nova] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Received event network-vif-plugged-35705f85-434c-481c-be8f-6182fda15267 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:16:58 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-1f866a77-db59-4767-847b-aab9bf66ec13 req-dabbb514-7db2-49c9-92bb-45a5cf1523f8 service nova] Acquiring lock "95b96d09-b9df-4e92-a141-f044078e4ce1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:16:58 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-1f866a77-db59-4767-847b-aab9bf66ec13 req-dabbb514-7db2-49c9-92bb-45a5cf1523f8 service nova] Lock "95b96d09-b9df-4e92-a141-f044078e4ce1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:16:58 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-1f866a77-db59-4767-847b-aab9bf66ec13 req-dabbb514-7db2-49c9-92bb-45a5cf1523f8 service nova] Lock "95b96d09-b9df-4e92-a141-f044078e4ce1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:16:58 user nova-compute[75245]: DEBUG nova.compute.manager [req-1f866a77-db59-4767-847b-aab9bf66ec13 req-dabbb514-7db2-49c9-92bb-45a5cf1523f8 service nova] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] No waiting events found dispatching network-vif-plugged-35705f85-434c-481c-be8f-6182fda15267 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:16:58 user nova-compute[75245]: WARNING nova.compute.manager [req-1f866a77-db59-4767-847b-aab9bf66ec13 req-dabbb514-7db2-49c9-92bb-45a5cf1523f8 service nova] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Received unexpected event network-vif-plugged-35705f85-434c-481c-be8f-6182fda15267 for instance with vm_state active and task_state rebuild_spawning.
Nov 29 16:16:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:16:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:00 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:17:00 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Starting heal instance info cache {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 16:17:00 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "refresh_cache-ed9a6a4e-2e7d-443c-82ef-f14f11d32c81" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:17:00 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquired lock "refresh_cache-ed9a6a4e-2e7d-443c-82ef-f14f11d32c81" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:17:00 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] Forcefully refreshing network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 16:17:00 user nova-compute[75245]: DEBUG nova.compute.manager [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Instance event wait completed in 0 seconds for  {{(pid=75245) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 16:17:00 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Guest created on hypervisor {{(pid=75245) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 16:17:00 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Instance spawned successfully.
Nov 29 16:17:00 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 16:17:00 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Found default for hw_cdrom_bus of ide {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:17:00 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Found default for hw_disk_bus of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:17:00 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Found default for hw_input_bus of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:17:00 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Found default for hw_pointer_model of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:17:00 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Found default for hw_video_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:17:00 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Found default for hw_vif_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:17:00 user nova-compute[75245]: DEBUG nova.compute.manager [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:17:00 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:17:00 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:17:00 user nova-compute[75245]: DEBUG nova.objects.instance [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75245) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 29 16:17:00 user nova-compute[75245]: DEBUG nova.compute.manager [req-b5eed742-42e4-4383-9b97-998079180d7e req-d796d901-b2a7-49db-86e9-728632dc347f service nova] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Received event network-vif-plugged-35705f85-434c-481c-be8f-6182fda15267 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:17:00 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b5eed742-42e4-4383-9b97-998079180d7e req-d796d901-b2a7-49db-86e9-728632dc347f service nova] Acquiring lock "95b96d09-b9df-4e92-a141-f044078e4ce1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:17:00 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b5eed742-42e4-4383-9b97-998079180d7e req-d796d901-b2a7-49db-86e9-728632dc347f service nova] Lock "95b96d09-b9df-4e92-a141-f044078e4ce1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:17:00 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b5eed742-42e4-4383-9b97-998079180d7e req-d796d901-b2a7-49db-86e9-728632dc347f service nova] Lock "95b96d09-b9df-4e92-a141-f044078e4ce1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:17:00 user nova-compute[75245]: DEBUG nova.compute.manager [req-b5eed742-42e4-4383-9b97-998079180d7e req-d796d901-b2a7-49db-86e9-728632dc347f service nova] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] No waiting events found dispatching network-vif-plugged-35705f85-434c-481c-be8f-6182fda15267 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:17:00 user nova-compute[75245]: WARNING nova.compute.manager [req-b5eed742-42e4-4383-9b97-998079180d7e req-d796d901-b2a7-49db-86e9-728632dc347f service nova] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Received unexpected event network-vif-plugged-35705f85-434c-481c-be8f-6182fda15267 for instance with vm_state active and task_state None.
Nov 29 16:17:00 user nova-compute[75245]: DEBUG nova.compute.manager [req-b5eed742-42e4-4383-9b97-998079180d7e req-d796d901-b2a7-49db-86e9-728632dc347f service nova] [instance: b99c5e50-a98b-45a2-b170-664c93109897] Received event network-changed-e9647e37-1ab6-40fb-8874-a626692dd676 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:17:00 user nova-compute[75245]: DEBUG nova.compute.manager [req-b5eed742-42e4-4383-9b97-998079180d7e req-d796d901-b2a7-49db-86e9-728632dc347f service nova] [instance: b99c5e50-a98b-45a2-b170-664c93109897] Refreshing instance network info cache due to event network-changed-e9647e37-1ab6-40fb-8874-a626692dd676. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:17:00 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b5eed742-42e4-4383-9b97-998079180d7e req-d796d901-b2a7-49db-86e9-728632dc347f service nova] Acquiring lock "refresh_cache-b99c5e50-a98b-45a2-b170-664c93109897" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:17:00 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b5eed742-42e4-4383-9b97-998079180d7e req-d796d901-b2a7-49db-86e9-728632dc347f service nova] Acquired lock "refresh_cache-b99c5e50-a98b-45a2-b170-664c93109897" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:17:00 user nova-compute[75245]: DEBUG nova.network.neutron [req-b5eed742-42e4-4383-9b97-998079180d7e req-d796d901-b2a7-49db-86e9-728632dc347f service nova] [instance: b99c5e50-a98b-45a2-b170-664c93109897] Refreshing network info cache for port e9647e37-1ab6-40fb-8874-a626692dd676 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:17:00 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] Updating instance_info_cache with network_info: [{"id": "c72edead-bad2-45c4-9ac8-90dd2a4f8ed5", "address": "fa:16:3e:bb:74:67", "network": {"id": "f1fac2f4-e789-443e-b6a5-1a3f829bc302", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1199431077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6b87e18ef1f48d19a6907b28cb54f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc72edead-ba", "ovs_interfaceid": "c72edead-bad2-45c4-9ac8-90dd2a4f8ed5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:17:00 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2834db4f-86f9-4ba4-8103-0f62910ed1e8 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.131s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:17:00 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Releasing lock "refresh_cache-ed9a6a4e-2e7d-443c-82ef-f14f11d32c81" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:17:00 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] Updated the network info_cache for instance {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 16:17:00 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:17:00 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:17:01 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:17:01 user nova-compute[75245]: DEBUG nova.network.neutron [req-b5eed742-42e4-4383-9b97-998079180d7e req-d796d901-b2a7-49db-86e9-728632dc347f service nova] [instance: b99c5e50-a98b-45a2-b170-664c93109897] Updated VIF entry in instance network info cache for port e9647e37-1ab6-40fb-8874-a626692dd676. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:17:01 user nova-compute[75245]: DEBUG nova.network.neutron [req-b5eed742-42e4-4383-9b97-998079180d7e req-d796d901-b2a7-49db-86e9-728632dc347f service nova] [instance: b99c5e50-a98b-45a2-b170-664c93109897] Updating instance_info_cache with network_info: [{"id": "e9647e37-1ab6-40fb-8874-a626692dd676", "address": "fa:16:3e:12:85:81", "network": {"id": "161e15da-e083-48c0-82ad-b2326e4dc33b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1831426097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c94b9aa8ead849878a724d3e77c2cf83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9647e37-1a", "ovs_interfaceid": "e9647e37-1ab6-40fb-8874-a626692dd676", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:17:01 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b5eed742-42e4-4383-9b97-998079180d7e req-d796d901-b2a7-49db-86e9-728632dc347f service nova] Releasing lock "refresh_cache-b99c5e50-a98b-45a2-b170-664c93109897" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:17:01 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:17:01 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75245) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 16:17:01 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:02 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:17:02 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-41373ce0-acf2-4a93-9186-0b90eb64fd5a tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Acquiring lock "b99c5e50-a98b-45a2-b170-664c93109897" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:17:02 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-41373ce0-acf2-4a93-9186-0b90eb64fd5a tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Lock "b99c5e50-a98b-45a2-b170-664c93109897" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:17:02 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:02 user nova-compute[75245]: DEBUG nova.objects.instance [None req-41373ce0-acf2-4a93-9186-0b90eb64fd5a tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Lazy-loading 'flavor' on Instance uuid b99c5e50-a98b-45a2-b170-664c93109897 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:17:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-41373ce0-acf2-4a93-9186-0b90eb64fd5a tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Lock "b99c5e50-a98b-45a2-b170-664c93109897" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:17:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-41373ce0-acf2-4a93-9186-0b90eb64fd5a tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Acquiring lock "b99c5e50-a98b-45a2-b170-664c93109897" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:17:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-41373ce0-acf2-4a93-9186-0b90eb64fd5a tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Lock "b99c5e50-a98b-45a2-b170-664c93109897" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:17:03 user nova-compute[75245]: INFO nova.compute.manager [None req-41373ce0-acf2-4a93-9186-0b90eb64fd5a tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] [instance: b99c5e50-a98b-45a2-b170-664c93109897] Attaching volume c8050167-ab4a-4f4b-b8ae-94daeafdedbf to /dev/sdc
Nov 29 16:17:03 user nova-compute[75245]: DEBUG os_brick.utils [None req-41373ce0-acf2-4a93-9186-0b90eb64fd5a tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:17:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:17:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:17:03 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[c09e97ae-1f53-4dd3-84d2-0fc144f4889e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:69ed8ed87091\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:17:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:17:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:17:03 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b69d90-2994-44c5-b6f3-26af032fa51d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:17:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:17:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:17:03 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca37cbd-7e82-4e6a-9c48-3bfc3663b522]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:17:03 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[1994e8b5-156e-414c-ba62-8b3e1bb8bfe0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:17:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-41373ce0-acf2-4a93-9186-0b90eb64fd5a tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Running cmd (subprocess): nvme version {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:17:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-41373ce0-acf2-4a93-9186-0b90eb64fd5a tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] 'nvme version' failed. Not Retrying. {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:17:03 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.nvmeof [None req-41373ce0-acf2-4a93-9186-0b90eb64fd5a tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] nvme not present on system {{(pid=75245) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 16:17:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:17:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:17:03 user nova-compute[75245]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 16:17:03 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[3826aad9-e78a-402a-8ae9-a3b7b43d3132]: (4, '') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:17:03 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-41373ce0-acf2-4a93-9186-0b90eb64fd5a tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75245) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 16:17:03 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-41373ce0-acf2-4a93-9186-0b90eb64fd5a tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 16:17:03 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-41373ce0-acf2-4a93-9186-0b90eb64fd5a tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] LIGHTOS: no hostnqn found. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 16:17:03 user nova-compute[75245]: DEBUG os_brick.utils [None req-41373ce0-acf2-4a93-9186-0b90eb64fd5a tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:69ed8ed87091', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:17:03 user nova-compute[75245]: DEBUG nova.virt.block_device [None req-41373ce0-acf2-4a93-9186-0b90eb64fd5a tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] [instance: b99c5e50-a98b-45a2-b170-664c93109897] Updating existing volume attachment record: 08f3f1a9-3267-4bde-ab35-886003ee31f1 {{(pid=75245) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 16:17:03 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:06 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:07 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:07 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:11 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41373ce0-acf2-4a93-9186-0b90eb64fd5a tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] [instance: b99c5e50-a98b-45a2-b170-664c93109897] Calling os-brick to attach iSCSI Volume {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 16:17:11 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-41373ce0-acf2-4a93-9186-0b90eb64fd5a tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c8050167-ab4a-4f4b-b8ae-94daeafdedbf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nqidYsjl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:17:11 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-41373ce0-acf2-4a93-9186-0b90eb64fd5a tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:17:11 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-41373ce0-acf2-4a93-9186-0b90eb64fd5a tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:17:11 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-41373ce0-acf2-4a93-9186-0b90eb64fd5a tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:17:11 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-41373ce0-acf2-4a93-9186-0b90eb64fd5a tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:17:11 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-41373ce0-acf2-4a93-9186-0b90eb64fd5a tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8050167-ab4a-4f4b-b8ae-94daeafdedbf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:17:11 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-41373ce0-acf2-4a93-9186-0b90eb64fd5a tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8050167-ab4a-4f4b-b8ae-94daeafdedbf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:17:11 user nova-compute[75245]: INFO os_brick.initiator.connectors.iscsi [None req-41373ce0-acf2-4a93-9186-0b90eb64fd5a tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 16:17:11 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8050167-ab4a-4f4b-b8ae-94daeafdedbf -p 172.16.0.220:3260 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:17:11 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8050167-ab4a-4f4b-b8ae-94daeafdedbf -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:17:11 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b0fb043-f833-4cd6-91d9-453368614a35]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:17:11 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-41373ce0-acf2-4a93-9186-0b90eb64fd5a tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 16:17:11 user nova-compute[75245]:  {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:17:11 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8050167-ab4a-4f4b-b8ae-94daeafdedbf -p 172.16.0.220:3260 --interface default --op new {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:17:11 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8050167-ab4a-4f4b-b8ae-94daeafdedbf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:17:11 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9373fa7-e796-4f76-855a-5ac23c1737b6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c8050167-ab4a-4f4b-b8ae-94daeafdedbf] added\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:17:11 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-41373ce0-acf2-4a93-9186-0b90eb64fd5a tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c8050167-ab4a-4f4b-b8ae-94daeafdedbf] added
Nov 29 16:17:11 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:17:11 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8050167-ab4a-4f4b-b8ae-94daeafdedbf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:17:11 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8050167-ab4a-4f4b-b8ae-94daeafdedbf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:17:11 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ccde27c-cacf-4f7a-8ad4-69c3f88d16c4]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:17:11 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-41373ce0-acf2-4a93-9186-0b90eb64fd5a tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:17:11 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8050167-ab4a-4f4b-b8ae-94daeafdedbf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:17:11 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8050167-ab4a-4f4b-b8ae-94daeafdedbf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:17:11 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[8619dee6-fcbc-46ec-afdd-2560d9b81eb5]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:17:11 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-41373ce0-acf2-4a93-9186-0b90eb64fd5a tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:17:11 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8050167-ab4a-4f4b-b8ae-94daeafdedbf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nqidYsjl {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:17:11 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8050167-ab4a-4f4b-b8ae-94daeafdedbf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nqidYsjl" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:17:11 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d5cdec-3a42-4f9a-8422-dbf47fdfc305]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:17:11 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-41373ce0-acf2-4a93-9186-0b90eb64fd5a tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nqidYsjl'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:17:11 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8050167-ab4a-4f4b-b8ae-94daeafdedbf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:17:11 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8050167-ab4a-4f4b-b8ae-94daeafdedbf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:17:11 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a41d2ee-8de8-42e1-83ea-777aeb05fdc9]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:17:11 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-41373ce0-acf2-4a93-9186-0b90eb64fd5a tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:17:11 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:17:11 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:17:11 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05eaf5f-eefd-44dc-835b-b7004c2cf868]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:17:11 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-41373ce0-acf2-4a93-9186-0b90eb64fd5a tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f (non-flash)
Nov 29 16:17:11 user nova-compute[75245]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c (non-flash)
Nov 29 16:17:11 user nova-compute[75245]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 (non-flash)
Nov 29 16:17:11 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:17:11 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-41373ce0-acf2-4a93-9186-0b90eb64fd5a tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f (non-flash)
Nov 29 16:17:11 user nova-compute[75245]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c (non-flash)
Nov 29 16:17:11 user nova-compute[75245]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 (non-flash)
Nov 29 16:17:11 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:17:11 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8050167-ab4a-4f4b-b8ae-94daeafdedbf -p 172.16.0.220:3260 --login {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:17:11 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8050167-ab4a-4f4b-b8ae-94daeafdedbf -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:17:11 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d229261-3abe-4523-8283-e317b737e323]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c8050167-ab4a-4f4b-b8ae-94daeafdedbf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c8050167-ab4a-4f4b-b8ae-94daeafdedbf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:17:11 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-41373ce0-acf2-4a93-9186-0b90eb64fd5a tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c8050167-ab4a-4f4b-b8ae-94daeafdedbf, portal: 172.16.0.220,3260]
Nov 29 16:17:11 user nova-compute[75245]: Login to [iface: default, target: iqn.2010-10.org.openstack:c8050167-ab4a-4f4b-b8ae-94daeafdedbf, portal: 172.16.0.220,3260] successful.
Nov 29 16:17:11 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:17:11 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8050167-ab4a-4f4b-b8ae-94daeafdedbf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:17:11 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8050167-ab4a-4f4b-b8ae-94daeafdedbf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:17:11 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5bfd8f-3223-447f-ad28-435168cf9318]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:17:11 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-41373ce0-acf2-4a93-9186-0b90eb64fd5a tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:17:11 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:17:11 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:17:11 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[b916f768-904d-42db-b5af-1fef9048d2d5]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8050167-ab4a-4f4b-b8ae-94daeafdedbf (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:17:11 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-41373ce0-acf2-4a93-9186-0b90eb64fd5a tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f (non-flash)
Nov 29 16:17:11 user nova-compute[75245]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c (non-flash)
Nov 29 16:17:11 user nova-compute[75245]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 (non-flash)
Nov 29 16:17:11 user nova-compute[75245]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8050167-ab4a-4f4b-b8ae-94daeafdedbf (non-flash)
Nov 29 16:17:11 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:17:11 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-41373ce0-acf2-4a93-9186-0b90eb64fd5a tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f (non-flash)
Nov 29 16:17:11 user nova-compute[75245]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c (non-flash)
Nov 29 16:17:11 user nova-compute[75245]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 (non-flash)
Nov 29 16:17:11 user nova-compute[75245]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8050167-ab4a-4f4b-b8ae-94daeafdedbf (non-flash)
Nov 29 16:17:11 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:17:11 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-41373ce0-acf2-4a93-9186-0b90eb64fd5a tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8050167-ab4a-4f4b-b8ae-94daeafdedbf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:17:11 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-41373ce0-acf2-4a93-9186-0b90eb64fd5a tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Connected to 172.16.0.220:3260 {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 16:17:11 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-41373ce0-acf2-4a93-9186-0b90eb64fd5a tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] HCTL ('35', '-', '-', 0) found on session 24 with lun 0 {{(pid=75245) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 16:17:11 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-41373ce0-acf2-4a93-9186-0b90eb64fd5a tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75245) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 16:17:11 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:17:11 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:17:11 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c1b922-b2e8-4f47-85cc-a2d5b2915019]: (4, ('- - 0', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:17:11 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-41373ce0-acf2-4a93-9186-0b90eb64fd5a tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Searching for a device in session 24 and hctl ['35', '*', '*', 0] yield: None {{(pid=75245) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 16:17:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:12 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-41373ce0-acf2-4a93-9186-0b90eb64fd5a tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Searching for a device in session 24 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75245) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 16:17:12 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-41373ce0-acf2-4a93-9186-0b90eb64fd5a tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:c8050167-ab4a-4f4b-b8ae-94daeafdedbf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nqidYsjl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 16:17:12 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-41373ce0-acf2-4a93-9186-0b90eb64fd5a tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:17:12 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-41373ce0-acf2-4a93-9186-0b90eb64fd5a tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] <== connect_volume: return (1351ms) {'type': 'block', 'scsi_wwn': '26337386662353234', 'path': '/dev/sdd'} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:17:12 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41373ce0-acf2-4a93-9186-0b90eb64fd5a tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] [instance: b99c5e50-a98b-45a2-b170-664c93109897] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26337386662353234', 'path': '/dev/sdd'} {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 16:17:12 user nova-compute[75245]: DEBUG nova.objects.instance [None req-41373ce0-acf2-4a93-9186-0b90eb64fd5a tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Lazy-loading 'flavor' on Instance uuid b99c5e50-a98b-45a2-b170-664c93109897 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:17:12 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-41373ce0-acf2-4a93-9186-0b90eb64fd5a tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 16:17:12 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:17:12 user nova-compute[75245]:   <source dev="/dev/sdd"/>
Nov 29 16:17:12 user nova-compute[75245]:   <target dev="sdc" bus="scsi"/>
Nov 29 16:17:12 user nova-compute[75245]:   <serial>c8050167-ab4a-4f4b-b8ae-94daeafdedbf</serial>
Nov 29 16:17:12 user nova-compute[75245]:   <address type="drive" controller="0" unit="2"/>
Nov 29 16:17:12 user nova-compute[75245]: </disk>
Nov 29 16:17:12 user nova-compute[75245]:  {{(pid=75245) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 16:17:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-41373ce0-acf2-4a93-9186-0b90eb64fd5a tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] No BDM found with device name sda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:17:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-41373ce0-acf2-4a93-9186-0b90eb64fd5a tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:17:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-41373ce0-acf2-4a93-9186-0b90eb64fd5a tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:17:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-41373ce0-acf2-4a93-9186-0b90eb64fd5a tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] No VIF found with MAC fa:16:3e:12:85:81, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:17:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-41373ce0-acf2-4a93-9186-0b90eb64fd5a tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Lock "b99c5e50-a98b-45a2-b170-664c93109897" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.265s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:17:14 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-9537776a-8063-4593-8022-ccb9838131d7 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Acquiring lock "b99c5e50-a98b-45a2-b170-664c93109897" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:17:14 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-9537776a-8063-4593-8022-ccb9838131d7 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Lock "b99c5e50-a98b-45a2-b170-664c93109897" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:17:14 user nova-compute[75245]: INFO nova.compute.manager [None req-9537776a-8063-4593-8022-ccb9838131d7 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] [instance: b99c5e50-a98b-45a2-b170-664c93109897] Detaching volume c8050167-ab4a-4f4b-b8ae-94daeafdedbf
Nov 29 16:17:14 user nova-compute[75245]: INFO nova.virt.block_device [None req-9537776a-8063-4593-8022-ccb9838131d7 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] [instance: b99c5e50-a98b-45a2-b170-664c93109897] Attempting to driver detach volume c8050167-ab4a-4f4b-b8ae-94daeafdedbf from mountpoint /dev/sdc
Nov 29 16:17:14 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-9537776a-8063-4593-8022-ccb9838131d7 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Attempting to detach device sdc from instance b99c5e50-a98b-45a2-b170-664c93109897 from the persistent domain config. {{(pid=75245) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 16:17:14 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-9537776a-8063-4593-8022-ccb9838131d7 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 16:17:14 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:17:14 user nova-compute[75245]:   <source dev="/dev/sdd"/>
Nov 29 16:17:14 user nova-compute[75245]:   <target dev="sdc" bus="scsi"/>
Nov 29 16:17:14 user nova-compute[75245]:   <serial>c8050167-ab4a-4f4b-b8ae-94daeafdedbf</serial>
Nov 29 16:17:14 user nova-compute[75245]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 29 16:17:14 user nova-compute[75245]: </disk>
Nov 29 16:17:14 user nova-compute[75245]:  {{(pid=75245) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 16:17:14 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-9537776a-8063-4593-8022-ccb9838131d7 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Successfully detached device sdc from instance b99c5e50-a98b-45a2-b170-664c93109897 from the persistent domain config.
Nov 29 16:17:14 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-9537776a-8063-4593-8022-ccb9838131d7 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance b99c5e50-a98b-45a2-b170-664c93109897 from the live domain config. {{(pid=75245) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 16:17:14 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-9537776a-8063-4593-8022-ccb9838131d7 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 16:17:14 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:17:14 user nova-compute[75245]:   <source dev="/dev/sdd"/>
Nov 29 16:17:14 user nova-compute[75245]:   <target dev="sdc" bus="scsi"/>
Nov 29 16:17:14 user nova-compute[75245]:   <serial>c8050167-ab4a-4f4b-b8ae-94daeafdedbf</serial>
Nov 29 16:17:14 user nova-compute[75245]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 29 16:17:14 user nova-compute[75245]: </disk>
Nov 29 16:17:14 user nova-compute[75245]:  {{(pid=75245) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 16:17:15 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-9537776a-8063-4593-8022-ccb9838131d7 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance b99c5e50-a98b-45a2-b170-664c93109897 {{(pid=75245) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 16:17:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:16 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:17 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:19 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:21 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:21 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:26 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:27 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:28 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Acquiring lock "f6720dc3-07fc-43e1-ba91-75e3d26a4a0f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:17:28 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Lock "f6720dc3-07fc-43e1-ba91-75e3d26a4a0f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:17:28 user nova-compute[75245]: DEBUG nova.compute.manager [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Starting instance... {{(pid=75245) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 16:17:29 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:17:29 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:17:29 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75245) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 16:17:29 user nova-compute[75245]: INFO nova.compute.claims [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Claim successful on node user
Nov 29 16:17:29 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:17:29 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:17:29 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.397s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:17:29 user nova-compute[75245]: DEBUG nova.compute.manager [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Start building networks asynchronously for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 16:17:29 user nova-compute[75245]: DEBUG nova.compute.manager [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Allocating IP information in the background. {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 16:17:29 user nova-compute[75245]: DEBUG nova.network.neutron [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] allocate_for_instance() {{(pid=75245) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 16:17:29 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 16:17:29 user nova-compute[75245]: DEBUG nova.compute.manager [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Start building block device mappings for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 16:17:29 user nova-compute[75245]: DEBUG nova.policy [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e746210be7104346bd8ed895b3f22cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77edb4b0a0024ef1a88cb67c11d51911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75245) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 16:17:29 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Acquiring lock "43ead766-eeb0-4c7a-a03a-6d4daf7106af" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:17:29 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lock "43ead766-eeb0-4c7a-a03a-6d4daf7106af" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:17:29 user nova-compute[75245]: DEBUG nova.compute.manager [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Starting instance... {{(pid=75245) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 16:17:29 user nova-compute[75245]: DEBUG nova.compute.manager [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Start spawning the instance on the hypervisor. {{(pid=75245) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 16:17:29 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Creating instance directory {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 16:17:29 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Creating image(s)
Nov 29 16:17:29 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Acquiring lock "/opt/stack/data/nova/instances/f6720dc3-07fc-43e1-ba91-75e3d26a4a0f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:17:29 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Lock "/opt/stack/data/nova/instances/f6720dc3-07fc-43e1-ba91-75e3d26a4a0f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:17:29 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Lock "/opt/stack/data/nova/instances/f6720dc3-07fc-43e1-ba91-75e3d26a4a0f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:17:29 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:17:29 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:17:29 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:17:29 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75245) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 16:17:29 user nova-compute[75245]: INFO nova.compute.claims [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Claim successful on node user
Nov 29 16:17:29 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.191s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:17:29 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Acquiring lock "d654f7206043e05d3525550b0fc885556eb999f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:17:29 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:17:29 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:17:30 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.188s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:17:30 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/f6720dc3-07fc-43e1-ba91-75e3d26a4a0f/disk 1073741824 {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:17:30 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/f6720dc3-07fc-43e1-ba91-75e3d26a4a0f/disk 1073741824" returned: 0 in 0.057s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:17:30 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:17:30 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:17:30 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:17:30 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:17:30 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.478s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:17:30 user nova-compute[75245]: DEBUG nova.compute.manager [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Start building networks asynchronously for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 16:17:30 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.194s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:17:30 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f6720dc3-07fc-43e1-ba91-75e3d26a4a0f/disk. size=1073741824 {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 16:17:30 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6720dc3-07fc-43e1-ba91-75e3d26a4a0f/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:17:30 user nova-compute[75245]: DEBUG nova.network.neutron [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Successfully created port: 80f91f45-781d-452c-b2c0-de2584494644 {{(pid=75245) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 16:17:30 user nova-compute[75245]: DEBUG nova.compute.manager [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Allocating IP information in the background. {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 16:17:30 user nova-compute[75245]: DEBUG nova.network.neutron [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] allocate_for_instance() {{(pid=75245) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 16:17:30 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6720dc3-07fc-43e1-ba91-75e3d26a4a0f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:17:30 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Cannot resize image /opt/stack/data/nova/instances/f6720dc3-07fc-43e1-ba91-75e3d26a4a0f/disk to a smaller size. {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 16:17:30 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Created local disks {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 16:17:30 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Ensure instance console log exists: /opt/stack/data/nova/instances/f6720dc3-07fc-43e1-ba91-75e3d26a4a0f/console.log {{(pid=75245) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 16:17:30 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:17:30 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:17:30 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:17:30 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 16:17:30 user nova-compute[75245]: DEBUG nova.compute.manager [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Start building block device mappings for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 16:17:30 user nova-compute[75245]: DEBUG nova.compute.manager [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Start spawning the instance on the hypervisor. {{(pid=75245) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 16:17:30 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Creating instance directory {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 16:17:30 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Creating image(s)
Nov 29 16:17:30 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Acquiring lock "/opt/stack/data/nova/instances/43ead766-eeb0-4c7a-a03a-6d4daf7106af/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:17:30 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lock "/opt/stack/data/nova/instances/43ead766-eeb0-4c7a-a03a-6d4daf7106af/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:17:30 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lock "/opt/stack/data/nova/instances/43ead766-eeb0-4c7a-a03a-6d4daf7106af/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:17:30 user nova-compute[75245]: DEBUG nova.policy [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7c4942f948584702a8c8b93248694a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd22948fbd074a7c94d8ad7614fbc220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75245) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 16:17:30 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:17:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.406s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:17:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Acquiring lock "d654f7206043e05d3525550b0fc885556eb999f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:17:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:17:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:17:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.197s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:17:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/43ead766-eeb0-4c7a-a03a-6d4daf7106af/disk 1073741824 {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:17:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/43ead766-eeb0-4c7a-a03a-6d4daf7106af/disk 1073741824" returned: 0 in 0.053s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:17:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:17:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:17:31 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.204s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:17:31 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Checking if we can resize image /opt/stack/data/nova/instances/43ead766-eeb0-4c7a-a03a-6d4daf7106af/disk. size=1073741824 {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 16:17:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43ead766-eeb0-4c7a-a03a-6d4daf7106af/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:17:31 user nova-compute[75245]: DEBUG nova.network.neutron [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Successfully updated port: 80f91f45-781d-452c-b2c0-de2584494644 {{(pid=75245) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 16:17:31 user nova-compute[75245]: DEBUG nova.compute.manager [req-e6ea62ae-86d6-46d4-8cc7-48cd3d228d8c req-b48d173b-e802-4412-b29d-c889277f0124 service nova] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Received event network-changed-80f91f45-781d-452c-b2c0-de2584494644 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:17:31 user nova-compute[75245]: DEBUG nova.compute.manager [req-e6ea62ae-86d6-46d4-8cc7-48cd3d228d8c req-b48d173b-e802-4412-b29d-c889277f0124 service nova] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Refreshing instance network info cache due to event network-changed-80f91f45-781d-452c-b2c0-de2584494644. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:17:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-e6ea62ae-86d6-46d4-8cc7-48cd3d228d8c req-b48d173b-e802-4412-b29d-c889277f0124 service nova] Acquiring lock "refresh_cache-f6720dc3-07fc-43e1-ba91-75e3d26a4a0f" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:17:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-e6ea62ae-86d6-46d4-8cc7-48cd3d228d8c req-b48d173b-e802-4412-b29d-c889277f0124 service nova] Acquired lock "refresh_cache-f6720dc3-07fc-43e1-ba91-75e3d26a4a0f" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:17:31 user nova-compute[75245]: DEBUG nova.network.neutron [req-e6ea62ae-86d6-46d4-8cc7-48cd3d228d8c req-b48d173b-e802-4412-b29d-c889277f0124 service nova] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Refreshing network info cache for port 80f91f45-781d-452c-b2c0-de2584494644 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:17:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Acquiring lock "refresh_cache-f6720dc3-07fc-43e1-ba91-75e3d26a4a0f" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:17:31 user nova-compute[75245]: DEBUG nova.network.neutron [req-e6ea62ae-86d6-46d4-8cc7-48cd3d228d8c req-b48d173b-e802-4412-b29d-c889277f0124 service nova] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Instance cache missing network info. {{(pid=75245) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 16:17:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43ead766-eeb0-4c7a-a03a-6d4daf7106af/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:17:31 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Cannot resize image /opt/stack/data/nova/instances/43ead766-eeb0-4c7a-a03a-6d4daf7106af/disk to a smaller size. {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 16:17:31 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Created local disks {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 16:17:31 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Ensure instance console log exists: /opt/stack/data/nova/instances/43ead766-eeb0-4c7a-a03a-6d4daf7106af/console.log {{(pid=75245) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 16:17:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:17:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:17:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:17:31 user nova-compute[75245]: DEBUG nova.network.neutron [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Successfully created port: 4aefd86e-7753-4693-9cbd-6ee2178443b5 {{(pid=75245) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 16:17:31 user nova-compute[75245]: DEBUG nova.network.neutron [req-e6ea62ae-86d6-46d4-8cc7-48cd3d228d8c req-b48d173b-e802-4412-b29d-c889277f0124 service nova] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:17:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-e6ea62ae-86d6-46d4-8cc7-48cd3d228d8c req-b48d173b-e802-4412-b29d-c889277f0124 service nova] Releasing lock "refresh_cache-f6720dc3-07fc-43e1-ba91-75e3d26a4a0f" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:17:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Acquired lock "refresh_cache-f6720dc3-07fc-43e1-ba91-75e3d26a4a0f" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:17:31 user nova-compute[75245]: DEBUG nova.network.neutron [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 16:17:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:32 user nova-compute[75245]: DEBUG nova.network.neutron [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Instance cache missing network info. {{(pid=75245) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 16:17:32 user nova-compute[75245]: DEBUG nova.network.neutron [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Updating instance_info_cache with network_info: [{"id": "80f91f45-781d-452c-b2c0-de2584494644", "address": "fa:16:3e:11:16:c3", "network": {"id": "0c0d4e62-be12-42e1-878c-a4a07270c108", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2066574781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77edb4b0a0024ef1a88cb67c11d51911", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80f91f45-78", "ovs_interfaceid": "80f91f45-781d-452c-b2c0-de2584494644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:17:32 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Releasing lock "refresh_cache-f6720dc3-07fc-43e1-ba91-75e3d26a4a0f" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:17:32 user nova-compute[75245]: DEBUG nova.compute.manager [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Instance network_info: |[{"id": "80f91f45-781d-452c-b2c0-de2584494644", "address": "fa:16:3e:11:16:c3", "network": {"id": "0c0d4e62-be12-42e1-878c-a4a07270c108", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2066574781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77edb4b0a0024ef1a88cb67c11d51911", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80f91f45-78", "ovs_interfaceid": "80f91f45-781d-452c-b2c0-de2584494644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 16:17:32 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Start _get_guest_xml network_info=[{"id": "80f91f45-781d-452c-b2c0-de2584494644", "address": "fa:16:3e:11:16:c3", "network": {"id": "0c0d4e62-be12-42e1-878c-a4a07270c108", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2066574781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77edb4b0a0024ef1a88cb67c11d51911", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80f91f45-78", "ovs_interfaceid": "80f91f45-781d-452c-b2c0-de2584494644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'a291d9c3-be02-4c6c-9649-4b45c5b7f487'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 16:17:32 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:17:32 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:17:32 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 16:17:32 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] CPU controller missing on host. {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 16:17:32 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 16:17:32 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] CPU controller found on host. {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 16:17:32 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75245) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 16:17:32 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T16:06:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 16:17:32 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Flavor limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 16:17:32 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Image limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 16:17:32 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Flavor pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 16:17:32 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Image pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 16:17:32 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 16:17:32 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 16:17:32 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 16:17:32 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Got 1 possible topologies {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 16:17:32 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 16:17:32 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 16:17:32 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T16:17:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-509169920',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-509169920',id=18,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBrxKq2a477G7fQ99CR3fI2bNDKuIY+WInOILJKOnZG664u+pIIu8QmsOdQ2tkxzkJGzMiOTR9GNSQO7MZOS3L5S3KmbXxtrzunCovcSXNCoaN7+W1BI3hrcIZ+N4h5Q6g==',key_name='tempest-keypair-1309950339',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77edb4b0a0024ef1a88cb67c11d51911',ramdisk_id='',reservation_id='r-x0llsnrl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-229817667',owner_user_name='tempest-TaggedAttachmentsTest-229817667-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:17:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e746210be7104346bd8ed895b3f22cd9',uuid=f6720dc3-07fc-43e1-ba91-75e3d26a4a0f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "80f91f45-781d-452c-b2c0-de2584494644", "address": "fa:16:3e:11:16:c3", "network": {"id": "0c0d4e62-be12-42e1-878c-a4a07270c108", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2066574781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77edb4b0a0024ef1a88cb67c11d51911", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80f91f45-78", "ovs_interfaceid": "80f91f45-781d-452c-b2c0-de2584494644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:17:32 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Converting VIF {"id": "80f91f45-781d-452c-b2c0-de2584494644", "address": "fa:16:3e:11:16:c3", "network": {"id": "0c0d4e62-be12-42e1-878c-a4a07270c108", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2066574781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77edb4b0a0024ef1a88cb67c11d51911", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80f91f45-78", "ovs_interfaceid": "80f91f45-781d-452c-b2c0-de2584494644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:17:32 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:16:c3,bridge_name='br-int',has_traffic_filtering=True,id=80f91f45-781d-452c-b2c0-de2584494644,network=Network(0c0d4e62-be12-42e1-878c-a4a07270c108),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80f91f45-78') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:17:32 user nova-compute[75245]: DEBUG nova.objects.instance [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Lazy-loading 'pci_devices' on Instance uuid f6720dc3-07fc-43e1-ba91-75e3d26a4a0f {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:17:32 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] End _get_guest_xml xml=<domain type="kvm">
Nov 29 16:17:32 user nova-compute[75245]:   <uuid>f6720dc3-07fc-43e1-ba91-75e3d26a4a0f</uuid>
Nov 29 16:17:32 user nova-compute[75245]:   <name>instance-00000012</name>
Nov 29 16:17:32 user nova-compute[75245]:   <memory>524288</memory>
Nov 29 16:17:32 user nova-compute[75245]:   <vcpu>1</vcpu>
Nov 29 16:17:32 user nova-compute[75245]:   <metadata>
Nov 29 16:17:32 user nova-compute[75245]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 16:17:32 user nova-compute[75245]:       <nova:package version="0.0.0"/>
Nov 29 16:17:32 user nova-compute[75245]:       <nova:name>tempest-device-tagging-server-509169920</nova:name>
Nov 29 16:17:32 user nova-compute[75245]:       <nova:creationTime>2023-11-29 16:17:32</nova:creationTime>
Nov 29 16:17:32 user nova-compute[75245]:       <nova:flavor name="m1.tiny">
Nov 29 16:17:32 user nova-compute[75245]:         <nova:memory>512</nova:memory>
Nov 29 16:17:32 user nova-compute[75245]:         <nova:disk>1</nova:disk>
Nov 29 16:17:32 user nova-compute[75245]:         <nova:swap>0</nova:swap>
Nov 29 16:17:32 user nova-compute[75245]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 16:17:32 user nova-compute[75245]:         <nova:vcpus>1</nova:vcpus>
Nov 29 16:17:32 user nova-compute[75245]:       </nova:flavor>
Nov 29 16:17:32 user nova-compute[75245]:       <nova:owner>
Nov 29 16:17:32 user nova-compute[75245]:         <nova:user uuid="e746210be7104346bd8ed895b3f22cd9">tempest-TaggedAttachmentsTest-229817667-project-member</nova:user>
Nov 29 16:17:32 user nova-compute[75245]:         <nova:project uuid="77edb4b0a0024ef1a88cb67c11d51911">tempest-TaggedAttachmentsTest-229817667</nova:project>
Nov 29 16:17:32 user nova-compute[75245]:       </nova:owner>
Nov 29 16:17:32 user nova-compute[75245]:       <nova:root type="image" uuid="a291d9c3-be02-4c6c-9649-4b45c5b7f487"/>
Nov 29 16:17:32 user nova-compute[75245]:       <nova:ports>
Nov 29 16:17:32 user nova-compute[75245]:         <nova:port uuid="80f91f45-781d-452c-b2c0-de2584494644">
Nov 29 16:17:32 user nova-compute[75245]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 29 16:17:32 user nova-compute[75245]:         </nova:port>
Nov 29 16:17:32 user nova-compute[75245]:       </nova:ports>
Nov 29 16:17:32 user nova-compute[75245]:     </nova:instance>
Nov 29 16:17:32 user nova-compute[75245]:   </metadata>
Nov 29 16:17:32 user nova-compute[75245]:   <sysinfo type="smbios">
Nov 29 16:17:32 user nova-compute[75245]:     <system>
Nov 29 16:17:32 user nova-compute[75245]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 16:17:32 user nova-compute[75245]:       <entry name="product">OpenStack Nova</entry>
Nov 29 16:17:32 user nova-compute[75245]:       <entry name="version">0.0.0</entry>
Nov 29 16:17:32 user nova-compute[75245]:       <entry name="serial">f6720dc3-07fc-43e1-ba91-75e3d26a4a0f</entry>
Nov 29 16:17:32 user nova-compute[75245]:       <entry name="uuid">f6720dc3-07fc-43e1-ba91-75e3d26a4a0f</entry>
Nov 29 16:17:32 user nova-compute[75245]:       <entry name="family">Virtual Machine</entry>
Nov 29 16:17:32 user nova-compute[75245]:     </system>
Nov 29 16:17:32 user nova-compute[75245]:   </sysinfo>
Nov 29 16:17:32 user nova-compute[75245]:   <os>
Nov 29 16:17:32 user nova-compute[75245]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 16:17:32 user nova-compute[75245]:     <boot dev="hd"/>
Nov 29 16:17:32 user nova-compute[75245]:     <smbios mode="sysinfo"/>
Nov 29 16:17:32 user nova-compute[75245]:   </os>
Nov 29 16:17:32 user nova-compute[75245]:   <features>
Nov 29 16:17:32 user nova-compute[75245]:     <acpi/>
Nov 29 16:17:32 user nova-compute[75245]:     <apic/>
Nov 29 16:17:32 user nova-compute[75245]:     <vmcoreinfo/>
Nov 29 16:17:32 user nova-compute[75245]:   </features>
Nov 29 16:17:32 user nova-compute[75245]:   <clock offset="utc">
Nov 29 16:17:32 user nova-compute[75245]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 16:17:32 user nova-compute[75245]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 16:17:32 user nova-compute[75245]:     <timer name="hpet" present="no"/>
Nov 29 16:17:32 user nova-compute[75245]:   </clock>
Nov 29 16:17:32 user nova-compute[75245]:   <cpu mode="custom" match="exact">
Nov 29 16:17:32 user nova-compute[75245]:     <model>Nehalem</model>
Nov 29 16:17:32 user nova-compute[75245]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 16:17:32 user nova-compute[75245]:   </cpu>
Nov 29 16:17:32 user nova-compute[75245]:   <devices>
Nov 29 16:17:32 user nova-compute[75245]:     <disk type="file" device="disk">
Nov 29 16:17:32 user nova-compute[75245]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 16:17:32 user nova-compute[75245]:       <source file="/opt/stack/data/nova/instances/f6720dc3-07fc-43e1-ba91-75e3d26a4a0f/disk"/>
Nov 29 16:17:32 user nova-compute[75245]:       <target dev="vda" bus="virtio"/>
Nov 29 16:17:32 user nova-compute[75245]:     </disk>
Nov 29 16:17:32 user nova-compute[75245]:     <disk type="file" device="cdrom">
Nov 29 16:17:32 user nova-compute[75245]:       <driver name="qemu" type="raw" cache="none"/>
Nov 29 16:17:32 user nova-compute[75245]:       <source file="/opt/stack/data/nova/instances/f6720dc3-07fc-43e1-ba91-75e3d26a4a0f/disk.config"/>
Nov 29 16:17:32 user nova-compute[75245]:       <target dev="hda" bus="ide"/>
Nov 29 16:17:32 user nova-compute[75245]:     </disk>
Nov 29 16:17:32 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 16:17:32 user nova-compute[75245]:       <mac address="fa:16:3e:11:16:c3"/>
Nov 29 16:17:32 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:17:32 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 16:17:32 user nova-compute[75245]:       <target dev="tap80f91f45-78"/>
Nov 29 16:17:32 user nova-compute[75245]:     </interface>
Nov 29 16:17:32 user nova-compute[75245]:     <serial type="pty">
Nov 29 16:17:32 user nova-compute[75245]:       <log file="/opt/stack/data/nova/instances/f6720dc3-07fc-43e1-ba91-75e3d26a4a0f/console.log" append="off"/>
Nov 29 16:17:32 user nova-compute[75245]:     </serial>
Nov 29 16:17:32 user nova-compute[75245]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 16:17:32 user nova-compute[75245]:     <video>
Nov 29 16:17:32 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:17:32 user nova-compute[75245]:     </video>
Nov 29 16:17:32 user nova-compute[75245]:     <rng model="virtio">
Nov 29 16:17:32 user nova-compute[75245]:       <backend model="random">/dev/urandom</backend>
Nov 29 16:17:32 user nova-compute[75245]:     </rng>
Nov 29 16:17:32 user nova-compute[75245]:     <controller type="usb" index="0" model="none"/>
Nov 29 16:17:32 user nova-compute[75245]:     <memballoon model="virtio">
Nov 29 16:17:32 user nova-compute[75245]:       <stats period="10"/>
Nov 29 16:17:32 user nova-compute[75245]:     </memballoon>
Nov 29 16:17:32 user nova-compute[75245]:   </devices>
Nov 29 16:17:32 user nova-compute[75245]: </domain>
Nov 29 16:17:32 user nova-compute[75245]:  {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 16:17:32 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T16:17:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-509169920',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-509169920',id=18,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBrxKq2a477G7fQ99CR3fI2bNDKuIY+WInOILJKOnZG664u+pIIu8QmsOdQ2tkxzkJGzMiOTR9GNSQO7MZOS3L5S3KmbXxtrzunCovcSXNCoaN7+W1BI3hrcIZ+N4h5Q6g==',key_name='tempest-keypair-1309950339',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77edb4b0a0024ef1a88cb67c11d51911',ramdisk_id='',reservation_id='r-x0llsnrl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-229817667',owner_user_name='tempest-TaggedAttachmentsTest-229817667-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:17:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e746210be7104346bd8ed895b3f22cd9',uuid=f6720dc3-07fc-43e1-ba91-75e3d26a4a0f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "80f91f45-781d-452c-b2c0-de2584494644", "address": "fa:16:3e:11:16:c3", "network": {"id": "0c0d4e62-be12-42e1-878c-a4a07270c108", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2066574781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77edb4b0a0024ef1a88cb67c11d51911", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80f91f45-78", "ovs_interfaceid": "80f91f45-781d-452c-b2c0-de2584494644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 16:17:32 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Converting VIF {"id": "80f91f45-781d-452c-b2c0-de2584494644", "address": "fa:16:3e:11:16:c3", "network": {"id": "0c0d4e62-be12-42e1-878c-a4a07270c108", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2066574781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77edb4b0a0024ef1a88cb67c11d51911", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80f91f45-78", "ovs_interfaceid": "80f91f45-781d-452c-b2c0-de2584494644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:17:32 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:16:c3,bridge_name='br-int',has_traffic_filtering=True,id=80f91f45-781d-452c-b2c0-de2584494644,network=Network(0c0d4e62-be12-42e1-878c-a4a07270c108),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80f91f45-78') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:17:32 user nova-compute[75245]: DEBUG os_vif [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:16:c3,bridge_name='br-int',has_traffic_filtering=True,id=80f91f45-781d-452c-b2c0-de2584494644,network=Network(0c0d4e62-be12-42e1-878c-a4a07270c108),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80f91f45-78') {{(pid=75245) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 16:17:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:17:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 16:17:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bde26bbd-e3e5-5520-8468-b977bd2cf012', '_type': 'linux-noop'}}, row=False) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:17:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap80f91f45-78, may_exist=True, interface_attrs={}) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:17:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap80f91f45-78, col_values=(('qos', UUID('0e440558-82f8-4efe-83c7-a406ede5fd58')),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:17:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap80f91f45-78, col_values=(('external_ids', {'iface-id': '80f91f45-781d-452c-b2c0-de2584494644', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:16:c3', 'vm-uuid': 'f6720dc3-07fc-43e1-ba91-75e3d26a4a0f'}),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:17:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:17:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:32 user nova-compute[75245]: INFO os_vif [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:16:c3,bridge_name='br-int',has_traffic_filtering=True,id=80f91f45-781d-452c-b2c0-de2584494644,network=Network(0c0d4e62-be12-42e1-878c-a4a07270c108),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80f91f45-78')
Nov 29 16:17:32 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:17:32 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] No BDM found with device name hda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:17:32 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] No VIF found with MAC fa:16:3e:11:16:c3, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:17:32 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Using config drive
Nov 29 16:17:32 user nova-compute[75245]: DEBUG nova.network.neutron [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Successfully updated port: 4aefd86e-7753-4693-9cbd-6ee2178443b5 {{(pid=75245) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 16:17:32 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Acquiring lock "refresh_cache-43ead766-eeb0-4c7a-a03a-6d4daf7106af" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:17:32 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Acquired lock "refresh_cache-43ead766-eeb0-4c7a-a03a-6d4daf7106af" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:17:32 user nova-compute[75245]: DEBUG nova.network.neutron [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 16:17:32 user nova-compute[75245]: DEBUG nova.network.neutron [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Instance cache missing network info. {{(pid=75245) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 16:17:32 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Creating config drive at /opt/stack/data/nova/instances/f6720dc3-07fc-43e1-ba91-75e3d26a4a0f/disk.config
Nov 29 16:17:32 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f6720dc3-07fc-43e1-ba91-75e3d26a4a0f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp9jfv54ku {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:17:32 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f6720dc3-07fc-43e1-ba91-75e3d26a4a0f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp9jfv54ku" returned: 0 in 0.055s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:17:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:33 user nova-compute[75245]: DEBUG nova.network.neutron [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Updating instance_info_cache with network_info: [{"id": "4aefd86e-7753-4693-9cbd-6ee2178443b5", "address": "fa:16:3e:d1:0a:c7", "network": {"id": "7f978dee-8a5e-4218-b6fc-2d550c0d7b5d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-53637364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd22948fbd074a7c94d8ad7614fbc220", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aefd86e-77", "ovs_interfaceid": "4aefd86e-7753-4693-9cbd-6ee2178443b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:17:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Releasing lock "refresh_cache-43ead766-eeb0-4c7a-a03a-6d4daf7106af" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:17:33 user nova-compute[75245]: DEBUG nova.compute.manager [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Instance network_info: |[{"id": "4aefd86e-7753-4693-9cbd-6ee2178443b5", "address": "fa:16:3e:d1:0a:c7", "network": {"id": "7f978dee-8a5e-4218-b6fc-2d550c0d7b5d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-53637364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd22948fbd074a7c94d8ad7614fbc220", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aefd86e-77", "ovs_interfaceid": "4aefd86e-7753-4693-9cbd-6ee2178443b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 16:17:33 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Start _get_guest_xml network_info=[{"id": "4aefd86e-7753-4693-9cbd-6ee2178443b5", "address": "fa:16:3e:d1:0a:c7", "network": {"id": "7f978dee-8a5e-4218-b6fc-2d550c0d7b5d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-53637364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd22948fbd074a7c94d8ad7614fbc220", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aefd86e-77", "ovs_interfaceid": "4aefd86e-7753-4693-9cbd-6ee2178443b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'a291d9c3-be02-4c6c-9649-4b45c5b7f487'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 16:17:33 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:17:33 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:17:33 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 16:17:33 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] CPU controller missing on host. {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 16:17:33 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 16:17:33 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] CPU controller found on host. {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 16:17:33 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75245) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 16:17:33 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T16:06:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 16:17:33 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Flavor limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 16:17:33 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Image limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 16:17:33 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Flavor pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 16:17:33 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Image pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 16:17:33 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 16:17:33 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 16:17:33 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 16:17:33 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Got 1 possible topologies {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 16:17:33 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 16:17:33 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 16:17:33 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:17:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1984176240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1984176240',id=19,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH74Z8eiyypbz1l5JPvqoE7mN6kpBjtN9LGqUH9Jk8PAY58RfZ7MUKhgrCMNHi/qzGIKNjocBtHkdxwKxLqCEmWTXuOZM9njdSqlsEwUOIVVwyojf8wouSpxuKrMcUkPaA==',key_name='tempest-keypair-572815760',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd22948fbd074a7c94d8ad7614fbc220',ramdisk_id='',reservation_id='r-48eaewao',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1524245296',owner_user_name='tempest-AttachVolumeShelveTestJSON-1524245296-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:17:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c4942f948584702a8c8b93248694a65',uuid=43ead766-eeb0-4c7a-a03a-6d4daf7106af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4aefd86e-7753-4693-9cbd-6ee2178443b5", "address": "fa:16:3e:d1:0a:c7", "network": {"id": "7f978dee-8a5e-4218-b6fc-2d550c0d7b5d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-53637364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd22948fbd074a7c94d8ad7614fbc220", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aefd86e-77", "ovs_interfaceid": "4aefd86e-7753-4693-9cbd-6ee2178443b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:17:33 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Converting VIF {"id": "4aefd86e-7753-4693-9cbd-6ee2178443b5", "address": "fa:16:3e:d1:0a:c7", "network": {"id": "7f978dee-8a5e-4218-b6fc-2d550c0d7b5d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-53637364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd22948fbd074a7c94d8ad7614fbc220", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aefd86e-77", "ovs_interfaceid": "4aefd86e-7753-4693-9cbd-6ee2178443b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:17:33 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:0a:c7,bridge_name='br-int',has_traffic_filtering=True,id=4aefd86e-7753-4693-9cbd-6ee2178443b5,network=Network(7f978dee-8a5e-4218-b6fc-2d550c0d7b5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4aefd86e-77') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:17:33 user nova-compute[75245]: DEBUG nova.objects.instance [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lazy-loading 'pci_devices' on Instance uuid 43ead766-eeb0-4c7a-a03a-6d4daf7106af {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:17:33 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] End _get_guest_xml xml=<domain type="kvm">
Nov 29 16:17:33 user nova-compute[75245]:   <uuid>43ead766-eeb0-4c7a-a03a-6d4daf7106af</uuid>
Nov 29 16:17:33 user nova-compute[75245]:   <name>instance-00000013</name>
Nov 29 16:17:33 user nova-compute[75245]:   <memory>524288</memory>
Nov 29 16:17:33 user nova-compute[75245]:   <vcpu>1</vcpu>
Nov 29 16:17:33 user nova-compute[75245]:   <metadata>
Nov 29 16:17:33 user nova-compute[75245]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 16:17:33 user nova-compute[75245]:       <nova:package version="0.0.0"/>
Nov 29 16:17:33 user nova-compute[75245]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1984176240</nova:name>
Nov 29 16:17:33 user nova-compute[75245]:       <nova:creationTime>2023-11-29 16:17:33</nova:creationTime>
Nov 29 16:17:33 user nova-compute[75245]:       <nova:flavor name="m1.tiny">
Nov 29 16:17:33 user nova-compute[75245]:         <nova:memory>512</nova:memory>
Nov 29 16:17:33 user nova-compute[75245]:         <nova:disk>1</nova:disk>
Nov 29 16:17:33 user nova-compute[75245]:         <nova:swap>0</nova:swap>
Nov 29 16:17:33 user nova-compute[75245]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 16:17:33 user nova-compute[75245]:         <nova:vcpus>1</nova:vcpus>
Nov 29 16:17:33 user nova-compute[75245]:       </nova:flavor>
Nov 29 16:17:33 user nova-compute[75245]:       <nova:owner>
Nov 29 16:17:33 user nova-compute[75245]:         <nova:user uuid="7c4942f948584702a8c8b93248694a65">tempest-AttachVolumeShelveTestJSON-1524245296-project-member</nova:user>
Nov 29 16:17:33 user nova-compute[75245]:         <nova:project uuid="fd22948fbd074a7c94d8ad7614fbc220">tempest-AttachVolumeShelveTestJSON-1524245296</nova:project>
Nov 29 16:17:33 user nova-compute[75245]:       </nova:owner>
Nov 29 16:17:33 user nova-compute[75245]:       <nova:root type="image" uuid="a291d9c3-be02-4c6c-9649-4b45c5b7f487"/>
Nov 29 16:17:33 user nova-compute[75245]:       <nova:ports>
Nov 29 16:17:33 user nova-compute[75245]:         <nova:port uuid="4aefd86e-7753-4693-9cbd-6ee2178443b5">
Nov 29 16:17:33 user nova-compute[75245]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 16:17:33 user nova-compute[75245]:         </nova:port>
Nov 29 16:17:33 user nova-compute[75245]:       </nova:ports>
Nov 29 16:17:33 user nova-compute[75245]:     </nova:instance>
Nov 29 16:17:33 user nova-compute[75245]:   </metadata>
Nov 29 16:17:33 user nova-compute[75245]:   <sysinfo type="smbios">
Nov 29 16:17:33 user nova-compute[75245]:     <system>
Nov 29 16:17:33 user nova-compute[75245]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 16:17:33 user nova-compute[75245]:       <entry name="product">OpenStack Nova</entry>
Nov 29 16:17:33 user nova-compute[75245]:       <entry name="version">0.0.0</entry>
Nov 29 16:17:33 user nova-compute[75245]:       <entry name="serial">43ead766-eeb0-4c7a-a03a-6d4daf7106af</entry>
Nov 29 16:17:33 user nova-compute[75245]:       <entry name="uuid">43ead766-eeb0-4c7a-a03a-6d4daf7106af</entry>
Nov 29 16:17:33 user nova-compute[75245]:       <entry name="family">Virtual Machine</entry>
Nov 29 16:17:33 user nova-compute[75245]:     </system>
Nov 29 16:17:33 user nova-compute[75245]:   </sysinfo>
Nov 29 16:17:33 user nova-compute[75245]:   <os>
Nov 29 16:17:33 user nova-compute[75245]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 16:17:33 user nova-compute[75245]:     <boot dev="hd"/>
Nov 29 16:17:33 user nova-compute[75245]:     <smbios mode="sysinfo"/>
Nov 29 16:17:33 user nova-compute[75245]:   </os>
Nov 29 16:17:33 user nova-compute[75245]:   <features>
Nov 29 16:17:33 user nova-compute[75245]:     <acpi/>
Nov 29 16:17:33 user nova-compute[75245]:     <apic/>
Nov 29 16:17:33 user nova-compute[75245]:     <vmcoreinfo/>
Nov 29 16:17:33 user nova-compute[75245]:   </features>
Nov 29 16:17:33 user nova-compute[75245]:   <clock offset="utc">
Nov 29 16:17:33 user nova-compute[75245]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 16:17:33 user nova-compute[75245]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 16:17:33 user nova-compute[75245]:     <timer name="hpet" present="no"/>
Nov 29 16:17:33 user nova-compute[75245]:   </clock>
Nov 29 16:17:33 user nova-compute[75245]:   <cpu mode="custom" match="exact">
Nov 29 16:17:33 user nova-compute[75245]:     <model>Nehalem</model>
Nov 29 16:17:33 user nova-compute[75245]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 16:17:33 user nova-compute[75245]:   </cpu>
Nov 29 16:17:33 user nova-compute[75245]:   <devices>
Nov 29 16:17:33 user nova-compute[75245]:     <disk type="file" device="disk">
Nov 29 16:17:33 user nova-compute[75245]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 16:17:33 user nova-compute[75245]:       <source file="/opt/stack/data/nova/instances/43ead766-eeb0-4c7a-a03a-6d4daf7106af/disk"/>
Nov 29 16:17:33 user nova-compute[75245]:       <target dev="vda" bus="virtio"/>
Nov 29 16:17:33 user nova-compute[75245]:     </disk>
Nov 29 16:17:33 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 16:17:33 user nova-compute[75245]:       <mac address="fa:16:3e:d1:0a:c7"/>
Nov 29 16:17:33 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:17:33 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 16:17:33 user nova-compute[75245]:       <target dev="tap4aefd86e-77"/>
Nov 29 16:17:33 user nova-compute[75245]:     </interface>
Nov 29 16:17:33 user nova-compute[75245]:     <serial type="pty">
Nov 29 16:17:33 user nova-compute[75245]:       <log file="/opt/stack/data/nova/instances/43ead766-eeb0-4c7a-a03a-6d4daf7106af/console.log" append="off"/>
Nov 29 16:17:33 user nova-compute[75245]:     </serial>
Nov 29 16:17:33 user nova-compute[75245]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 16:17:33 user nova-compute[75245]:     <video>
Nov 29 16:17:33 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:17:33 user nova-compute[75245]:     </video>
Nov 29 16:17:33 user nova-compute[75245]:     <rng model="virtio">
Nov 29 16:17:33 user nova-compute[75245]:       <backend model="random">/dev/urandom</backend>
Nov 29 16:17:33 user nova-compute[75245]:     </rng>
Nov 29 16:17:33 user nova-compute[75245]:     <controller type="usb" index="0" model="none"/>
Nov 29 16:17:33 user nova-compute[75245]:     <memballoon model="virtio">
Nov 29 16:17:33 user nova-compute[75245]:       <stats period="10"/>
Nov 29 16:17:33 user nova-compute[75245]:     </memballoon>
Nov 29 16:17:33 user nova-compute[75245]:   </devices>
Nov 29 16:17:33 user nova-compute[75245]: </domain>
Nov 29 16:17:33 user nova-compute[75245]:  {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 16:17:33 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:17:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1984176240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1984176240',id=19,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH74Z8eiyypbz1l5JPvqoE7mN6kpBjtN9LGqUH9Jk8PAY58RfZ7MUKhgrCMNHi/qzGIKNjocBtHkdxwKxLqCEmWTXuOZM9njdSqlsEwUOIVVwyojf8wouSpxuKrMcUkPaA==',key_name='tempest-keypair-572815760',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd22948fbd074a7c94d8ad7614fbc220',ramdisk_id='',reservation_id='r-48eaewao',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1524245296',owner_user_name='tempest-AttachVolumeShelveTestJSON-1524245296-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:17:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c4942f948584702a8c8b93248694a65',uuid=43ead766-eeb0-4c7a-a03a-6d4daf7106af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4aefd86e-7753-4693-9cbd-6ee2178443b5", "address": "fa:16:3e:d1:0a:c7", "network": {"id": "7f978dee-8a5e-4218-b6fc-2d550c0d7b5d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-53637364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd22948fbd074a7c94d8ad7614fbc220", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aefd86e-77", "ovs_interfaceid": "4aefd86e-7753-4693-9cbd-6ee2178443b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 16:17:33 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Converting VIF {"id": "4aefd86e-7753-4693-9cbd-6ee2178443b5", "address": "fa:16:3e:d1:0a:c7", "network": {"id": "7f978dee-8a5e-4218-b6fc-2d550c0d7b5d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-53637364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd22948fbd074a7c94d8ad7614fbc220", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aefd86e-77", "ovs_interfaceid": "4aefd86e-7753-4693-9cbd-6ee2178443b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:17:33 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:0a:c7,bridge_name='br-int',has_traffic_filtering=True,id=4aefd86e-7753-4693-9cbd-6ee2178443b5,network=Network(7f978dee-8a5e-4218-b6fc-2d550c0d7b5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4aefd86e-77') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:17:33 user nova-compute[75245]: DEBUG os_vif [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:0a:c7,bridge_name='br-int',has_traffic_filtering=True,id=4aefd86e-7753-4693-9cbd-6ee2178443b5,network=Network(7f978dee-8a5e-4218-b6fc-2d550c0d7b5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4aefd86e-77') {{(pid=75245) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 16:17:33 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:33 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:17:33 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 16:17:33 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:33 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'eb7a32ce-b097-5a12-beb7-548fe3b8490b', '_type': 'linux-noop'}}, row=False) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:17:33 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:33 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:17:33 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:33 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:33 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4aefd86e-77, may_exist=True, interface_attrs={}) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:17:33 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4aefd86e-77, col_values=(('qos', UUID('94b35240-05fe-4c8d-baf7-9b20a45a6def')),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:17:33 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4aefd86e-77, col_values=(('external_ids', {'iface-id': '4aefd86e-7753-4693-9cbd-6ee2178443b5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:0a:c7', 'vm-uuid': '43ead766-eeb0-4c7a-a03a-6d4daf7106af'}),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:17:33 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:17:33 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:33 user nova-compute[75245]: INFO os_vif [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:0a:c7,bridge_name='br-int',has_traffic_filtering=True,id=4aefd86e-7753-4693-9cbd-6ee2178443b5,network=Network(7f978dee-8a5e-4218-b6fc-2d550c0d7b5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4aefd86e-77')
Nov 29 16:17:33 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:17:33 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] No VIF found with MAC fa:16:3e:d1:0a:c7, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:17:33 user nova-compute[75245]: DEBUG nova.compute.manager [req-078bfbb5-4851-4b9d-8e30-f37d69ee02f5 req-1dd0b3cf-72eb-417a-91af-dc99ea7b4169 service nova] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Received event network-changed-4aefd86e-7753-4693-9cbd-6ee2178443b5 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:17:33 user nova-compute[75245]: DEBUG nova.compute.manager [req-078bfbb5-4851-4b9d-8e30-f37d69ee02f5 req-1dd0b3cf-72eb-417a-91af-dc99ea7b4169 service nova] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Refreshing instance network info cache due to event network-changed-4aefd86e-7753-4693-9cbd-6ee2178443b5. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:17:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-078bfbb5-4851-4b9d-8e30-f37d69ee02f5 req-1dd0b3cf-72eb-417a-91af-dc99ea7b4169 service nova] Acquiring lock "refresh_cache-43ead766-eeb0-4c7a-a03a-6d4daf7106af" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:17:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-078bfbb5-4851-4b9d-8e30-f37d69ee02f5 req-1dd0b3cf-72eb-417a-91af-dc99ea7b4169 service nova] Acquired lock "refresh_cache-43ead766-eeb0-4c7a-a03a-6d4daf7106af" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:17:33 user nova-compute[75245]: DEBUG nova.network.neutron [req-078bfbb5-4851-4b9d-8e30-f37d69ee02f5 req-1dd0b3cf-72eb-417a-91af-dc99ea7b4169 service nova] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Refreshing network info cache for port 4aefd86e-7753-4693-9cbd-6ee2178443b5 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:17:34 user nova-compute[75245]: DEBUG nova.network.neutron [req-078bfbb5-4851-4b9d-8e30-f37d69ee02f5 req-1dd0b3cf-72eb-417a-91af-dc99ea7b4169 service nova] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Updated VIF entry in instance network info cache for port 4aefd86e-7753-4693-9cbd-6ee2178443b5. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:17:34 user nova-compute[75245]: DEBUG nova.network.neutron [req-078bfbb5-4851-4b9d-8e30-f37d69ee02f5 req-1dd0b3cf-72eb-417a-91af-dc99ea7b4169 service nova] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Updating instance_info_cache with network_info: [{"id": "4aefd86e-7753-4693-9cbd-6ee2178443b5", "address": "fa:16:3e:d1:0a:c7", "network": {"id": "7f978dee-8a5e-4218-b6fc-2d550c0d7b5d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-53637364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd22948fbd074a7c94d8ad7614fbc220", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aefd86e-77", "ovs_interfaceid": "4aefd86e-7753-4693-9cbd-6ee2178443b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:17:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:34 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-078bfbb5-4851-4b9d-8e30-f37d69ee02f5 req-1dd0b3cf-72eb-417a-91af-dc99ea7b4169 service nova] Releasing lock "refresh_cache-43ead766-eeb0-4c7a-a03a-6d4daf7106af" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:17:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:35 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-9537776a-8063-4593-8022-ccb9838131d7 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance b99c5e50-a98b-45a2-b170-664c93109897 is timed out.
Nov 29 16:17:35 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-9537776a-8063-4593-8022-ccb9838131d7 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Successfully detached device sdc from instance b99c5e50-a98b-45a2-b170-664c93109897 from the live domain config.
Nov 29 16:17:35 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9537776a-8063-4593-8022-ccb9838131d7 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] [instance: b99c5e50-a98b-45a2-b170-664c93109897] calling os-brick to detach iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 16:17:35 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-9537776a-8063-4593-8022-ccb9838131d7 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, {'target_iqn': 'iqn.2010-10.org.openstack:c8050167-ab4a-4f4b-b8ae-94daeafdedbf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nqidYsjl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:17:35 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-9537776a-8063-4593-8022-ccb9838131d7 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:17:35 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-9537776a-8063-4593-8022-ccb9838131d7 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:17:35 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-9537776a-8063-4593-8022-ccb9838131d7 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:17:35 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:17:35 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:17:35 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e4f052-90f5-4b4d-825f-acb8f56b2769]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c8050167-ab4a-4f4b-b8ae-94daeafdedbf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:17:35 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-9537776a-8063-4593-8022-ccb9838131d7 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 16:17:35 user nova-compute[75245]: No targets found.
Nov 29 16:17:35 user nova-compute[75245]: iSNS:
Nov 29 16:17:35 user nova-compute[75245]: No targets found.
Nov 29 16:17:35 user nova-compute[75245]: STATIC:
Nov 29 16:17:35 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026
Nov 29 16:17:35 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:17:35 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:17:35 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:c8050167-ab4a-4f4b-b8ae-94daeafdedbf
Nov 29 16:17:35 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:17:35 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:17:35 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c
Nov 29 16:17:35 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:17:35 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:17:35 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f
Nov 29 16:17:35 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:17:35 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:17:35 user nova-compute[75245]: FIRMWARE:
Nov 29 16:17:35 user nova-compute[75245]: No targets found.
Nov 29 16:17:35 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:17:35 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-9537776a-8063-4593-8022-ccb9838131d7 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 16:17:35 user nova-compute[75245]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 16:17:35 user nova-compute[75245]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75245) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 16:17:35 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-9537776a-8063-4593-8022-ccb9838131d7 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8050167-ab4a-4f4b-b8ae-94daeafdedbf', 0)] {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 16:17:35 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:17:35 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:17:35 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba13080f-d020-45c0-b683-5b0aa247dad5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8050167-ab4a-4f4b-b8ae-94daeafdedbf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:17:35 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:17:35 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:17:35 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f414f0e-5988-4e12-9a38-a3ffe517a7ee]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8050167-ab4a-4f4b-b8ae-94daeafdedbf (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:17:35 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-9537776a-8063-4593-8022-ccb9838131d7 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f (non-flash)
Nov 29 16:17:35 user nova-compute[75245]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c (non-flash)
Nov 29 16:17:35 user nova-compute[75245]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 (non-flash)
Nov 29 16:17:35 user nova-compute[75245]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8050167-ab4a-4f4b-b8ae-94daeafdedbf (non-flash)
Nov 29 16:17:35 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:17:35 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-9537776a-8063-4593-8022-ccb9838131d7 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f (non-flash)
Nov 29 16:17:35 user nova-compute[75245]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c (non-flash)
Nov 29 16:17:35 user nova-compute[75245]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 (non-flash)
Nov 29 16:17:35 user nova-compute[75245]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8050167-ab4a-4f4b-b8ae-94daeafdedbf (non-flash)
Nov 29 16:17:35 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:17:35 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-9537776a-8063-4593-8022-ccb9838131d7 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0d441c0f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8050167-ab4a-4f4b-b8ae-94daeafdedbf'): ({'sdd'}, set())}) {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 16:17:35 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-9537776a-8063-4593-8022-ccb9838131d7 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Removing single pathed devices sdd {{(pid=75245) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 16:17:35 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:17:35 user nova-compute[75245]: DEBUG nova.compute.manager [req-94ccb15d-371e-4514-ade4-658797ab12d8 req-d76aa926-c6fe-487b-ae7b-12e6b589d8f7 service nova] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Received event network-vif-plugged-80f91f45-781d-452c-b2c0-de2584494644 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:17:35 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-94ccb15d-371e-4514-ade4-658797ab12d8 req-d76aa926-c6fe-487b-ae7b-12e6b589d8f7 service nova] Acquiring lock "f6720dc3-07fc-43e1-ba91-75e3d26a4a0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:17:35 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-94ccb15d-371e-4514-ade4-658797ab12d8 req-d76aa926-c6fe-487b-ae7b-12e6b589d8f7 service nova] Lock "f6720dc3-07fc-43e1-ba91-75e3d26a4a0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:17:35 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-94ccb15d-371e-4514-ade4-658797ab12d8 req-d76aa926-c6fe-487b-ae7b-12e6b589d8f7 service nova] Lock "f6720dc3-07fc-43e1-ba91-75e3d26a4a0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:17:35 user nova-compute[75245]: DEBUG nova.compute.manager [req-94ccb15d-371e-4514-ade4-658797ab12d8 req-d76aa926-c6fe-487b-ae7b-12e6b589d8f7 service nova] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] No waiting events found dispatching network-vif-plugged-80f91f45-781d-452c-b2c0-de2584494644 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:17:35 user nova-compute[75245]: WARNING nova.compute.manager [req-94ccb15d-371e-4514-ade4-658797ab12d8 req-d76aa926-c6fe-487b-ae7b-12e6b589d8f7 service nova] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Received unexpected event network-vif-plugged-80f91f45-781d-452c-b2c0-de2584494644 for instance with vm_state building and task_state spawning.
Nov 29 16:17:35 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:17:35 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[8745deb8-4938-4967-b08d-6aaa933cfc5f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:17:35 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:17:35 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:17:35 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[da6089d7-4db8-4d5f-925d-deeb259b7245]: (4, ('ok\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:17:35 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-9537776a-8063-4593-8022-ccb9838131d7 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Flushing IO for device /dev/sdd {{(pid=75245) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 16:17:35 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:17:35 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:17:35 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[da89abf2-5e88-48f1-a3a5-cfcb206f609d]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:17:35 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-9537776a-8063-4593-8022-ccb9838131d7 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75245) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 16:17:35 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:17:35 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:17:35 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa71619-e558-4d58-968c-ad80d9ea85da]: (4, ('1', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:17:35 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-9537776a-8063-4593-8022-ccb9838131d7 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 16:17:35 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-9537776a-8063-4593-8022-ccb9838131d7 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] SCSI volumes sdd have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 16:17:35 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-9537776a-8063-4593-8022-ccb9838131d7 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8050167-ab4a-4f4b-b8ae-94daeafdedbf')] {{(pid=75245) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 16:17:35 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8050167-ab4a-4f4b-b8ae-94daeafdedbf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:17:35 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8050167-ab4a-4f4b-b8ae-94daeafdedbf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.039s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:17:35 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a054a49-d517-41a3-9aa2-22ebf3a0aaa1]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:17:35 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-9537776a-8063-4593-8022-ccb9838131d7 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:17:35 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8050167-ab4a-4f4b-b8ae-94daeafdedbf -p 172.16.0.220:3260 --logout {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:17:35 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8050167-ab4a-4f4b-b8ae-94daeafdedbf -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:17:35 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb92f2bd-a568-4a21-bcef-d66fee64d653]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:c8050167-ab4a-4f4b-b8ae-94daeafdedbf, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:c8050167-ab4a-4f4b-b8ae-94daeafdedbf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:17:35 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-9537776a-8063-4593-8022-ccb9838131d7 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:c8050167-ab4a-4f4b-b8ae-94daeafdedbf, portal: 172.16.0.220,3260]
Nov 29 16:17:35 user nova-compute[75245]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:c8050167-ab4a-4f4b-b8ae-94daeafdedbf, portal: 172.16.0.220,3260] successful.
Nov 29 16:17:35 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:17:35 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8050167-ab4a-4f4b-b8ae-94daeafdedbf -p 172.16.0.220:3260 --op delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:17:35 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8050167-ab4a-4f4b-b8ae-94daeafdedbf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:17:35 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[642e12fd-5795-493d-b9ee-68da78724f3b]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:17:35 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-9537776a-8063-4593-8022-ccb9838131d7 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:17:35 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-9537776a-8063-4593-8022-ccb9838131d7 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.384s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:17:35 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-9537776a-8063-4593-8022-ccb9838131d7 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] <== disconnect_volume: return (386ms) None {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:17:35 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9537776a-8063-4593-8022-ccb9838131d7 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] [instance: b99c5e50-a98b-45a2-b170-664c93109897] Disconnected iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 16:17:35 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:35 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:35 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:35 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:35 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:35 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:35 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:36 user nova-compute[75245]: DEBUG nova.compute.manager [req-cc99d80d-1fef-497b-8ac6-466bb1d403dd req-9bbbcf0c-60dc-4d83-ae00-f473fc0d65d2 service nova] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Received event network-vif-plugged-4aefd86e-7753-4693-9cbd-6ee2178443b5 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:17:36 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-cc99d80d-1fef-497b-8ac6-466bb1d403dd req-9bbbcf0c-60dc-4d83-ae00-f473fc0d65d2 service nova] Acquiring lock "43ead766-eeb0-4c7a-a03a-6d4daf7106af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:17:36 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-cc99d80d-1fef-497b-8ac6-466bb1d403dd req-9bbbcf0c-60dc-4d83-ae00-f473fc0d65d2 service nova] Lock "43ead766-eeb0-4c7a-a03a-6d4daf7106af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:17:36 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-cc99d80d-1fef-497b-8ac6-466bb1d403dd req-9bbbcf0c-60dc-4d83-ae00-f473fc0d65d2 service nova] Lock "43ead766-eeb0-4c7a-a03a-6d4daf7106af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:17:36 user nova-compute[75245]: DEBUG nova.compute.manager [req-cc99d80d-1fef-497b-8ac6-466bb1d403dd req-9bbbcf0c-60dc-4d83-ae00-f473fc0d65d2 service nova] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] No waiting events found dispatching network-vif-plugged-4aefd86e-7753-4693-9cbd-6ee2178443b5 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:17:36 user nova-compute[75245]: WARNING nova.compute.manager [req-cc99d80d-1fef-497b-8ac6-466bb1d403dd req-9bbbcf0c-60dc-4d83-ae00-f473fc0d65d2 service nova] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Received unexpected event network-vif-plugged-4aefd86e-7753-4693-9cbd-6ee2178443b5 for instance with vm_state building and task_state spawning.
Nov 29 16:17:36 user nova-compute[75245]: DEBUG nova.objects.instance [None req-9537776a-8063-4593-8022-ccb9838131d7 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Lazy-loading 'flavor' on Instance uuid b99c5e50-a98b-45a2-b170-664c93109897 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:17:36 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:36 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:36 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-9537776a-8063-4593-8022-ccb9838131d7 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Lock "b99c5e50-a98b-45a2-b170-664c93109897" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.146s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:17:36 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:37 user nova-compute[75245]: DEBUG nova.compute.manager [req-20bb5893-880a-4ba2-95cb-ed22ee603d8b req-3f2e4bb7-ae17-49c2-b986-a3b25315b1cf service nova] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Received event network-vif-plugged-80f91f45-781d-452c-b2c0-de2584494644 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:17:37 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-20bb5893-880a-4ba2-95cb-ed22ee603d8b req-3f2e4bb7-ae17-49c2-b986-a3b25315b1cf service nova] Acquiring lock "f6720dc3-07fc-43e1-ba91-75e3d26a4a0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:17:37 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-20bb5893-880a-4ba2-95cb-ed22ee603d8b req-3f2e4bb7-ae17-49c2-b986-a3b25315b1cf service nova] Lock "f6720dc3-07fc-43e1-ba91-75e3d26a4a0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:17:37 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-20bb5893-880a-4ba2-95cb-ed22ee603d8b req-3f2e4bb7-ae17-49c2-b986-a3b25315b1cf service nova] Lock "f6720dc3-07fc-43e1-ba91-75e3d26a4a0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:17:37 user nova-compute[75245]: DEBUG nova.compute.manager [req-20bb5893-880a-4ba2-95cb-ed22ee603d8b req-3f2e4bb7-ae17-49c2-b986-a3b25315b1cf service nova] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] No waiting events found dispatching network-vif-plugged-80f91f45-781d-452c-b2c0-de2584494644 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:17:37 user nova-compute[75245]: WARNING nova.compute.manager [req-20bb5893-880a-4ba2-95cb-ed22ee603d8b req-3f2e4bb7-ae17-49c2-b986-a3b25315b1cf service nova] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Received unexpected event network-vif-plugged-80f91f45-781d-452c-b2c0-de2584494644 for instance with vm_state building and task_state spawning.
Nov 29 16:17:37 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-a992625e-b8d0-4954-adc2-36eae0bab753 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Acquiring lock "b99c5e50-a98b-45a2-b170-664c93109897" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:17:37 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-a992625e-b8d0-4954-adc2-36eae0bab753 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Lock "b99c5e50-a98b-45a2-b170-664c93109897" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:17:37 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-a992625e-b8d0-4954-adc2-36eae0bab753 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Acquiring lock "b99c5e50-a98b-45a2-b170-664c93109897-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:17:37 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-a992625e-b8d0-4954-adc2-36eae0bab753 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Lock "b99c5e50-a98b-45a2-b170-664c93109897-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:17:37 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-a992625e-b8d0-4954-adc2-36eae0bab753 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Lock "b99c5e50-a98b-45a2-b170-664c93109897-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:17:37 user nova-compute[75245]: INFO nova.compute.manager [None req-a992625e-b8d0-4954-adc2-36eae0bab753 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] [instance: b99c5e50-a98b-45a2-b170-664c93109897] Terminating instance
Nov 29 16:17:37 user nova-compute[75245]: DEBUG nova.compute.manager [None req-a992625e-b8d0-4954-adc2-36eae0bab753 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] [instance: b99c5e50-a98b-45a2-b170-664c93109897] Start destroying the instance on the hypervisor. {{(pid=75245) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 16:17:37 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:37 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:37 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:38 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:38 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:38 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:38 user nova-compute[75245]: DEBUG nova.compute.manager [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Instance event wait completed in 0 seconds for  {{(pid=75245) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 16:17:38 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Guest created on hypervisor {{(pid=75245) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 16:17:38 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Instance spawned successfully.
Nov 29 16:17:38 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 16:17:38 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Found default for hw_cdrom_bus of ide {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:17:38 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Found default for hw_disk_bus of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:17:38 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Found default for hw_input_bus of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:17:38 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Found default for hw_pointer_model of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:17:38 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Found default for hw_video_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:17:38 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Found default for hw_vif_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:17:38 user nova-compute[75245]: DEBUG nova.compute.manager [req-961cd359-9adf-44c3-b0a9-5753bd56f8d4 req-ce6835c5-b4e8-4c5e-bd8b-342080fbcd1c service nova] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Received event network-vif-plugged-4aefd86e-7753-4693-9cbd-6ee2178443b5 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:17:38 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-961cd359-9adf-44c3-b0a9-5753bd56f8d4 req-ce6835c5-b4e8-4c5e-bd8b-342080fbcd1c service nova] Acquiring lock "43ead766-eeb0-4c7a-a03a-6d4daf7106af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:17:38 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-961cd359-9adf-44c3-b0a9-5753bd56f8d4 req-ce6835c5-b4e8-4c5e-bd8b-342080fbcd1c service nova] Lock "43ead766-eeb0-4c7a-a03a-6d4daf7106af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:17:38 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-961cd359-9adf-44c3-b0a9-5753bd56f8d4 req-ce6835c5-b4e8-4c5e-bd8b-342080fbcd1c service nova] Lock "43ead766-eeb0-4c7a-a03a-6d4daf7106af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:17:38 user nova-compute[75245]: DEBUG nova.compute.manager [req-961cd359-9adf-44c3-b0a9-5753bd56f8d4 req-ce6835c5-b4e8-4c5e-bd8b-342080fbcd1c service nova] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] No waiting events found dispatching network-vif-plugged-4aefd86e-7753-4693-9cbd-6ee2178443b5 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:17:38 user nova-compute[75245]: WARNING nova.compute.manager [req-961cd359-9adf-44c3-b0a9-5753bd56f8d4 req-ce6835c5-b4e8-4c5e-bd8b-342080fbcd1c service nova] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Received unexpected event network-vif-plugged-4aefd86e-7753-4693-9cbd-6ee2178443b5 for instance with vm_state building and task_state spawning.
Nov 29 16:17:38 user nova-compute[75245]: INFO nova.compute.manager [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Took 9.04 seconds to spawn the instance on the hypervisor.
Nov 29 16:17:38 user nova-compute[75245]: DEBUG nova.compute.manager [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:17:38 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: b99c5e50-a98b-45a2-b170-664c93109897] Instance destroyed successfully.
Nov 29 16:17:38 user nova-compute[75245]: DEBUG nova.objects.instance [None req-a992625e-b8d0-4954-adc2-36eae0bab753 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Lazy-loading 'resources' on Instance uuid b99c5e50-a98b-45a2-b170-664c93109897 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:17:38 user nova-compute[75245]: DEBUG nova.compute.manager [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Instance event wait completed in 0 seconds for  {{(pid=75245) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 16:17:38 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Guest created on hypervisor {{(pid=75245) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 16:17:38 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-a992625e-b8d0-4954-adc2-36eae0bab753 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T16:15:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-674037423',display_name='tempest-AttachSCSIVolumeTestJSON-server-674037423',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-674037423',id=17,image_ref='6ccaa852-1bd2-402f-9049-f4756a98a62d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIpbMVJBSu/Ho+4zKgopCd5vpQe24yBq2pRAbQj56Fjeu3rEN8WLJ/OnuC/3M5/73jIWk4qKKgJeSYC72pnvhZ2F5SminNo1Wjy4vZjuBEckasGfduEk4ayj5vlBID6mRw==',key_name='tempest-keypair-881689391',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:15:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c94b9aa8ead849878a724d3e77c2cf83',ramdisk_id='',reservation_id='r-tirig9ki',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ccaa852-1bd2-402f-9049-f4756a98a62d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1036962361',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1036962361-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:15:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc3579c7a7b54cf592cbdf7df55e2d0e',uuid=b99c5e50-a98b-45a2-b170-664c93109897,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e9647e37-1ab6-40fb-8874-a626692dd676", "address": "fa:16:3e:12:85:81", "network": {"id": "161e15da-e083-48c0-82ad-b2326e4dc33b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1831426097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c94b9aa8ead849878a724d3e77c2cf83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9647e37-1a", "ovs_interfaceid": "e9647e37-1ab6-40fb-8874-a626692dd676", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 16:17:38 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-a992625e-b8d0-4954-adc2-36eae0bab753 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Converting VIF {"id": "e9647e37-1ab6-40fb-8874-a626692dd676", "address": "fa:16:3e:12:85:81", "network": {"id": "161e15da-e083-48c0-82ad-b2326e4dc33b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1831426097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c94b9aa8ead849878a724d3e77c2cf83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9647e37-1a", "ovs_interfaceid": "e9647e37-1ab6-40fb-8874-a626692dd676", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:17:38 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-a992625e-b8d0-4954-adc2-36eae0bab753 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:12:85:81,bridge_name='br-int',has_traffic_filtering=True,id=e9647e37-1ab6-40fb-8874-a626692dd676,network=Network(161e15da-e083-48c0-82ad-b2326e4dc33b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9647e37-1a') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:17:38 user nova-compute[75245]: DEBUG os_vif [None req-a992625e-b8d0-4954-adc2-36eae0bab753 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:85:81,bridge_name='br-int',has_traffic_filtering=True,id=e9647e37-1ab6-40fb-8874-a626692dd676,network=Network(161e15da-e083-48c0-82ad-b2326e4dc33b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9647e37-1a') {{(pid=75245) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 16:17:38 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:38 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape9647e37-1a, bridge=br-int, if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:17:38 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:38 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:38 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=38496aa3-c8f0-4444-9639-74dec538863a) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:17:38 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:38 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:17:38 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Instance spawned successfully.
Nov 29 16:17:38 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 16:17:38 user nova-compute[75245]: INFO os_vif [None req-a992625e-b8d0-4954-adc2-36eae0bab753 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:85:81,bridge_name='br-int',has_traffic_filtering=True,id=e9647e37-1ab6-40fb-8874-a626692dd676,network=Network(161e15da-e083-48c0-82ad-b2326e4dc33b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9647e37-1a')
Nov 29 16:17:38 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-a992625e-b8d0-4954-adc2-36eae0bab753 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] [instance: b99c5e50-a98b-45a2-b170-664c93109897] Deleting instance files /opt/stack/data/nova/instances/b99c5e50-a98b-45a2-b170-664c93109897_del
Nov 29 16:17:38 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-a992625e-b8d0-4954-adc2-36eae0bab753 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] [instance: b99c5e50-a98b-45a2-b170-664c93109897] Deletion of /opt/stack/data/nova/instances/b99c5e50-a98b-45a2-b170-664c93109897_del complete
Nov 29 16:17:38 user nova-compute[75245]: INFO nova.compute.manager [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Took 9.77 seconds to build instance.
Nov 29 16:17:38 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Found default for hw_cdrom_bus of ide {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:17:38 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Found default for hw_disk_bus of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:17:38 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Found default for hw_input_bus of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:17:38 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Found default for hw_pointer_model of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:17:38 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Found default for hw_video_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:17:38 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Found default for hw_vif_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:17:38 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d2b2dfa3-0a58-4d3b-9548-232beda72f44 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Lock "f6720dc3-07fc-43e1-ba91-75e3d26a4a0f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.869s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:17:38 user nova-compute[75245]: INFO nova.compute.manager [None req-a992625e-b8d0-4954-adc2-36eae0bab753 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] [instance: b99c5e50-a98b-45a2-b170-664c93109897] Took 1.07 seconds to destroy the instance on the hypervisor.
Nov 29 16:17:38 user nova-compute[75245]: DEBUG oslo.service.loopingcall [None req-a992625e-b8d0-4954-adc2-36eae0bab753 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75245) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 16:17:38 user nova-compute[75245]: DEBUG nova.compute.manager [-] [instance: b99c5e50-a98b-45a2-b170-664c93109897] Deallocating network for instance {{(pid=75245) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 16:17:38 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: b99c5e50-a98b-45a2-b170-664c93109897] deallocate_for_instance() {{(pid=75245) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 16:17:38 user nova-compute[75245]: INFO nova.compute.manager [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Took 8.17 seconds to spawn the instance on the hypervisor.
Nov 29 16:17:38 user nova-compute[75245]: DEBUG nova.compute.manager [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:17:38 user nova-compute[75245]: INFO nova.compute.manager [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Took 9.21 seconds to build instance.
Nov 29 16:17:38 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-da9aae8d-1b9d-4615-9751-c31ab690bd57 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lock "43ead766-eeb0-4c7a-a03a-6d4daf7106af" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.345s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:17:39 user nova-compute[75245]: DEBUG nova.compute.manager [req-d0a0ce93-236c-449b-84b3-ecba95f2e649 req-b908076d-e91b-4c63-b626-bf87c8066b7f service nova] [instance: b99c5e50-a98b-45a2-b170-664c93109897] Received event network-vif-unplugged-e9647e37-1ab6-40fb-8874-a626692dd676 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:17:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d0a0ce93-236c-449b-84b3-ecba95f2e649 req-b908076d-e91b-4c63-b626-bf87c8066b7f service nova] Acquiring lock "b99c5e50-a98b-45a2-b170-664c93109897-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:17:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d0a0ce93-236c-449b-84b3-ecba95f2e649 req-b908076d-e91b-4c63-b626-bf87c8066b7f service nova] Lock "b99c5e50-a98b-45a2-b170-664c93109897-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:17:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d0a0ce93-236c-449b-84b3-ecba95f2e649 req-b908076d-e91b-4c63-b626-bf87c8066b7f service nova] Lock "b99c5e50-a98b-45a2-b170-664c93109897-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:17:39 user nova-compute[75245]: DEBUG nova.compute.manager [req-d0a0ce93-236c-449b-84b3-ecba95f2e649 req-b908076d-e91b-4c63-b626-bf87c8066b7f service nova] [instance: b99c5e50-a98b-45a2-b170-664c93109897] No waiting events found dispatching network-vif-unplugged-e9647e37-1ab6-40fb-8874-a626692dd676 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:17:39 user nova-compute[75245]: DEBUG nova.compute.manager [req-d0a0ce93-236c-449b-84b3-ecba95f2e649 req-b908076d-e91b-4c63-b626-bf87c8066b7f service nova] [instance: b99c5e50-a98b-45a2-b170-664c93109897] Received event network-vif-unplugged-e9647e37-1ab6-40fb-8874-a626692dd676 for instance with task_state deleting. {{(pid=75245) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 16:17:39 user nova-compute[75245]: DEBUG nova.compute.manager [req-d0a0ce93-236c-449b-84b3-ecba95f2e649 req-b908076d-e91b-4c63-b626-bf87c8066b7f service nova] [instance: b99c5e50-a98b-45a2-b170-664c93109897] Received event network-vif-plugged-e9647e37-1ab6-40fb-8874-a626692dd676 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:17:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d0a0ce93-236c-449b-84b3-ecba95f2e649 req-b908076d-e91b-4c63-b626-bf87c8066b7f service nova] Acquiring lock "b99c5e50-a98b-45a2-b170-664c93109897-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:17:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d0a0ce93-236c-449b-84b3-ecba95f2e649 req-b908076d-e91b-4c63-b626-bf87c8066b7f service nova] Lock "b99c5e50-a98b-45a2-b170-664c93109897-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:17:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d0a0ce93-236c-449b-84b3-ecba95f2e649 req-b908076d-e91b-4c63-b626-bf87c8066b7f service nova] Lock "b99c5e50-a98b-45a2-b170-664c93109897-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:17:39 user nova-compute[75245]: DEBUG nova.compute.manager [req-d0a0ce93-236c-449b-84b3-ecba95f2e649 req-b908076d-e91b-4c63-b626-bf87c8066b7f service nova] [instance: b99c5e50-a98b-45a2-b170-664c93109897] No waiting events found dispatching network-vif-plugged-e9647e37-1ab6-40fb-8874-a626692dd676 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:17:39 user nova-compute[75245]: WARNING nova.compute.manager [req-d0a0ce93-236c-449b-84b3-ecba95f2e649 req-b908076d-e91b-4c63-b626-bf87c8066b7f service nova] [instance: b99c5e50-a98b-45a2-b170-664c93109897] Received unexpected event network-vif-plugged-e9647e37-1ab6-40fb-8874-a626692dd676 for instance with vm_state active and task_state deleting.
Nov 29 16:17:39 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: b99c5e50-a98b-45a2-b170-664c93109897] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:17:39 user nova-compute[75245]: DEBUG nova.compute.manager [req-09c93aff-8eb2-42c7-a05c-74088f193438 req-9b704263-1426-4025-8785-2dea126ac424 service nova] [instance: b99c5e50-a98b-45a2-b170-664c93109897] Received event network-vif-deleted-e9647e37-1ab6-40fb-8874-a626692dd676 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:17:39 user nova-compute[75245]: INFO nova.compute.manager [req-09c93aff-8eb2-42c7-a05c-74088f193438 req-9b704263-1426-4025-8785-2dea126ac424 service nova] [instance: b99c5e50-a98b-45a2-b170-664c93109897] Neutron deleted interface e9647e37-1ab6-40fb-8874-a626692dd676; detaching it from the instance and deleting it from the info cache
Nov 29 16:17:39 user nova-compute[75245]: DEBUG nova.network.neutron [req-09c93aff-8eb2-42c7-a05c-74088f193438 req-9b704263-1426-4025-8785-2dea126ac424 service nova] [instance: b99c5e50-a98b-45a2-b170-664c93109897] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:17:39 user nova-compute[75245]: INFO nova.compute.manager [-] [instance: b99c5e50-a98b-45a2-b170-664c93109897] Took 1.00 seconds to deallocate network for instance.
Nov 29 16:17:39 user nova-compute[75245]: DEBUG nova.compute.manager [req-09c93aff-8eb2-42c7-a05c-74088f193438 req-9b704263-1426-4025-8785-2dea126ac424 service nova] [instance: b99c5e50-a98b-45a2-b170-664c93109897] Detach interface failed, port_id=e9647e37-1ab6-40fb-8874-a626692dd676, reason: Instance b99c5e50-a98b-45a2-b170-664c93109897 could not be found. {{(pid=75245) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 16:17:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-a992625e-b8d0-4954-adc2-36eae0bab753 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:17:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-a992625e-b8d0-4954-adc2-36eae0bab753 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:17:40 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-a992625e-b8d0-4954-adc2-36eae0bab753 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:17:40 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-a992625e-b8d0-4954-adc2-36eae0bab753 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:17:40 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-a992625e-b8d0-4954-adc2-36eae0bab753 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.685s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:17:40 user nova-compute[75245]: INFO nova.scheduler.client.report [None req-a992625e-b8d0-4954-adc2-36eae0bab753 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Deleted allocations for instance b99c5e50-a98b-45a2-b170-664c93109897
Nov 29 16:17:40 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-a992625e-b8d0-4954-adc2-36eae0bab753 tempest-AttachSCSIVolumeTestJSON-1036962361 tempest-AttachSCSIVolumeTestJSON-1036962361-project-member] Lock "b99c5e50-a98b-45a2-b170-664c93109897" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.009s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:17:41 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:43 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:43 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:43 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:46 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Acquiring lock "84bae51e-2a85-442d-bbd2-fc89f30f40b7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:17:46 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Lock "84bae51e-2a85-442d-bbd2-fc89f30f40b7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:17:46 user nova-compute[75245]: DEBUG nova.compute.manager [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Starting instance... {{(pid=75245) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 16:17:47 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:17:47 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:17:47 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75245) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 16:17:47 user nova-compute[75245]: INFO nova.compute.claims [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Claim successful on node user
Nov 29 16:17:47 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:17:47 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:17:47 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.406s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:17:47 user nova-compute[75245]: DEBUG nova.compute.manager [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Start building networks asynchronously for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 16:17:47 user nova-compute[75245]: DEBUG nova.compute.manager [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Allocating IP information in the background. {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 16:17:47 user nova-compute[75245]: DEBUG nova.network.neutron [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] allocate_for_instance() {{(pid=75245) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 16:17:47 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 16:17:47 user nova-compute[75245]: DEBUG nova.compute.manager [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Start building block device mappings for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 16:17:47 user nova-compute[75245]: DEBUG nova.policy [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ecd08c449e8643c2b0eb4b2dc8cd7780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c018212e0654c4db442ca65a386f397', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75245) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 16:17:47 user nova-compute[75245]: DEBUG nova.compute.manager [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Start spawning the instance on the hypervisor. {{(pid=75245) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 16:17:47 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Creating instance directory {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 16:17:47 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Creating image(s)
Nov 29 16:17:47 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Acquiring lock "/opt/stack/data/nova/instances/84bae51e-2a85-442d-bbd2-fc89f30f40b7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:17:47 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Lock "/opt/stack/data/nova/instances/84bae51e-2a85-442d-bbd2-fc89f30f40b7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:17:47 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Lock "/opt/stack/data/nova/instances/84bae51e-2a85-442d-bbd2-fc89f30f40b7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:17:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:17:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.171s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:17:47 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Acquiring lock "d654f7206043e05d3525550b0fc885556eb999f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:17:47 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:17:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:17:48 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.179s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:17:48 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/84bae51e-2a85-442d-bbd2-fc89f30f40b7/disk 1073741824 {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:17:48 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:48 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/84bae51e-2a85-442d-bbd2-fc89f30f40b7/disk 1073741824" returned: 0 in 0.058s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:17:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:17:48 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:17:48 user nova-compute[75245]: DEBUG nova.network.neutron [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Successfully created port: 27fc0374-0770-4171-a730-6696b09362eb {{(pid=75245) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 16:17:48 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.184s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:17:48 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Checking if we can resize image /opt/stack/data/nova/instances/84bae51e-2a85-442d-bbd2-fc89f30f40b7/disk. size=1073741824 {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 16:17:48 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bae51e-2a85-442d-bbd2-fc89f30f40b7/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:17:48 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bae51e-2a85-442d-bbd2-fc89f30f40b7/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:17:48 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Cannot resize image /opt/stack/data/nova/instances/84bae51e-2a85-442d-bbd2-fc89f30f40b7/disk to a smaller size. {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 16:17:48 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Created local disks {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 16:17:48 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Ensure instance console log exists: /opt/stack/data/nova/instances/84bae51e-2a85-442d-bbd2-fc89f30f40b7/console.log {{(pid=75245) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 16:17:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:17:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:17:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:17:48 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:48 user nova-compute[75245]: DEBUG nova.network.neutron [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Successfully updated port: 27fc0374-0770-4171-a730-6696b09362eb {{(pid=75245) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 16:17:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Acquiring lock "refresh_cache-84bae51e-2a85-442d-bbd2-fc89f30f40b7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:17:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Acquired lock "refresh_cache-84bae51e-2a85-442d-bbd2-fc89f30f40b7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:17:48 user nova-compute[75245]: DEBUG nova.network.neutron [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 16:17:48 user nova-compute[75245]: DEBUG nova.compute.manager [req-0d997d7b-19ab-4947-b3e5-b44a3a29507c req-7ffa24af-69ed-4d0b-8416-811e330464b0 service nova] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Received event network-changed-27fc0374-0770-4171-a730-6696b09362eb {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:17:48 user nova-compute[75245]: DEBUG nova.compute.manager [req-0d997d7b-19ab-4947-b3e5-b44a3a29507c req-7ffa24af-69ed-4d0b-8416-811e330464b0 service nova] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Refreshing instance network info cache due to event network-changed-27fc0374-0770-4171-a730-6696b09362eb. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:17:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-0d997d7b-19ab-4947-b3e5-b44a3a29507c req-7ffa24af-69ed-4d0b-8416-811e330464b0 service nova] Acquiring lock "refresh_cache-84bae51e-2a85-442d-bbd2-fc89f30f40b7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:17:48 user nova-compute[75245]: DEBUG nova.network.neutron [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Instance cache missing network info. {{(pid=75245) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 16:17:49 user nova-compute[75245]: DEBUG nova.network.neutron [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Updating instance_info_cache with network_info: [{"id": "27fc0374-0770-4171-a730-6696b09362eb", "address": "fa:16:3e:d1:e4:30", "network": {"id": "e38d9eed-b29b-4a4c-b084-876554dc5263", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1284740336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c018212e0654c4db442ca65a386f397", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27fc0374-07", "ovs_interfaceid": "27fc0374-0770-4171-a730-6696b09362eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:17:49 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Releasing lock "refresh_cache-84bae51e-2a85-442d-bbd2-fc89f30f40b7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:17:49 user nova-compute[75245]: DEBUG nova.compute.manager [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Instance network_info: |[{"id": "27fc0374-0770-4171-a730-6696b09362eb", "address": "fa:16:3e:d1:e4:30", "network": {"id": "e38d9eed-b29b-4a4c-b084-876554dc5263", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1284740336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c018212e0654c4db442ca65a386f397", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27fc0374-07", "ovs_interfaceid": "27fc0374-0770-4171-a730-6696b09362eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 16:17:49 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-0d997d7b-19ab-4947-b3e5-b44a3a29507c req-7ffa24af-69ed-4d0b-8416-811e330464b0 service nova] Acquired lock "refresh_cache-84bae51e-2a85-442d-bbd2-fc89f30f40b7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:17:49 user nova-compute[75245]: DEBUG nova.network.neutron [req-0d997d7b-19ab-4947-b3e5-b44a3a29507c req-7ffa24af-69ed-4d0b-8416-811e330464b0 service nova] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Refreshing network info cache for port 27fc0374-0770-4171-a730-6696b09362eb {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:17:49 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Start _get_guest_xml network_info=[{"id": "27fc0374-0770-4171-a730-6696b09362eb", "address": "fa:16:3e:d1:e4:30", "network": {"id": "e38d9eed-b29b-4a4c-b084-876554dc5263", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1284740336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c018212e0654c4db442ca65a386f397", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27fc0374-07", "ovs_interfaceid": "27fc0374-0770-4171-a730-6696b09362eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'a291d9c3-be02-4c6c-9649-4b45c5b7f487'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 16:17:49 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:17:49 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:17:49 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 16:17:49 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] CPU controller missing on host. {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 16:17:49 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 16:17:49 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] CPU controller found on host. {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 16:17:49 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75245) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 16:17:49 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T16:06:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 16:17:49 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Flavor limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 16:17:49 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Image limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 16:17:49 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Flavor pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 16:17:49 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Image pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 16:17:49 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 16:17:49 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 16:17:49 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 16:17:49 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Got 1 possible topologies {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 16:17:49 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 16:17:49 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 16:17:49 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:17:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-185985516',display_name='tempest-ServerActionsTestOtherB-server-185985516',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-185985516',id=20,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMGVVYk91CF4EJNlPGJ16B9aebX0g0461zoNkayBpAbBcPtumcB5nsUcunIZSLwTkPZC3DIGJ81mZLNGLk1xqtQ18lArBUMtmLGCUS7pb+CbAh4z22M0J6OlcUXZFjAglA==',key_name='tempest-keypair-1103342865',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c018212e0654c4db442ca65a386f397',ramdisk_id='',reservation_id='r-rarysz12',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1446057763',owner_user_name='tempest-ServerActionsTestOtherB-1446057763-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:17:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecd08c449e8643c2b0eb4b2dc8cd7780',uuid=84bae51e-2a85-442d-bbd2-fc89f30f40b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27fc0374-0770-4171-a730-6696b09362eb", "address": "fa:16:3e:d1:e4:30", "network": {"id": "e38d9eed-b29b-4a4c-b084-876554dc5263", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1284740336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c018212e0654c4db442ca65a386f397", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27fc0374-07", "ovs_interfaceid": "27fc0374-0770-4171-a730-6696b09362eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:17:49 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Converting VIF {"id": "27fc0374-0770-4171-a730-6696b09362eb", "address": "fa:16:3e:d1:e4:30", "network": {"id": "e38d9eed-b29b-4a4c-b084-876554dc5263", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1284740336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c018212e0654c4db442ca65a386f397", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27fc0374-07", "ovs_interfaceid": "27fc0374-0770-4171-a730-6696b09362eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:17:49 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:e4:30,bridge_name='br-int',has_traffic_filtering=True,id=27fc0374-0770-4171-a730-6696b09362eb,network=Network(e38d9eed-b29b-4a4c-b084-876554dc5263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27fc0374-07') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:17:49 user nova-compute[75245]: DEBUG nova.objects.instance [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Lazy-loading 'pci_devices' on Instance uuid 84bae51e-2a85-442d-bbd2-fc89f30f40b7 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:17:49 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] End _get_guest_xml xml=<domain type="kvm">
Nov 29 16:17:49 user nova-compute[75245]:   <uuid>84bae51e-2a85-442d-bbd2-fc89f30f40b7</uuid>
Nov 29 16:17:49 user nova-compute[75245]:   <name>instance-00000014</name>
Nov 29 16:17:49 user nova-compute[75245]:   <memory>524288</memory>
Nov 29 16:17:49 user nova-compute[75245]:   <vcpu>1</vcpu>
Nov 29 16:17:49 user nova-compute[75245]:   <metadata>
Nov 29 16:17:49 user nova-compute[75245]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 16:17:49 user nova-compute[75245]:       <nova:package version="0.0.0"/>
Nov 29 16:17:49 user nova-compute[75245]:       <nova:name>tempest-ServerActionsTestOtherB-server-185985516</nova:name>
Nov 29 16:17:49 user nova-compute[75245]:       <nova:creationTime>2023-11-29 16:17:49</nova:creationTime>
Nov 29 16:17:49 user nova-compute[75245]:       <nova:flavor name="m1.tiny">
Nov 29 16:17:49 user nova-compute[75245]:         <nova:memory>512</nova:memory>
Nov 29 16:17:49 user nova-compute[75245]:         <nova:disk>1</nova:disk>
Nov 29 16:17:49 user nova-compute[75245]:         <nova:swap>0</nova:swap>
Nov 29 16:17:49 user nova-compute[75245]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 16:17:49 user nova-compute[75245]:         <nova:vcpus>1</nova:vcpus>
Nov 29 16:17:49 user nova-compute[75245]:       </nova:flavor>
Nov 29 16:17:49 user nova-compute[75245]:       <nova:owner>
Nov 29 16:17:49 user nova-compute[75245]:         <nova:user uuid="ecd08c449e8643c2b0eb4b2dc8cd7780">tempest-ServerActionsTestOtherB-1446057763-project-member</nova:user>
Nov 29 16:17:49 user nova-compute[75245]:         <nova:project uuid="3c018212e0654c4db442ca65a386f397">tempest-ServerActionsTestOtherB-1446057763</nova:project>
Nov 29 16:17:49 user nova-compute[75245]:       </nova:owner>
Nov 29 16:17:49 user nova-compute[75245]:       <nova:root type="image" uuid="a291d9c3-be02-4c6c-9649-4b45c5b7f487"/>
Nov 29 16:17:49 user nova-compute[75245]:       <nova:ports>
Nov 29 16:17:49 user nova-compute[75245]:         <nova:port uuid="27fc0374-0770-4171-a730-6696b09362eb">
Nov 29 16:17:49 user nova-compute[75245]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 16:17:49 user nova-compute[75245]:         </nova:port>
Nov 29 16:17:49 user nova-compute[75245]:       </nova:ports>
Nov 29 16:17:49 user nova-compute[75245]:     </nova:instance>
Nov 29 16:17:49 user nova-compute[75245]:   </metadata>
Nov 29 16:17:49 user nova-compute[75245]:   <sysinfo type="smbios">
Nov 29 16:17:49 user nova-compute[75245]:     <system>
Nov 29 16:17:49 user nova-compute[75245]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 16:17:49 user nova-compute[75245]:       <entry name="product">OpenStack Nova</entry>
Nov 29 16:17:49 user nova-compute[75245]:       <entry name="version">0.0.0</entry>
Nov 29 16:17:49 user nova-compute[75245]:       <entry name="serial">84bae51e-2a85-442d-bbd2-fc89f30f40b7</entry>
Nov 29 16:17:49 user nova-compute[75245]:       <entry name="uuid">84bae51e-2a85-442d-bbd2-fc89f30f40b7</entry>
Nov 29 16:17:49 user nova-compute[75245]:       <entry name="family">Virtual Machine</entry>
Nov 29 16:17:49 user nova-compute[75245]:     </system>
Nov 29 16:17:49 user nova-compute[75245]:   </sysinfo>
Nov 29 16:17:49 user nova-compute[75245]:   <os>
Nov 29 16:17:49 user nova-compute[75245]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 16:17:49 user nova-compute[75245]:     <boot dev="hd"/>
Nov 29 16:17:49 user nova-compute[75245]:     <smbios mode="sysinfo"/>
Nov 29 16:17:49 user nova-compute[75245]:   </os>
Nov 29 16:17:49 user nova-compute[75245]:   <features>
Nov 29 16:17:49 user nova-compute[75245]:     <acpi/>
Nov 29 16:17:49 user nova-compute[75245]:     <apic/>
Nov 29 16:17:49 user nova-compute[75245]:     <vmcoreinfo/>
Nov 29 16:17:49 user nova-compute[75245]:   </features>
Nov 29 16:17:49 user nova-compute[75245]:   <clock offset="utc">
Nov 29 16:17:49 user nova-compute[75245]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 16:17:49 user nova-compute[75245]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 16:17:49 user nova-compute[75245]:     <timer name="hpet" present="no"/>
Nov 29 16:17:49 user nova-compute[75245]:   </clock>
Nov 29 16:17:49 user nova-compute[75245]:   <cpu mode="custom" match="exact">
Nov 29 16:17:49 user nova-compute[75245]:     <model>Nehalem</model>
Nov 29 16:17:49 user nova-compute[75245]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 16:17:49 user nova-compute[75245]:   </cpu>
Nov 29 16:17:49 user nova-compute[75245]:   <devices>
Nov 29 16:17:49 user nova-compute[75245]:     <disk type="file" device="disk">
Nov 29 16:17:49 user nova-compute[75245]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 16:17:49 user nova-compute[75245]:       <source file="/opt/stack/data/nova/instances/84bae51e-2a85-442d-bbd2-fc89f30f40b7/disk"/>
Nov 29 16:17:49 user nova-compute[75245]:       <target dev="vda" bus="virtio"/>
Nov 29 16:17:49 user nova-compute[75245]:     </disk>
Nov 29 16:17:49 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 16:17:49 user nova-compute[75245]:       <mac address="fa:16:3e:d1:e4:30"/>
Nov 29 16:17:49 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:17:49 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 16:17:49 user nova-compute[75245]:       <target dev="tap27fc0374-07"/>
Nov 29 16:17:49 user nova-compute[75245]:     </interface>
Nov 29 16:17:49 user nova-compute[75245]:     <serial type="pty">
Nov 29 16:17:49 user nova-compute[75245]:       <log file="/opt/stack/data/nova/instances/84bae51e-2a85-442d-bbd2-fc89f30f40b7/console.log" append="off"/>
Nov 29 16:17:49 user nova-compute[75245]:     </serial>
Nov 29 16:17:49 user nova-compute[75245]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 16:17:49 user nova-compute[75245]:     <video>
Nov 29 16:17:49 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:17:49 user nova-compute[75245]:     </video>
Nov 29 16:17:49 user nova-compute[75245]:     <rng model="virtio">
Nov 29 16:17:49 user nova-compute[75245]:       <backend model="random">/dev/urandom</backend>
Nov 29 16:17:49 user nova-compute[75245]:     </rng>
Nov 29 16:17:49 user nova-compute[75245]:     <controller type="usb" index="0" model="none"/>
Nov 29 16:17:49 user nova-compute[75245]:     <memballoon model="virtio">
Nov 29 16:17:49 user nova-compute[75245]:       <stats period="10"/>
Nov 29 16:17:49 user nova-compute[75245]:     </memballoon>
Nov 29 16:17:49 user nova-compute[75245]:   </devices>
Nov 29 16:17:49 user nova-compute[75245]: </domain>
Nov 29 16:17:49 user nova-compute[75245]:  {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 16:17:49 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:17:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-185985516',display_name='tempest-ServerActionsTestOtherB-server-185985516',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-185985516',id=20,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMGVVYk91CF4EJNlPGJ16B9aebX0g0461zoNkayBpAbBcPtumcB5nsUcunIZSLwTkPZC3DIGJ81mZLNGLk1xqtQ18lArBUMtmLGCUS7pb+CbAh4z22M0J6OlcUXZFjAglA==',key_name='tempest-keypair-1103342865',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c018212e0654c4db442ca65a386f397',ramdisk_id='',reservation_id='r-rarysz12',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1446057763',owner_user_name='tempest-ServerActionsTestOtherB-1446057763-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:17:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecd08c449e8643c2b0eb4b2dc8cd7780',uuid=84bae51e-2a85-442d-bbd2-fc89f30f40b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27fc0374-0770-4171-a730-6696b09362eb", "address": "fa:16:3e:d1:e4:30", "network": {"id": "e38d9eed-b29b-4a4c-b084-876554dc5263", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1284740336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c018212e0654c4db442ca65a386f397", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27fc0374-07", "ovs_interfaceid": "27fc0374-0770-4171-a730-6696b09362eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 16:17:49 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Converting VIF {"id": "27fc0374-0770-4171-a730-6696b09362eb", "address": "fa:16:3e:d1:e4:30", "network": {"id": "e38d9eed-b29b-4a4c-b084-876554dc5263", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1284740336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c018212e0654c4db442ca65a386f397", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27fc0374-07", "ovs_interfaceid": "27fc0374-0770-4171-a730-6696b09362eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:17:49 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:e4:30,bridge_name='br-int',has_traffic_filtering=True,id=27fc0374-0770-4171-a730-6696b09362eb,network=Network(e38d9eed-b29b-4a4c-b084-876554dc5263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27fc0374-07') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:17:49 user nova-compute[75245]: DEBUG os_vif [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:e4:30,bridge_name='br-int',has_traffic_filtering=True,id=27fc0374-0770-4171-a730-6696b09362eb,network=Network(e38d9eed-b29b-4a4c-b084-876554dc5263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27fc0374-07') {{(pid=75245) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 16:17:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:17:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 16:17:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fb342857-b7c7-5f40-b45a-63f3fe5e782f', '_type': 'linux-noop'}}, row=False) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:17:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap27fc0374-07, may_exist=True, interface_attrs={}) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:17:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap27fc0374-07, col_values=(('qos', UUID('dbce8307-8fb1-459b-b185-17942287f4dd')),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:17:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap27fc0374-07, col_values=(('external_ids', {'iface-id': '27fc0374-0770-4171-a730-6696b09362eb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:e4:30', 'vm-uuid': '84bae51e-2a85-442d-bbd2-fc89f30f40b7'}),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:17:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:17:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:49 user nova-compute[75245]: INFO os_vif [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:e4:30,bridge_name='br-int',has_traffic_filtering=True,id=27fc0374-0770-4171-a730-6696b09362eb,network=Network(e38d9eed-b29b-4a4c-b084-876554dc5263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27fc0374-07')
Nov 29 16:17:49 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:17:49 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] No VIF found with MAC fa:16:3e:d1:e4:30, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:17:49 user nova-compute[75245]: DEBUG nova.network.neutron [req-0d997d7b-19ab-4947-b3e5-b44a3a29507c req-7ffa24af-69ed-4d0b-8416-811e330464b0 service nova] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Updated VIF entry in instance network info cache for port 27fc0374-0770-4171-a730-6696b09362eb. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:17:49 user nova-compute[75245]: DEBUG nova.network.neutron [req-0d997d7b-19ab-4947-b3e5-b44a3a29507c req-7ffa24af-69ed-4d0b-8416-811e330464b0 service nova] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Updating instance_info_cache with network_info: [{"id": "27fc0374-0770-4171-a730-6696b09362eb", "address": "fa:16:3e:d1:e4:30", "network": {"id": "e38d9eed-b29b-4a4c-b084-876554dc5263", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1284740336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c018212e0654c4db442ca65a386f397", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27fc0374-07", "ovs_interfaceid": "27fc0374-0770-4171-a730-6696b09362eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:17:49 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-0d997d7b-19ab-4947-b3e5-b44a3a29507c req-7ffa24af-69ed-4d0b-8416-811e330464b0 service nova] Releasing lock "refresh_cache-84bae51e-2a85-442d-bbd2-fc89f30f40b7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:17:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:50 user nova-compute[75245]: DEBUG nova.compute.manager [req-56860fd5-deaa-4f54-879e-7d9210702d3c req-e0820207-83a6-4a27-93ac-a136789b1952 service nova] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Received event network-vif-plugged-27fc0374-0770-4171-a730-6696b09362eb {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:17:50 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-56860fd5-deaa-4f54-879e-7d9210702d3c req-e0820207-83a6-4a27-93ac-a136789b1952 service nova] Acquiring lock "84bae51e-2a85-442d-bbd2-fc89f30f40b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:17:50 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-56860fd5-deaa-4f54-879e-7d9210702d3c req-e0820207-83a6-4a27-93ac-a136789b1952 service nova] Lock "84bae51e-2a85-442d-bbd2-fc89f30f40b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:17:50 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-56860fd5-deaa-4f54-879e-7d9210702d3c req-e0820207-83a6-4a27-93ac-a136789b1952 service nova] Lock "84bae51e-2a85-442d-bbd2-fc89f30f40b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:17:50 user nova-compute[75245]: DEBUG nova.compute.manager [req-56860fd5-deaa-4f54-879e-7d9210702d3c req-e0820207-83a6-4a27-93ac-a136789b1952 service nova] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] No waiting events found dispatching network-vif-plugged-27fc0374-0770-4171-a730-6696b09362eb {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:17:50 user nova-compute[75245]: WARNING nova.compute.manager [req-56860fd5-deaa-4f54-879e-7d9210702d3c req-e0820207-83a6-4a27-93ac-a136789b1952 service nova] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Received unexpected event network-vif-plugged-27fc0374-0770-4171-a730-6696b09362eb for instance with vm_state building and task_state spawning.
Nov 29 16:17:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:52 user nova-compute[75245]: DEBUG nova.compute.manager [req-1d341d8a-a690-45c9-aa71-122eebb8211f req-db00fc3a-6527-425a-ba3a-33ddd691865a service nova] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Received event network-vif-plugged-27fc0374-0770-4171-a730-6696b09362eb {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:17:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-1d341d8a-a690-45c9-aa71-122eebb8211f req-db00fc3a-6527-425a-ba3a-33ddd691865a service nova] Acquiring lock "84bae51e-2a85-442d-bbd2-fc89f30f40b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:17:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-1d341d8a-a690-45c9-aa71-122eebb8211f req-db00fc3a-6527-425a-ba3a-33ddd691865a service nova] Lock "84bae51e-2a85-442d-bbd2-fc89f30f40b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:17:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-1d341d8a-a690-45c9-aa71-122eebb8211f req-db00fc3a-6527-425a-ba3a-33ddd691865a service nova] Lock "84bae51e-2a85-442d-bbd2-fc89f30f40b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:17:52 user nova-compute[75245]: DEBUG nova.compute.manager [req-1d341d8a-a690-45c9-aa71-122eebb8211f req-db00fc3a-6527-425a-ba3a-33ddd691865a service nova] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] No waiting events found dispatching network-vif-plugged-27fc0374-0770-4171-a730-6696b09362eb {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:17:52 user nova-compute[75245]: WARNING nova.compute.manager [req-1d341d8a-a690-45c9-aa71-122eebb8211f req-db00fc3a-6527-425a-ba3a-33ddd691865a service nova] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Received unexpected event network-vif-plugged-27fc0374-0770-4171-a730-6696b09362eb for instance with vm_state building and task_state spawning.
Nov 29 16:17:53 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:53 user nova-compute[75245]: DEBUG nova.compute.manager [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Instance event wait completed in 0 seconds for  {{(pid=75245) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 16:17:53 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Guest created on hypervisor {{(pid=75245) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 16:17:53 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Instance spawned successfully.
Nov 29 16:17:53 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 16:17:53 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Found default for hw_cdrom_bus of ide {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:17:53 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Found default for hw_disk_bus of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:17:53 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Found default for hw_input_bus of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:17:53 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Found default for hw_pointer_model of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:17:53 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Found default for hw_video_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:17:53 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Found default for hw_vif_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:17:53 user nova-compute[75245]: INFO nova.compute.manager [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Took 5.59 seconds to spawn the instance on the hypervisor.
Nov 29 16:17:53 user nova-compute[75245]: DEBUG nova.compute.manager [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:17:53 user nova-compute[75245]: INFO nova.compute.manager [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Took 6.35 seconds to build instance.
Nov 29 16:17:53 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-f9078dea-5aa2-44fc-9d34-3c771efa6ebf tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Lock "84bae51e-2a85-442d-bbd2-fc89f30f40b7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.437s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:17:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:55 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:17:55 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:17:56 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:17:56 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:17:56 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:17:56 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:17:56 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75245) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 16:17:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/816edb0e-c4fc-470b-8151-f98502e50789/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:17:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/816edb0e-c4fc-470b-8151-f98502e50789/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:17:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/816edb0e-c4fc-470b-8151-f98502e50789/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:17:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/816edb0e-c4fc-470b-8151-f98502e50789/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:17:57 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:17:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6720dc3-07fc-43e1-ba91-75e3d26a4a0f/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:17:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6720dc3-07fc-43e1-ba91-75e3d26a4a0f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:17:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6720dc3-07fc-43e1-ba91-75e3d26a4a0f/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:17:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6720dc3-07fc-43e1-ba91-75e3d26a4a0f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:17:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd819060-4388-444d-809e-94f6b2e8f102/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:17:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd819060-4388-444d-809e-94f6b2e8f102/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:17:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd819060-4388-444d-809e-94f6b2e8f102/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:17:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd819060-4388-444d-809e-94f6b2e8f102/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:17:57 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:17:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43ead766-eeb0-4c7a-a03a-6d4daf7106af/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:17:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43ead766-eeb0-4c7a-a03a-6d4daf7106af/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:17:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43ead766-eeb0-4c7a-a03a-6d4daf7106af/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:17:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43ead766-eeb0-4c7a-a03a-6d4daf7106af/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:17:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:17:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:17:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:17:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:17:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:17:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:17:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:17:59 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:17:59 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:17:59 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bae51e-2a85-442d-bbd2-fc89f30f40b7/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:17:59 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bae51e-2a85-442d-bbd2-fc89f30f40b7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:17:59 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bae51e-2a85-442d-bbd2-fc89f30f40b7/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:17:59 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:17:59 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bae51e-2a85-442d-bbd2-fc89f30f40b7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:17:59 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:17:59 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:17:59 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Hypervisor/Node resource view: name=user free_ram=7795MB free_disk=25.43701171875GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75245) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 16:17:59 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:17:59 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:18:00 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:18:00 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance ed9a6a4e-2e7d-443c-82ef-f14f11d32c81 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:18:00 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance fd819060-4388-444d-809e-94f6b2e8f102 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:18:00 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 816edb0e-c4fc-470b-8151-f98502e50789 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:18:00 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 95b96d09-b9df-4e92-a141-f044078e4ce1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:18:00 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance f6720dc3-07fc-43e1-ba91-75e3d26a4a0f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:18:00 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 43ead766-eeb0-4c7a-a03a-6d4daf7106af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:18:00 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 84bae51e-2a85-442d-bbd2-fc89f30f40b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:18:00 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 16:18:00 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 16:18:00 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:18:00 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:18:00 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Compute_service record updated for user:user {{(pid=75245) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 16:18:00 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.395s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:18:01 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:18:01 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:18:01 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Starting heal instance info cache {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 16:18:01 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "refresh_cache-fd819060-4388-444d-809e-94f6b2e8f102" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:18:01 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquired lock "refresh_cache-fd819060-4388-444d-809e-94f6b2e8f102" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:18:01 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: fd819060-4388-444d-809e-94f6b2e8f102] Forcefully refreshing network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 16:18:02 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: fd819060-4388-444d-809e-94f6b2e8f102] Updating instance_info_cache with network_info: [{"id": "e11ba0cd-c449-4b18-a32e-41d267535482", "address": "fa:16:3e:a4:25:65", "network": {"id": "11119178-094d-4c14-8eea-233947dddfe4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1660525559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0009bdf2ef8f43a59341dd6eea441b02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape11ba0cd-c4", "ovs_interfaceid": "e11ba0cd-c449-4b18-a32e-41d267535482", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:18:02 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Releasing lock "refresh_cache-fd819060-4388-444d-809e-94f6b2e8f102" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:18:02 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: fd819060-4388-444d-809e-94f6b2e8f102] Updated the network info_cache for instance {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 16:18:02 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:18:02 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:18:02 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:18:02 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75245) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 16:18:02 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:18:03 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:18:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:18:06 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:18:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:18:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:18:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:18:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-39fa85d6-25a1-482d-8d88-a1b019201278 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Acquiring lock "95b96d09-b9df-4e92-a141-f044078e4ce1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:18:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-39fa85d6-25a1-482d-8d88-a1b019201278 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Lock "95b96d09-b9df-4e92-a141-f044078e4ce1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:18:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-39fa85d6-25a1-482d-8d88-a1b019201278 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Acquiring lock "95b96d09-b9df-4e92-a141-f044078e4ce1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:18:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-39fa85d6-25a1-482d-8d88-a1b019201278 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Lock "95b96d09-b9df-4e92-a141-f044078e4ce1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:18:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-39fa85d6-25a1-482d-8d88-a1b019201278 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Lock "95b96d09-b9df-4e92-a141-f044078e4ce1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:18:13 user nova-compute[75245]: INFO nova.compute.manager [None req-39fa85d6-25a1-482d-8d88-a1b019201278 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Terminating instance
Nov 29 16:18:13 user nova-compute[75245]: DEBUG nova.compute.manager [None req-39fa85d6-25a1-482d-8d88-a1b019201278 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Start destroying the instance on the hypervisor. {{(pid=75245) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 16:18:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:18:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:18:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:18:13 user nova-compute[75245]: DEBUG nova.compute.manager [req-18953fd8-6533-4ddf-91c3-6dc0f58d8e1e req-d0d957eb-e4a1-4f40-ac52-4c5b9796ccf5 service nova] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Received event network-vif-unplugged-35705f85-434c-481c-be8f-6182fda15267 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:18:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-18953fd8-6533-4ddf-91c3-6dc0f58d8e1e req-d0d957eb-e4a1-4f40-ac52-4c5b9796ccf5 service nova] Acquiring lock "95b96d09-b9df-4e92-a141-f044078e4ce1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:18:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-18953fd8-6533-4ddf-91c3-6dc0f58d8e1e req-d0d957eb-e4a1-4f40-ac52-4c5b9796ccf5 service nova] Lock "95b96d09-b9df-4e92-a141-f044078e4ce1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:18:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-18953fd8-6533-4ddf-91c3-6dc0f58d8e1e req-d0d957eb-e4a1-4f40-ac52-4c5b9796ccf5 service nova] Lock "95b96d09-b9df-4e92-a141-f044078e4ce1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:18:13 user nova-compute[75245]: DEBUG nova.compute.manager [req-18953fd8-6533-4ddf-91c3-6dc0f58d8e1e req-d0d957eb-e4a1-4f40-ac52-4c5b9796ccf5 service nova] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] No waiting events found dispatching network-vif-unplugged-35705f85-434c-481c-be8f-6182fda15267 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:18:13 user nova-compute[75245]: DEBUG nova.compute.manager [req-18953fd8-6533-4ddf-91c3-6dc0f58d8e1e req-d0d957eb-e4a1-4f40-ac52-4c5b9796ccf5 service nova] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Received event network-vif-unplugged-35705f85-434c-481c-be8f-6182fda15267 for instance with task_state deleting. {{(pid=75245) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 16:18:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:18:13 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Instance destroyed successfully.
Nov 29 16:18:13 user nova-compute[75245]: DEBUG nova.objects.instance [None req-39fa85d6-25a1-482d-8d88-a1b019201278 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Lazy-loading 'resources' on Instance uuid 95b96d09-b9df-4e92-a141-f044078e4ce1 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:18:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-39fa85d6-25a1-482d-8d88-a1b019201278 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T16:14:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-909618067',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1148731204',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHlR5MzIPbCau2nJtv2utk0O1W1k0aEGcfbcv1sh7yMNFDLP7hs7yhHF8D8CRcgmIp1z1EERmv0wTgIEJhrbP+HwDUzTtl9AyFgANaK56wESe9DOxRAA657EmdA7oyz8OQ==',key_name='tempest-keypair-1816958253',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:17:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7cd0053203ae489cb4bd097d7815b4e5',ramdisk_id='',reservation_id='r-if6royoq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-2087197629',owner_user_name='tempest-ServerActionsV293TestJSON-2087197629-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:17:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6753af2ac6a40d98a2e2ecf8a56c73c',uuid=95b96d09-b9df-4e92-a141-f044078e4ce1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "35705f85-434c-481c-be8f-6182fda15267", "address": "fa:16:3e:64:70:89", "network": {"id": "3e4157dc-b9ba-40de-a00e-6f4c9a3c089b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-448760355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cd0053203ae489cb4bd097d7815b4e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35705f85-43", "ovs_interfaceid": "35705f85-434c-481c-be8f-6182fda15267", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 16:18:13 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-39fa85d6-25a1-482d-8d88-a1b019201278 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Converting VIF {"id": "35705f85-434c-481c-be8f-6182fda15267", "address": "fa:16:3e:64:70:89", "network": {"id": "3e4157dc-b9ba-40de-a00e-6f4c9a3c089b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-448760355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cd0053203ae489cb4bd097d7815b4e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35705f85-43", "ovs_interfaceid": "35705f85-434c-481c-be8f-6182fda15267", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:18:13 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-39fa85d6-25a1-482d-8d88-a1b019201278 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:64:70:89,bridge_name='br-int',has_traffic_filtering=True,id=35705f85-434c-481c-be8f-6182fda15267,network=Network(3e4157dc-b9ba-40de-a00e-6f4c9a3c089b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35705f85-43') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:18:13 user nova-compute[75245]: DEBUG os_vif [None req-39fa85d6-25a1-482d-8d88-a1b019201278 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:70:89,bridge_name='br-int',has_traffic_filtering=True,id=35705f85-434c-481c-be8f-6182fda15267,network=Network(3e4157dc-b9ba-40de-a00e-6f4c9a3c089b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35705f85-43') {{(pid=75245) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 16:18:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:18:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap35705f85-43, bridge=br-int, if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:18:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:18:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:18:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:18:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b8287d0b-be48-46a1-919a-8a391b314377) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:18:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:18:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:18:13 user nova-compute[75245]: INFO os_vif [None req-39fa85d6-25a1-482d-8d88-a1b019201278 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:70:89,bridge_name='br-int',has_traffic_filtering=True,id=35705f85-434c-481c-be8f-6182fda15267,network=Network(3e4157dc-b9ba-40de-a00e-6f4c9a3c089b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35705f85-43')
Nov 29 16:18:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39fa85d6-25a1-482d-8d88-a1b019201278 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] calling os-brick to detach iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 16:18:13 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-39fa85d6-25a1-482d-8d88-a1b019201278 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, {'target_iqn': 'iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GHLbXqeE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:18:13 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-39fa85d6-25a1-482d-8d88-a1b019201278 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:18:13 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-39fa85d6-25a1-482d-8d88-a1b019201278 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:18:13 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-39fa85d6-25a1-482d-8d88-a1b019201278 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:18:13 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:18:13 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:18:13 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[22eab127-3c29-44c6-a4e2-82fbea782b40]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:18:13 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-39fa85d6-25a1-482d-8d88-a1b019201278 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 16:18:13 user nova-compute[75245]: No targets found.
Nov 29 16:18:13 user nova-compute[75245]: iSNS:
Nov 29 16:18:13 user nova-compute[75245]: No targets found.
Nov 29 16:18:13 user nova-compute[75245]: STATIC:
Nov 29 16:18:13 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026
Nov 29 16:18:13 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:18:13 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:18:13 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c
Nov 29 16:18:13 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:18:13 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:18:13 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f
Nov 29 16:18:13 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:18:13 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:18:13 user nova-compute[75245]: FIRMWARE:
Nov 29 16:18:13 user nova-compute[75245]: No targets found.
Nov 29 16:18:13 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:18:13 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-39fa85d6-25a1-482d-8d88-a1b019201278 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 16:18:13 user nova-compute[75245]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 16:18:13 user nova-compute[75245]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75245) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 16:18:13 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-39fa85d6-25a1-482d-8d88-a1b019201278 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026', 0)] {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 16:18:13 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:18:13 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:18:13 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c23be1-e17f-42d7-9da7-d59e6a7266fe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:18:13 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:18:13 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:18:13 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[94dd486b-2de0-414b-a9e8-096c38dc6751]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:18:13 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-39fa85d6-25a1-482d-8d88-a1b019201278 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f (non-flash)
Nov 29 16:18:13 user nova-compute[75245]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c (non-flash)
Nov 29 16:18:13 user nova-compute[75245]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 (non-flash)
Nov 29 16:18:13 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:18:13 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-39fa85d6-25a1-482d-8d88-a1b019201278 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f (non-flash)
Nov 29 16:18:13 user nova-compute[75245]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c (non-flash)
Nov 29 16:18:13 user nova-compute[75245]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 (non-flash)
Nov 29 16:18:13 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:18:14 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-39fa85d6-25a1-482d-8d88-a1b019201278 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0d4d43d2d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026'): ({'sdb'}, set())}) {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 16:18:14 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-39fa85d6-25a1-482d-8d88-a1b019201278 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Removing single pathed devices sdb {{(pid=75245) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 16:18:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:18:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:18:14 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9024a9f-f226-4726-9bc2-3e8b8ceb94df]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:18:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:18:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:18:14 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf87de72-13b4-4feb-b9fb-baa5dd263936]: (4, ('ok\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:18:14 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-39fa85d6-25a1-482d-8d88-a1b019201278 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Flushing IO for device /dev/sdb {{(pid=75245) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 16:18:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:18:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:18:14 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[2daa9095-3af7-49ea-989b-206b5d8d8bdb]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:18:14 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-39fa85d6-25a1-482d-8d88-a1b019201278 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75245) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 16:18:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:18:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:18:14 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bff9d15-ce7b-484b-9479-788f6523d8a5]: (4, ('1', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:18:14 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-39fa85d6-25a1-482d-8d88-a1b019201278 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 16:18:14 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-39fa85d6-25a1-482d-8d88-a1b019201278 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] SCSI volumes sdb have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 16:18:14 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-39fa85d6-25a1-482d-8d88-a1b019201278 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026')] {{(pid=75245) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 16:18:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:18:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:18:14 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c501af-109d-43b4-9a18-91fb31e661d3]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:18:14 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-39fa85d6-25a1-482d-8d88-a1b019201278 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:18:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 -p 172.16.0.220:3260 --logout {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:18:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:18:14 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[294b50de-918d-4678-a739-0abfadf7c64a]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:18:14 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-39fa85d6-25a1-482d-8d88-a1b019201278 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026, portal: 172.16.0.220,3260]
Nov 29 16:18:14 user nova-compute[75245]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026, portal: 172.16.0.220,3260] successful.
Nov 29 16:18:14 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:18:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 -p 172.16.0.220:3260 --op delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:18:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2d1dade-8389-4b92-bdd5-e4eeb4df7026 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:18:14 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b36fcd-7698-466a-af21-1260ce19d813]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:18:14 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-39fa85d6-25a1-482d-8d88-a1b019201278 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:18:14 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-39fa85d6-25a1-482d-8d88-a1b019201278 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:18:14 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-39fa85d6-25a1-482d-8d88-a1b019201278 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] <== disconnect_volume: return (330ms) None {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:18:14 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39fa85d6-25a1-482d-8d88-a1b019201278 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Disconnected iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 16:18:14 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-39fa85d6-25a1-482d-8d88-a1b019201278 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Deleting instance files /opt/stack/data/nova/instances/95b96d09-b9df-4e92-a141-f044078e4ce1_del
Nov 29 16:18:14 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-39fa85d6-25a1-482d-8d88-a1b019201278 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Deletion of /opt/stack/data/nova/instances/95b96d09-b9df-4e92-a141-f044078e4ce1_del complete
Nov 29 16:18:14 user nova-compute[75245]: INFO nova.compute.manager [None req-39fa85d6-25a1-482d-8d88-a1b019201278 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Took 1.24 seconds to destroy the instance on the hypervisor.
Nov 29 16:18:14 user nova-compute[75245]: DEBUG oslo.service.loopingcall [None req-39fa85d6-25a1-482d-8d88-a1b019201278 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75245) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 16:18:14 user nova-compute[75245]: DEBUG nova.compute.manager [-] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Deallocating network for instance {{(pid=75245) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 16:18:14 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] deallocate_for_instance() {{(pid=75245) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 16:18:15 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:18:15 user nova-compute[75245]: INFO nova.compute.manager [-] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Took 0.68 seconds to deallocate network for instance.
Nov 29 16:18:15 user nova-compute[75245]: DEBUG nova.compute.manager [req-946e8466-a861-42c4-b61f-c0fe0e3e5978 req-09efac7a-81ff-44dc-b817-459483945c30 service nova] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Received event network-vif-plugged-35705f85-434c-481c-be8f-6182fda15267 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:18:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-946e8466-a861-42c4-b61f-c0fe0e3e5978 req-09efac7a-81ff-44dc-b817-459483945c30 service nova] Acquiring lock "95b96d09-b9df-4e92-a141-f044078e4ce1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:18:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-946e8466-a861-42c4-b61f-c0fe0e3e5978 req-09efac7a-81ff-44dc-b817-459483945c30 service nova] Lock "95b96d09-b9df-4e92-a141-f044078e4ce1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:18:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-946e8466-a861-42c4-b61f-c0fe0e3e5978 req-09efac7a-81ff-44dc-b817-459483945c30 service nova] Lock "95b96d09-b9df-4e92-a141-f044078e4ce1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:18:15 user nova-compute[75245]: DEBUG nova.compute.manager [req-946e8466-a861-42c4-b61f-c0fe0e3e5978 req-09efac7a-81ff-44dc-b817-459483945c30 service nova] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] No waiting events found dispatching network-vif-plugged-35705f85-434c-481c-be8f-6182fda15267 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:18:15 user nova-compute[75245]: WARNING nova.compute.manager [req-946e8466-a861-42c4-b61f-c0fe0e3e5978 req-09efac7a-81ff-44dc-b817-459483945c30 service nova] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Received unexpected event network-vif-plugged-35705f85-434c-481c-be8f-6182fda15267 for instance with vm_state active and task_state deleting.
Nov 29 16:18:15 user nova-compute[75245]: DEBUG nova.compute.manager [req-946e8466-a861-42c4-b61f-c0fe0e3e5978 req-09efac7a-81ff-44dc-b817-459483945c30 service nova] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Received event network-vif-deleted-35705f85-434c-481c-be8f-6182fda15267 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:18:15 user nova-compute[75245]: INFO nova.compute.manager [None req-39fa85d6-25a1-482d-8d88-a1b019201278 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Took 0.75 seconds to detach 1 volumes for instance.
Nov 29 16:18:15 user nova-compute[75245]: DEBUG nova.compute.manager [None req-39fa85d6-25a1-482d-8d88-a1b019201278 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] [instance: 95b96d09-b9df-4e92-a141-f044078e4ce1] Deleting volume: f2d1dade-8389-4b92-bdd5-e4eeb4df7026 {{(pid=75245) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 29 16:18:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-39fa85d6-25a1-482d-8d88-a1b019201278 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:18:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-39fa85d6-25a1-482d-8d88-a1b019201278 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:18:16 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-9fadcc65-9519-4c0d-b82b-78f3ca10b36f tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Acquiring lock "fd819060-4388-444d-809e-94f6b2e8f102" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:18:16 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-9fadcc65-9519-4c0d-b82b-78f3ca10b36f tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Lock "fd819060-4388-444d-809e-94f6b2e8f102" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:18:16 user nova-compute[75245]: INFO nova.compute.manager [None req-9fadcc65-9519-4c0d-b82b-78f3ca10b36f tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] [instance: fd819060-4388-444d-809e-94f6b2e8f102] Detaching volume 6756bb27-a338-4643-9c32-aa6a83de210f
Nov 29 16:18:16 user nova-compute[75245]: INFO nova.virt.block_device [None req-9fadcc65-9519-4c0d-b82b-78f3ca10b36f tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] [instance: fd819060-4388-444d-809e-94f6b2e8f102] Attempting to driver detach volume 6756bb27-a338-4643-9c32-aa6a83de210f from mountpoint /dev/vdb
Nov 29 16:18:16 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-9fadcc65-9519-4c0d-b82b-78f3ca10b36f tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Attempting to detach device vdb from instance fd819060-4388-444d-809e-94f6b2e8f102 from the persistent domain config. {{(pid=75245) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 16:18:16 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-9fadcc65-9519-4c0d-b82b-78f3ca10b36f tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 16:18:16 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:18:16 user nova-compute[75245]:   <source dev="/dev/sdi"/>
Nov 29 16:18:16 user nova-compute[75245]:   <target dev="vdb" bus="virtio"/>
Nov 29 16:18:16 user nova-compute[75245]:   <serial>6756bb27-a338-4643-9c32-aa6a83de210f</serial>
Nov 29 16:18:16 user nova-compute[75245]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 16:18:16 user nova-compute[75245]: </disk>
Nov 29 16:18:16 user nova-compute[75245]:  {{(pid=75245) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 16:18:16 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-9fadcc65-9519-4c0d-b82b-78f3ca10b36f tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Successfully detached device vdb from instance fd819060-4388-444d-809e-94f6b2e8f102 from the persistent domain config.
Nov 29 16:18:16 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-9fadcc65-9519-4c0d-b82b-78f3ca10b36f tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fd819060-4388-444d-809e-94f6b2e8f102 from the live domain config. {{(pid=75245) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 16:18:16 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-9fadcc65-9519-4c0d-b82b-78f3ca10b36f tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 16:18:16 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:18:16 user nova-compute[75245]:   <source dev="/dev/sdi"/>
Nov 29 16:18:16 user nova-compute[75245]:   <target dev="vdb" bus="virtio"/>
Nov 29 16:18:16 user nova-compute[75245]:   <serial>6756bb27-a338-4643-9c32-aa6a83de210f</serial>
Nov 29 16:18:16 user nova-compute[75245]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 16:18:16 user nova-compute[75245]: </disk>
Nov 29 16:18:16 user nova-compute[75245]:  {{(pid=75245) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 16:18:16 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-39fa85d6-25a1-482d-8d88-a1b019201278 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:18:16 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-39fa85d6-25a1-482d-8d88-a1b019201278 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:18:16 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-39fa85d6-25a1-482d-8d88-a1b019201278 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.409s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:18:16 user nova-compute[75245]: INFO nova.scheduler.client.report [None req-39fa85d6-25a1-482d-8d88-a1b019201278 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Deleted allocations for instance 95b96d09-b9df-4e92-a141-f044078e4ce1
Nov 29 16:18:16 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-39fa85d6-25a1-482d-8d88-a1b019201278 tempest-ServerActionsV293TestJSON-2087197629 tempest-ServerActionsV293TestJSON-2087197629-project-member] Lock "95b96d09-b9df-4e92-a141-f044078e4ce1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.351s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:18:16 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-9fadcc65-9519-4c0d-b82b-78f3ca10b36f tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fd819060-4388-444d-809e-94f6b2e8f102 {{(pid=75245) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 16:18:18 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:18:18 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:18:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:18:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:18:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:18:33 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:18:33 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:18:33 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75245) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 16:18:33 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:18:33 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:18:33 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:18:36 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:18:36 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-9fadcc65-9519-4c0d-b82b-78f3ca10b36f tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fd819060-4388-444d-809e-94f6b2e8f102 is timed out.
Nov 29 16:18:36 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-9fadcc65-9519-4c0d-b82b-78f3ca10b36f tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Successfully detached device vdb from instance fd819060-4388-444d-809e-94f6b2e8f102 from the live domain config.
Nov 29 16:18:36 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9fadcc65-9519-4c0d-b82b-78f3ca10b36f tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] [instance: fd819060-4388-444d-809e-94f6b2e8f102] calling os-brick to detach iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 16:18:36 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fadcc65-9519-4c0d-b82b-78f3ca10b36f tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, {'target_iqn': 'iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IpewjSOb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:18:36 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-9fadcc65-9519-4c0d-b82b-78f3ca10b36f tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:18:36 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-9fadcc65-9519-4c0d-b82b-78f3ca10b36f tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:18:36 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-9fadcc65-9519-4c0d-b82b-78f3ca10b36f tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:18:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:18:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:18:36 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25242bf-d6c2-4390-91e9-2d56f0f6d782]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:18:36 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fadcc65-9519-4c0d-b82b-78f3ca10b36f tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 16:18:36 user nova-compute[75245]: No targets found.
Nov 29 16:18:36 user nova-compute[75245]: iSNS:
Nov 29 16:18:36 user nova-compute[75245]: No targets found.
Nov 29 16:18:36 user nova-compute[75245]: STATIC:
Nov 29 16:18:36 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c
Nov 29 16:18:36 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:18:36 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:18:36 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f
Nov 29 16:18:36 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:18:36 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:18:36 user nova-compute[75245]: FIRMWARE:
Nov 29 16:18:36 user nova-compute[75245]: No targets found.
Nov 29 16:18:36 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:18:36 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fadcc65-9519-4c0d-b82b-78f3ca10b36f tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 16:18:36 user nova-compute[75245]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 16:18:36 user nova-compute[75245]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75245) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 16:18:36 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fadcc65-9519-4c0d-b82b-78f3ca10b36f tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f', 0)] {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 16:18:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:18:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:18:36 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d4afab-21e9-4cfa-9a42-299b43de97c3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:18:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:18:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:18:36 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab1dbaf-2c42-44c3-ac37-12a9f1e7b883]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:18:36 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fadcc65-9519-4c0d-b82b-78f3ca10b36f tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f (non-flash)
Nov 29 16:18:36 user nova-compute[75245]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c (non-flash)
Nov 29 16:18:36 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:18:36 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fadcc65-9519-4c0d-b82b-78f3ca10b36f tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f (non-flash)
Nov 29 16:18:36 user nova-compute[75245]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c (non-flash)
Nov 29 16:18:36 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:18:36 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fadcc65-9519-4c0d-b82b-78f3ca10b36f tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0d4c1fa7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f'): ({'sdi'}, set())}) {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 16:18:36 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-9fadcc65-9519-4c0d-b82b-78f3ca10b36f tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Removing single pathed devices sdi {{(pid=75245) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 16:18:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:18:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:18:36 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e643d3-6da2-476e-a118-595c74c6c13a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:18:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:18:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.023s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:18:36 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde59598-81ea-4328-92c0-72e31bbf4b0c]: (4, ('ok\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:18:36 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-9fadcc65-9519-4c0d-b82b-78f3ca10b36f tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Flushing IO for device /dev/sdi {{(pid=75245) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 16:18:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:18:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:18:36 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[34adcfeb-f30e-4703-a103-626590e02f37]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:18:36 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-9fadcc65-9519-4c0d-b82b-78f3ca10b36f tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75245) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 16:18:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:18:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.055s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:18:36 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[4505ab29-fe84-40f6-8042-9588cdf23b00]: (4, ('1', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:18:36 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-9fadcc65-9519-4c0d-b82b-78f3ca10b36f tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 16:18:36 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-9fadcc65-9519-4c0d-b82b-78f3ca10b36f tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] SCSI volumes sdi have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 16:18:36 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fadcc65-9519-4c0d-b82b-78f3ca10b36f tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f')] {{(pid=75245) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 16:18:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:18:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:18:36 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f25818-9e13-461b-a86b-bbc66ef216ba]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:18:36 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fadcc65-9519-4c0d-b82b-78f3ca10b36f tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:18:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f -p 172.16.0.220:3260 --logout {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:18:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:18:36 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d648a6-924e-4d70-b671-9bc8c0ac77b6]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:18:36 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fadcc65-9519-4c0d-b82b-78f3ca10b36f tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f, portal: 172.16.0.220,3260]
Nov 29 16:18:36 user nova-compute[75245]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f, portal: 172.16.0.220,3260] successful.
Nov 29 16:18:36 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:18:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f -p 172.16.0.220:3260 --op delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:18:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6756bb27-a338-4643-9c32-aa6a83de210f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:18:36 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f85ebdc-0a43-42ab-ad38-6d739d394168]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:18:36 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fadcc65-9519-4c0d-b82b-78f3ca10b36f tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:18:36 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-9fadcc65-9519-4c0d-b82b-78f3ca10b36f tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:18:36 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fadcc65-9519-4c0d-b82b-78f3ca10b36f tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] <== disconnect_volume: return (323ms) None {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:18:36 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9fadcc65-9519-4c0d-b82b-78f3ca10b36f tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] [instance: fd819060-4388-444d-809e-94f6b2e8f102] Disconnected iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 16:18:37 user nova-compute[75245]: DEBUG nova.objects.instance [None req-9fadcc65-9519-4c0d-b82b-78f3ca10b36f tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Lazy-loading 'flavor' on Instance uuid fd819060-4388-444d-809e-94f6b2e8f102 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:18:37 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-9fadcc65-9519-4c0d-b82b-78f3ca10b36f tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Lock "fd819060-4388-444d-809e-94f6b2e8f102" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.851s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:18:38 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:18:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:18:43 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:18:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:18:46 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3811459b-ced9-4e27-8b36-e6a76e1d12f7 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Acquiring lock "816edb0e-c4fc-470b-8151-f98502e50789" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:18:46 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3811459b-ced9-4e27-8b36-e6a76e1d12f7 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "816edb0e-c4fc-470b-8151-f98502e50789" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:18:46 user nova-compute[75245]: INFO nova.compute.manager [None req-3811459b-ced9-4e27-8b36-e6a76e1d12f7 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Detaching volume 6a84dd1c-3444-4e5d-ae8f-654a1901737c
Nov 29 16:18:46 user nova-compute[75245]: INFO nova.virt.block_device [None req-3811459b-ced9-4e27-8b36-e6a76e1d12f7 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Attempting to driver detach volume 6a84dd1c-3444-4e5d-ae8f-654a1901737c from mountpoint /dev/vdb
Nov 29 16:18:46 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-3811459b-ced9-4e27-8b36-e6a76e1d12f7 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Attempting to detach device vdb from instance 816edb0e-c4fc-470b-8151-f98502e50789 from the persistent domain config. {{(pid=75245) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 16:18:46 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-3811459b-ced9-4e27-8b36-e6a76e1d12f7 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 16:18:46 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:18:46 user nova-compute[75245]:   <source dev="/dev/sdc"/>
Nov 29 16:18:46 user nova-compute[75245]:   <target dev="vdb" bus="virtio"/>
Nov 29 16:18:46 user nova-compute[75245]:   <serial>6a84dd1c-3444-4e5d-ae8f-654a1901737c</serial>
Nov 29 16:18:46 user nova-compute[75245]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 16:18:46 user nova-compute[75245]: </disk>
Nov 29 16:18:46 user nova-compute[75245]:  {{(pid=75245) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 16:18:46 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-3811459b-ced9-4e27-8b36-e6a76e1d12f7 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Successfully detached device vdb from instance 816edb0e-c4fc-470b-8151-f98502e50789 from the persistent domain config.
Nov 29 16:18:46 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-3811459b-ced9-4e27-8b36-e6a76e1d12f7 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 816edb0e-c4fc-470b-8151-f98502e50789 from the live domain config. {{(pid=75245) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 16:18:46 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-3811459b-ced9-4e27-8b36-e6a76e1d12f7 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 16:18:46 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:18:46 user nova-compute[75245]:   <source dev="/dev/sdc"/>
Nov 29 16:18:46 user nova-compute[75245]:   <target dev="vdb" bus="virtio"/>
Nov 29 16:18:46 user nova-compute[75245]:   <serial>6a84dd1c-3444-4e5d-ae8f-654a1901737c</serial>
Nov 29 16:18:46 user nova-compute[75245]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 16:18:46 user nova-compute[75245]: </disk>
Nov 29 16:18:46 user nova-compute[75245]:  {{(pid=75245) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 16:18:46 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-44e1b0e2-5b9d-4dd0-b756-63c988d2d97e tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Acquiring lock "6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:18:46 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-44e1b0e2-5b9d-4dd0-b756-63c988d2d97e tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Lock "6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:18:46 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-44e1b0e2-5b9d-4dd0-b756-63c988d2d97e tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Acquiring lock "6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:18:46 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-44e1b0e2-5b9d-4dd0-b756-63c988d2d97e tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Lock "6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:18:46 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-44e1b0e2-5b9d-4dd0-b756-63c988d2d97e tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Lock "6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:18:46 user nova-compute[75245]: INFO nova.compute.manager [None req-44e1b0e2-5b9d-4dd0-b756-63c988d2d97e tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] [instance: 6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7] Terminating instance
Nov 29 16:18:46 user nova-compute[75245]: DEBUG nova.compute.manager [None req-44e1b0e2-5b9d-4dd0-b756-63c988d2d97e tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] [instance: 6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7] Start destroying the instance on the hypervisor. {{(pid=75245) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 16:18:46 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:18:46 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:18:46 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:18:46 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:18:46 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-3811459b-ced9-4e27-8b36-e6a76e1d12f7 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 816edb0e-c4fc-470b-8151-f98502e50789 {{(pid=75245) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 16:18:46 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:18:47 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7] Instance destroyed successfully.
Nov 29 16:18:47 user nova-compute[75245]: DEBUG nova.objects.instance [None req-44e1b0e2-5b9d-4dd0-b756-63c988d2d97e tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Lazy-loading 'resources' on Instance uuid 6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:18:47 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-44e1b0e2-5b9d-4dd0-b756-63c988d2d97e tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:09:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1366697277',display_name='tempest-ServersNegativeTestJSON-server-1366697277',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1366697277',id=2,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:10:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='17fcceabdcb74404971adda76fd4e48d',ramdisk_id='',reservation_id='r-mqw20ccf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1566439864',owner_user_name='tempest-ServersNegativeTestJSON-1566439864-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:10:13Z,user_data=None,user_id='97d9ea0d0a1842649850d631bed11ac1',uuid=6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "de56e47e-57ae-4e15-9d07-57eca8971e14", "address": "fa:16:3e:cc:b6:56", "network": {"id": "04f30281-e256-4d60-82d2-89004740b1b8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-649945802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17fcceabdcb74404971adda76fd4e48d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde56e47e-57", "ovs_interfaceid": "de56e47e-57ae-4e15-9d07-57eca8971e14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 16:18:47 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-44e1b0e2-5b9d-4dd0-b756-63c988d2d97e tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Converting VIF {"id": "de56e47e-57ae-4e15-9d07-57eca8971e14", "address": "fa:16:3e:cc:b6:56", "network": {"id": "04f30281-e256-4d60-82d2-89004740b1b8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-649945802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17fcceabdcb74404971adda76fd4e48d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde56e47e-57", "ovs_interfaceid": "de56e47e-57ae-4e15-9d07-57eca8971e14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:18:47 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-44e1b0e2-5b9d-4dd0-b756-63c988d2d97e tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cc:b6:56,bridge_name='br-int',has_traffic_filtering=True,id=de56e47e-57ae-4e15-9d07-57eca8971e14,network=Network(04f30281-e256-4d60-82d2-89004740b1b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde56e47e-57') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:18:47 user nova-compute[75245]: DEBUG os_vif [None req-44e1b0e2-5b9d-4dd0-b756-63c988d2d97e tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:b6:56,bridge_name='br-int',has_traffic_filtering=True,id=de56e47e-57ae-4e15-9d07-57eca8971e14,network=Network(04f30281-e256-4d60-82d2-89004740b1b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde56e47e-57') {{(pid=75245) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 16:18:47 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:18:47 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapde56e47e-57, bridge=br-int, if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:18:47 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:18:47 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:18:47 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:18:47 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dae1e128-df4e-4693-ac27-db848fb4a53d) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:18:47 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:18:47 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:18:47 user nova-compute[75245]: INFO os_vif [None req-44e1b0e2-5b9d-4dd0-b756-63c988d2d97e tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:b6:56,bridge_name='br-int',has_traffic_filtering=True,id=de56e47e-57ae-4e15-9d07-57eca8971e14,network=Network(04f30281-e256-4d60-82d2-89004740b1b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde56e47e-57')
Nov 29 16:18:47 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-44e1b0e2-5b9d-4dd0-b756-63c988d2d97e tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] [instance: 6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7] Deleting instance files /opt/stack/data/nova/instances/6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7_del
Nov 29 16:18:47 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-44e1b0e2-5b9d-4dd0-b756-63c988d2d97e tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] [instance: 6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7] Deletion of /opt/stack/data/nova/instances/6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7_del complete
Nov 29 16:18:47 user nova-compute[75245]: INFO nova.compute.manager [None req-44e1b0e2-5b9d-4dd0-b756-63c988d2d97e tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] [instance: 6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 29 16:18:47 user nova-compute[75245]: DEBUG oslo.service.loopingcall [None req-44e1b0e2-5b9d-4dd0-b756-63c988d2d97e tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75245) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 16:18:47 user nova-compute[75245]: DEBUG nova.compute.manager [-] [instance: 6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7] Deallocating network for instance {{(pid=75245) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 16:18:47 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: 6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7] deallocate_for_instance() {{(pid=75245) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 16:18:47 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: 6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:18:47 user nova-compute[75245]: INFO nova.compute.manager [-] [instance: 6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7] Took 0.49 seconds to deallocate network for instance.
Nov 29 16:18:47 user nova-compute[75245]: DEBUG nova.compute.manager [req-b0bd3280-c176-4fc9-a7cf-0b2849ea8f71 req-743f09e7-bbb1-4845-b0cb-45d5ef7c64dc service nova] [instance: 6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7] Received event network-vif-deleted-de56e47e-57ae-4e15-9d07-57eca8971e14 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:18:47 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-44e1b0e2-5b9d-4dd0-b756-63c988d2d97e tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:18:47 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-44e1b0e2-5b9d-4dd0-b756-63c988d2d97e tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:18:48 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-44e1b0e2-5b9d-4dd0-b756-63c988d2d97e tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:18:48 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-44e1b0e2-5b9d-4dd0-b756-63c988d2d97e tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:18:48 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:18:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-44e1b0e2-5b9d-4dd0-b756-63c988d2d97e tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.251s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:18:48 user nova-compute[75245]: INFO nova.scheduler.client.report [None req-44e1b0e2-5b9d-4dd0-b756-63c988d2d97e tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Deleted allocations for instance 6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7
Nov 29 16:18:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Acquiring lock "8785a3c2-5b7a-4382-b50d-cecd8743329c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:18:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "8785a3c2-5b7a-4382-b50d-cecd8743329c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:18:48 user nova-compute[75245]: DEBUG nova.compute.manager [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Starting instance... {{(pid=75245) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 16:18:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-44e1b0e2-5b9d-4dd0-b756-63c988d2d97e tempest-ServersNegativeTestJSON-1566439864 tempest-ServersNegativeTestJSON-1566439864-project-member] Lock "6a8fcf91-e074-4c2f-b2a8-b20321e8c1c7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.826s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:18:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:18:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:18:48 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75245) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 16:18:48 user nova-compute[75245]: INFO nova.compute.claims [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Claim successful on node user
Nov 29 16:18:48 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:18:48 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:18:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.323s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:18:48 user nova-compute[75245]: DEBUG nova.compute.manager [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Start building networks asynchronously for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 16:18:48 user nova-compute[75245]: DEBUG nova.compute.manager [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Allocating IP information in the background. {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 16:18:48 user nova-compute[75245]: DEBUG nova.network.neutron [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] allocate_for_instance() {{(pid=75245) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 16:18:48 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 16:18:48 user nova-compute[75245]: DEBUG nova.compute.manager [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Start building block device mappings for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 16:18:48 user nova-compute[75245]: DEBUG nova.policy [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4f20e7c9ae22462ea6bc623c93697fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d52776451e947f5a9ef3fa44ac8acbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75245) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 16:18:48 user nova-compute[75245]: DEBUG nova.compute.manager [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Start spawning the instance on the hypervisor. {{(pid=75245) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 16:18:48 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Creating instance directory {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 16:18:48 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Creating image(s)
Nov 29 16:18:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Acquiring lock "/opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:18:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "/opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:18:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "/opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:18:48 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:18:49 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.212s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:18:49 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Acquiring lock "d654f7206043e05d3525550b0fc885556eb999f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:18:49 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:18:49 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:18:49 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.178s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:18:49 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk 1073741824 {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:18:49 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk 1073741824" returned: 0 in 0.061s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:18:49 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:18:49 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:18:49 user nova-compute[75245]: DEBUG nova.network.neutron [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Successfully created port: 8c7418c2-2459-4bc3-acfb-16df97c78f67 {{(pid=75245) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 16:18:49 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.178s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:18:49 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk. size=1073741824 {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 16:18:49 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:18:49 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:18:49 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Cannot resize image /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk to a smaller size. {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 16:18:49 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Created local disks {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 16:18:49 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Ensure instance console log exists: /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/console.log {{(pid=75245) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 16:18:49 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:18:49 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:18:49 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:18:49 user nova-compute[75245]: DEBUG nova.network.neutron [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Successfully updated port: 8c7418c2-2459-4bc3-acfb-16df97c78f67 {{(pid=75245) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 16:18:49 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Acquiring lock "refresh_cache-8785a3c2-5b7a-4382-b50d-cecd8743329c" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:18:49 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Acquired lock "refresh_cache-8785a3c2-5b7a-4382-b50d-cecd8743329c" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:18:49 user nova-compute[75245]: DEBUG nova.network.neutron [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 16:18:49 user nova-compute[75245]: DEBUG nova.compute.manager [req-4a644c2d-44b3-4a03-b6dd-75bd56cd621c req-600adb75-98d0-40c8-a946-dc8b5b1890eb service nova] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Received event network-changed-8c7418c2-2459-4bc3-acfb-16df97c78f67 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:18:49 user nova-compute[75245]: DEBUG nova.compute.manager [req-4a644c2d-44b3-4a03-b6dd-75bd56cd621c req-600adb75-98d0-40c8-a946-dc8b5b1890eb service nova] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Refreshing instance network info cache due to event network-changed-8c7418c2-2459-4bc3-acfb-16df97c78f67. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:18:49 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-4a644c2d-44b3-4a03-b6dd-75bd56cd621c req-600adb75-98d0-40c8-a946-dc8b5b1890eb service nova] Acquiring lock "refresh_cache-8785a3c2-5b7a-4382-b50d-cecd8743329c" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:18:50 user nova-compute[75245]: DEBUG nova.network.neutron [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Instance cache missing network info. {{(pid=75245) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 16:18:50 user nova-compute[75245]: DEBUG nova.network.neutron [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Updating instance_info_cache with network_info: [{"id": "8c7418c2-2459-4bc3-acfb-16df97c78f67", "address": "fa:16:3e:82:d0:d8", "network": {"id": "6a7f7426-b595-4aa3-bf80-cc92ba7ce15e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-917300903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d52776451e947f5a9ef3fa44ac8acbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7418c2-24", "ovs_interfaceid": "8c7418c2-2459-4bc3-acfb-16df97c78f67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:18:50 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Releasing lock "refresh_cache-8785a3c2-5b7a-4382-b50d-cecd8743329c" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:18:50 user nova-compute[75245]: DEBUG nova.compute.manager [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Instance network_info: |[{"id": "8c7418c2-2459-4bc3-acfb-16df97c78f67", "address": "fa:16:3e:82:d0:d8", "network": {"id": "6a7f7426-b595-4aa3-bf80-cc92ba7ce15e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-917300903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d52776451e947f5a9ef3fa44ac8acbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7418c2-24", "ovs_interfaceid": "8c7418c2-2459-4bc3-acfb-16df97c78f67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 16:18:50 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-4a644c2d-44b3-4a03-b6dd-75bd56cd621c req-600adb75-98d0-40c8-a946-dc8b5b1890eb service nova] Acquired lock "refresh_cache-8785a3c2-5b7a-4382-b50d-cecd8743329c" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:18:50 user nova-compute[75245]: DEBUG nova.network.neutron [req-4a644c2d-44b3-4a03-b6dd-75bd56cd621c req-600adb75-98d0-40c8-a946-dc8b5b1890eb service nova] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Refreshing network info cache for port 8c7418c2-2459-4bc3-acfb-16df97c78f67 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:18:50 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Start _get_guest_xml network_info=[{"id": "8c7418c2-2459-4bc3-acfb-16df97c78f67", "address": "fa:16:3e:82:d0:d8", "network": {"id": "6a7f7426-b595-4aa3-bf80-cc92ba7ce15e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-917300903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d52776451e947f5a9ef3fa44ac8acbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7418c2-24", "ovs_interfaceid": "8c7418c2-2459-4bc3-acfb-16df97c78f67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'a291d9c3-be02-4c6c-9649-4b45c5b7f487'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 16:18:50 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:18:50 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:18:50 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 16:18:50 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] CPU controller missing on host. {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 16:18:50 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 16:18:50 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] CPU controller found on host. {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 16:18:50 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75245) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 16:18:50 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T16:06:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 16:18:50 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Flavor limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 16:18:50 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Image limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 16:18:50 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Flavor pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 16:18:50 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Image pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 16:18:50 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 16:18:50 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 16:18:50 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 16:18:50 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Got 1 possible topologies {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 16:18:50 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 16:18:50 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 16:18:50 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:18:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-908755378',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-908755378',id=21,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d52776451e947f5a9ef3fa44ac8acbb',ramdisk_id='',reservation_id='r-ehafhgpq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1780163218',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:18:49Z,user_data=None,user_id='4f20e7c9ae22462ea6bc623c93697fce',uuid=8785a3c2-5b7a-4382-b50d-cecd8743329c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c7418c2-2459-4bc3-acfb-16df97c78f67", "address": "fa:16:3e:82:d0:d8", "network": {"id": "6a7f7426-b595-4aa3-bf80-cc92ba7ce15e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-917300903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d52776451e947f5a9ef3fa44ac8acbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7418c2-24", "ovs_interfaceid": "8c7418c2-2459-4bc3-acfb-16df97c78f67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:18:50 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Converting VIF {"id": "8c7418c2-2459-4bc3-acfb-16df97c78f67", "address": "fa:16:3e:82:d0:d8", "network": {"id": "6a7f7426-b595-4aa3-bf80-cc92ba7ce15e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-917300903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d52776451e947f5a9ef3fa44ac8acbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7418c2-24", "ovs_interfaceid": "8c7418c2-2459-4bc3-acfb-16df97c78f67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:18:50 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:d0:d8,bridge_name='br-int',has_traffic_filtering=True,id=8c7418c2-2459-4bc3-acfb-16df97c78f67,network=Network(6a7f7426-b595-4aa3-bf80-cc92ba7ce15e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c7418c2-24') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:18:50 user nova-compute[75245]: DEBUG nova.objects.instance [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lazy-loading 'pci_devices' on Instance uuid 8785a3c2-5b7a-4382-b50d-cecd8743329c {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:18:50 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] End _get_guest_xml xml=<domain type="kvm">
Nov 29 16:18:50 user nova-compute[75245]:   <uuid>8785a3c2-5b7a-4382-b50d-cecd8743329c</uuid>
Nov 29 16:18:50 user nova-compute[75245]:   <name>instance-00000015</name>
Nov 29 16:18:50 user nova-compute[75245]:   <memory>524288</memory>
Nov 29 16:18:50 user nova-compute[75245]:   <vcpu>1</vcpu>
Nov 29 16:18:50 user nova-compute[75245]:   <metadata>
Nov 29 16:18:50 user nova-compute[75245]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 16:18:50 user nova-compute[75245]:       <nova:package version="0.0.0"/>
Nov 29 16:18:50 user nova-compute[75245]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-908755378</nova:name>
Nov 29 16:18:50 user nova-compute[75245]:       <nova:creationTime>2023-11-29 16:18:50</nova:creationTime>
Nov 29 16:18:50 user nova-compute[75245]:       <nova:flavor name="m1.tiny">
Nov 29 16:18:50 user nova-compute[75245]:         <nova:memory>512</nova:memory>
Nov 29 16:18:50 user nova-compute[75245]:         <nova:disk>1</nova:disk>
Nov 29 16:18:50 user nova-compute[75245]:         <nova:swap>0</nova:swap>
Nov 29 16:18:50 user nova-compute[75245]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 16:18:50 user nova-compute[75245]:         <nova:vcpus>1</nova:vcpus>
Nov 29 16:18:50 user nova-compute[75245]:       </nova:flavor>
Nov 29 16:18:50 user nova-compute[75245]:       <nova:owner>
Nov 29 16:18:50 user nova-compute[75245]:         <nova:user uuid="4f20e7c9ae22462ea6bc623c93697fce">tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member</nova:user>
Nov 29 16:18:50 user nova-compute[75245]:         <nova:project uuid="1d52776451e947f5a9ef3fa44ac8acbb">tempest-ServerBootFromVolumeStableRescueTest-1780163218</nova:project>
Nov 29 16:18:50 user nova-compute[75245]:       </nova:owner>
Nov 29 16:18:50 user nova-compute[75245]:       <nova:root type="image" uuid="a291d9c3-be02-4c6c-9649-4b45c5b7f487"/>
Nov 29 16:18:50 user nova-compute[75245]:       <nova:ports>
Nov 29 16:18:50 user nova-compute[75245]:         <nova:port uuid="8c7418c2-2459-4bc3-acfb-16df97c78f67">
Nov 29 16:18:50 user nova-compute[75245]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 29 16:18:50 user nova-compute[75245]:         </nova:port>
Nov 29 16:18:50 user nova-compute[75245]:       </nova:ports>
Nov 29 16:18:50 user nova-compute[75245]:     </nova:instance>
Nov 29 16:18:50 user nova-compute[75245]:   </metadata>
Nov 29 16:18:50 user nova-compute[75245]:   <sysinfo type="smbios">
Nov 29 16:18:50 user nova-compute[75245]:     <system>
Nov 29 16:18:50 user nova-compute[75245]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 16:18:50 user nova-compute[75245]:       <entry name="product">OpenStack Nova</entry>
Nov 29 16:18:50 user nova-compute[75245]:       <entry name="version">0.0.0</entry>
Nov 29 16:18:50 user nova-compute[75245]:       <entry name="serial">8785a3c2-5b7a-4382-b50d-cecd8743329c</entry>
Nov 29 16:18:50 user nova-compute[75245]:       <entry name="uuid">8785a3c2-5b7a-4382-b50d-cecd8743329c</entry>
Nov 29 16:18:50 user nova-compute[75245]:       <entry name="family">Virtual Machine</entry>
Nov 29 16:18:50 user nova-compute[75245]:     </system>
Nov 29 16:18:50 user nova-compute[75245]:   </sysinfo>
Nov 29 16:18:50 user nova-compute[75245]:   <os>
Nov 29 16:18:50 user nova-compute[75245]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 16:18:50 user nova-compute[75245]:     <boot dev="hd"/>
Nov 29 16:18:50 user nova-compute[75245]:     <smbios mode="sysinfo"/>
Nov 29 16:18:50 user nova-compute[75245]:   </os>
Nov 29 16:18:50 user nova-compute[75245]:   <features>
Nov 29 16:18:50 user nova-compute[75245]:     <acpi/>
Nov 29 16:18:50 user nova-compute[75245]:     <apic/>
Nov 29 16:18:50 user nova-compute[75245]:     <vmcoreinfo/>
Nov 29 16:18:50 user nova-compute[75245]:   </features>
Nov 29 16:18:50 user nova-compute[75245]:   <clock offset="utc">
Nov 29 16:18:50 user nova-compute[75245]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 16:18:50 user nova-compute[75245]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 16:18:50 user nova-compute[75245]:     <timer name="hpet" present="no"/>
Nov 29 16:18:50 user nova-compute[75245]:   </clock>
Nov 29 16:18:50 user nova-compute[75245]:   <cpu mode="custom" match="exact">
Nov 29 16:18:50 user nova-compute[75245]:     <model>Nehalem</model>
Nov 29 16:18:50 user nova-compute[75245]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 16:18:50 user nova-compute[75245]:   </cpu>
Nov 29 16:18:50 user nova-compute[75245]:   <devices>
Nov 29 16:18:50 user nova-compute[75245]:     <disk type="file" device="disk">
Nov 29 16:18:50 user nova-compute[75245]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 16:18:50 user nova-compute[75245]:       <source file="/opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk"/>
Nov 29 16:18:50 user nova-compute[75245]:       <target dev="vda" bus="virtio"/>
Nov 29 16:18:50 user nova-compute[75245]:     </disk>
Nov 29 16:18:50 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 16:18:50 user nova-compute[75245]:       <mac address="fa:16:3e:82:d0:d8"/>
Nov 29 16:18:50 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:18:50 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 16:18:50 user nova-compute[75245]:       <target dev="tap8c7418c2-24"/>
Nov 29 16:18:50 user nova-compute[75245]:     </interface>
Nov 29 16:18:50 user nova-compute[75245]:     <serial type="pty">
Nov 29 16:18:50 user nova-compute[75245]:       <log file="/opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/console.log" append="off"/>
Nov 29 16:18:50 user nova-compute[75245]:     </serial>
Nov 29 16:18:50 user nova-compute[75245]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 16:18:50 user nova-compute[75245]:     <video>
Nov 29 16:18:50 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:18:50 user nova-compute[75245]:     </video>
Nov 29 16:18:50 user nova-compute[75245]:     <rng model="virtio">
Nov 29 16:18:50 user nova-compute[75245]:       <backend model="random">/dev/urandom</backend>
Nov 29 16:18:50 user nova-compute[75245]:     </rng>
Nov 29 16:18:50 user nova-compute[75245]:     <controller type="usb" index="0" model="none"/>
Nov 29 16:18:50 user nova-compute[75245]:     <memballoon model="virtio">
Nov 29 16:18:50 user nova-compute[75245]:       <stats period="10"/>
Nov 29 16:18:50 user nova-compute[75245]:     </memballoon>
Nov 29 16:18:50 user nova-compute[75245]:   </devices>
Nov 29 16:18:50 user nova-compute[75245]: </domain>
Nov 29 16:18:50 user nova-compute[75245]:  {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 16:18:50 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:18:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-908755378',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-908755378',id=21,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d52776451e947f5a9ef3fa44ac8acbb',ramdisk_id='',reservation_id='r-ehafhgpq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1780163218',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:18:49Z,user_data=None,user_id='4f20e7c9ae22462ea6bc623c93697fce',uuid=8785a3c2-5b7a-4382-b50d-cecd8743329c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c7418c2-2459-4bc3-acfb-16df97c78f67", "address": "fa:16:3e:82:d0:d8", "network": {"id": "6a7f7426-b595-4aa3-bf80-cc92ba7ce15e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-917300903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d52776451e947f5a9ef3fa44ac8acbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7418c2-24", "ovs_interfaceid": "8c7418c2-2459-4bc3-acfb-16df97c78f67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 16:18:50 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Converting VIF {"id": "8c7418c2-2459-4bc3-acfb-16df97c78f67", "address": "fa:16:3e:82:d0:d8", "network": {"id": "6a7f7426-b595-4aa3-bf80-cc92ba7ce15e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-917300903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d52776451e947f5a9ef3fa44ac8acbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7418c2-24", "ovs_interfaceid": "8c7418c2-2459-4bc3-acfb-16df97c78f67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:18:50 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:d0:d8,bridge_name='br-int',has_traffic_filtering=True,id=8c7418c2-2459-4bc3-acfb-16df97c78f67,network=Network(6a7f7426-b595-4aa3-bf80-cc92ba7ce15e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c7418c2-24') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:18:50 user nova-compute[75245]: DEBUG os_vif [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:d0:d8,bridge_name='br-int',has_traffic_filtering=True,id=8c7418c2-2459-4bc3-acfb-16df97c78f67,network=Network(6a7f7426-b595-4aa3-bf80-cc92ba7ce15e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c7418c2-24') {{(pid=75245) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 16:18:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:18:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:18:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 16:18:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:18:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '32bbfdd8-78d9-5915-920d-0fd921a0fdf4', '_type': 'linux-noop'}}, row=False) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:18:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:18:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:18:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:18:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8c7418c2-24, may_exist=True, interface_attrs={}) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:18:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8c7418c2-24, col_values=(('qos', UUID('edfb0820-f4bd-46f3-aa92-1bc3e132cd8f')),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:18:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8c7418c2-24, col_values=(('external_ids', {'iface-id': '8c7418c2-2459-4bc3-acfb-16df97c78f67', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:82:d0:d8', 'vm-uuid': '8785a3c2-5b7a-4382-b50d-cecd8743329c'}),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:18:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:18:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:18:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:18:50 user nova-compute[75245]: INFO os_vif [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:d0:d8,bridge_name='br-int',has_traffic_filtering=True,id=8c7418c2-2459-4bc3-acfb-16df97c78f67,network=Network(6a7f7426-b595-4aa3-bf80-cc92ba7ce15e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c7418c2-24')
Nov 29 16:18:50 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:18:50 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] No VIF found with MAC fa:16:3e:82:d0:d8, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:18:50 user nova-compute[75245]: DEBUG nova.network.neutron [req-4a644c2d-44b3-4a03-b6dd-75bd56cd621c req-600adb75-98d0-40c8-a946-dc8b5b1890eb service nova] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Updated VIF entry in instance network info cache for port 8c7418c2-2459-4bc3-acfb-16df97c78f67. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:18:50 user nova-compute[75245]: DEBUG nova.network.neutron [req-4a644c2d-44b3-4a03-b6dd-75bd56cd621c req-600adb75-98d0-40c8-a946-dc8b5b1890eb service nova] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Updating instance_info_cache with network_info: [{"id": "8c7418c2-2459-4bc3-acfb-16df97c78f67", "address": "fa:16:3e:82:d0:d8", "network": {"id": "6a7f7426-b595-4aa3-bf80-cc92ba7ce15e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-917300903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d52776451e947f5a9ef3fa44ac8acbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7418c2-24", "ovs_interfaceid": "8c7418c2-2459-4bc3-acfb-16df97c78f67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:18:50 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-4a644c2d-44b3-4a03-b6dd-75bd56cd621c req-600adb75-98d0-40c8-a946-dc8b5b1890eb service nova] Releasing lock "refresh_cache-8785a3c2-5b7a-4382-b50d-cecd8743329c" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:18:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:18:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:18:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:18:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:18:52 user nova-compute[75245]: DEBUG nova.compute.manager [req-6e03bdcb-cc78-4e30-b76e-24d63daad6f8 req-d6a02cb2-398c-4b0b-9768-d4b7c48775d5 service nova] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Received event network-vif-plugged-8c7418c2-2459-4bc3-acfb-16df97c78f67 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:18:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-6e03bdcb-cc78-4e30-b76e-24d63daad6f8 req-d6a02cb2-398c-4b0b-9768-d4b7c48775d5 service nova] Acquiring lock "8785a3c2-5b7a-4382-b50d-cecd8743329c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:18:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-6e03bdcb-cc78-4e30-b76e-24d63daad6f8 req-d6a02cb2-398c-4b0b-9768-d4b7c48775d5 service nova] Lock "8785a3c2-5b7a-4382-b50d-cecd8743329c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:18:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-6e03bdcb-cc78-4e30-b76e-24d63daad6f8 req-d6a02cb2-398c-4b0b-9768-d4b7c48775d5 service nova] Lock "8785a3c2-5b7a-4382-b50d-cecd8743329c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:18:52 user nova-compute[75245]: DEBUG nova.compute.manager [req-6e03bdcb-cc78-4e30-b76e-24d63daad6f8 req-d6a02cb2-398c-4b0b-9768-d4b7c48775d5 service nova] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] No waiting events found dispatching network-vif-plugged-8c7418c2-2459-4bc3-acfb-16df97c78f67 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:18:52 user nova-compute[75245]: WARNING nova.compute.manager [req-6e03bdcb-cc78-4e30-b76e-24d63daad6f8 req-d6a02cb2-398c-4b0b-9768-d4b7c48775d5 service nova] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Received unexpected event network-vif-plugged-8c7418c2-2459-4bc3-acfb-16df97c78f67 for instance with vm_state building and task_state spawning.
Nov 29 16:18:52 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:18:52 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:18:52 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:18:53 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:18:53 user nova-compute[75245]: DEBUG nova.compute.manager [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Instance event wait completed in 0 seconds for  {{(pid=75245) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 16:18:53 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Guest created on hypervisor {{(pid=75245) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 16:18:53 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Instance spawned successfully.
Nov 29 16:18:53 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 16:18:53 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Found default for hw_cdrom_bus of ide {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:18:53 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Found default for hw_disk_bus of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:18:53 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Found default for hw_input_bus of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:18:53 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Found default for hw_pointer_model of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:18:53 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Found default for hw_video_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:18:53 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Found default for hw_vif_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:18:53 user nova-compute[75245]: INFO nova.compute.manager [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Took 5.14 seconds to spawn the instance on the hypervisor.
Nov 29 16:18:53 user nova-compute[75245]: DEBUG nova.compute.manager [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:18:54 user nova-compute[75245]: INFO nova.compute.manager [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Took 5.77 seconds to build instance.
Nov 29 16:18:54 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d05adcca-37df-4129-9fc6-617978bdc9db tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "8785a3c2-5b7a-4382-b50d-cecd8743329c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.865s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:18:54 user nova-compute[75245]: DEBUG nova.compute.manager [req-0eb858ea-d510-419a-829e-131240f37d0f req-632b728d-d761-46cd-8480-2942795b4cd6 service nova] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Received event network-vif-plugged-8c7418c2-2459-4bc3-acfb-16df97c78f67 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:18:54 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-0eb858ea-d510-419a-829e-131240f37d0f req-632b728d-d761-46cd-8480-2942795b4cd6 service nova] Acquiring lock "8785a3c2-5b7a-4382-b50d-cecd8743329c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:18:54 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-0eb858ea-d510-419a-829e-131240f37d0f req-632b728d-d761-46cd-8480-2942795b4cd6 service nova] Lock "8785a3c2-5b7a-4382-b50d-cecd8743329c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:18:54 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-0eb858ea-d510-419a-829e-131240f37d0f req-632b728d-d761-46cd-8480-2942795b4cd6 service nova] Lock "8785a3c2-5b7a-4382-b50d-cecd8743329c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:18:54 user nova-compute[75245]: DEBUG nova.compute.manager [req-0eb858ea-d510-419a-829e-131240f37d0f req-632b728d-d761-46cd-8480-2942795b4cd6 service nova] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] No waiting events found dispatching network-vif-plugged-8c7418c2-2459-4bc3-acfb-16df97c78f67 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:18:54 user nova-compute[75245]: WARNING nova.compute.manager [req-0eb858ea-d510-419a-829e-131240f37d0f req-632b728d-d761-46cd-8480-2942795b4cd6 service nova] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Received unexpected event network-vif-plugged-8c7418c2-2459-4bc3-acfb-16df97c78f67 for instance with vm_state active and task_state None.
Nov 29 16:18:55 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:18:55 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:18:56 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:18:57 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:18:57 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Starting heal instance info cache {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 16:18:57 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "refresh_cache-816edb0e-c4fc-470b-8151-f98502e50789" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:18:57 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquired lock "refresh_cache-816edb0e-c4fc-470b-8151-f98502e50789" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:18:57 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Forcefully refreshing network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 16:18:58 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Updating instance_info_cache with network_info: [{"id": "f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76", "address": "fa:16:3e:f9:3e:bc", "network": {"id": "f1fac2f4-e789-443e-b6a5-1a3f829bc302", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1199431077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6b87e18ef1f48d19a6907b28cb54f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf038ddf7-a5", "ovs_interfaceid": "f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:18:58 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Releasing lock "refresh_cache-816edb0e-c4fc-470b-8151-f98502e50789" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:18:58 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Updated the network info_cache for instance {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 16:18:58 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:18:58 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:18:58 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:18:58 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:18:58 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75245) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 16:18:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:18:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/816edb0e-c4fc-470b-8151-f98502e50789/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:18:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/816edb0e-c4fc-470b-8151-f98502e50789/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:18:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/816edb0e-c4fc-470b-8151-f98502e50789/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:18:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/816edb0e-c4fc-470b-8151-f98502e50789/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:18:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6720dc3-07fc-43e1-ba91-75e3d26a4a0f/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:18:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6720dc3-07fc-43e1-ba91-75e3d26a4a0f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:18:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6720dc3-07fc-43e1-ba91-75e3d26a4a0f/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:18:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6720dc3-07fc-43e1-ba91-75e3d26a4a0f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:18:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd819060-4388-444d-809e-94f6b2e8f102/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:18:59 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd819060-4388-444d-809e-94f6b2e8f102/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:18:59 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd819060-4388-444d-809e-94f6b2e8f102/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:18:59 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd819060-4388-444d-809e-94f6b2e8f102/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:18:59 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:18:59 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:18:59 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:18:59 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:18:59 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43ead766-eeb0-4c7a-a03a-6d4daf7106af/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:18:59 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43ead766-eeb0-4c7a-a03a-6d4daf7106af/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:18:59 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43ead766-eeb0-4c7a-a03a-6d4daf7106af/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:19:00 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43ead766-eeb0-4c7a-a03a-6d4daf7106af/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:19:00 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:19:00 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:19:00 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:19:00 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:19:00 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:19:00 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bae51e-2a85-442d-bbd2-fc89f30f40b7/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:19:00 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bae51e-2a85-442d-bbd2-fc89f30f40b7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:19:00 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bae51e-2a85-442d-bbd2-fc89f30f40b7/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:19:00 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bae51e-2a85-442d-bbd2-fc89f30f40b7/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:19:01 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:19:01 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:19:01 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Hypervisor/Node resource view: name=user free_ram=8037MB free_disk=25.463764190673828GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75245) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 16:19:01 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:19:01 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:19:01 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance ed9a6a4e-2e7d-443c-82ef-f14f11d32c81 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:19:01 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance fd819060-4388-444d-809e-94f6b2e8f102 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:19:01 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 816edb0e-c4fc-470b-8151-f98502e50789 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:19:01 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance f6720dc3-07fc-43e1-ba91-75e3d26a4a0f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:19:01 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 43ead766-eeb0-4c7a-a03a-6d4daf7106af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:19:01 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 84bae51e-2a85-442d-bbd2-fc89f30f40b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:19:01 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 8785a3c2-5b7a-4382-b50d-cecd8743329c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:19:01 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 16:19:01 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 16:19:01 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:19:01 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:19:01 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Compute_service record updated for user:user {{(pid=75245) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 16:19:01 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.375s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:19:03 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:19:05 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:19:05 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:19:05 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:19:05 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:19:05 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:19:05 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75245) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 16:19:05 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:19:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-8b3bff99-5a5a-4d5a-a8cf-10c8fa46207d tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Acquiring lock "fd819060-4388-444d-809e-94f6b2e8f102" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:19:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-8b3bff99-5a5a-4d5a-a8cf-10c8fa46207d tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Lock "fd819060-4388-444d-809e-94f6b2e8f102" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:19:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-8b3bff99-5a5a-4d5a-a8cf-10c8fa46207d tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Acquiring lock "fd819060-4388-444d-809e-94f6b2e8f102-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:19:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-8b3bff99-5a5a-4d5a-a8cf-10c8fa46207d tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Lock "fd819060-4388-444d-809e-94f6b2e8f102-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:19:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-8b3bff99-5a5a-4d5a-a8cf-10c8fa46207d tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Lock "fd819060-4388-444d-809e-94f6b2e8f102-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:19:06 user nova-compute[75245]: INFO nova.compute.manager [None req-8b3bff99-5a5a-4d5a-a8cf-10c8fa46207d tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] [instance: fd819060-4388-444d-809e-94f6b2e8f102] Terminating instance
Nov 29 16:19:06 user nova-compute[75245]: DEBUG nova.compute.manager [None req-8b3bff99-5a5a-4d5a-a8cf-10c8fa46207d tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] [instance: fd819060-4388-444d-809e-94f6b2e8f102] Start destroying the instance on the hypervisor. {{(pid=75245) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 16:19:06 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:19:06 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:19:06 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:19:06 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-3811459b-ced9-4e27-8b36-e6a76e1d12f7 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 816edb0e-c4fc-470b-8151-f98502e50789 is timed out.
Nov 29 16:19:06 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-3811459b-ced9-4e27-8b36-e6a76e1d12f7 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Successfully detached device vdb from instance 816edb0e-c4fc-470b-8151-f98502e50789 from the live domain config.
Nov 29 16:19:06 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3811459b-ced9-4e27-8b36-e6a76e1d12f7 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] calling os-brick to detach iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 16:19:06 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-3811459b-ced9-4e27-8b36-e6a76e1d12f7 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, {'target_iqn': 'iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sPFkjprb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:19:06 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-3811459b-ced9-4e27-8b36-e6a76e1d12f7 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:19:06 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-3811459b-ced9-4e27-8b36-e6a76e1d12f7 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:19:06 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-3811459b-ced9-4e27-8b36-e6a76e1d12f7 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:19:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:19:06 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:19:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:19:06 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[a036c2a5-1970-48c6-94bd-25d8491a4c72]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:19:06 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-3811459b-ced9-4e27-8b36-e6a76e1d12f7 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 16:19:06 user nova-compute[75245]: No targets found.
Nov 29 16:19:06 user nova-compute[75245]: iSNS:
Nov 29 16:19:06 user nova-compute[75245]: No targets found.
Nov 29 16:19:06 user nova-compute[75245]: STATIC:
Nov 29 16:19:06 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c
Nov 29 16:19:06 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:19:06 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:19:06 user nova-compute[75245]: FIRMWARE:
Nov 29 16:19:06 user nova-compute[75245]: No targets found.
Nov 29 16:19:06 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:19:06 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-3811459b-ced9-4e27-8b36-e6a76e1d12f7 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 16:19:06 user nova-compute[75245]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 16:19:06 user nova-compute[75245]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75245) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 16:19:06 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-3811459b-ced9-4e27-8b36-e6a76e1d12f7 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c', 0)] {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 16:19:06 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:19:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:19:06 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:19:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:19:06 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[29518834-3dbd-49e6-b06a-af0849995c1c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:19:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:19:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:19:06 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[19305a95-d4eb-4c5c-bbb7-b4d8c5ce0c27]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:19:06 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-3811459b-ced9-4e27-8b36-e6a76e1d12f7 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c (non-flash)
Nov 29 16:19:06 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:19:06 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-3811459b-ced9-4e27-8b36-e6a76e1d12f7 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c (non-flash)
Nov 29 16:19:06 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:19:06 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-3811459b-ced9-4e27-8b36-e6a76e1d12f7 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0d57029750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c'): ({'sdc'}, set())}) {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 16:19:06 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-3811459b-ced9-4e27-8b36-e6a76e1d12f7 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Removing single pathed devices sdc {{(pid=75245) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 16:19:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:19:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:19:06 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af30ea6-7a06-44c5-9dc8-2ce207462db8]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:19:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:19:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:19:06 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b2f680-3b73-4093-a37a-1e9aa55633ab]: (4, ('ok\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:19:06 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-3811459b-ced9-4e27-8b36-e6a76e1d12f7 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Flushing IO for device /dev/sdc {{(pid=75245) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 16:19:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:19:06 user nova-compute[75245]: DEBUG nova.compute.manager [req-6e3a4513-d43f-4d3f-a501-46dc58425467 req-8d24e50c-3971-4541-a4a4-9a034fc6d9bc service nova] [instance: fd819060-4388-444d-809e-94f6b2e8f102] Received event network-vif-unplugged-e11ba0cd-c449-4b18-a32e-41d267535482 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:19:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-6e3a4513-d43f-4d3f-a501-46dc58425467 req-8d24e50c-3971-4541-a4a4-9a034fc6d9bc service nova] Acquiring lock "fd819060-4388-444d-809e-94f6b2e8f102-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:19:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-6e3a4513-d43f-4d3f-a501-46dc58425467 req-8d24e50c-3971-4541-a4a4-9a034fc6d9bc service nova] Lock "fd819060-4388-444d-809e-94f6b2e8f102-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:19:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-6e3a4513-d43f-4d3f-a501-46dc58425467 req-8d24e50c-3971-4541-a4a4-9a034fc6d9bc service nova] Lock "fd819060-4388-444d-809e-94f6b2e8f102-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:19:06 user nova-compute[75245]: DEBUG nova.compute.manager [req-6e3a4513-d43f-4d3f-a501-46dc58425467 req-8d24e50c-3971-4541-a4a4-9a034fc6d9bc service nova] [instance: fd819060-4388-444d-809e-94f6b2e8f102] No waiting events found dispatching network-vif-unplugged-e11ba0cd-c449-4b18-a32e-41d267535482 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:19:06 user nova-compute[75245]: DEBUG nova.compute.manager [req-6e3a4513-d43f-4d3f-a501-46dc58425467 req-8d24e50c-3971-4541-a4a4-9a034fc6d9bc service nova] [instance: fd819060-4388-444d-809e-94f6b2e8f102] Received event network-vif-unplugged-e11ba0cd-c449-4b18-a32e-41d267535482 for instance with task_state deleting. {{(pid=75245) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 16:19:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:19:06 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[febab5fc-2bb9-4d07-9e88-74888663f3ea]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:19:06 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-3811459b-ced9-4e27-8b36-e6a76e1d12f7 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75245) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 16:19:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:19:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:19:06 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[e658a04d-243e-42f0-a7d2-d132d7349499]: (4, ('1', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:19:06 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-3811459b-ced9-4e27-8b36-e6a76e1d12f7 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 16:19:06 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-3811459b-ced9-4e27-8b36-e6a76e1d12f7 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] SCSI volumes sdc have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 16:19:06 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-3811459b-ced9-4e27-8b36-e6a76e1d12f7 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c')] {{(pid=75245) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 16:19:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:19:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:19:07 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f9b4d6-cfcc-47d3-99bd-e7f510e909f1]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:19:07 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-3811459b-ced9-4e27-8b36-e6a76e1d12f7 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:19:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c -p 172.16.0.220:3260 --logout {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:19:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:19:07 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f3dc95-f47a-4714-8a94-aa751ab8511d]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:19:07 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-3811459b-ced9-4e27-8b36-e6a76e1d12f7 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c, portal: 172.16.0.220,3260]
Nov 29 16:19:07 user nova-compute[75245]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c, portal: 172.16.0.220,3260] successful.
Nov 29 16:19:07 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:19:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c -p 172.16.0.220:3260 --op delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:19:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a84dd1c-3444-4e5d-ae8f-654a1901737c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:19:07 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f67255c-aa89-4993-bdf7-cbbdd34c102a]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:19:07 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-3811459b-ced9-4e27-8b36-e6a76e1d12f7 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:19:07 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-3811459b-ced9-4e27-8b36-e6a76e1d12f7 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.370s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:19:07 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-3811459b-ced9-4e27-8b36-e6a76e1d12f7 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] <== disconnect_volume: return (371ms) None {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:19:07 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3811459b-ced9-4e27-8b36-e6a76e1d12f7 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Disconnected iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 16:19:07 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: fd819060-4388-444d-809e-94f6b2e8f102] Instance destroyed successfully.
Nov 29 16:19:07 user nova-compute[75245]: DEBUG nova.objects.instance [None req-8b3bff99-5a5a-4d5a-a8cf-10c8fa46207d tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Lazy-loading 'resources' on Instance uuid fd819060-4388-444d-809e-94f6b2e8f102 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:19:07 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-8b3bff99-5a5a-4d5a-a8cf-10c8fa46207d tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:12:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1191837883',display_name='tempest-TestServerVolumeAttachmentScenario-server-1191837883',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1191837883',id=12,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqIAcvL8oOHh14XiJ8Jw34Fv+TabeY+nKRvPbM4RQlW2iQfoCOJ6QkZq8sbm/svDFL6vYihoQRx3m74p2mQdaKcXZMvvxWrFblyl0gLgaWHEavJaTl6Pd6G28sSWZnMoQ==',key_name='tempest-keypair-997920350',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:12:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0009bdf2ef8f43a59341dd6eea441b02',ramdisk_id='',reservation_id='r-2o8molwz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-126150791',owner_user_name='tempest-TestServerVolumeAttachmentScenario-126150791-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:12:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='577a5571c39b493d8ea0f177f26aad27',uuid=fd819060-4388-444d-809e-94f6b2e8f102,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e11ba0cd-c449-4b18-a32e-41d267535482", "address": "fa:16:3e:a4:25:65", "network": {"id": "11119178-094d-4c14-8eea-233947dddfe4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1660525559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0009bdf2ef8f43a59341dd6eea441b02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape11ba0cd-c4", "ovs_interfaceid": "e11ba0cd-c449-4b18-a32e-41d267535482", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 16:19:07 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-8b3bff99-5a5a-4d5a-a8cf-10c8fa46207d tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Converting VIF {"id": "e11ba0cd-c449-4b18-a32e-41d267535482", "address": "fa:16:3e:a4:25:65", "network": {"id": "11119178-094d-4c14-8eea-233947dddfe4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1660525559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0009bdf2ef8f43a59341dd6eea441b02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape11ba0cd-c4", "ovs_interfaceid": "e11ba0cd-c449-4b18-a32e-41d267535482", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:19:07 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-8b3bff99-5a5a-4d5a-a8cf-10c8fa46207d tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a4:25:65,bridge_name='br-int',has_traffic_filtering=True,id=e11ba0cd-c449-4b18-a32e-41d267535482,network=Network(11119178-094d-4c14-8eea-233947dddfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape11ba0cd-c4') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:19:07 user nova-compute[75245]: DEBUG os_vif [None req-8b3bff99-5a5a-4d5a-a8cf-10c8fa46207d tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:25:65,bridge_name='br-int',has_traffic_filtering=True,id=e11ba0cd-c449-4b18-a32e-41d267535482,network=Network(11119178-094d-4c14-8eea-233947dddfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape11ba0cd-c4') {{(pid=75245) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 16:19:07 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:19:07 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape11ba0cd-c4, bridge=br-int, if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:19:07 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:19:07 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:19:07 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:19:07 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=57129fff-f93f-4474-94e9-3276b96dcb9e) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:19:07 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:19:07 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:19:07 user nova-compute[75245]: INFO os_vif [None req-8b3bff99-5a5a-4d5a-a8cf-10c8fa46207d tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:25:65,bridge_name='br-int',has_traffic_filtering=True,id=e11ba0cd-c449-4b18-a32e-41d267535482,network=Network(11119178-094d-4c14-8eea-233947dddfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape11ba0cd-c4')
Nov 29 16:19:07 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-8b3bff99-5a5a-4d5a-a8cf-10c8fa46207d tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] [instance: fd819060-4388-444d-809e-94f6b2e8f102] Deleting instance files /opt/stack/data/nova/instances/fd819060-4388-444d-809e-94f6b2e8f102_del
Nov 29 16:19:07 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-8b3bff99-5a5a-4d5a-a8cf-10c8fa46207d tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] [instance: fd819060-4388-444d-809e-94f6b2e8f102] Deletion of /opt/stack/data/nova/instances/fd819060-4388-444d-809e-94f6b2e8f102_del complete
Nov 29 16:19:07 user nova-compute[75245]: INFO nova.compute.manager [None req-8b3bff99-5a5a-4d5a-a8cf-10c8fa46207d tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] [instance: fd819060-4388-444d-809e-94f6b2e8f102] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 29 16:19:07 user nova-compute[75245]: DEBUG oslo.service.loopingcall [None req-8b3bff99-5a5a-4d5a-a8cf-10c8fa46207d tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75245) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 16:19:07 user nova-compute[75245]: DEBUG nova.compute.manager [-] [instance: fd819060-4388-444d-809e-94f6b2e8f102] Deallocating network for instance {{(pid=75245) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 16:19:07 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: fd819060-4388-444d-809e-94f6b2e8f102] deallocate_for_instance() {{(pid=75245) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 16:19:07 user nova-compute[75245]: DEBUG nova.objects.instance [None req-3811459b-ced9-4e27-8b36-e6a76e1d12f7 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lazy-loading 'flavor' on Instance uuid 816edb0e-c4fc-470b-8151-f98502e50789 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:19:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3811459b-ced9-4e27-8b36-e6a76e1d12f7 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "816edb0e-c4fc-470b-8151-f98502e50789" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.828s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:19:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:19:08 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: fd819060-4388-444d-809e-94f6b2e8f102] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:19:08 user nova-compute[75245]: INFO nova.compute.manager [-] [instance: fd819060-4388-444d-809e-94f6b2e8f102] Took 0.95 seconds to deallocate network for instance.
Nov 29 16:19:08 user nova-compute[75245]: DEBUG nova.compute.manager [req-b648ea22-5c69-4614-a26d-48461006a773 req-b4db7851-5bd1-4115-9eb8-ccab67700c55 service nova] [instance: fd819060-4388-444d-809e-94f6b2e8f102] Received event network-vif-deleted-e11ba0cd-c449-4b18-a32e-41d267535482 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:19:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-8b3bff99-5a5a-4d5a-a8cf-10c8fa46207d tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:19:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-8b3bff99-5a5a-4d5a-a8cf-10c8fa46207d tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:19:08 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-8b3bff99-5a5a-4d5a-a8cf-10c8fa46207d tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:19:08 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-8b3bff99-5a5a-4d5a-a8cf-10c8fa46207d tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:19:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-8b3bff99-5a5a-4d5a-a8cf-10c8fa46207d tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.368s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:19:08 user nova-compute[75245]: INFO nova.scheduler.client.report [None req-8b3bff99-5a5a-4d5a-a8cf-10c8fa46207d tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Deleted allocations for instance fd819060-4388-444d-809e-94f6b2e8f102
Nov 29 16:19:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-8b3bff99-5a5a-4d5a-a8cf-10c8fa46207d tempest-TestServerVolumeAttachmentScenario-126150791 tempest-TestServerVolumeAttachmentScenario-126150791-project-member] Lock "fd819060-4388-444d-809e-94f6b2e8f102" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.420s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:19:08 user nova-compute[75245]: DEBUG nova.compute.manager [req-38debbfb-b387-4a12-b55d-f1df2ffe9623 req-63186f48-f196-4e91-bcca-8473f02ebedb service nova] [instance: fd819060-4388-444d-809e-94f6b2e8f102] Received event network-vif-plugged-e11ba0cd-c449-4b18-a32e-41d267535482 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:19:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-38debbfb-b387-4a12-b55d-f1df2ffe9623 req-63186f48-f196-4e91-bcca-8473f02ebedb service nova] Acquiring lock "fd819060-4388-444d-809e-94f6b2e8f102-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:19:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-38debbfb-b387-4a12-b55d-f1df2ffe9623 req-63186f48-f196-4e91-bcca-8473f02ebedb service nova] Lock "fd819060-4388-444d-809e-94f6b2e8f102-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:19:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-38debbfb-b387-4a12-b55d-f1df2ffe9623 req-63186f48-f196-4e91-bcca-8473f02ebedb service nova] Lock "fd819060-4388-444d-809e-94f6b2e8f102-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:19:08 user nova-compute[75245]: DEBUG nova.compute.manager [req-38debbfb-b387-4a12-b55d-f1df2ffe9623 req-63186f48-f196-4e91-bcca-8473f02ebedb service nova] [instance: fd819060-4388-444d-809e-94f6b2e8f102] No waiting events found dispatching network-vif-plugged-e11ba0cd-c449-4b18-a32e-41d267535482 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:19:08 user nova-compute[75245]: WARNING nova.compute.manager [req-38debbfb-b387-4a12-b55d-f1df2ffe9623 req-63186f48-f196-4e91-bcca-8473f02ebedb service nova] [instance: fd819060-4388-444d-809e-94f6b2e8f102] Received unexpected event network-vif-plugged-e11ba0cd-c449-4b18-a32e-41d267535482 for instance with vm_state deleted and task_state None.
Nov 29 16:19:12 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:19:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:19:17 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:19:18 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:19:19 user nova-compute[75245]: DEBUG nova.compute.manager [req-b4e22b6f-9bd6-485b-a4cc-ad55a0c0ae60 req-78fc762e-5b5e-49c4-82d7-3fc70a19417c service nova] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Received event network-changed-80f91f45-781d-452c-b2c0-de2584494644 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:19:19 user nova-compute[75245]: DEBUG nova.compute.manager [req-b4e22b6f-9bd6-485b-a4cc-ad55a0c0ae60 req-78fc762e-5b5e-49c4-82d7-3fc70a19417c service nova] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Refreshing instance network info cache due to event network-changed-80f91f45-781d-452c-b2c0-de2584494644. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:19:19 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b4e22b6f-9bd6-485b-a4cc-ad55a0c0ae60 req-78fc762e-5b5e-49c4-82d7-3fc70a19417c service nova] Acquiring lock "refresh_cache-f6720dc3-07fc-43e1-ba91-75e3d26a4a0f" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:19:19 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b4e22b6f-9bd6-485b-a4cc-ad55a0c0ae60 req-78fc762e-5b5e-49c4-82d7-3fc70a19417c service nova] Acquired lock "refresh_cache-f6720dc3-07fc-43e1-ba91-75e3d26a4a0f" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:19:19 user nova-compute[75245]: DEBUG nova.network.neutron [req-b4e22b6f-9bd6-485b-a4cc-ad55a0c0ae60 req-78fc762e-5b5e-49c4-82d7-3fc70a19417c service nova] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Refreshing network info cache for port 80f91f45-781d-452c-b2c0-de2584494644 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:19:20 user nova-compute[75245]: DEBUG nova.network.neutron [req-b4e22b6f-9bd6-485b-a4cc-ad55a0c0ae60 req-78fc762e-5b5e-49c4-82d7-3fc70a19417c service nova] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Updated VIF entry in instance network info cache for port 80f91f45-781d-452c-b2c0-de2584494644. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:19:20 user nova-compute[75245]: DEBUG nova.network.neutron [req-b4e22b6f-9bd6-485b-a4cc-ad55a0c0ae60 req-78fc762e-5b5e-49c4-82d7-3fc70a19417c service nova] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Updating instance_info_cache with network_info: [{"id": "80f91f45-781d-452c-b2c0-de2584494644", "address": "fa:16:3e:11:16:c3", "network": {"id": "0c0d4e62-be12-42e1-878c-a4a07270c108", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2066574781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77edb4b0a0024ef1a88cb67c11d51911", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80f91f45-78", "ovs_interfaceid": "80f91f45-781d-452c-b2c0-de2584494644", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:19:20 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b4e22b6f-9bd6-485b-a4cc-ad55a0c0ae60 req-78fc762e-5b5e-49c4-82d7-3fc70a19417c service nova] Releasing lock "refresh_cache-f6720dc3-07fc-43e1-ba91-75e3d26a4a0f" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:19:20 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4f52aa14-302d-41fd-86ec-7b747275dbab tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Acquiring lock "interface-f6720dc3-07fc-43e1-ba91-75e3d26a4a0f-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:19:20 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4f52aa14-302d-41fd-86ec-7b747275dbab tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Lock "interface-f6720dc3-07fc-43e1-ba91-75e3d26a4a0f-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:19:20 user nova-compute[75245]: DEBUG nova.objects.instance [None req-4f52aa14-302d-41fd-86ec-7b747275dbab tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Lazy-loading 'flavor' on Instance uuid f6720dc3-07fc-43e1-ba91-75e3d26a4a0f {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:19:20 user nova-compute[75245]: DEBUG nova.objects.instance [None req-4f52aa14-302d-41fd-86ec-7b747275dbab tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Lazy-loading 'pci_requests' on Instance uuid f6720dc3-07fc-43e1-ba91-75e3d26a4a0f {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:19:20 user nova-compute[75245]: DEBUG nova.objects.base [None req-4f52aa14-302d-41fd-86ec-7b747275dbab tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Object Instance<f6720dc3-07fc-43e1-ba91-75e3d26a4a0f> lazy-loaded attributes: flavor,pci_requests {{(pid=75245) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 16:19:20 user nova-compute[75245]: DEBUG nova.network.neutron [None req-4f52aa14-302d-41fd-86ec-7b747275dbab tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] allocate_for_instance() {{(pid=75245) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 16:19:20 user nova-compute[75245]: DEBUG nova.policy [None req-4f52aa14-302d-41fd-86ec-7b747275dbab tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e746210be7104346bd8ed895b3f22cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77edb4b0a0024ef1a88cb67c11d51911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75245) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 16:19:20 user nova-compute[75245]: DEBUG nova.compute.manager [req-dadcc035-1a6c-44bd-b215-f1436993baa9 req-3577eb48-1cbf-4d17-a4dd-4d5ba7044ab9 service nova] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Received event network-changed-4aefd86e-7753-4693-9cbd-6ee2178443b5 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:19:20 user nova-compute[75245]: DEBUG nova.compute.manager [req-dadcc035-1a6c-44bd-b215-f1436993baa9 req-3577eb48-1cbf-4d17-a4dd-4d5ba7044ab9 service nova] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Refreshing instance network info cache due to event network-changed-4aefd86e-7753-4693-9cbd-6ee2178443b5. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:19:20 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-dadcc035-1a6c-44bd-b215-f1436993baa9 req-3577eb48-1cbf-4d17-a4dd-4d5ba7044ab9 service nova] Acquiring lock "refresh_cache-43ead766-eeb0-4c7a-a03a-6d4daf7106af" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:19:20 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-dadcc035-1a6c-44bd-b215-f1436993baa9 req-3577eb48-1cbf-4d17-a4dd-4d5ba7044ab9 service nova] Acquired lock "refresh_cache-43ead766-eeb0-4c7a-a03a-6d4daf7106af" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:19:20 user nova-compute[75245]: DEBUG nova.network.neutron [req-dadcc035-1a6c-44bd-b215-f1436993baa9 req-3577eb48-1cbf-4d17-a4dd-4d5ba7044ab9 service nova] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Refreshing network info cache for port 4aefd86e-7753-4693-9cbd-6ee2178443b5 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:19:21 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:19:21 user nova-compute[75245]: DEBUG nova.network.neutron [None req-4f52aa14-302d-41fd-86ec-7b747275dbab tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Successfully created port: f96864d7-90bc-4830-a939-4ef48125e8ba {{(pid=75245) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 16:19:21 user nova-compute[75245]: DEBUG nova.network.neutron [req-dadcc035-1a6c-44bd-b215-f1436993baa9 req-3577eb48-1cbf-4d17-a4dd-4d5ba7044ab9 service nova] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Updated VIF entry in instance network info cache for port 4aefd86e-7753-4693-9cbd-6ee2178443b5. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:19:21 user nova-compute[75245]: DEBUG nova.network.neutron [req-dadcc035-1a6c-44bd-b215-f1436993baa9 req-3577eb48-1cbf-4d17-a4dd-4d5ba7044ab9 service nova] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Updating instance_info_cache with network_info: [{"id": "4aefd86e-7753-4693-9cbd-6ee2178443b5", "address": "fa:16:3e:d1:0a:c7", "network": {"id": "7f978dee-8a5e-4218-b6fc-2d550c0d7b5d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-53637364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd22948fbd074a7c94d8ad7614fbc220", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aefd86e-77", "ovs_interfaceid": "4aefd86e-7753-4693-9cbd-6ee2178443b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:19:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-dadcc035-1a6c-44bd-b215-f1436993baa9 req-3577eb48-1cbf-4d17-a4dd-4d5ba7044ab9 service nova] Releasing lock "refresh_cache-43ead766-eeb0-4c7a-a03a-6d4daf7106af" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:19:22 user nova-compute[75245]: DEBUG nova.network.neutron [None req-4f52aa14-302d-41fd-86ec-7b747275dbab tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Successfully updated port: f96864d7-90bc-4830-a939-4ef48125e8ba {{(pid=75245) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 16:19:22 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4f52aa14-302d-41fd-86ec-7b747275dbab tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Acquiring lock "refresh_cache-f6720dc3-07fc-43e1-ba91-75e3d26a4a0f" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:19:22 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4f52aa14-302d-41fd-86ec-7b747275dbab tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Acquired lock "refresh_cache-f6720dc3-07fc-43e1-ba91-75e3d26a4a0f" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:19:22 user nova-compute[75245]: DEBUG nova.network.neutron [None req-4f52aa14-302d-41fd-86ec-7b747275dbab tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 16:19:22 user nova-compute[75245]: DEBUG nova.compute.manager [req-0579c868-ef8f-4a0a-8f4e-3ab5cfdf1273 req-ad4950b2-db53-4dfb-8b86-f4b41f5dc30a service nova] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Received event network-changed-f96864d7-90bc-4830-a939-4ef48125e8ba {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:19:22 user nova-compute[75245]: DEBUG nova.compute.manager [req-0579c868-ef8f-4a0a-8f4e-3ab5cfdf1273 req-ad4950b2-db53-4dfb-8b86-f4b41f5dc30a service nova] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Refreshing instance network info cache due to event network-changed-f96864d7-90bc-4830-a939-4ef48125e8ba. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:19:22 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-0579c868-ef8f-4a0a-8f4e-3ab5cfdf1273 req-ad4950b2-db53-4dfb-8b86-f4b41f5dc30a service nova] Acquiring lock "refresh_cache-f6720dc3-07fc-43e1-ba91-75e3d26a4a0f" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:19:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:19:22 user nova-compute[75245]: DEBUG nova.network.neutron [None req-4f52aa14-302d-41fd-86ec-7b747275dbab tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Updating instance_info_cache with network_info: [{"id": "80f91f45-781d-452c-b2c0-de2584494644", "address": "fa:16:3e:11:16:c3", "network": {"id": "0c0d4e62-be12-42e1-878c-a4a07270c108", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2066574781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77edb4b0a0024ef1a88cb67c11d51911", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80f91f45-78", "ovs_interfaceid": "80f91f45-781d-452c-b2c0-de2584494644", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f96864d7-90bc-4830-a939-4ef48125e8ba", "address": "fa:16:3e:87:e1:00", "network": {"id": "e3acd9cb-1104-4bb7-904d-adf9c4de10bb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-338053759", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "77edb4b0a0024ef1a88cb67c11d51911", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf96864d7-90", "ovs_interfaceid": "f96864d7-90bc-4830-a939-4ef48125e8ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:19:22 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4f52aa14-302d-41fd-86ec-7b747275dbab tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Releasing lock "refresh_cache-f6720dc3-07fc-43e1-ba91-75e3d26a4a0f" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:19:22 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-0579c868-ef8f-4a0a-8f4e-3ab5cfdf1273 req-ad4950b2-db53-4dfb-8b86-f4b41f5dc30a service nova] Acquired lock "refresh_cache-f6720dc3-07fc-43e1-ba91-75e3d26a4a0f" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:19:22 user nova-compute[75245]: DEBUG nova.network.neutron [req-0579c868-ef8f-4a0a-8f4e-3ab5cfdf1273 req-ad4950b2-db53-4dfb-8b86-f4b41f5dc30a service nova] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Refreshing network info cache for port f96864d7-90bc-4830-a939-4ef48125e8ba {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:19:22 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-4f52aa14-302d-41fd-86ec-7b747275dbab tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T16:17:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-509169920',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-509169920',id=18,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBrxKq2a477G7fQ99CR3fI2bNDKuIY+WInOILJKOnZG664u+pIIu8QmsOdQ2tkxzkJGzMiOTR9GNSQO7MZOS3L5S3KmbXxtrzunCovcSXNCoaN7+W1BI3hrcIZ+N4h5Q6g==',key_name='tempest-keypair-1309950339',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:17:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='77edb4b0a0024ef1a88cb67c11d51911',ramdisk_id='',reservation_id='r-x0llsnrl',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-229817667',owner_user_name='tempest-TaggedAttachmentsTest-229817667-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:17:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e746210be7104346bd8ed895b3f22cd9',uuid=f6720dc3-07fc-43e1-ba91-75e3d26a4a0f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f96864d7-90bc-4830-a939-4ef48125e8ba", "address": "fa:16:3e:87:e1:00", "network": {"id": "e3acd9cb-1104-4bb7-904d-adf9c4de10bb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-338053759", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "77edb4b0a0024ef1a88cb67c11d51911", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf96864d7-90", "ovs_interfaceid": "f96864d7-90bc-4830-a939-4ef48125e8ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 16:19:22 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-4f52aa14-302d-41fd-86ec-7b747275dbab tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Converting VIF {"id": "f96864d7-90bc-4830-a939-4ef48125e8ba", "address": "fa:16:3e:87:e1:00", "network": {"id": "e3acd9cb-1104-4bb7-904d-adf9c4de10bb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-338053759", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "77edb4b0a0024ef1a88cb67c11d51911", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf96864d7-90", "ovs_interfaceid": "f96864d7-90bc-4830-a939-4ef48125e8ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:19:22 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-4f52aa14-302d-41fd-86ec-7b747275dbab tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:e1:00,bridge_name='br-int',has_traffic_filtering=True,id=f96864d7-90bc-4830-a939-4ef48125e8ba,network=Network(e3acd9cb-1104-4bb7-904d-adf9c4de10bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf96864d7-90') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:19:22 user nova-compute[75245]: DEBUG os_vif [None req-4f52aa14-302d-41fd-86ec-7b747275dbab tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:e1:00,bridge_name='br-int',has_traffic_filtering=True,id=f96864d7-90bc-4830-a939-4ef48125e8ba,network=Network(e3acd9cb-1104-4bb7-904d-adf9c4de10bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf96864d7-90') {{(pid=75245) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 16:19:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:19:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:19:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 16:19:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:19:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fe1a07ae-0bfe-5f0d-aebc-7b0a86ea2238', '_type': 'linux-noop'}}, row=False) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:19:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:19:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:19:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf96864d7-90, may_exist=True, interface_attrs={}) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:19:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf96864d7-90, col_values=(('qos', UUID('8858dad5-028c-46d2-a395-a3fd30b46c1a')),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:19:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf96864d7-90, col_values=(('external_ids', {'iface-id': 'f96864d7-90bc-4830-a939-4ef48125e8ba', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:e1:00', 'vm-uuid': 'f6720dc3-07fc-43e1-ba91-75e3d26a4a0f'}),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:19:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:19:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:19:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:19:22 user nova-compute[75245]: INFO os_vif [None req-4f52aa14-302d-41fd-86ec-7b747275dbab tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:e1:00,bridge_name='br-int',has_traffic_filtering=True,id=f96864d7-90bc-4830-a939-4ef48125e8ba,network=Network(e3acd9cb-1104-4bb7-904d-adf9c4de10bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf96864d7-90')
Nov 29 16:19:22 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-4f52aa14-302d-41fd-86ec-7b747275dbab tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T16:17:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-509169920',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-509169920',id=18,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBrxKq2a477G7fQ99CR3fI2bNDKuIY+WInOILJKOnZG664u+pIIu8QmsOdQ2tkxzkJGzMiOTR9GNSQO7MZOS3L5S3KmbXxtrzunCovcSXNCoaN7+W1BI3hrcIZ+N4h5Q6g==',key_name='tempest-keypair-1309950339',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:17:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='77edb4b0a0024ef1a88cb67c11d51911',ramdisk_id='',reservation_id='r-x0llsnrl',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-229817667',owner_user_name='tempest-TaggedAttachmentsTest-229817667-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:17:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e746210be7104346bd8ed895b3f22cd9',uuid=f6720dc3-07fc-43e1-ba91-75e3d26a4a0f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f96864d7-90bc-4830-a939-4ef48125e8ba", "address": "fa:16:3e:87:e1:00", "network": {"id": "e3acd9cb-1104-4bb7-904d-adf9c4de10bb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-338053759", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "77edb4b0a0024ef1a88cb67c11d51911", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf96864d7-90", "ovs_interfaceid": "f96864d7-90bc-4830-a939-4ef48125e8ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:19:22 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-4f52aa14-302d-41fd-86ec-7b747275dbab tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Converting VIF {"id": "f96864d7-90bc-4830-a939-4ef48125e8ba", "address": "fa:16:3e:87:e1:00", "network": {"id": "e3acd9cb-1104-4bb7-904d-adf9c4de10bb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-338053759", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "77edb4b0a0024ef1a88cb67c11d51911", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf96864d7-90", "ovs_interfaceid": "f96864d7-90bc-4830-a939-4ef48125e8ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:19:22 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-4f52aa14-302d-41fd-86ec-7b747275dbab tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:e1:00,bridge_name='br-int',has_traffic_filtering=True,id=f96864d7-90bc-4830-a939-4ef48125e8ba,network=Network(e3acd9cb-1104-4bb7-904d-adf9c4de10bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf96864d7-90') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:19:22 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-4f52aa14-302d-41fd-86ec-7b747275dbab tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] attach device xml: <interface type="ethernet">
Nov 29 16:19:22 user nova-compute[75245]:   <mac address="fa:16:3e:87:e1:00"/>
Nov 29 16:19:22 user nova-compute[75245]:   <model type="virtio"/>
Nov 29 16:19:22 user nova-compute[75245]:   <mtu size="1442"/>
Nov 29 16:19:22 user nova-compute[75245]:   <target dev="tapf96864d7-90"/>
Nov 29 16:19:22 user nova-compute[75245]: </interface>
Nov 29 16:19:22 user nova-compute[75245]:  {{(pid=75245) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 16:19:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:19:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:19:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:19:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:19:23 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-4f52aa14-302d-41fd-86ec-7b747275dbab tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:19:23 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-4f52aa14-302d-41fd-86ec-7b747275dbab tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] No BDM found with device name hda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:19:23 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-4f52aa14-302d-41fd-86ec-7b747275dbab tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] No VIF found with MAC fa:16:3e:11:16:c3, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:19:23 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-4f52aa14-302d-41fd-86ec-7b747275dbab tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 16:19:23 user nova-compute[75245]:   <nova:package version="0.0.0"/>
Nov 29 16:19:23 user nova-compute[75245]:   <nova:name>tempest-device-tagging-server-509169920</nova:name>
Nov 29 16:19:23 user nova-compute[75245]:   <nova:creationTime>2023-11-29 16:19:23</nova:creationTime>
Nov 29 16:19:23 user nova-compute[75245]:   <nova:flavor name="m1.tiny">
Nov 29 16:19:23 user nova-compute[75245]:     <nova:memory>512</nova:memory>
Nov 29 16:19:23 user nova-compute[75245]:     <nova:disk>1</nova:disk>
Nov 29 16:19:23 user nova-compute[75245]:     <nova:swap>0</nova:swap>
Nov 29 16:19:23 user nova-compute[75245]:     <nova:ephemeral>0</nova:ephemeral>
Nov 29 16:19:23 user nova-compute[75245]:     <nova:vcpus>1</nova:vcpus>
Nov 29 16:19:23 user nova-compute[75245]:   </nova:flavor>
Nov 29 16:19:23 user nova-compute[75245]:   <nova:owner>
Nov 29 16:19:23 user nova-compute[75245]:     <nova:user uuid="e746210be7104346bd8ed895b3f22cd9">tempest-TaggedAttachmentsTest-229817667-project-member</nova:user>
Nov 29 16:19:23 user nova-compute[75245]:     <nova:project uuid="77edb4b0a0024ef1a88cb67c11d51911">tempest-TaggedAttachmentsTest-229817667</nova:project>
Nov 29 16:19:23 user nova-compute[75245]:   </nova:owner>
Nov 29 16:19:23 user nova-compute[75245]:   <nova:root type="image" uuid="a291d9c3-be02-4c6c-9649-4b45c5b7f487"/>
Nov 29 16:19:23 user nova-compute[75245]:   <nova:ports>
Nov 29 16:19:23 user nova-compute[75245]:     <nova:port uuid="80f91f45-781d-452c-b2c0-de2584494644">
Nov 29 16:19:23 user nova-compute[75245]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 29 16:19:23 user nova-compute[75245]:     </nova:port>
Nov 29 16:19:23 user nova-compute[75245]:     <nova:port uuid="f96864d7-90bc-4830-a939-4ef48125e8ba">
Nov 29 16:19:23 user nova-compute[75245]:       <nova:ip type="fixed" address="10.10.10.87" ipVersion="4"/>
Nov 29 16:19:23 user nova-compute[75245]:     </nova:port>
Nov 29 16:19:23 user nova-compute[75245]:   </nova:ports>
Nov 29 16:19:23 user nova-compute[75245]: </nova:instance>
Nov 29 16:19:23 user nova-compute[75245]:  {{(pid=75245) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 29 16:19:23 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4f52aa14-302d-41fd-86ec-7b747275dbab tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Lock "interface-f6720dc3-07fc-43e1-ba91-75e3d26a4a0f-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 2.986s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:19:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:19:23 user nova-compute[75245]: DEBUG nova.network.neutron [req-0579c868-ef8f-4a0a-8f4e-3ab5cfdf1273 req-ad4950b2-db53-4dfb-8b86-f4b41f5dc30a service nova] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Updated VIF entry in instance network info cache for port f96864d7-90bc-4830-a939-4ef48125e8ba. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:19:23 user nova-compute[75245]: DEBUG nova.network.neutron [req-0579c868-ef8f-4a0a-8f4e-3ab5cfdf1273 req-ad4950b2-db53-4dfb-8b86-f4b41f5dc30a service nova] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Updating instance_info_cache with network_info: [{"id": "80f91f45-781d-452c-b2c0-de2584494644", "address": "fa:16:3e:11:16:c3", "network": {"id": "0c0d4e62-be12-42e1-878c-a4a07270c108", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2066574781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77edb4b0a0024ef1a88cb67c11d51911", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80f91f45-78", "ovs_interfaceid": "80f91f45-781d-452c-b2c0-de2584494644", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f96864d7-90bc-4830-a939-4ef48125e8ba", "address": "fa:16:3e:87:e1:00", "network": {"id": "e3acd9cb-1104-4bb7-904d-adf9c4de10bb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-338053759", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "77edb4b0a0024ef1a88cb67c11d51911", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf96864d7-90", "ovs_interfaceid": "f96864d7-90bc-4830-a939-4ef48125e8ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:19:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:19:23 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-0579c868-ef8f-4a0a-8f4e-3ab5cfdf1273 req-ad4950b2-db53-4dfb-8b86-f4b41f5dc30a service nova] Releasing lock "refresh_cache-f6720dc3-07fc-43e1-ba91-75e3d26a4a0f" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:19:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:19:23 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-f03f9f7b-ec2d-4edd-bd50-58d3ffaaff7a tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Acquiring lock "f6720dc3-07fc-43e1-ba91-75e3d26a4a0f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:19:23 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-f03f9f7b-ec2d-4edd-bd50-58d3ffaaff7a tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Lock "f6720dc3-07fc-43e1-ba91-75e3d26a4a0f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:19:23 user nova-compute[75245]: DEBUG nova.objects.instance [None req-f03f9f7b-ec2d-4edd-bd50-58d3ffaaff7a tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Lazy-loading 'flavor' on Instance uuid f6720dc3-07fc-43e1-ba91-75e3d26a4a0f {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:19:23 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-f03f9f7b-ec2d-4edd-bd50-58d3ffaaff7a tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Lock "f6720dc3-07fc-43e1-ba91-75e3d26a4a0f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:19:24 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-f03f9f7b-ec2d-4edd-bd50-58d3ffaaff7a tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Acquiring lock "f6720dc3-07fc-43e1-ba91-75e3d26a4a0f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:19:24 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-f03f9f7b-ec2d-4edd-bd50-58d3ffaaff7a tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Lock "f6720dc3-07fc-43e1-ba91-75e3d26a4a0f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:19:24 user nova-compute[75245]: INFO nova.compute.manager [None req-f03f9f7b-ec2d-4edd-bd50-58d3ffaaff7a tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Attaching volume 8d770f89-1bee-4af8-95bc-bb5df1b53f0d to /dev/vdb
Nov 29 16:19:24 user nova-compute[75245]: DEBUG os_brick.utils [None req-f03f9f7b-ec2d-4edd-bd50-58d3ffaaff7a tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:19:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:19:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:19:24 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[444e9e2f-07b4-45d0-948b-64fde4f930fe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:69ed8ed87091\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:19:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:19:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:19:24 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcfe5d31-eb8d-4b56-a83e-5916f102a52c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:19:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:19:24 user nova-compute[75245]: DEBUG nova.compute.manager [req-118f83cc-61f3-4e43-a203-08fb1a5584b2 req-0a314cc0-c148-4791-97bc-7ba7cd57de36 service nova] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Received event network-vif-plugged-f96864d7-90bc-4830-a939-4ef48125e8ba {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:19:24 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-118f83cc-61f3-4e43-a203-08fb1a5584b2 req-0a314cc0-c148-4791-97bc-7ba7cd57de36 service nova] Acquiring lock "f6720dc3-07fc-43e1-ba91-75e3d26a4a0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:19:24 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-118f83cc-61f3-4e43-a203-08fb1a5584b2 req-0a314cc0-c148-4791-97bc-7ba7cd57de36 service nova] Lock "f6720dc3-07fc-43e1-ba91-75e3d26a4a0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:19:24 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-118f83cc-61f3-4e43-a203-08fb1a5584b2 req-0a314cc0-c148-4791-97bc-7ba7cd57de36 service nova] Lock "f6720dc3-07fc-43e1-ba91-75e3d26a4a0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:19:24 user nova-compute[75245]: DEBUG nova.compute.manager [req-118f83cc-61f3-4e43-a203-08fb1a5584b2 req-0a314cc0-c148-4791-97bc-7ba7cd57de36 service nova] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] No waiting events found dispatching network-vif-plugged-f96864d7-90bc-4830-a939-4ef48125e8ba {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:19:24 user nova-compute[75245]: WARNING nova.compute.manager [req-118f83cc-61f3-4e43-a203-08fb1a5584b2 req-0a314cc0-c148-4791-97bc-7ba7cd57de36 service nova] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Received unexpected event network-vif-plugged-f96864d7-90bc-4830-a939-4ef48125e8ba for instance with vm_state active and task_state None.
Nov 29 16:19:24 user nova-compute[75245]: DEBUG nova.compute.manager [req-118f83cc-61f3-4e43-a203-08fb1a5584b2 req-0a314cc0-c148-4791-97bc-7ba7cd57de36 service nova] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Received event network-vif-plugged-f96864d7-90bc-4830-a939-4ef48125e8ba {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:19:24 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-118f83cc-61f3-4e43-a203-08fb1a5584b2 req-0a314cc0-c148-4791-97bc-7ba7cd57de36 service nova] Acquiring lock "f6720dc3-07fc-43e1-ba91-75e3d26a4a0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:19:24 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-118f83cc-61f3-4e43-a203-08fb1a5584b2 req-0a314cc0-c148-4791-97bc-7ba7cd57de36 service nova] Lock "f6720dc3-07fc-43e1-ba91-75e3d26a4a0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:19:24 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-118f83cc-61f3-4e43-a203-08fb1a5584b2 req-0a314cc0-c148-4791-97bc-7ba7cd57de36 service nova] Lock "f6720dc3-07fc-43e1-ba91-75e3d26a4a0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:19:24 user nova-compute[75245]: DEBUG nova.compute.manager [req-118f83cc-61f3-4e43-a203-08fb1a5584b2 req-0a314cc0-c148-4791-97bc-7ba7cd57de36 service nova] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] No waiting events found dispatching network-vif-plugged-f96864d7-90bc-4830-a939-4ef48125e8ba {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:19:24 user nova-compute[75245]: WARNING nova.compute.manager [req-118f83cc-61f3-4e43-a203-08fb1a5584b2 req-0a314cc0-c148-4791-97bc-7ba7cd57de36 service nova] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Received unexpected event network-vif-plugged-f96864d7-90bc-4830-a939-4ef48125e8ba for instance with vm_state active and task_state None.
Nov 29 16:19:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:19:24 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e8c893-6c00-48cc-bb9f-af0a2af70ad5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:19:24 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba8c3e1-6de4-4e81-9cc6-fc9f64d5810b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:19:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-f03f9f7b-ec2d-4edd-bd50-58d3ffaaff7a tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Running cmd (subprocess): nvme version {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:19:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-f03f9f7b-ec2d-4edd-bd50-58d3ffaaff7a tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] 'nvme version' failed. Not Retrying. {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:19:24 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f03f9f7b-ec2d-4edd-bd50-58d3ffaaff7a tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] nvme not present on system {{(pid=75245) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 16:19:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:19:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:19:24 user nova-compute[75245]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 16:19:24 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4419520-da08-4070-9c35-267b51d3fb68]: (4, '') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:19:24 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-f03f9f7b-ec2d-4edd-bd50-58d3ffaaff7a tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75245) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 16:19:24 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-f03f9f7b-ec2d-4edd-bd50-58d3ffaaff7a tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 16:19:24 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-f03f9f7b-ec2d-4edd-bd50-58d3ffaaff7a tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] LIGHTOS: no hostnqn found. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 16:19:24 user nova-compute[75245]: DEBUG os_brick.utils [None req-f03f9f7b-ec2d-4edd-bd50-58d3ffaaff7a tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:69ed8ed87091', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:19:24 user nova-compute[75245]: DEBUG nova.virt.block_device [None req-f03f9f7b-ec2d-4edd-bd50-58d3ffaaff7a tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Updating existing volume attachment record: 5c7dafd1-8d4d-45a1-96fe-8308e7f04206 {{(pid=75245) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 16:19:24 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d4ee5bfd-4d72-4cec-ba65-b3dbeaba082f tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Acquiring lock "43ead766-eeb0-4c7a-a03a-6d4daf7106af" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:19:24 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d4ee5bfd-4d72-4cec-ba65-b3dbeaba082f tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lock "43ead766-eeb0-4c7a-a03a-6d4daf7106af" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:19:24 user nova-compute[75245]: INFO nova.compute.manager [None req-d4ee5bfd-4d72-4cec-ba65-b3dbeaba082f tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Shelving
Nov 29 16:19:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:19:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:19:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:19:25 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:19:25 user nova-compute[75245]: DEBUG nova.compute.manager [req-2da58425-8df3-478f-b687-d31aba036703 req-a5daf42f-68f5-4d31-b20e-8ad02e0f510c service nova] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Received event network-vif-unplugged-4aefd86e-7753-4693-9cbd-6ee2178443b5 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:19:25 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-2da58425-8df3-478f-b687-d31aba036703 req-a5daf42f-68f5-4d31-b20e-8ad02e0f510c service nova] Acquiring lock "43ead766-eeb0-4c7a-a03a-6d4daf7106af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:19:25 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-2da58425-8df3-478f-b687-d31aba036703 req-a5daf42f-68f5-4d31-b20e-8ad02e0f510c service nova] Lock "43ead766-eeb0-4c7a-a03a-6d4daf7106af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:19:25 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-2da58425-8df3-478f-b687-d31aba036703 req-a5daf42f-68f5-4d31-b20e-8ad02e0f510c service nova] Lock "43ead766-eeb0-4c7a-a03a-6d4daf7106af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:19:25 user nova-compute[75245]: DEBUG nova.compute.manager [req-2da58425-8df3-478f-b687-d31aba036703 req-a5daf42f-68f5-4d31-b20e-8ad02e0f510c service nova] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] No waiting events found dispatching network-vif-unplugged-4aefd86e-7753-4693-9cbd-6ee2178443b5 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:19:25 user nova-compute[75245]: WARNING nova.compute.manager [req-2da58425-8df3-478f-b687-d31aba036703 req-a5daf42f-68f5-4d31-b20e-8ad02e0f510c service nova] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Received unexpected event network-vif-unplugged-4aefd86e-7753-4693-9cbd-6ee2178443b5 for instance with vm_state active and task_state shelving.
Nov 29 16:19:25 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Instance destroyed successfully.
Nov 29 16:19:25 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-d4ee5bfd-4d72-4cec-ba65-b3dbeaba082f tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Beginning cold snapshot process
Nov 29 16:19:25 user nova-compute[75245]: DEBUG nova.privsep.utils [None req-d4ee5bfd-4d72-4cec-ba65-b3dbeaba082f tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75245) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 16:19:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-d4ee5bfd-4d72-4cec-ba65-b3dbeaba082f tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/43ead766-eeb0-4c7a-a03a-6d4daf7106af/disk /opt/stack/data/nova/instances/snapshots/tmp167zjjf3/b0081d7546044eed8386438d31476434 {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:19:26 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-d4ee5bfd-4d72-4cec-ba65-b3dbeaba082f tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/43ead766-eeb0-4c7a-a03a-6d4daf7106af/disk /opt/stack/data/nova/instances/snapshots/tmp167zjjf3/b0081d7546044eed8386438d31476434" returned: 0 in 0.830s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:19:26 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-d4ee5bfd-4d72-4cec-ba65-b3dbeaba082f tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Snapshot extracted, beginning image upload
Nov 29 16:19:27 user nova-compute[75245]: DEBUG nova.compute.manager [req-e139aa9a-35b0-4b7f-9f09-b6140ebbd1e5 req-1ac3a4ab-7e12-403d-8cc1-14c7bfefb6f0 service nova] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Received event network-vif-plugged-4aefd86e-7753-4693-9cbd-6ee2178443b5 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:19:27 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-e139aa9a-35b0-4b7f-9f09-b6140ebbd1e5 req-1ac3a4ab-7e12-403d-8cc1-14c7bfefb6f0 service nova] Acquiring lock "43ead766-eeb0-4c7a-a03a-6d4daf7106af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:19:27 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-e139aa9a-35b0-4b7f-9f09-b6140ebbd1e5 req-1ac3a4ab-7e12-403d-8cc1-14c7bfefb6f0 service nova] Lock "43ead766-eeb0-4c7a-a03a-6d4daf7106af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:19:27 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-e139aa9a-35b0-4b7f-9f09-b6140ebbd1e5 req-1ac3a4ab-7e12-403d-8cc1-14c7bfefb6f0 service nova] Lock "43ead766-eeb0-4c7a-a03a-6d4daf7106af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:19:27 user nova-compute[75245]: DEBUG nova.compute.manager [req-e139aa9a-35b0-4b7f-9f09-b6140ebbd1e5 req-1ac3a4ab-7e12-403d-8cc1-14c7bfefb6f0 service nova] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] No waiting events found dispatching network-vif-plugged-4aefd86e-7753-4693-9cbd-6ee2178443b5 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:19:27 user nova-compute[75245]: WARNING nova.compute.manager [req-e139aa9a-35b0-4b7f-9f09-b6140ebbd1e5 req-1ac3a4ab-7e12-403d-8cc1-14c7bfefb6f0 service nova] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Received unexpected event network-vif-plugged-4aefd86e-7753-4693-9cbd-6ee2178443b5 for instance with vm_state active and task_state shelving_image_uploading.
Nov 29 16:19:27 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:19:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:19:29 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-d4ee5bfd-4d72-4cec-ba65-b3dbeaba082f tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Snapshot image upload complete
Nov 29 16:19:29 user nova-compute[75245]: DEBUG nova.compute.manager [None req-d4ee5bfd-4d72-4cec-ba65-b3dbeaba082f tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:19:29 user nova-compute[75245]: INFO nova.compute.manager [None req-d4ee5bfd-4d72-4cec-ba65-b3dbeaba082f tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Shelve offloading
Nov 29 16:19:29 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Instance destroyed successfully.
Nov 29 16:19:29 user nova-compute[75245]: DEBUG nova.compute.manager [None req-d4ee5bfd-4d72-4cec-ba65-b3dbeaba082f tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:19:29 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d4ee5bfd-4d72-4cec-ba65-b3dbeaba082f tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Acquiring lock "refresh_cache-43ead766-eeb0-4c7a-a03a-6d4daf7106af" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:19:29 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d4ee5bfd-4d72-4cec-ba65-b3dbeaba082f tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Acquired lock "refresh_cache-43ead766-eeb0-4c7a-a03a-6d4daf7106af" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:19:29 user nova-compute[75245]: DEBUG nova.network.neutron [None req-d4ee5bfd-4d72-4cec-ba65-b3dbeaba082f tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 16:19:30 user nova-compute[75245]: DEBUG nova.network.neutron [None req-d4ee5bfd-4d72-4cec-ba65-b3dbeaba082f tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Updating instance_info_cache with network_info: [{"id": "4aefd86e-7753-4693-9cbd-6ee2178443b5", "address": "fa:16:3e:d1:0a:c7", "network": {"id": "7f978dee-8a5e-4218-b6fc-2d550c0d7b5d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-53637364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd22948fbd074a7c94d8ad7614fbc220", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aefd86e-77", "ovs_interfaceid": "4aefd86e-7753-4693-9cbd-6ee2178443b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:19:30 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d4ee5bfd-4d72-4cec-ba65-b3dbeaba082f tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Releasing lock "refresh_cache-43ead766-eeb0-4c7a-a03a-6d4daf7106af" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:19:30 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Instance destroyed successfully.
Nov 29 16:19:30 user nova-compute[75245]: DEBUG nova.objects.instance [None req-d4ee5bfd-4d72-4cec-ba65-b3dbeaba082f tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lazy-loading 'resources' on Instance uuid 43ead766-eeb0-4c7a-a03a-6d4daf7106af {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:19:30 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-d4ee5bfd-4d72-4cec-ba65-b3dbeaba082f tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:17:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1984176240',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1984176240',id=19,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH74Z8eiyypbz1l5JPvqoE7mN6kpBjtN9LGqUH9Jk8PAY58RfZ7MUKhgrCMNHi/qzGIKNjocBtHkdxwKxLqCEmWTXuOZM9njdSqlsEwUOIVVwyojf8wouSpxuKrMcUkPaA==',key_name='tempest-keypair-572815760',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:17:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='fd22948fbd074a7c94d8ad7614fbc220',ramdisk_id='',reservation_id='r-48eaewao',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1524245296',owner_user_name='tempest-AttachVolumeShelveTestJSON-1524245296-project-member',shelved_at='2023-11-29T16:19:29.502137',shelved_host='user',shelved_image_id='13f64672-2403-41c9-bc86-f40febafc109'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:19:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c4942f948584702a8c8b93248694a65',uuid=43ead766-eeb0-4c7a-a03a-6d4daf7106af,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "4aefd86e-7753-4693-9cbd-6ee2178443b5", "address": "fa:16:3e:d1:0a:c7", "network": {"id": "7f978dee-8a5e-4218-b6fc-2d550c0d7b5d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-53637364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd22948fbd074a7c94d8ad7614fbc220", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aefd86e-77", "ovs_interfaceid": "4aefd86e-7753-4693-9cbd-6ee2178443b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 16:19:30 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-d4ee5bfd-4d72-4cec-ba65-b3dbeaba082f tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Converting VIF {"id": "4aefd86e-7753-4693-9cbd-6ee2178443b5", "address": "fa:16:3e:d1:0a:c7", "network": {"id": "7f978dee-8a5e-4218-b6fc-2d550c0d7b5d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-53637364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd22948fbd074a7c94d8ad7614fbc220", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aefd86e-77", "ovs_interfaceid": "4aefd86e-7753-4693-9cbd-6ee2178443b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:19:30 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-d4ee5bfd-4d72-4cec-ba65-b3dbeaba082f tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:0a:c7,bridge_name='br-int',has_traffic_filtering=True,id=4aefd86e-7753-4693-9cbd-6ee2178443b5,network=Network(7f978dee-8a5e-4218-b6fc-2d550c0d7b5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4aefd86e-77') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:19:30 user nova-compute[75245]: DEBUG os_vif [None req-d4ee5bfd-4d72-4cec-ba65-b3dbeaba082f tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:0a:c7,bridge_name='br-int',has_traffic_filtering=True,id=4aefd86e-7753-4693-9cbd-6ee2178443b5,network=Network(7f978dee-8a5e-4218-b6fc-2d550c0d7b5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4aefd86e-77') {{(pid=75245) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 16:19:30 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:19:30 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4aefd86e-77, bridge=br-int, if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:19:30 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:19:30 user nova-compute[75245]: DEBUG nova.compute.manager [req-cd15c7ad-e670-43df-91e0-f63527bec1a6 req-4fd64c61-c703-419b-86a7-b70cc7c8f85b service nova] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Received event network-changed-4aefd86e-7753-4693-9cbd-6ee2178443b5 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:19:30 user nova-compute[75245]: DEBUG nova.compute.manager [req-cd15c7ad-e670-43df-91e0-f63527bec1a6 req-4fd64c61-c703-419b-86a7-b70cc7c8f85b service nova] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Refreshing instance network info cache due to event network-changed-4aefd86e-7753-4693-9cbd-6ee2178443b5. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:19:30 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-cd15c7ad-e670-43df-91e0-f63527bec1a6 req-4fd64c61-c703-419b-86a7-b70cc7c8f85b service nova] Acquiring lock "refresh_cache-43ead766-eeb0-4c7a-a03a-6d4daf7106af" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:19:30 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-cd15c7ad-e670-43df-91e0-f63527bec1a6 req-4fd64c61-c703-419b-86a7-b70cc7c8f85b service nova] Acquired lock "refresh_cache-43ead766-eeb0-4c7a-a03a-6d4daf7106af" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:19:30 user nova-compute[75245]: DEBUG nova.network.neutron [req-cd15c7ad-e670-43df-91e0-f63527bec1a6 req-4fd64c61-c703-419b-86a7-b70cc7c8f85b service nova] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Refreshing network info cache for port 4aefd86e-7753-4693-9cbd-6ee2178443b5 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:19:30 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:19:30 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:19:30 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=94b35240-05fe-4c8d-baf7-9b20a45a6def) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:19:30 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:19:30 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:19:30 user nova-compute[75245]: INFO os_vif [None req-d4ee5bfd-4d72-4cec-ba65-b3dbeaba082f tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:0a:c7,bridge_name='br-int',has_traffic_filtering=True,id=4aefd86e-7753-4693-9cbd-6ee2178443b5,network=Network(7f978dee-8a5e-4218-b6fc-2d550c0d7b5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4aefd86e-77')
Nov 29 16:19:30 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-d4ee5bfd-4d72-4cec-ba65-b3dbeaba082f tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Deleting instance files /opt/stack/data/nova/instances/43ead766-eeb0-4c7a-a03a-6d4daf7106af_del
Nov 29 16:19:30 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-d4ee5bfd-4d72-4cec-ba65-b3dbeaba082f tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Deletion of /opt/stack/data/nova/instances/43ead766-eeb0-4c7a-a03a-6d4daf7106af_del complete
Nov 29 16:19:30 user nova-compute[75245]: INFO nova.scheduler.client.report [None req-d4ee5bfd-4d72-4cec-ba65-b3dbeaba082f tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Deleted allocations for instance 43ead766-eeb0-4c7a-a03a-6d4daf7106af
Nov 29 16:19:30 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d4ee5bfd-4d72-4cec-ba65-b3dbeaba082f tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:19:30 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d4ee5bfd-4d72-4cec-ba65-b3dbeaba082f tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:19:30 user nova-compute[75245]: DEBUG nova.objects.instance [None req-d4ee5bfd-4d72-4cec-ba65-b3dbeaba082f tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lazy-loading 'numa_topology' on Instance uuid 43ead766-eeb0-4c7a-a03a-6d4daf7106af {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:19:30 user nova-compute[75245]: DEBUG nova.objects.base [None req-d4ee5bfd-4d72-4cec-ba65-b3dbeaba082f tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Object Instance<43ead766-eeb0-4c7a-a03a-6d4daf7106af> lazy-loaded attributes: resources,numa_topology {{(pid=75245) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 16:19:31 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-d4ee5bfd-4d72-4cec-ba65-b3dbeaba082f tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:19:31 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-d4ee5bfd-4d72-4cec-ba65-b3dbeaba082f tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:19:31 user nova-compute[75245]: DEBUG nova.network.neutron [req-cd15c7ad-e670-43df-91e0-f63527bec1a6 req-4fd64c61-c703-419b-86a7-b70cc7c8f85b service nova] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Updated VIF entry in instance network info cache for port 4aefd86e-7753-4693-9cbd-6ee2178443b5. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:19:31 user nova-compute[75245]: DEBUG nova.network.neutron [req-cd15c7ad-e670-43df-91e0-f63527bec1a6 req-4fd64c61-c703-419b-86a7-b70cc7c8f85b service nova] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Updating instance_info_cache with network_info: [{"id": "4aefd86e-7753-4693-9cbd-6ee2178443b5", "address": "fa:16:3e:d1:0a:c7", "network": {"id": "7f978dee-8a5e-4218-b6fc-2d550c0d7b5d", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-53637364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd22948fbd074a7c94d8ad7614fbc220", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap4aefd86e-77", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:19:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-cd15c7ad-e670-43df-91e0-f63527bec1a6 req-4fd64c61-c703-419b-86a7-b70cc7c8f85b service nova] Releasing lock "refresh_cache-43ead766-eeb0-4c7a-a03a-6d4daf7106af" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:19:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d4ee5bfd-4d72-4cec-ba65-b3dbeaba082f tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.227s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:19:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d4ee5bfd-4d72-4cec-ba65-b3dbeaba082f tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lock "43ead766-eeb0-4c7a-a03a-6d4daf7106af" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.296s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:19:31 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f03f9f7b-ec2d-4edd-bd50-58d3ffaaff7a tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Calling os-brick to attach iSCSI Volume {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 16:19:31 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-f03f9f7b-ec2d-4edd-bd50-58d3ffaaff7a tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8d770f89-1bee-4af8-95bc-bb5df1b53f0d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Grlfdqpe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:19:31 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-f03f9f7b-ec2d-4edd-bd50-58d3ffaaff7a tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:19:31 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-f03f9f7b-ec2d-4edd-bd50-58d3ffaaff7a tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:19:31 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-f03f9f7b-ec2d-4edd-bd50-58d3ffaaff7a tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:19:31 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-f03f9f7b-ec2d-4edd-bd50-58d3ffaaff7a tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:19:31 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-f03f9f7b-ec2d-4edd-bd50-58d3ffaaff7a tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d770f89-1bee-4af8-95bc-bb5df1b53f0d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:19:31 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-f03f9f7b-ec2d-4edd-bd50-58d3ffaaff7a tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d770f89-1bee-4af8-95bc-bb5df1b53f0d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:19:31 user nova-compute[75245]: INFO os_brick.initiator.connectors.iscsi [None req-f03f9f7b-ec2d-4edd-bd50-58d3ffaaff7a tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 16:19:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d770f89-1bee-4af8-95bc-bb5df1b53f0d -p 172.16.0.220:3260 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:19:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d770f89-1bee-4af8-95bc-bb5df1b53f0d -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:19:31 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[07769d99-0a96-4e55-899c-d5d98d0ae249]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:19:31 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-f03f9f7b-ec2d-4edd-bd50-58d3ffaaff7a tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 16:19:31 user nova-compute[75245]:  {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:19:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d770f89-1bee-4af8-95bc-bb5df1b53f0d -p 172.16.0.220:3260 --interface default --op new {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:19:32 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d770f89-1bee-4af8-95bc-bb5df1b53f0d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:19:32 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d5ae39-d282-477f-baa2-3fe4d1394649]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8d770f89-1bee-4af8-95bc-bb5df1b53f0d] added\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:19:32 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-f03f9f7b-ec2d-4edd-bd50-58d3ffaaff7a tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8d770f89-1bee-4af8-95bc-bb5df1b53f0d] added
Nov 29 16:19:32 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:19:32 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d770f89-1bee-4af8-95bc-bb5df1b53f0d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:19:32 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d770f89-1bee-4af8-95bc-bb5df1b53f0d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:19:32 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[546b56e4-7bb6-4743-a323-ad48204ff985]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:19:32 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-f03f9f7b-ec2d-4edd-bd50-58d3ffaaff7a tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:19:32 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d770f89-1bee-4af8-95bc-bb5df1b53f0d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:19:32 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d770f89-1bee-4af8-95bc-bb5df1b53f0d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:19:32 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[f619b63b-b5ad-447e-9d7c-05241c832860]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:19:32 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-f03f9f7b-ec2d-4edd-bd50-58d3ffaaff7a tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:19:32 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d770f89-1bee-4af8-95bc-bb5df1b53f0d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Grlfdqpe {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:19:32 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d770f89-1bee-4af8-95bc-bb5df1b53f0d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Grlfdqpe" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:19:32 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a32c5ad-4136-47f7-8c67-2592fdb29ee2]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:19:32 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-f03f9f7b-ec2d-4edd-bd50-58d3ffaaff7a tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'Grlfdqpe'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:19:32 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d770f89-1bee-4af8-95bc-bb5df1b53f0d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:19:32 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d770f89-1bee-4af8-95bc-bb5df1b53f0d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:19:32 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[06070836-4be1-48c0-b7b4-f421f410b13f]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:19:32 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-f03f9f7b-ec2d-4edd-bd50-58d3ffaaff7a tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:19:32 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:19:32 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:19:32 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[310e52b1-95b1-407e-9421-4ba562cbc808]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:19:32 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-f03f9f7b-ec2d-4edd-bd50-58d3ffaaff7a tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 16:19:32 user nova-compute[75245]:  {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:19:32 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-f03f9f7b-ec2d-4edd-bd50-58d3ffaaff7a tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 16:19:32 user nova-compute[75245]:  {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:19:32 user nova-compute[75245]: WARNING os_brick.initiator.connectors.iscsi [None req-f03f9f7b-ec2d-4edd-bd50-58d3ffaaff7a tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 16:19:32 user nova-compute[75245]: 
Nov 29 16:19:32 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d770f89-1bee-4af8-95bc-bb5df1b53f0d -p 172.16.0.220:3260 --login {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:19:32 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d770f89-1bee-4af8-95bc-bb5df1b53f0d -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:19:32 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[848e5e96-b2ac-4af7-9983-453f9cba7b7d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8d770f89-1bee-4af8-95bc-bb5df1b53f0d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8d770f89-1bee-4af8-95bc-bb5df1b53f0d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:19:32 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-f03f9f7b-ec2d-4edd-bd50-58d3ffaaff7a tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8d770f89-1bee-4af8-95bc-bb5df1b53f0d, portal: 172.16.0.220,3260]
Nov 29 16:19:32 user nova-compute[75245]: Login to [iface: default, target: iqn.2010-10.org.openstack:8d770f89-1bee-4af8-95bc-bb5df1b53f0d, portal: 172.16.0.220,3260] successful.
Nov 29 16:19:32 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:19:32 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d770f89-1bee-4af8-95bc-bb5df1b53f0d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:19:32 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d770f89-1bee-4af8-95bc-bb5df1b53f0d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:19:32 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[891e058d-4be8-4353-aadd-a27f903696ef]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:19:32 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-f03f9f7b-ec2d-4edd-bd50-58d3ffaaff7a tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:19:32 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:19:32 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:19:32 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b07445-f05a-4571-914e-50bfe3808fa1]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d770f89-1bee-4af8-95bc-bb5df1b53f0d (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:19:32 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-f03f9f7b-ec2d-4edd-bd50-58d3ffaaff7a tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d770f89-1bee-4af8-95bc-bb5df1b53f0d (non-flash)
Nov 29 16:19:32 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:19:32 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-f03f9f7b-ec2d-4edd-bd50-58d3ffaaff7a tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d770f89-1bee-4af8-95bc-bb5df1b53f0d (non-flash)
Nov 29 16:19:32 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:19:32 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-f03f9f7b-ec2d-4edd-bd50-58d3ffaaff7a tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d770f89-1bee-4af8-95bc-bb5df1b53f0d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:19:32 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-f03f9f7b-ec2d-4edd-bd50-58d3ffaaff7a tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Connected to 172.16.0.220:3260 {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 16:19:32 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-f03f9f7b-ec2d-4edd-bd50-58d3ffaaff7a tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] HCTL ('33', '-', '-', 0) found on session 25 with lun 0 {{(pid=75245) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 16:19:32 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-f03f9f7b-ec2d-4edd-bd50-58d3ffaaff7a tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75245) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 16:19:32 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:19:32 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:19:32 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[9178232d-f08d-4739-a654-16aa11a02505]: (4, ('- - 0', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:19:32 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-f03f9f7b-ec2d-4edd-bd50-58d3ffaaff7a tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Searching for a device in session 25 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75245) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 16:19:32 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-f03f9f7b-ec2d-4edd-bd50-58d3ffaaff7a tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8d770f89-1bee-4af8-95bc-bb5df1b53f0d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Grlfdqpe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 16:19:33 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:19:33 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-f03f9f7b-ec2d-4edd-bd50-58d3ffaaff7a tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:19:33 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-f03f9f7b-ec2d-4edd-bd50-58d3ffaaff7a tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '23364303138336662', 'path': '/dev/sdb'} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:19:33 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f03f9f7b-ec2d-4edd-bd50-58d3ffaaff7a tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23364303138336662', 'path': '/dev/sdb'} {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 16:19:33 user nova-compute[75245]: DEBUG nova.objects.instance [None req-f03f9f7b-ec2d-4edd-bd50-58d3ffaaff7a tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Lazy-loading 'flavor' on Instance uuid f6720dc3-07fc-43e1-ba91-75e3d26a4a0f {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:19:33 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-f03f9f7b-ec2d-4edd-bd50-58d3ffaaff7a tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 16:19:33 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:19:33 user nova-compute[75245]:   <source dev="/dev/sdb"/>
Nov 29 16:19:33 user nova-compute[75245]:   <target dev="vdb" bus="virtio"/>
Nov 29 16:19:33 user nova-compute[75245]:   <serial>8d770f89-1bee-4af8-95bc-bb5df1b53f0d</serial>
Nov 29 16:19:33 user nova-compute[75245]: </disk>
Nov 29 16:19:33 user nova-compute[75245]:  {{(pid=75245) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 16:19:33 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-f03f9f7b-ec2d-4edd-bd50-58d3ffaaff7a tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:19:33 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-f03f9f7b-ec2d-4edd-bd50-58d3ffaaff7a tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] No BDM found with device name hda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:19:33 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-f03f9f7b-ec2d-4edd-bd50-58d3ffaaff7a tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] No VIF found with MAC fa:16:3e:11:16:c3, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:19:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-f03f9f7b-ec2d-4edd-bd50-58d3ffaaff7a tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Lock "f6720dc3-07fc-43e1-ba91-75e3d26a4a0f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.786s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:19:35 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-8b7e1a73-0f52-43c1-82a5-e5876ace543d tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Acquiring lock "f6720dc3-07fc-43e1-ba91-75e3d26a4a0f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:19:35 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-8b7e1a73-0f52-43c1-82a5-e5876ace543d tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Lock "f6720dc3-07fc-43e1-ba91-75e3d26a4a0f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:19:35 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:19:35 user nova-compute[75245]: INFO nova.compute.manager [None req-8b7e1a73-0f52-43c1-82a5-e5876ace543d tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Detaching volume 8d770f89-1bee-4af8-95bc-bb5df1b53f0d
Nov 29 16:19:35 user nova-compute[75245]: INFO nova.virt.block_device [None req-8b7e1a73-0f52-43c1-82a5-e5876ace543d tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Attempting to driver detach volume 8d770f89-1bee-4af8-95bc-bb5df1b53f0d from mountpoint /dev/vdb
Nov 29 16:19:35 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-8b7e1a73-0f52-43c1-82a5-e5876ace543d tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Attempting to detach device vdb from instance f6720dc3-07fc-43e1-ba91-75e3d26a4a0f from the persistent domain config. {{(pid=75245) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 16:19:35 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-8b7e1a73-0f52-43c1-82a5-e5876ace543d tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 16:19:35 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:19:35 user nova-compute[75245]:   <source dev="/dev/sdb"/>
Nov 29 16:19:35 user nova-compute[75245]:   <target dev="vdb" bus="virtio"/>
Nov 29 16:19:35 user nova-compute[75245]:   <serial>8d770f89-1bee-4af8-95bc-bb5df1b53f0d</serial>
Nov 29 16:19:35 user nova-compute[75245]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 29 16:19:35 user nova-compute[75245]: </disk>
Nov 29 16:19:35 user nova-compute[75245]:  {{(pid=75245) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 16:19:35 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-8b7e1a73-0f52-43c1-82a5-e5876ace543d tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Successfully detached device vdb from instance f6720dc3-07fc-43e1-ba91-75e3d26a4a0f from the persistent domain config.
Nov 29 16:19:35 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-8b7e1a73-0f52-43c1-82a5-e5876ace543d tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f6720dc3-07fc-43e1-ba91-75e3d26a4a0f from the live domain config. {{(pid=75245) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 16:19:35 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-8b7e1a73-0f52-43c1-82a5-e5876ace543d tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 16:19:35 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:19:35 user nova-compute[75245]:   <source dev="/dev/sdb"/>
Nov 29 16:19:35 user nova-compute[75245]:   <target dev="vdb" bus="virtio"/>
Nov 29 16:19:35 user nova-compute[75245]:   <serial>8d770f89-1bee-4af8-95bc-bb5df1b53f0d</serial>
Nov 29 16:19:35 user nova-compute[75245]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 29 16:19:35 user nova-compute[75245]: </disk>
Nov 29 16:19:35 user nova-compute[75245]:  {{(pid=75245) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 16:19:36 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-8b7e1a73-0f52-43c1-82a5-e5876ace543d tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f6720dc3-07fc-43e1-ba91-75e3d26a4a0f {{(pid=75245) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 16:19:36 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-e5d90596-7c42-4eb6-b791-269f9755f272 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Acquiring lock "816edb0e-c4fc-470b-8151-f98502e50789" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:19:36 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-e5d90596-7c42-4eb6-b791-269f9755f272 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "816edb0e-c4fc-470b-8151-f98502e50789" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:19:36 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-e5d90596-7c42-4eb6-b791-269f9755f272 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Acquiring lock "816edb0e-c4fc-470b-8151-f98502e50789-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:19:36 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-e5d90596-7c42-4eb6-b791-269f9755f272 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "816edb0e-c4fc-470b-8151-f98502e50789-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:19:36 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-e5d90596-7c42-4eb6-b791-269f9755f272 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "816edb0e-c4fc-470b-8151-f98502e50789-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:19:36 user nova-compute[75245]: INFO nova.compute.manager [None req-e5d90596-7c42-4eb6-b791-269f9755f272 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Terminating instance
Nov 29 16:19:36 user nova-compute[75245]: DEBUG nova.compute.manager [None req-e5d90596-7c42-4eb6-b791-269f9755f272 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Start destroying the instance on the hypervisor. {{(pid=75245) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 16:19:36 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:19:36 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:19:36 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:19:36 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:19:37 user nova-compute[75245]: DEBUG nova.compute.manager [req-3950781b-4afd-4a81-a2be-5e91efa2f1c5 req-df19e1fd-6a01-4235-b0d9-ee8953e0c4c0 service nova] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Received event network-vif-unplugged-f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:19:37 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-3950781b-4afd-4a81-a2be-5e91efa2f1c5 req-df19e1fd-6a01-4235-b0d9-ee8953e0c4c0 service nova] Acquiring lock "816edb0e-c4fc-470b-8151-f98502e50789-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:19:37 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-3950781b-4afd-4a81-a2be-5e91efa2f1c5 req-df19e1fd-6a01-4235-b0d9-ee8953e0c4c0 service nova] Lock "816edb0e-c4fc-470b-8151-f98502e50789-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:19:37 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-3950781b-4afd-4a81-a2be-5e91efa2f1c5 req-df19e1fd-6a01-4235-b0d9-ee8953e0c4c0 service nova] Lock "816edb0e-c4fc-470b-8151-f98502e50789-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:19:37 user nova-compute[75245]: DEBUG nova.compute.manager [req-3950781b-4afd-4a81-a2be-5e91efa2f1c5 req-df19e1fd-6a01-4235-b0d9-ee8953e0c4c0 service nova] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] No waiting events found dispatching network-vif-unplugged-f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:19:37 user nova-compute[75245]: DEBUG nova.compute.manager [req-3950781b-4afd-4a81-a2be-5e91efa2f1c5 req-df19e1fd-6a01-4235-b0d9-ee8953e0c4c0 service nova] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Received event network-vif-unplugged-f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76 for instance with task_state deleting. {{(pid=75245) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 16:19:37 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:19:37 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:19:37 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:19:37 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:19:37 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Instance destroyed successfully.
Nov 29 16:19:37 user nova-compute[75245]: DEBUG nova.objects.instance [None req-e5d90596-7c42-4eb6-b791-269f9755f272 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lazy-loading 'resources' on Instance uuid 816edb0e-c4fc-470b-8151-f98502e50789 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:19:37 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-e5d90596-7c42-4eb6-b791-269f9755f272 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T16:13:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1242011736',display_name='tempest-ServerActionsTestOtherA-server-627394806',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1242011736',id=15,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqtiPWs7C4RKGy4yNsp7JTc2XDL0TwaTur5f1RRj6K0Rb6+sFA2CPy5UHpa1YR4wGjwq9AoHpMqOkkk3stctHMw5fDz8nndvq/jbvNk3M28JEwy6jco6tcwC+4eKQq8uQ==',key_name='tempest-keypair-1228788968',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:16:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c6b87e18ef1f48d19a6907b28cb54f04',ramdisk_id='',reservation_id='r-zsz4hlok',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1840344781',owner_user_name='tempest-ServerActionsTestOtherA-1840344781-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:16:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be595c3f7084413180f2ab86e9c56a64',uuid=816edb0e-c4fc-470b-8151-f98502e50789,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76", "address": "fa:16:3e:f9:3e:bc", "network": {"id": "f1fac2f4-e789-443e-b6a5-1a3f829bc302", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1199431077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6b87e18ef1f48d19a6907b28cb54f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf038ddf7-a5", "ovs_interfaceid": "f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 16:19:37 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-e5d90596-7c42-4eb6-b791-269f9755f272 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Converting VIF {"id": "f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76", "address": "fa:16:3e:f9:3e:bc", "network": {"id": "f1fac2f4-e789-443e-b6a5-1a3f829bc302", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1199431077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6b87e18ef1f48d19a6907b28cb54f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf038ddf7-a5", "ovs_interfaceid": "f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:19:37 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-e5d90596-7c42-4eb6-b791-269f9755f272 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:3e:bc,bridge_name='br-int',has_traffic_filtering=True,id=f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76,network=Network(f1fac2f4-e789-443e-b6a5-1a3f829bc302),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf038ddf7-a5') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:19:37 user nova-compute[75245]: DEBUG os_vif [None req-e5d90596-7c42-4eb6-b791-269f9755f272 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:3e:bc,bridge_name='br-int',has_traffic_filtering=True,id=f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76,network=Network(f1fac2f4-e789-443e-b6a5-1a3f829bc302),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf038ddf7-a5') {{(pid=75245) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 16:19:37 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:19:37 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf038ddf7-a5, bridge=br-int, if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:19:37 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:19:37 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:19:37 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:19:37 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8c82a80f-4fca-4679-a455-8d18fb0846e9) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:19:37 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:19:37 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:19:37 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:19:37 user nova-compute[75245]: INFO os_vif [None req-e5d90596-7c42-4eb6-b791-269f9755f272 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:3e:bc,bridge_name='br-int',has_traffic_filtering=True,id=f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76,network=Network(f1fac2f4-e789-443e-b6a5-1a3f829bc302),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf038ddf7-a5')
Nov 29 16:19:37 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-e5d90596-7c42-4eb6-b791-269f9755f272 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Deleting instance files /opt/stack/data/nova/instances/816edb0e-c4fc-470b-8151-f98502e50789_del
Nov 29 16:19:37 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-e5d90596-7c42-4eb6-b791-269f9755f272 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Deletion of /opt/stack/data/nova/instances/816edb0e-c4fc-470b-8151-f98502e50789_del complete
Nov 29 16:19:37 user nova-compute[75245]: INFO nova.compute.manager [None req-e5d90596-7c42-4eb6-b791-269f9755f272 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Took 1.08 seconds to destroy the instance on the hypervisor.
Nov 29 16:19:37 user nova-compute[75245]: DEBUG oslo.service.loopingcall [None req-e5d90596-7c42-4eb6-b791-269f9755f272 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75245) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 16:19:37 user nova-compute[75245]: DEBUG nova.compute.manager [-] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Deallocating network for instance {{(pid=75245) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 16:19:37 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] deallocate_for_instance() {{(pid=75245) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 16:19:37 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:19:37 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:19:37 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:19:37 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:19:38 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:19:38 user nova-compute[75245]: DEBUG nova.compute.manager [req-3d0dae0a-fc03-48a6-8105-936d0e99dae7 req-227bd07e-c2e8-47b9-bfd4-5479d467a089 service nova] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Received event network-changed-27fc0374-0770-4171-a730-6696b09362eb {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:19:38 user nova-compute[75245]: DEBUG nova.compute.manager [req-3d0dae0a-fc03-48a6-8105-936d0e99dae7 req-227bd07e-c2e8-47b9-bfd4-5479d467a089 service nova] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Refreshing instance network info cache due to event network-changed-27fc0374-0770-4171-a730-6696b09362eb. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:19:38 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-3d0dae0a-fc03-48a6-8105-936d0e99dae7 req-227bd07e-c2e8-47b9-bfd4-5479d467a089 service nova] Acquiring lock "refresh_cache-84bae51e-2a85-442d-bbd2-fc89f30f40b7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:19:38 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-3d0dae0a-fc03-48a6-8105-936d0e99dae7 req-227bd07e-c2e8-47b9-bfd4-5479d467a089 service nova] Acquired lock "refresh_cache-84bae51e-2a85-442d-bbd2-fc89f30f40b7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:19:38 user nova-compute[75245]: DEBUG nova.network.neutron [req-3d0dae0a-fc03-48a6-8105-936d0e99dae7 req-227bd07e-c2e8-47b9-bfd4-5479d467a089 service nova] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Refreshing network info cache for port 27fc0374-0770-4171-a730-6696b09362eb {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:19:39 user nova-compute[75245]: DEBUG nova.compute.manager [req-971fd495-5abb-4c71-853d-aaad2a0b6d62 req-d4d07d2c-7e28-4555-89ff-77036e94b6cd service nova] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Received event network-vif-plugged-f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:19:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-971fd495-5abb-4c71-853d-aaad2a0b6d62 req-d4d07d2c-7e28-4555-89ff-77036e94b6cd service nova] Acquiring lock "816edb0e-c4fc-470b-8151-f98502e50789-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:19:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-971fd495-5abb-4c71-853d-aaad2a0b6d62 req-d4d07d2c-7e28-4555-89ff-77036e94b6cd service nova] Lock "816edb0e-c4fc-470b-8151-f98502e50789-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:19:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-971fd495-5abb-4c71-853d-aaad2a0b6d62 req-d4d07d2c-7e28-4555-89ff-77036e94b6cd service nova] Lock "816edb0e-c4fc-470b-8151-f98502e50789-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:19:39 user nova-compute[75245]: DEBUG nova.compute.manager [req-971fd495-5abb-4c71-853d-aaad2a0b6d62 req-d4d07d2c-7e28-4555-89ff-77036e94b6cd service nova] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] No waiting events found dispatching network-vif-plugged-f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:19:39 user nova-compute[75245]: WARNING nova.compute.manager [req-971fd495-5abb-4c71-853d-aaad2a0b6d62 req-d4d07d2c-7e28-4555-89ff-77036e94b6cd service nova] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Received unexpected event network-vif-plugged-f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76 for instance with vm_state active and task_state deleting.
Nov 29 16:19:39 user nova-compute[75245]: DEBUG nova.compute.manager [req-971fd495-5abb-4c71-853d-aaad2a0b6d62 req-d4d07d2c-7e28-4555-89ff-77036e94b6cd service nova] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Received event network-vif-plugged-f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:19:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-971fd495-5abb-4c71-853d-aaad2a0b6d62 req-d4d07d2c-7e28-4555-89ff-77036e94b6cd service nova] Acquiring lock "816edb0e-c4fc-470b-8151-f98502e50789-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:19:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-971fd495-5abb-4c71-853d-aaad2a0b6d62 req-d4d07d2c-7e28-4555-89ff-77036e94b6cd service nova] Lock "816edb0e-c4fc-470b-8151-f98502e50789-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:19:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-971fd495-5abb-4c71-853d-aaad2a0b6d62 req-d4d07d2c-7e28-4555-89ff-77036e94b6cd service nova] Lock "816edb0e-c4fc-470b-8151-f98502e50789-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:19:39 user nova-compute[75245]: DEBUG nova.compute.manager [req-971fd495-5abb-4c71-853d-aaad2a0b6d62 req-d4d07d2c-7e28-4555-89ff-77036e94b6cd service nova] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] No waiting events found dispatching network-vif-plugged-f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:19:39 user nova-compute[75245]: WARNING nova.compute.manager [req-971fd495-5abb-4c71-853d-aaad2a0b6d62 req-d4d07d2c-7e28-4555-89ff-77036e94b6cd service nova] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Received unexpected event network-vif-plugged-f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76 for instance with vm_state active and task_state deleting.
Nov 29 16:19:39 user nova-compute[75245]: DEBUG nova.compute.manager [req-971fd495-5abb-4c71-853d-aaad2a0b6d62 req-d4d07d2c-7e28-4555-89ff-77036e94b6cd service nova] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Received event network-vif-plugged-f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:19:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-971fd495-5abb-4c71-853d-aaad2a0b6d62 req-d4d07d2c-7e28-4555-89ff-77036e94b6cd service nova] Acquiring lock "816edb0e-c4fc-470b-8151-f98502e50789-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:19:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-971fd495-5abb-4c71-853d-aaad2a0b6d62 req-d4d07d2c-7e28-4555-89ff-77036e94b6cd service nova] Lock "816edb0e-c4fc-470b-8151-f98502e50789-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:19:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-971fd495-5abb-4c71-853d-aaad2a0b6d62 req-d4d07d2c-7e28-4555-89ff-77036e94b6cd service nova] Lock "816edb0e-c4fc-470b-8151-f98502e50789-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:19:39 user nova-compute[75245]: DEBUG nova.compute.manager [req-971fd495-5abb-4c71-853d-aaad2a0b6d62 req-d4d07d2c-7e28-4555-89ff-77036e94b6cd service nova] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] No waiting events found dispatching network-vif-plugged-f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:19:39 user nova-compute[75245]: WARNING nova.compute.manager [req-971fd495-5abb-4c71-853d-aaad2a0b6d62 req-d4d07d2c-7e28-4555-89ff-77036e94b6cd service nova] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Received unexpected event network-vif-plugged-f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76 for instance with vm_state active and task_state deleting.
Nov 29 16:19:39 user nova-compute[75245]: DEBUG nova.compute.manager [req-971fd495-5abb-4c71-853d-aaad2a0b6d62 req-d4d07d2c-7e28-4555-89ff-77036e94b6cd service nova] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Received event network-vif-unplugged-f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:19:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-971fd495-5abb-4c71-853d-aaad2a0b6d62 req-d4d07d2c-7e28-4555-89ff-77036e94b6cd service nova] Acquiring lock "816edb0e-c4fc-470b-8151-f98502e50789-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:19:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-971fd495-5abb-4c71-853d-aaad2a0b6d62 req-d4d07d2c-7e28-4555-89ff-77036e94b6cd service nova] Lock "816edb0e-c4fc-470b-8151-f98502e50789-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:19:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-971fd495-5abb-4c71-853d-aaad2a0b6d62 req-d4d07d2c-7e28-4555-89ff-77036e94b6cd service nova] Lock "816edb0e-c4fc-470b-8151-f98502e50789-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:19:39 user nova-compute[75245]: DEBUG nova.compute.manager [req-971fd495-5abb-4c71-853d-aaad2a0b6d62 req-d4d07d2c-7e28-4555-89ff-77036e94b6cd service nova] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] No waiting events found dispatching network-vif-unplugged-f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:19:39 user nova-compute[75245]: DEBUG nova.compute.manager [req-971fd495-5abb-4c71-853d-aaad2a0b6d62 req-d4d07d2c-7e28-4555-89ff-77036e94b6cd service nova] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Received event network-vif-unplugged-f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76 for instance with task_state deleting. {{(pid=75245) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 16:19:39 user nova-compute[75245]: DEBUG nova.compute.manager [req-971fd495-5abb-4c71-853d-aaad2a0b6d62 req-d4d07d2c-7e28-4555-89ff-77036e94b6cd service nova] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Received event network-vif-plugged-f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:19:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-971fd495-5abb-4c71-853d-aaad2a0b6d62 req-d4d07d2c-7e28-4555-89ff-77036e94b6cd service nova] Acquiring lock "816edb0e-c4fc-470b-8151-f98502e50789-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:19:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-971fd495-5abb-4c71-853d-aaad2a0b6d62 req-d4d07d2c-7e28-4555-89ff-77036e94b6cd service nova] Lock "816edb0e-c4fc-470b-8151-f98502e50789-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:19:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-971fd495-5abb-4c71-853d-aaad2a0b6d62 req-d4d07d2c-7e28-4555-89ff-77036e94b6cd service nova] Lock "816edb0e-c4fc-470b-8151-f98502e50789-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:19:39 user nova-compute[75245]: DEBUG nova.compute.manager [req-971fd495-5abb-4c71-853d-aaad2a0b6d62 req-d4d07d2c-7e28-4555-89ff-77036e94b6cd service nova] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] No waiting events found dispatching network-vif-plugged-f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:19:39 user nova-compute[75245]: WARNING nova.compute.manager [req-971fd495-5abb-4c71-853d-aaad2a0b6d62 req-d4d07d2c-7e28-4555-89ff-77036e94b6cd service nova] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Received unexpected event network-vif-plugged-f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76 for instance with vm_state active and task_state deleting.
Nov 29 16:19:39 user nova-compute[75245]: DEBUG nova.network.neutron [req-3d0dae0a-fc03-48a6-8105-936d0e99dae7 req-227bd07e-c2e8-47b9-bfd4-5479d467a089 service nova] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Updated VIF entry in instance network info cache for port 27fc0374-0770-4171-a730-6696b09362eb. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:19:39 user nova-compute[75245]: DEBUG nova.network.neutron [req-3d0dae0a-fc03-48a6-8105-936d0e99dae7 req-227bd07e-c2e8-47b9-bfd4-5479d467a089 service nova] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Updating instance_info_cache with network_info: [{"id": "27fc0374-0770-4171-a730-6696b09362eb", "address": "fa:16:3e:d1:e4:30", "network": {"id": "e38d9eed-b29b-4a4c-b084-876554dc5263", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1284740336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c018212e0654c4db442ca65a386f397", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27fc0374-07", "ovs_interfaceid": "27fc0374-0770-4171-a730-6696b09362eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:19:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-3d0dae0a-fc03-48a6-8105-936d0e99dae7 req-227bd07e-c2e8-47b9-bfd4-5479d467a089 service nova] Releasing lock "refresh_cache-84bae51e-2a85-442d-bbd2-fc89f30f40b7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:19:39 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:19:39 user nova-compute[75245]: INFO nova.compute.manager [-] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Took 1.82 seconds to deallocate network for instance.
Nov 29 16:19:39 user nova-compute[75245]: DEBUG nova.compute.manager [req-ba387377-a369-4182-a5e8-33c264354ce3 req-c398e291-d563-4c37-9198-113d9a78d22b service nova] [instance: 816edb0e-c4fc-470b-8151-f98502e50789] Received event network-vif-deleted-f038ddf7-a5dc-43a8-b1a7-fb0d0926cd76 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:19:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-e5d90596-7c42-4eb6-b791-269f9755f272 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:19:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-e5d90596-7c42-4eb6-b791-269f9755f272 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:19:39 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-e5d90596-7c42-4eb6-b791-269f9755f272 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:19:39 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-e5d90596-7c42-4eb6-b791-269f9755f272 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:19:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-e5d90596-7c42-4eb6-b791-269f9755f272 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.299s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:19:39 user nova-compute[75245]: INFO nova.scheduler.client.report [None req-e5d90596-7c42-4eb6-b791-269f9755f272 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Deleted allocations for instance 816edb0e-c4fc-470b-8151-f98502e50789
Nov 29 16:19:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-e5d90596-7c42-4eb6-b791-269f9755f272 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "816edb0e-c4fc-470b-8151-f98502e50789" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.409s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:19:40 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:19:42 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:19:43 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:19:47 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:19:48 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:19:52 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:19:53 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:19:56 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-8b7e1a73-0f52-43c1-82a5-e5876ace543d tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f6720dc3-07fc-43e1-ba91-75e3d26a4a0f is timed out.
Nov 29 16:19:56 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-8b7e1a73-0f52-43c1-82a5-e5876ace543d tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Successfully detached device vdb from instance f6720dc3-07fc-43e1-ba91-75e3d26a4a0f from the live domain config.
Nov 29 16:19:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b7e1a73-0f52-43c1-82a5-e5876ace543d tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] calling os-brick to detach iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 16:19:56 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7e1a73-0f52-43c1-82a5-e5876ace543d tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, {'target_iqn': 'iqn.2010-10.org.openstack:8d770f89-1bee-4af8-95bc-bb5df1b53f0d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Grlfdqpe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:19:56 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-8b7e1a73-0f52-43c1-82a5-e5876ace543d tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:19:56 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-8b7e1a73-0f52-43c1-82a5-e5876ace543d tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:19:56 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-8b7e1a73-0f52-43c1-82a5-e5876ace543d tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:19:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:19:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:19:56 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd402a3-a70f-406f-acb2-16961994b6db]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8d770f89-1bee-4af8-95bc-bb5df1b53f0d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:19:56 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7e1a73-0f52-43c1-82a5-e5876ace543d tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 16:19:56 user nova-compute[75245]: No targets found.
Nov 29 16:19:56 user nova-compute[75245]: iSNS:
Nov 29 16:19:56 user nova-compute[75245]: No targets found.
Nov 29 16:19:56 user nova-compute[75245]: STATIC:
Nov 29 16:19:56 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:8d770f89-1bee-4af8-95bc-bb5df1b53f0d
Nov 29 16:19:56 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:19:56 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:19:56 user nova-compute[75245]: FIRMWARE:
Nov 29 16:19:56 user nova-compute[75245]: No targets found.
Nov 29 16:19:56 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:19:56 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7e1a73-0f52-43c1-82a5-e5876ace543d tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 16:19:56 user nova-compute[75245]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 16:19:56 user nova-compute[75245]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75245) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 16:19:56 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7e1a73-0f52-43c1-82a5-e5876ace543d tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d770f89-1bee-4af8-95bc-bb5df1b53f0d', 0)] {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 16:19:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:19:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:19:56 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a95b61-25d6-4b23-b673-fe777ab33732]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d770f89-1bee-4af8-95bc-bb5df1b53f0d\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:19:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:19:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:19:56 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[1895d778-8be4-4ae9-9417-ac66634ea4d3]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d770f89-1bee-4af8-95bc-bb5df1b53f0d (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:19:56 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7e1a73-0f52-43c1-82a5-e5876ace543d tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d770f89-1bee-4af8-95bc-bb5df1b53f0d (non-flash)
Nov 29 16:19:56 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:19:56 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7e1a73-0f52-43c1-82a5-e5876ace543d tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d770f89-1bee-4af8-95bc-bb5df1b53f0d (non-flash)
Nov 29 16:19:56 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:19:56 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7e1a73-0f52-43c1-82a5-e5876ace543d tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0d4414ed40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d770f89-1bee-4af8-95bc-bb5df1b53f0d'): ({'sdb'}, set())}) {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 16:19:56 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-8b7e1a73-0f52-43c1-82a5-e5876ace543d tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Removing single pathed devices sdb {{(pid=75245) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 16:19:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:19:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:19:56 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e95c01-47e7-40da-92f4-5c34edb4ebab]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:19:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:19:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:19:56 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[946fab9e-1235-452a-9ec7-97960b72bcd7]: (4, ('ok\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:19:56 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-8b7e1a73-0f52-43c1-82a5-e5876ace543d tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Flushing IO for device /dev/sdb {{(pid=75245) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 16:19:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:19:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:19:56 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[d908fc12-324d-412d-be81-fd1f589cabf1]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:19:56 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-8b7e1a73-0f52-43c1-82a5-e5876ace543d tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75245) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 16:19:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:19:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:19:56 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[70cd1e2a-68e8-4335-becb-6148c7ed8380]: (4, ('1', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:19:56 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-8b7e1a73-0f52-43c1-82a5-e5876ace543d tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 16:19:56 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-8b7e1a73-0f52-43c1-82a5-e5876ace543d tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] SCSI volumes sdb have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 16:19:56 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7e1a73-0f52-43c1-82a5-e5876ace543d tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d770f89-1bee-4af8-95bc-bb5df1b53f0d')] {{(pid=75245) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 16:19:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d770f89-1bee-4af8-95bc-bb5df1b53f0d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:19:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d770f89-1bee-4af8-95bc-bb5df1b53f0d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:19:56 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[f997fdf9-2e40-44c1-a9e7-d61ef40630e1]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:19:56 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7e1a73-0f52-43c1-82a5-e5876ace543d tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:19:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d770f89-1bee-4af8-95bc-bb5df1b53f0d -p 172.16.0.220:3260 --logout {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:19:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d770f89-1bee-4af8-95bc-bb5df1b53f0d -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:19:56 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[9518de87-f614-4704-9864-7d9f072c6c58]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:8d770f89-1bee-4af8-95bc-bb5df1b53f0d, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:8d770f89-1bee-4af8-95bc-bb5df1b53f0d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:19:56 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7e1a73-0f52-43c1-82a5-e5876ace543d tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:8d770f89-1bee-4af8-95bc-bb5df1b53f0d, portal: 172.16.0.220,3260]
Nov 29 16:19:56 user nova-compute[75245]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:8d770f89-1bee-4af8-95bc-bb5df1b53f0d, portal: 172.16.0.220,3260] successful.
Nov 29 16:19:56 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:19:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d770f89-1bee-4af8-95bc-bb5df1b53f0d -p 172.16.0.220:3260 --op delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:19:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d770f89-1bee-4af8-95bc-bb5df1b53f0d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:19:56 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c763ac-b0b3-4ff2-a4a5-f1badf5fc672]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:19:56 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7e1a73-0f52-43c1-82a5-e5876ace543d tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:19:56 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-8b7e1a73-0f52-43c1-82a5-e5876ace543d tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:19:56 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7e1a73-0f52-43c1-82a5-e5876ace543d tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] <== disconnect_volume: return (279ms) None {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:19:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b7e1a73-0f52-43c1-82a5-e5876ace543d tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Disconnected iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 16:19:57 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:19:57 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Starting heal instance info cache {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 16:19:57 user nova-compute[75245]: DEBUG nova.objects.instance [None req-8b7e1a73-0f52-43c1-82a5-e5876ace543d tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Lazy-loading 'flavor' on Instance uuid f6720dc3-07fc-43e1-ba91-75e3d26a4a0f {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:19:57 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:19:57 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Didn't find any instances for network info cache update. {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 16:19:57 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:19:57 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-8b7e1a73-0f52-43c1-82a5-e5876ace543d tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Lock "f6720dc3-07fc-43e1-ba91-75e3d26a4a0f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.069s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:19:58 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3590f4fa-73c3-4546-b9f9-55270b54b706 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Acquiring lock "interface-f6720dc3-07fc-43e1-ba91-75e3d26a4a0f-f96864d7-90bc-4830-a939-4ef48125e8ba" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:19:58 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3590f4fa-73c3-4546-b9f9-55270b54b706 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Lock "interface-f6720dc3-07fc-43e1-ba91-75e3d26a4a0f-f96864d7-90bc-4830-a939-4ef48125e8ba" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:19:58 user nova-compute[75245]: DEBUG nova.objects.instance [None req-3590f4fa-73c3-4546-b9f9-55270b54b706 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Lazy-loading 'flavor' on Instance uuid f6720dc3-07fc-43e1-ba91-75e3d26a4a0f {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:19:58 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-3590f4fa-73c3-4546-b9f9-55270b54b706 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T16:17:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-509169920',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-509169920',id=18,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBrxKq2a477G7fQ99CR3fI2bNDKuIY+WInOILJKOnZG664u+pIIu8QmsOdQ2tkxzkJGzMiOTR9GNSQO7MZOS3L5S3KmbXxtrzunCovcSXNCoaN7+W1BI3hrcIZ+N4h5Q6g==',key_name='tempest-keypair-1309950339',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:17:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='77edb4b0a0024ef1a88cb67c11d51911',ramdisk_id='',reservation_id='r-x0llsnrl',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-229817667',owner_user_name='tempest-TaggedAttachmentsTest-229817667-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:17:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e746210be7104346bd8ed895b3f22cd9',uuid=f6720dc3-07fc-43e1-ba91-75e3d26a4a0f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f96864d7-90bc-4830-a939-4ef48125e8ba", "address": "fa:16:3e:87:e1:00", "network": {"id": "e3acd9cb-1104-4bb7-904d-adf9c4de10bb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-338053759", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "77edb4b0a0024ef1a88cb67c11d51911", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf96864d7-90", "ovs_interfaceid": "f96864d7-90bc-4830-a939-4ef48125e8ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:19:58 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-3590f4fa-73c3-4546-b9f9-55270b54b706 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Converting VIF {"id": "f96864d7-90bc-4830-a939-4ef48125e8ba", "address": "fa:16:3e:87:e1:00", "network": {"id": "e3acd9cb-1104-4bb7-904d-adf9c4de10bb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-338053759", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "77edb4b0a0024ef1a88cb67c11d51911", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf96864d7-90", "ovs_interfaceid": "f96864d7-90bc-4830-a939-4ef48125e8ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:19:58 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-3590f4fa-73c3-4546-b9f9-55270b54b706 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:e1:00,bridge_name='br-int',has_traffic_filtering=True,id=f96864d7-90bc-4830-a939-4ef48125e8ba,network=Network(e3acd9cb-1104-4bb7-904d-adf9c4de10bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf96864d7-90') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:19:58 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-3590f4fa-73c3-4546-b9f9-55270b54b706 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:87:e1:00"/><model type="virtio"/><mtu size="1442"/><target dev="tapf96864d7-90"/></interface> {{(pid=75245) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 29 16:19:58 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-3590f4fa-73c3-4546-b9f9-55270b54b706 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:87:e1:00"/><model type="virtio"/><mtu size="1442"/><target dev="tapf96864d7-90"/></interface> {{(pid=75245) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 29 16:19:58 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-3590f4fa-73c3-4546-b9f9-55270b54b706 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Attempting to detach device tapf96864d7-90 from instance f6720dc3-07fc-43e1-ba91-75e3d26a4a0f from the persistent domain config. {{(pid=75245) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 16:19:58 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-3590f4fa-73c3-4546-b9f9-55270b54b706 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] detach device xml: <interface type="ethernet">
Nov 29 16:19:58 user nova-compute[75245]:   <mac address="fa:16:3e:87:e1:00"/>
Nov 29 16:19:58 user nova-compute[75245]:   <model type="virtio"/>
Nov 29 16:19:58 user nova-compute[75245]:   <mtu size="1442"/>
Nov 29 16:19:58 user nova-compute[75245]:   <target dev="tapf96864d7-90"/>
Nov 29 16:19:58 user nova-compute[75245]: </interface>
Nov 29 16:19:58 user nova-compute[75245]:  {{(pid=75245) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 16:19:58 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-3590f4fa-73c3-4546-b9f9-55270b54b706 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:87:e1:00"/><model type="virtio"/><mtu size="1442"/><target dev="tapf96864d7-90"/></interface> {{(pid=75245) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 29 16:19:58 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-3590f4fa-73c3-4546-b9f9-55270b54b706 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:87:e1:00"/><model type="virtio"/><mtu size="1442"/><target dev="tapf96864d7-90"/></interface>not found in domain: <domain type='kvm' id='21'>
Nov 29 16:19:58 user nova-compute[75245]:   <name>instance-00000012</name>
Nov 29 16:19:58 user nova-compute[75245]:   <uuid>f6720dc3-07fc-43e1-ba91-75e3d26a4a0f</uuid>
Nov 29 16:19:58 user nova-compute[75245]:   <metadata>
Nov 29 16:19:58 user nova-compute[75245]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 16:19:58 user nova-compute[75245]:   <nova:package version="0.0.0"/>
Nov 29 16:19:58 user nova-compute[75245]:   <nova:name>tempest-device-tagging-server-509169920</nova:name>
Nov 29 16:19:58 user nova-compute[75245]:   <nova:creationTime>2023-11-29 16:19:23</nova:creationTime>
Nov 29 16:19:58 user nova-compute[75245]:   <nova:flavor name="m1.tiny">
Nov 29 16:19:58 user nova-compute[75245]:     <nova:memory>512</nova:memory>
Nov 29 16:19:58 user nova-compute[75245]:     <nova:disk>1</nova:disk>
Nov 29 16:19:58 user nova-compute[75245]:     <nova:swap>0</nova:swap>
Nov 29 16:19:58 user nova-compute[75245]:     <nova:ephemeral>0</nova:ephemeral>
Nov 29 16:19:58 user nova-compute[75245]:     <nova:vcpus>1</nova:vcpus>
Nov 29 16:19:58 user nova-compute[75245]:   </nova:flavor>
Nov 29 16:19:58 user nova-compute[75245]:   <nova:owner>
Nov 29 16:19:58 user nova-compute[75245]:     <nova:user uuid="e746210be7104346bd8ed895b3f22cd9">tempest-TaggedAttachmentsTest-229817667-project-member</nova:user>
Nov 29 16:19:58 user nova-compute[75245]:     <nova:project uuid="77edb4b0a0024ef1a88cb67c11d51911">tempest-TaggedAttachmentsTest-229817667</nova:project>
Nov 29 16:19:58 user nova-compute[75245]:   </nova:owner>
Nov 29 16:19:58 user nova-compute[75245]:   <nova:root type="image" uuid="a291d9c3-be02-4c6c-9649-4b45c5b7f487"/>
Nov 29 16:19:58 user nova-compute[75245]:   <nova:ports>
Nov 29 16:19:58 user nova-compute[75245]:     <nova:port uuid="80f91f45-781d-452c-b2c0-de2584494644">
Nov 29 16:19:58 user nova-compute[75245]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 29 16:19:58 user nova-compute[75245]:     </nova:port>
Nov 29 16:19:58 user nova-compute[75245]:     <nova:port uuid="f96864d7-90bc-4830-a939-4ef48125e8ba">
Nov 29 16:19:58 user nova-compute[75245]:       <nova:ip type="fixed" address="10.10.10.87" ipVersion="4"/>
Nov 29 16:19:58 user nova-compute[75245]:     </nova:port>
Nov 29 16:19:58 user nova-compute[75245]:   </nova:ports>
Nov 29 16:19:58 user nova-compute[75245]: </nova:instance>
Nov 29 16:19:58 user nova-compute[75245]:   </metadata>
Nov 29 16:19:58 user nova-compute[75245]:   <memory unit='KiB'>524288</memory>
Nov 29 16:19:58 user nova-compute[75245]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 29 16:19:58 user nova-compute[75245]:   <vcpu placement='static'>1</vcpu>
Nov 29 16:19:58 user nova-compute[75245]:   <resource>
Nov 29 16:19:58 user nova-compute[75245]:     <partition>/machine</partition>
Nov 29 16:19:58 user nova-compute[75245]:   </resource>
Nov 29 16:19:58 user nova-compute[75245]:   <sysinfo type='smbios'>
Nov 29 16:19:58 user nova-compute[75245]:     <system>
Nov 29 16:19:58 user nova-compute[75245]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 29 16:19:58 user nova-compute[75245]:       <entry name='product'>OpenStack Nova</entry>
Nov 29 16:19:58 user nova-compute[75245]:       <entry name='version'>0.0.0</entry>
Nov 29 16:19:58 user nova-compute[75245]:       <entry name='serial'>f6720dc3-07fc-43e1-ba91-75e3d26a4a0f</entry>
Nov 29 16:19:58 user nova-compute[75245]:       <entry name='uuid'>f6720dc3-07fc-43e1-ba91-75e3d26a4a0f</entry>
Nov 29 16:19:58 user nova-compute[75245]:       <entry name='family'>Virtual Machine</entry>
Nov 29 16:19:58 user nova-compute[75245]:     </system>
Nov 29 16:19:58 user nova-compute[75245]:   </sysinfo>
Nov 29 16:19:58 user nova-compute[75245]:   <os>
Nov 29 16:19:58 user nova-compute[75245]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 29 16:19:58 user nova-compute[75245]:     <boot dev='hd'/>
Nov 29 16:19:58 user nova-compute[75245]:     <smbios mode='sysinfo'/>
Nov 29 16:19:58 user nova-compute[75245]:   </os>
Nov 29 16:19:58 user nova-compute[75245]:   <features>
Nov 29 16:19:58 user nova-compute[75245]:     <acpi/>
Nov 29 16:19:58 user nova-compute[75245]:     <apic/>
Nov 29 16:19:58 user nova-compute[75245]:     <vmcoreinfo state='on'/>
Nov 29 16:19:58 user nova-compute[75245]:   </features>
Nov 29 16:19:58 user nova-compute[75245]:   <cpu mode='custom' match='exact' check='full'>
Nov 29 16:19:58 user nova-compute[75245]:     <model fallback='forbid'>Nehalem</model>
Nov 29 16:19:58 user nova-compute[75245]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 29 16:19:58 user nova-compute[75245]:     <feature policy='require' name='vme'/>
Nov 29 16:19:58 user nova-compute[75245]:     <feature policy='require' name='x2apic'/>
Nov 29 16:19:58 user nova-compute[75245]:     <feature policy='require' name='hypervisor'/>
Nov 29 16:19:58 user nova-compute[75245]:   </cpu>
Nov 29 16:19:58 user nova-compute[75245]:   <clock offset='utc'>
Nov 29 16:19:58 user nova-compute[75245]:     <timer name='pit' tickpolicy='delay'/>
Nov 29 16:19:58 user nova-compute[75245]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 29 16:19:58 user nova-compute[75245]:     <timer name='hpet' present='no'/>
Nov 29 16:19:58 user nova-compute[75245]:   </clock>
Nov 29 16:19:58 user nova-compute[75245]:   <on_poweroff>destroy</on_poweroff>
Nov 29 16:19:58 user nova-compute[75245]:   <on_reboot>restart</on_reboot>
Nov 29 16:19:58 user nova-compute[75245]:   <on_crash>destroy</on_crash>
Nov 29 16:19:58 user nova-compute[75245]:   <devices>
Nov 29 16:19:58 user nova-compute[75245]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 29 16:19:58 user nova-compute[75245]:     <disk type='file' device='disk'>
Nov 29 16:19:58 user nova-compute[75245]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 29 16:19:58 user nova-compute[75245]:       <source file='/opt/stack/data/nova/instances/f6720dc3-07fc-43e1-ba91-75e3d26a4a0f/disk' index='2'/>
Nov 29 16:19:58 user nova-compute[75245]:       <backingStore type='file' index='3'>
Nov 29 16:19:58 user nova-compute[75245]:         <format type='raw'/>
Nov 29 16:19:58 user nova-compute[75245]:         <source file='/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8'/>
Nov 29 16:19:58 user nova-compute[75245]:         <backingStore/>
Nov 29 16:19:58 user nova-compute[75245]:       </backingStore>
Nov 29 16:19:58 user nova-compute[75245]:       <target dev='vda' bus='virtio'/>
Nov 29 16:19:58 user nova-compute[75245]:       <alias name='virtio-disk0'/>
Nov 29 16:19:58 user nova-compute[75245]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 29 16:19:58 user nova-compute[75245]:     </disk>
Nov 29 16:19:58 user nova-compute[75245]:     <disk type='file' device='cdrom'>
Nov 29 16:19:58 user nova-compute[75245]:       <driver name='qemu' type='raw' cache='none'/>
Nov 29 16:19:58 user nova-compute[75245]:       <source file='/opt/stack/data/nova/instances/f6720dc3-07fc-43e1-ba91-75e3d26a4a0f/disk.config' index='1'/>
Nov 29 16:19:58 user nova-compute[75245]:       <backingStore/>
Nov 29 16:19:58 user nova-compute[75245]:       <target dev='hda' bus='ide'/>
Nov 29 16:19:58 user nova-compute[75245]:       <readonly/>
Nov 29 16:19:58 user nova-compute[75245]:       <alias name='ide0-0-0'/>
Nov 29 16:19:58 user nova-compute[75245]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 29 16:19:58 user nova-compute[75245]:     </disk>
Nov 29 16:19:58 user nova-compute[75245]:     <controller type='usb' index='0' model='none'>
Nov 29 16:19:58 user nova-compute[75245]:       <alias name='usb'/>
Nov 29 16:19:58 user nova-compute[75245]:     </controller>
Nov 29 16:19:58 user nova-compute[75245]:     <controller type='pci' index='0' model='pci-root'>
Nov 29 16:19:58 user nova-compute[75245]:       <alias name='pci.0'/>
Nov 29 16:19:58 user nova-compute[75245]:     </controller>
Nov 29 16:19:58 user nova-compute[75245]:     <controller type='ide' index='0'>
Nov 29 16:19:58 user nova-compute[75245]:       <alias name='ide'/>
Nov 29 16:19:58 user nova-compute[75245]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 29 16:19:58 user nova-compute[75245]:     </controller>
Nov 29 16:19:58 user nova-compute[75245]:     <interface type='ethernet'>
Nov 29 16:19:58 user nova-compute[75245]:       <mac address='fa:16:3e:11:16:c3'/>
Nov 29 16:19:58 user nova-compute[75245]:       <target dev='tap80f91f45-78'/>
Nov 29 16:19:58 user nova-compute[75245]:       <model type='virtio'/>
Nov 29 16:19:58 user nova-compute[75245]:       <mtu size='1442'/>
Nov 29 16:19:58 user nova-compute[75245]:       <alias name='net0'/>
Nov 29 16:19:58 user nova-compute[75245]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 29 16:19:58 user nova-compute[75245]:     </interface>
Nov 29 16:19:58 user nova-compute[75245]:     <interface type='ethernet'>
Nov 29 16:19:58 user nova-compute[75245]:       <mac address='fa:16:3e:87:e1:00'/>
Nov 29 16:19:58 user nova-compute[75245]:       <target dev='tapf96864d7-90'/>
Nov 29 16:19:58 user nova-compute[75245]:       <model type='virtio'/>
Nov 29 16:19:58 user nova-compute[75245]:       <mtu size='1442'/>
Nov 29 16:19:58 user nova-compute[75245]:       <alias name='net1'/>
Nov 29 16:19:58 user nova-compute[75245]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 29 16:19:58 user nova-compute[75245]:     </interface>
Nov 29 16:19:58 user nova-compute[75245]:     <serial type='pty'>
Nov 29 16:19:58 user nova-compute[75245]:       <source path='/dev/pts/6'/>
Nov 29 16:19:58 user nova-compute[75245]:       <log file='/opt/stack/data/nova/instances/f6720dc3-07fc-43e1-ba91-75e3d26a4a0f/console.log' append='off'/>
Nov 29 16:19:58 user nova-compute[75245]:       <target type='isa-serial' port='0'>
Nov 29 16:19:58 user nova-compute[75245]:         <model name='isa-serial'/>
Nov 29 16:19:58 user nova-compute[75245]:       </target>
Nov 29 16:19:58 user nova-compute[75245]:       <alias name='serial0'/>
Nov 29 16:19:58 user nova-compute[75245]:     </serial>
Nov 29 16:19:58 user nova-compute[75245]:     <console type='pty' tty='/dev/pts/6'>
Nov 29 16:19:58 user nova-compute[75245]:       <source path='/dev/pts/6'/>
Nov 29 16:19:58 user nova-compute[75245]:       <log file='/opt/stack/data/nova/instances/f6720dc3-07fc-43e1-ba91-75e3d26a4a0f/console.log' append='off'/>
Nov 29 16:19:58 user nova-compute[75245]:       <target type='serial' port='0'/>
Nov 29 16:19:58 user nova-compute[75245]:       <alias name='serial0'/>
Nov 29 16:19:58 user nova-compute[75245]:     </console>
Nov 29 16:19:58 user nova-compute[75245]:     <input type='mouse' bus='ps2'>
Nov 29 16:19:58 user nova-compute[75245]:       <alias name='input0'/>
Nov 29 16:19:58 user nova-compute[75245]:     </input>
Nov 29 16:19:58 user nova-compute[75245]:     <input type='keyboard' bus='ps2'>
Nov 29 16:19:58 user nova-compute[75245]:       <alias name='input1'/>
Nov 29 16:19:58 user nova-compute[75245]:     </input>
Nov 29 16:19:58 user nova-compute[75245]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 29 16:19:58 user nova-compute[75245]:       <listen type='address' address='0.0.0.0'/>
Nov 29 16:19:58 user nova-compute[75245]:     </graphics>
Nov 29 16:19:58 user nova-compute[75245]:     <audio id='1' type='none'/>
Nov 29 16:19:58 user nova-compute[75245]:     <video>
Nov 29 16:19:58 user nova-compute[75245]:       <model type='virtio' heads='1' primary='yes'/>
Nov 29 16:19:58 user nova-compute[75245]:       <alias name='video0'/>
Nov 29 16:19:58 user nova-compute[75245]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 29 16:19:58 user nova-compute[75245]:     </video>
Nov 29 16:19:58 user nova-compute[75245]:     <memballoon model='virtio'>
Nov 29 16:19:58 user nova-compute[75245]:       <stats period='10'/>
Nov 29 16:19:58 user nova-compute[75245]:       <alias name='balloon0'/>
Nov 29 16:19:58 user nova-compute[75245]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 29 16:19:58 user nova-compute[75245]:     </memballoon>
Nov 29 16:19:58 user nova-compute[75245]:     <rng model='virtio'>
Nov 29 16:19:58 user nova-compute[75245]:       <backend model='random'>/dev/urandom</backend>
Nov 29 16:19:58 user nova-compute[75245]:       <alias name='rng0'/>
Nov 29 16:19:58 user nova-compute[75245]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 29 16:19:58 user nova-compute[75245]:     </rng>
Nov 29 16:19:58 user nova-compute[75245]:   </devices>
Nov 29 16:19:58 user nova-compute[75245]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 29 16:19:58 user nova-compute[75245]:     <label>libvirt-f6720dc3-07fc-43e1-ba91-75e3d26a4a0f</label>
Nov 29 16:19:58 user nova-compute[75245]:     <imagelabel>libvirt-f6720dc3-07fc-43e1-ba91-75e3d26a4a0f</imagelabel>
Nov 29 16:19:58 user nova-compute[75245]:   </seclabel>
Nov 29 16:19:58 user nova-compute[75245]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 29 16:19:58 user nova-compute[75245]:     <label>+64055:+108</label>
Nov 29 16:19:58 user nova-compute[75245]:     <imagelabel>+64055:+108</imagelabel>
Nov 29 16:19:58 user nova-compute[75245]:   </seclabel>
Nov 29 16:19:58 user nova-compute[75245]: </domain>
Nov 29 16:19:58 user nova-compute[75245]:  {{(pid=75245) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 29 16:19:58 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-3590f4fa-73c3-4546-b9f9-55270b54b706 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Successfully detached device tapf96864d7-90 from instance f6720dc3-07fc-43e1-ba91-75e3d26a4a0f from the persistent domain config.
Nov 29 16:19:58 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-3590f4fa-73c3-4546-b9f9-55270b54b706 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] (1/8): Attempting to detach device tapf96864d7-90 with device alias net1 from instance f6720dc3-07fc-43e1-ba91-75e3d26a4a0f from the live domain config. {{(pid=75245) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 16:19:58 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-3590f4fa-73c3-4546-b9f9-55270b54b706 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] detach device xml: <interface type="ethernet">
Nov 29 16:19:58 user nova-compute[75245]:   <mac address="fa:16:3e:87:e1:00"/>
Nov 29 16:19:58 user nova-compute[75245]:   <model type="virtio"/>
Nov 29 16:19:58 user nova-compute[75245]:   <mtu size="1442"/>
Nov 29 16:19:58 user nova-compute[75245]:   <target dev="tapf96864d7-90"/>
Nov 29 16:19:58 user nova-compute[75245]: </interface>
Nov 29 16:19:58 user nova-compute[75245]:  {{(pid=75245) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 16:19:58 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:19:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:19:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:19:58 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-3590f4fa-73c3-4546-b9f9-55270b54b706 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Start waiting for the detach event from libvirt for device tapf96864d7-90 with device alias net1 for instance f6720dc3-07fc-43e1-ba91-75e3d26a4a0f {{(pid=75245) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 16:19:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:19:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:19:58 user nova-compute[75245]: DEBUG nova.compute.manager [req-7ec84667-d9a9-49da-a846-9b31daa63809 req-b1d4e2ec-d19f-4a81-818b-e9c5effafce0 service nova] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Received event network-vif-unplugged-f96864d7-90bc-4830-a939-4ef48125e8ba {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:19:58 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-7ec84667-d9a9-49da-a846-9b31daa63809 req-b1d4e2ec-d19f-4a81-818b-e9c5effafce0 service nova] Acquiring lock "f6720dc3-07fc-43e1-ba91-75e3d26a4a0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:19:58 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-7ec84667-d9a9-49da-a846-9b31daa63809 req-b1d4e2ec-d19f-4a81-818b-e9c5effafce0 service nova] Lock "f6720dc3-07fc-43e1-ba91-75e3d26a4a0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:19:58 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-7ec84667-d9a9-49da-a846-9b31daa63809 req-b1d4e2ec-d19f-4a81-818b-e9c5effafce0 service nova] Lock "f6720dc3-07fc-43e1-ba91-75e3d26a4a0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:19:58 user nova-compute[75245]: DEBUG nova.compute.manager [req-7ec84667-d9a9-49da-a846-9b31daa63809 req-b1d4e2ec-d19f-4a81-818b-e9c5effafce0 service nova] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] No waiting events found dispatching network-vif-unplugged-f96864d7-90bc-4830-a939-4ef48125e8ba {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:19:58 user nova-compute[75245]: WARNING nova.compute.manager [req-7ec84667-d9a9-49da-a846-9b31daa63809 req-b1d4e2ec-d19f-4a81-818b-e9c5effafce0 service nova] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Received unexpected event network-vif-unplugged-f96864d7-90bc-4830-a939-4ef48125e8ba for instance with vm_state active and task_state None.
Nov 29 16:19:59 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:19:59 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:19:59 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:19:59 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:19:59 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75245) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 16:19:59 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6720dc3-07fc-43e1-ba91-75e3d26a4a0f/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:19:59 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6720dc3-07fc-43e1-ba91-75e3d26a4a0f/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:19:59 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6720dc3-07fc-43e1-ba91-75e3d26a4a0f/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:20:00 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6720dc3-07fc-43e1-ba91-75e3d26a4a0f/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:20:00 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:20:00 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:20:00 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:20:00 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:20:00 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:20:00 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:20:00 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:20:00 user nova-compute[75245]: DEBUG nova.compute.manager [req-51be4f07-c708-4729-9a47-d033e5e19397 req-ab192d7c-6ff8-44a6-8e84-d752fc7cd3e6 service nova] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Received event network-vif-plugged-f96864d7-90bc-4830-a939-4ef48125e8ba {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:20:00 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-51be4f07-c708-4729-9a47-d033e5e19397 req-ab192d7c-6ff8-44a6-8e84-d752fc7cd3e6 service nova] Acquiring lock "f6720dc3-07fc-43e1-ba91-75e3d26a4a0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:20:00 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-51be4f07-c708-4729-9a47-d033e5e19397 req-ab192d7c-6ff8-44a6-8e84-d752fc7cd3e6 service nova] Lock "f6720dc3-07fc-43e1-ba91-75e3d26a4a0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:20:00 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-51be4f07-c708-4729-9a47-d033e5e19397 req-ab192d7c-6ff8-44a6-8e84-d752fc7cd3e6 service nova] Lock "f6720dc3-07fc-43e1-ba91-75e3d26a4a0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:20:00 user nova-compute[75245]: DEBUG nova.compute.manager [req-51be4f07-c708-4729-9a47-d033e5e19397 req-ab192d7c-6ff8-44a6-8e84-d752fc7cd3e6 service nova] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] No waiting events found dispatching network-vif-plugged-f96864d7-90bc-4830-a939-4ef48125e8ba {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:20:00 user nova-compute[75245]: WARNING nova.compute.manager [req-51be4f07-c708-4729-9a47-d033e5e19397 req-ab192d7c-6ff8-44a6-8e84-d752fc7cd3e6 service nova] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Received unexpected event network-vif-plugged-f96864d7-90bc-4830-a939-4ef48125e8ba for instance with vm_state active and task_state None.
Nov 29 16:20:00 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:20:00 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bae51e-2a85-442d-bbd2-fc89f30f40b7/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:20:01 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bae51e-2a85-442d-bbd2-fc89f30f40b7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:20:01 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bae51e-2a85-442d-bbd2-fc89f30f40b7/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:20:01 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bae51e-2a85-442d-bbd2-fc89f30f40b7/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:20:01 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:20:01 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:20:01 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Hypervisor/Node resource view: name=user free_ram=8372MB free_disk=25.457321166992188GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75245) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 16:20:01 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:20:01 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:20:01 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance ed9a6a4e-2e7d-443c-82ef-f14f11d32c81 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:20:01 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance f6720dc3-07fc-43e1-ba91-75e3d26a4a0f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:20:01 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 84bae51e-2a85-442d-bbd2-fc89f30f40b7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:20:01 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 8785a3c2-5b7a-4382-b50d-cecd8743329c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:20:01 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 16:20:01 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 16:20:01 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:20:01 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:20:01 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Compute_service record updated for user:user {{(pid=75245) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 16:20:01 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.313s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:20:02 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:20:04 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:20:04 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:20:04 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:20:04 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:20:04 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:20:04 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75245) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 16:20:07 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:20:07 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:20:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:20:12 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:20:12 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:20:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:20:17 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:20:18 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-3590f4fa-73c3-4546-b9f9-55270b54b706 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Waiting for libvirt event about the detach of device tapf96864d7-90 with device alias net1 from instance f6720dc3-07fc-43e1-ba91-75e3d26a4a0f is timed out.
Nov 29 16:20:18 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-3590f4fa-73c3-4546-b9f9-55270b54b706 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:87:e1:00"/><model type="virtio"/><mtu size="1442"/><target dev="tapf96864d7-90"/></interface> {{(pid=75245) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 29 16:20:18 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-3590f4fa-73c3-4546-b9f9-55270b54b706 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:87:e1:00"/><model type="virtio"/><mtu size="1442"/><target dev="tapf96864d7-90"/></interface>not found in domain: <domain type='kvm' id='21'>
Nov 29 16:20:18 user nova-compute[75245]:   <name>instance-00000012</name>
Nov 29 16:20:18 user nova-compute[75245]:   <uuid>f6720dc3-07fc-43e1-ba91-75e3d26a4a0f</uuid>
Nov 29 16:20:18 user nova-compute[75245]:   <metadata>
Nov 29 16:20:18 user nova-compute[75245]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 16:20:18 user nova-compute[75245]:   <nova:package version="0.0.0"/>
Nov 29 16:20:18 user nova-compute[75245]:   <nova:name>tempest-device-tagging-server-509169920</nova:name>
Nov 29 16:20:18 user nova-compute[75245]:   <nova:creationTime>2023-11-29 16:19:23</nova:creationTime>
Nov 29 16:20:18 user nova-compute[75245]:   <nova:flavor name="m1.tiny">
Nov 29 16:20:18 user nova-compute[75245]:     <nova:memory>512</nova:memory>
Nov 29 16:20:18 user nova-compute[75245]:     <nova:disk>1</nova:disk>
Nov 29 16:20:18 user nova-compute[75245]:     <nova:swap>0</nova:swap>
Nov 29 16:20:18 user nova-compute[75245]:     <nova:ephemeral>0</nova:ephemeral>
Nov 29 16:20:18 user nova-compute[75245]:     <nova:vcpus>1</nova:vcpus>
Nov 29 16:20:18 user nova-compute[75245]:   </nova:flavor>
Nov 29 16:20:18 user nova-compute[75245]:   <nova:owner>
Nov 29 16:20:18 user nova-compute[75245]:     <nova:user uuid="e746210be7104346bd8ed895b3f22cd9">tempest-TaggedAttachmentsTest-229817667-project-member</nova:user>
Nov 29 16:20:18 user nova-compute[75245]:     <nova:project uuid="77edb4b0a0024ef1a88cb67c11d51911">tempest-TaggedAttachmentsTest-229817667</nova:project>
Nov 29 16:20:18 user nova-compute[75245]:   </nova:owner>
Nov 29 16:20:18 user nova-compute[75245]:   <nova:root type="image" uuid="a291d9c3-be02-4c6c-9649-4b45c5b7f487"/>
Nov 29 16:20:18 user nova-compute[75245]:   <nova:ports>
Nov 29 16:20:18 user nova-compute[75245]:     <nova:port uuid="80f91f45-781d-452c-b2c0-de2584494644">
Nov 29 16:20:18 user nova-compute[75245]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 29 16:20:18 user nova-compute[75245]:     </nova:port>
Nov 29 16:20:18 user nova-compute[75245]:     <nova:port uuid="f96864d7-90bc-4830-a939-4ef48125e8ba">
Nov 29 16:20:18 user nova-compute[75245]:       <nova:ip type="fixed" address="10.10.10.87" ipVersion="4"/>
Nov 29 16:20:18 user nova-compute[75245]:     </nova:port>
Nov 29 16:20:18 user nova-compute[75245]:   </nova:ports>
Nov 29 16:20:18 user nova-compute[75245]: </nova:instance>
Nov 29 16:20:18 user nova-compute[75245]:   </metadata>
Nov 29 16:20:18 user nova-compute[75245]:   <memory unit='KiB'>524288</memory>
Nov 29 16:20:18 user nova-compute[75245]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 29 16:20:18 user nova-compute[75245]:   <vcpu placement='static'>1</vcpu>
Nov 29 16:20:18 user nova-compute[75245]:   <resource>
Nov 29 16:20:18 user nova-compute[75245]:     <partition>/machine</partition>
Nov 29 16:20:18 user nova-compute[75245]:   </resource>
Nov 29 16:20:18 user nova-compute[75245]:   <sysinfo type='smbios'>
Nov 29 16:20:18 user nova-compute[75245]:     <system>
Nov 29 16:20:18 user nova-compute[75245]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 29 16:20:18 user nova-compute[75245]:       <entry name='product'>OpenStack Nova</entry>
Nov 29 16:20:18 user nova-compute[75245]:       <entry name='version'>0.0.0</entry>
Nov 29 16:20:18 user nova-compute[75245]:       <entry name='serial'>f6720dc3-07fc-43e1-ba91-75e3d26a4a0f</entry>
Nov 29 16:20:18 user nova-compute[75245]:       <entry name='uuid'>f6720dc3-07fc-43e1-ba91-75e3d26a4a0f</entry>
Nov 29 16:20:18 user nova-compute[75245]:       <entry name='family'>Virtual Machine</entry>
Nov 29 16:20:18 user nova-compute[75245]:     </system>
Nov 29 16:20:18 user nova-compute[75245]:   </sysinfo>
Nov 29 16:20:18 user nova-compute[75245]:   <os>
Nov 29 16:20:18 user nova-compute[75245]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 29 16:20:18 user nova-compute[75245]:     <boot dev='hd'/>
Nov 29 16:20:18 user nova-compute[75245]:     <smbios mode='sysinfo'/>
Nov 29 16:20:18 user nova-compute[75245]:   </os>
Nov 29 16:20:18 user nova-compute[75245]:   <features>
Nov 29 16:20:18 user nova-compute[75245]:     <acpi/>
Nov 29 16:20:18 user nova-compute[75245]:     <apic/>
Nov 29 16:20:18 user nova-compute[75245]:     <vmcoreinfo state='on'/>
Nov 29 16:20:18 user nova-compute[75245]:   </features>
Nov 29 16:20:18 user nova-compute[75245]:   <cpu mode='custom' match='exact' check='full'>
Nov 29 16:20:18 user nova-compute[75245]:     <model fallback='forbid'>Nehalem</model>
Nov 29 16:20:18 user nova-compute[75245]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 29 16:20:18 user nova-compute[75245]:     <feature policy='require' name='vme'/>
Nov 29 16:20:18 user nova-compute[75245]:     <feature policy='require' name='x2apic'/>
Nov 29 16:20:18 user nova-compute[75245]:     <feature policy='require' name='hypervisor'/>
Nov 29 16:20:18 user nova-compute[75245]:   </cpu>
Nov 29 16:20:18 user nova-compute[75245]:   <clock offset='utc'>
Nov 29 16:20:18 user nova-compute[75245]:     <timer name='pit' tickpolicy='delay'/>
Nov 29 16:20:18 user nova-compute[75245]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 29 16:20:18 user nova-compute[75245]:     <timer name='hpet' present='no'/>
Nov 29 16:20:18 user nova-compute[75245]:   </clock>
Nov 29 16:20:18 user nova-compute[75245]:   <on_poweroff>destroy</on_poweroff>
Nov 29 16:20:18 user nova-compute[75245]:   <on_reboot>restart</on_reboot>
Nov 29 16:20:18 user nova-compute[75245]:   <on_crash>destroy</on_crash>
Nov 29 16:20:18 user nova-compute[75245]:   <devices>
Nov 29 16:20:18 user nova-compute[75245]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 29 16:20:18 user nova-compute[75245]:     <disk type='file' device='disk'>
Nov 29 16:20:18 user nova-compute[75245]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 29 16:20:18 user nova-compute[75245]:       <source file='/opt/stack/data/nova/instances/f6720dc3-07fc-43e1-ba91-75e3d26a4a0f/disk' index='2'/>
Nov 29 16:20:18 user nova-compute[75245]:       <backingStore type='file' index='3'>
Nov 29 16:20:18 user nova-compute[75245]:         <format type='raw'/>
Nov 29 16:20:18 user nova-compute[75245]:         <source file='/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8'/>
Nov 29 16:20:18 user nova-compute[75245]:         <backingStore/>
Nov 29 16:20:18 user nova-compute[75245]:       </backingStore>
Nov 29 16:20:18 user nova-compute[75245]:       <target dev='vda' bus='virtio'/>
Nov 29 16:20:18 user nova-compute[75245]:       <alias name='virtio-disk0'/>
Nov 29 16:20:18 user nova-compute[75245]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 29 16:20:18 user nova-compute[75245]:     </disk>
Nov 29 16:20:18 user nova-compute[75245]:     <disk type='file' device='cdrom'>
Nov 29 16:20:18 user nova-compute[75245]:       <driver name='qemu' type='raw' cache='none'/>
Nov 29 16:20:18 user nova-compute[75245]:       <source file='/opt/stack/data/nova/instances/f6720dc3-07fc-43e1-ba91-75e3d26a4a0f/disk.config' index='1'/>
Nov 29 16:20:18 user nova-compute[75245]:       <backingStore/>
Nov 29 16:20:18 user nova-compute[75245]:       <target dev='hda' bus='ide'/>
Nov 29 16:20:18 user nova-compute[75245]:       <readonly/>
Nov 29 16:20:18 user nova-compute[75245]:       <alias name='ide0-0-0'/>
Nov 29 16:20:18 user nova-compute[75245]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 29 16:20:18 user nova-compute[75245]:     </disk>
Nov 29 16:20:18 user nova-compute[75245]:     <controller type='usb' index='0' model='none'>
Nov 29 16:20:18 user nova-compute[75245]:       <alias name='usb'/>
Nov 29 16:20:18 user nova-compute[75245]:     </controller>
Nov 29 16:20:18 user nova-compute[75245]:     <controller type='pci' index='0' model='pci-root'>
Nov 29 16:20:18 user nova-compute[75245]:       <alias name='pci.0'/>
Nov 29 16:20:18 user nova-compute[75245]:     </controller>
Nov 29 16:20:18 user nova-compute[75245]:     <controller type='ide' index='0'>
Nov 29 16:20:18 user nova-compute[75245]:       <alias name='ide'/>
Nov 29 16:20:18 user nova-compute[75245]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 29 16:20:18 user nova-compute[75245]:     </controller>
Nov 29 16:20:18 user nova-compute[75245]:     <interface type='ethernet'>
Nov 29 16:20:18 user nova-compute[75245]:       <mac address='fa:16:3e:11:16:c3'/>
Nov 29 16:20:18 user nova-compute[75245]:       <target dev='tap80f91f45-78'/>
Nov 29 16:20:18 user nova-compute[75245]:       <model type='virtio'/>
Nov 29 16:20:18 user nova-compute[75245]:       <mtu size='1442'/>
Nov 29 16:20:18 user nova-compute[75245]:       <alias name='net0'/>
Nov 29 16:20:18 user nova-compute[75245]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 29 16:20:18 user nova-compute[75245]:     </interface>
Nov 29 16:20:18 user nova-compute[75245]:     <serial type='pty'>
Nov 29 16:20:18 user nova-compute[75245]:       <source path='/dev/pts/6'/>
Nov 29 16:20:18 user nova-compute[75245]:       <log file='/opt/stack/data/nova/instances/f6720dc3-07fc-43e1-ba91-75e3d26a4a0f/console.log' append='off'/>
Nov 29 16:20:18 user nova-compute[75245]:       <target type='isa-serial' port='0'>
Nov 29 16:20:18 user nova-compute[75245]:         <model name='isa-serial'/>
Nov 29 16:20:18 user nova-compute[75245]:       </target>
Nov 29 16:20:18 user nova-compute[75245]:       <alias name='serial0'/>
Nov 29 16:20:18 user nova-compute[75245]:     </serial>
Nov 29 16:20:18 user nova-compute[75245]:     <console type='pty' tty='/dev/pts/6'>
Nov 29 16:20:18 user nova-compute[75245]:       <source path='/dev/pts/6'/>
Nov 29 16:20:18 user nova-compute[75245]:       <log file='/opt/stack/data/nova/instances/f6720dc3-07fc-43e1-ba91-75e3d26a4a0f/console.log' append='off'/>
Nov 29 16:20:18 user nova-compute[75245]:       <target type='serial' port='0'/>
Nov 29 16:20:18 user nova-compute[75245]:       <alias name='serial0'/>
Nov 29 16:20:18 user nova-compute[75245]:     </console>
Nov 29 16:20:18 user nova-compute[75245]:     <input type='mouse' bus='ps2'>
Nov 29 16:20:18 user nova-compute[75245]:       <alias name='input0'/>
Nov 29 16:20:18 user nova-compute[75245]:     </input>
Nov 29 16:20:18 user nova-compute[75245]:     <input type='keyboard' bus='ps2'>
Nov 29 16:20:18 user nova-compute[75245]:       <alias name='input1'/>
Nov 29 16:20:18 user nova-compute[75245]:     </input>
Nov 29 16:20:18 user nova-compute[75245]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 29 16:20:18 user nova-compute[75245]:       <listen type='address' address='0.0.0.0'/>
Nov 29 16:20:18 user nova-compute[75245]:     </graphics>
Nov 29 16:20:18 user nova-compute[75245]:     <audio id='1' type='none'/>
Nov 29 16:20:18 user nova-compute[75245]:     <video>
Nov 29 16:20:18 user nova-compute[75245]:       <model type='virtio' heads='1' primary='yes'/>
Nov 29 16:20:18 user nova-compute[75245]:       <alias name='video0'/>
Nov 29 16:20:18 user nova-compute[75245]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 29 16:20:18 user nova-compute[75245]:     </video>
Nov 29 16:20:18 user nova-compute[75245]:     <memballoon model='virtio'>
Nov 29 16:20:18 user nova-compute[75245]:       <stats period='10'/>
Nov 29 16:20:18 user nova-compute[75245]:       <alias name='balloon0'/>
Nov 29 16:20:18 user nova-compute[75245]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 29 16:20:18 user nova-compute[75245]:     </memballoon>
Nov 29 16:20:18 user nova-compute[75245]:     <rng model='virtio'>
Nov 29 16:20:18 user nova-compute[75245]:       <backend model='random'>/dev/urandom</backend>
Nov 29 16:20:18 user nova-compute[75245]:       <alias name='rng0'/>
Nov 29 16:20:18 user nova-compute[75245]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 29 16:20:18 user nova-compute[75245]:     </rng>
Nov 29 16:20:18 user nova-compute[75245]:   </devices>
Nov 29 16:20:18 user nova-compute[75245]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 29 16:20:18 user nova-compute[75245]:     <label>libvirt-f6720dc3-07fc-43e1-ba91-75e3d26a4a0f</label>
Nov 29 16:20:18 user nova-compute[75245]:     <imagelabel>libvirt-f6720dc3-07fc-43e1-ba91-75e3d26a4a0f</imagelabel>
Nov 29 16:20:18 user nova-compute[75245]:   </seclabel>
Nov 29 16:20:18 user nova-compute[75245]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 29 16:20:18 user nova-compute[75245]:     <label>+64055:+108</label>
Nov 29 16:20:18 user nova-compute[75245]:     <imagelabel>+64055:+108</imagelabel>
Nov 29 16:20:18 user nova-compute[75245]:   </seclabel>
Nov 29 16:20:18 user nova-compute[75245]: </domain>
Nov 29 16:20:18 user nova-compute[75245]:  {{(pid=75245) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 29 16:20:18 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-3590f4fa-73c3-4546-b9f9-55270b54b706 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Successfully detached device tapf96864d7-90 from instance f6720dc3-07fc-43e1-ba91-75e3d26a4a0f from the live domain config.
Nov 29 16:20:18 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-3590f4fa-73c3-4546-b9f9-55270b54b706 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T16:17:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-509169920',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-509169920',id=18,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBrxKq2a477G7fQ99CR3fI2bNDKuIY+WInOILJKOnZG664u+pIIu8QmsOdQ2tkxzkJGzMiOTR9GNSQO7MZOS3L5S3KmbXxtrzunCovcSXNCoaN7+W1BI3hrcIZ+N4h5Q6g==',key_name='tempest-keypair-1309950339',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:17:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='77edb4b0a0024ef1a88cb67c11d51911',ramdisk_id='',reservation_id='r-x0llsnrl',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-229817667',owner_user_name='tempest-TaggedAttachmentsTest-229817667-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:17:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e746210be7104346bd8ed895b3f22cd9',uuid=f6720dc3-07fc-43e1-ba91-75e3d26a4a0f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f96864d7-90bc-4830-a939-4ef48125e8ba", "address": "fa:16:3e:87:e1:00", "network": {"id": "e3acd9cb-1104-4bb7-904d-adf9c4de10bb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-338053759", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "77edb4b0a0024ef1a88cb67c11d51911", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf96864d7-90", "ovs_interfaceid": "f96864d7-90bc-4830-a939-4ef48125e8ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 16:20:18 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-3590f4fa-73c3-4546-b9f9-55270b54b706 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Converting VIF {"id": "f96864d7-90bc-4830-a939-4ef48125e8ba", "address": "fa:16:3e:87:e1:00", "network": {"id": "e3acd9cb-1104-4bb7-904d-adf9c4de10bb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-338053759", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "77edb4b0a0024ef1a88cb67c11d51911", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf96864d7-90", "ovs_interfaceid": "f96864d7-90bc-4830-a939-4ef48125e8ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:20:18 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-3590f4fa-73c3-4546-b9f9-55270b54b706 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:e1:00,bridge_name='br-int',has_traffic_filtering=True,id=f96864d7-90bc-4830-a939-4ef48125e8ba,network=Network(e3acd9cb-1104-4bb7-904d-adf9c4de10bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf96864d7-90') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:20:18 user nova-compute[75245]: DEBUG os_vif [None req-3590f4fa-73c3-4546-b9f9-55270b54b706 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:e1:00,bridge_name='br-int',has_traffic_filtering=True,id=f96864d7-90bc-4830-a939-4ef48125e8ba,network=Network(e3acd9cb-1104-4bb7-904d-adf9c4de10bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf96864d7-90') {{(pid=75245) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 16:20:18 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:20:18 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf96864d7-90, bridge=br-int, if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:20:18 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:20:18 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:20:18 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:20:18 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8858dad5-028c-46d2-a395-a3fd30b46c1a) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:20:18 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:20:18 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:20:18 user nova-compute[75245]: INFO os_vif [None req-3590f4fa-73c3-4546-b9f9-55270b54b706 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:e1:00,bridge_name='br-int',has_traffic_filtering=True,id=f96864d7-90bc-4830-a939-4ef48125e8ba,network=Network(e3acd9cb-1104-4bb7-904d-adf9c4de10bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf96864d7-90')
Nov 29 16:20:18 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-3590f4fa-73c3-4546-b9f9-55270b54b706 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 16:20:18 user nova-compute[75245]:   <nova:package version="0.0.0"/>
Nov 29 16:20:18 user nova-compute[75245]:   <nova:name>tempest-device-tagging-server-509169920</nova:name>
Nov 29 16:20:18 user nova-compute[75245]:   <nova:creationTime>2023-11-29 16:20:18</nova:creationTime>
Nov 29 16:20:18 user nova-compute[75245]:   <nova:flavor name="m1.tiny">
Nov 29 16:20:18 user nova-compute[75245]:     <nova:memory>512</nova:memory>
Nov 29 16:20:18 user nova-compute[75245]:     <nova:disk>1</nova:disk>
Nov 29 16:20:18 user nova-compute[75245]:     <nova:swap>0</nova:swap>
Nov 29 16:20:18 user nova-compute[75245]:     <nova:ephemeral>0</nova:ephemeral>
Nov 29 16:20:18 user nova-compute[75245]:     <nova:vcpus>1</nova:vcpus>
Nov 29 16:20:18 user nova-compute[75245]:   </nova:flavor>
Nov 29 16:20:18 user nova-compute[75245]:   <nova:owner>
Nov 29 16:20:18 user nova-compute[75245]:     <nova:user uuid="e746210be7104346bd8ed895b3f22cd9">tempest-TaggedAttachmentsTest-229817667-project-member</nova:user>
Nov 29 16:20:18 user nova-compute[75245]:     <nova:project uuid="77edb4b0a0024ef1a88cb67c11d51911">tempest-TaggedAttachmentsTest-229817667</nova:project>
Nov 29 16:20:18 user nova-compute[75245]:   </nova:owner>
Nov 29 16:20:18 user nova-compute[75245]:   <nova:root type="image" uuid="a291d9c3-be02-4c6c-9649-4b45c5b7f487"/>
Nov 29 16:20:18 user nova-compute[75245]:   <nova:ports>
Nov 29 16:20:18 user nova-compute[75245]:     <nova:port uuid="80f91f45-781d-452c-b2c0-de2584494644">
Nov 29 16:20:18 user nova-compute[75245]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 29 16:20:18 user nova-compute[75245]:     </nova:port>
Nov 29 16:20:18 user nova-compute[75245]:   </nova:ports>
Nov 29 16:20:18 user nova-compute[75245]: </nova:instance>
Nov 29 16:20:18 user nova-compute[75245]:  {{(pid=75245) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 29 16:20:19 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3590f4fa-73c3-4546-b9f9-55270b54b706 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Acquiring lock "refresh_cache-f6720dc3-07fc-43e1-ba91-75e3d26a4a0f" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:20:19 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3590f4fa-73c3-4546-b9f9-55270b54b706 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Acquired lock "refresh_cache-f6720dc3-07fc-43e1-ba91-75e3d26a4a0f" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:20:19 user nova-compute[75245]: DEBUG nova.network.neutron [None req-3590f4fa-73c3-4546-b9f9-55270b54b706 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 16:20:19 user nova-compute[75245]: DEBUG nova.compute.manager [req-ad2258c2-6fe7-4591-8e9e-4c707a0aafbf req-cdc54154-c6b5-4ce4-a17d-37862354bea1 service nova] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Received event network-vif-deleted-f96864d7-90bc-4830-a939-4ef48125e8ba {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:20:19 user nova-compute[75245]: INFO nova.compute.manager [req-ad2258c2-6fe7-4591-8e9e-4c707a0aafbf req-cdc54154-c6b5-4ce4-a17d-37862354bea1 service nova] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Neutron deleted interface f96864d7-90bc-4830-a939-4ef48125e8ba; detaching it from the instance and deleting it from the info cache
Nov 29 16:20:19 user nova-compute[75245]: DEBUG nova.network.neutron [req-ad2258c2-6fe7-4591-8e9e-4c707a0aafbf req-cdc54154-c6b5-4ce4-a17d-37862354bea1 service nova] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Updating instance_info_cache with network_info: [{"id": "80f91f45-781d-452c-b2c0-de2584494644", "address": "fa:16:3e:11:16:c3", "network": {"id": "0c0d4e62-be12-42e1-878c-a4a07270c108", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2066574781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77edb4b0a0024ef1a88cb67c11d51911", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80f91f45-78", "ovs_interfaceid": "80f91f45-781d-452c-b2c0-de2584494644", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:20:19 user nova-compute[75245]: DEBUG nova.objects.instance [req-ad2258c2-6fe7-4591-8e9e-4c707a0aafbf req-cdc54154-c6b5-4ce4-a17d-37862354bea1 service nova] Lazy-loading 'system_metadata' on Instance uuid f6720dc3-07fc-43e1-ba91-75e3d26a4a0f {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:20:19 user nova-compute[75245]: DEBUG nova.objects.instance [req-ad2258c2-6fe7-4591-8e9e-4c707a0aafbf req-cdc54154-c6b5-4ce4-a17d-37862354bea1 service nova] Lazy-loading 'flavor' on Instance uuid f6720dc3-07fc-43e1-ba91-75e3d26a4a0f {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:20:19 user nova-compute[75245]: DEBUG nova.objects.base [req-ad2258c2-6fe7-4591-8e9e-4c707a0aafbf req-cdc54154-c6b5-4ce4-a17d-37862354bea1 service nova] Object Instance<f6720dc3-07fc-43e1-ba91-75e3d26a4a0f> lazy-loaded attributes: system_metadata,flavor {{(pid=75245) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 16:20:19 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [req-ad2258c2-6fe7-4591-8e9e-4c707a0aafbf req-cdc54154-c6b5-4ce4-a17d-37862354bea1 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T16:17:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-509169920',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-509169920',id=18,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBrxKq2a477G7fQ99CR3fI2bNDKuIY+WInOILJKOnZG664u+pIIu8QmsOdQ2tkxzkJGzMiOTR9GNSQO7MZOS3L5S3KmbXxtrzunCovcSXNCoaN7+W1BI3hrcIZ+N4h5Q6g==',key_name='tempest-keypair-1309950339',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:17:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='77edb4b0a0024ef1a88cb67c11d51911',ramdisk_id='',reservation_id='r-x0llsnrl',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-229817667',owner_user_name='tempest-TaggedAttachmentsTest-229817667-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:17:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e746210be7104346bd8ed895b3f22cd9',uuid=f6720dc3-07fc-43e1-ba91-75e3d26a4a0f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f96864d7-90bc-4830-a939-4ef48125e8ba", "address": "fa:16:3e:87:e1:00", "network": {"id": "e3acd9cb-1104-4bb7-904d-adf9c4de10bb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-338053759", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "77edb4b0a0024ef1a88cb67c11d51911", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf96864d7-90", "ovs_interfaceid": "f96864d7-90bc-4830-a939-4ef48125e8ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:20:19 user nova-compute[75245]: DEBUG nova.network.os_vif_util [req-ad2258c2-6fe7-4591-8e9e-4c707a0aafbf req-cdc54154-c6b5-4ce4-a17d-37862354bea1 service nova] Converting VIF {"id": "f96864d7-90bc-4830-a939-4ef48125e8ba", "address": "fa:16:3e:87:e1:00", "network": {"id": "e3acd9cb-1104-4bb7-904d-adf9c4de10bb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-338053759", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "77edb4b0a0024ef1a88cb67c11d51911", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf96864d7-90", "ovs_interfaceid": "f96864d7-90bc-4830-a939-4ef48125e8ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:20:19 user nova-compute[75245]: DEBUG nova.network.os_vif_util [req-ad2258c2-6fe7-4591-8e9e-4c707a0aafbf req-cdc54154-c6b5-4ce4-a17d-37862354bea1 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:e1:00,bridge_name='br-int',has_traffic_filtering=True,id=f96864d7-90bc-4830-a939-4ef48125e8ba,network=Network(e3acd9cb-1104-4bb7-904d-adf9c4de10bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf96864d7-90') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:20:19 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [req-ad2258c2-6fe7-4591-8e9e-4c707a0aafbf req-cdc54154-c6b5-4ce4-a17d-37862354bea1 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:87:e1:00"/><model type="virtio"/><mtu size="1442"/><target dev="tapf96864d7-90"/></interface> {{(pid=75245) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 29 16:20:19 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [req-ad2258c2-6fe7-4591-8e9e-4c707a0aafbf req-cdc54154-c6b5-4ce4-a17d-37862354bea1 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:87:e1:00"/><model type="virtio"/><mtu size="1442"/><target dev="tapf96864d7-90"/></interface>not found in domain: <domain type='kvm' id='21'>
Nov 29 16:20:19 user nova-compute[75245]:   <name>instance-00000012</name>
Nov 29 16:20:19 user nova-compute[75245]:   <uuid>f6720dc3-07fc-43e1-ba91-75e3d26a4a0f</uuid>
Nov 29 16:20:19 user nova-compute[75245]:   <metadata>
Nov 29 16:20:19 user nova-compute[75245]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 16:20:19 user nova-compute[75245]:   <nova:package version="0.0.0"/>
Nov 29 16:20:19 user nova-compute[75245]:   <nova:name>tempest-device-tagging-server-509169920</nova:name>
Nov 29 16:20:19 user nova-compute[75245]:   <nova:creationTime>2023-11-29 16:20:18</nova:creationTime>
Nov 29 16:20:19 user nova-compute[75245]:   <nova:flavor name="m1.tiny">
Nov 29 16:20:19 user nova-compute[75245]:     <nova:memory>512</nova:memory>
Nov 29 16:20:19 user nova-compute[75245]:     <nova:disk>1</nova:disk>
Nov 29 16:20:19 user nova-compute[75245]:     <nova:swap>0</nova:swap>
Nov 29 16:20:19 user nova-compute[75245]:     <nova:ephemeral>0</nova:ephemeral>
Nov 29 16:20:19 user nova-compute[75245]:     <nova:vcpus>1</nova:vcpus>
Nov 29 16:20:19 user nova-compute[75245]:   </nova:flavor>
Nov 29 16:20:19 user nova-compute[75245]:   <nova:owner>
Nov 29 16:20:19 user nova-compute[75245]:     <nova:user uuid="e746210be7104346bd8ed895b3f22cd9">tempest-TaggedAttachmentsTest-229817667-project-member</nova:user>
Nov 29 16:20:19 user nova-compute[75245]:     <nova:project uuid="77edb4b0a0024ef1a88cb67c11d51911">tempest-TaggedAttachmentsTest-229817667</nova:project>
Nov 29 16:20:19 user nova-compute[75245]:   </nova:owner>
Nov 29 16:20:19 user nova-compute[75245]:   <nova:root type="image" uuid="a291d9c3-be02-4c6c-9649-4b45c5b7f487"/>
Nov 29 16:20:19 user nova-compute[75245]:   <nova:ports>
Nov 29 16:20:19 user nova-compute[75245]:     <nova:port uuid="80f91f45-781d-452c-b2c0-de2584494644">
Nov 29 16:20:19 user nova-compute[75245]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 29 16:20:19 user nova-compute[75245]:     </nova:port>
Nov 29 16:20:19 user nova-compute[75245]:   </nova:ports>
Nov 29 16:20:19 user nova-compute[75245]: </nova:instance>
Nov 29 16:20:19 user nova-compute[75245]:   </metadata>
Nov 29 16:20:19 user nova-compute[75245]:   <memory unit='KiB'>524288</memory>
Nov 29 16:20:19 user nova-compute[75245]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 29 16:20:19 user nova-compute[75245]:   <vcpu placement='static'>1</vcpu>
Nov 29 16:20:19 user nova-compute[75245]:   <resource>
Nov 29 16:20:19 user nova-compute[75245]:     <partition>/machine</partition>
Nov 29 16:20:19 user nova-compute[75245]:   </resource>
Nov 29 16:20:19 user nova-compute[75245]:   <sysinfo type='smbios'>
Nov 29 16:20:19 user nova-compute[75245]:     <system>
Nov 29 16:20:19 user nova-compute[75245]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 29 16:20:19 user nova-compute[75245]:       <entry name='product'>OpenStack Nova</entry>
Nov 29 16:20:19 user nova-compute[75245]:       <entry name='version'>0.0.0</entry>
Nov 29 16:20:19 user nova-compute[75245]:       <entry name='serial'>f6720dc3-07fc-43e1-ba91-75e3d26a4a0f</entry>
Nov 29 16:20:19 user nova-compute[75245]:       <entry name='uuid'>f6720dc3-07fc-43e1-ba91-75e3d26a4a0f</entry>
Nov 29 16:20:19 user nova-compute[75245]:       <entry name='family'>Virtual Machine</entry>
Nov 29 16:20:19 user nova-compute[75245]:     </system>
Nov 29 16:20:19 user nova-compute[75245]:   </sysinfo>
Nov 29 16:20:19 user nova-compute[75245]:   <os>
Nov 29 16:20:19 user nova-compute[75245]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 29 16:20:19 user nova-compute[75245]:     <boot dev='hd'/>
Nov 29 16:20:19 user nova-compute[75245]:     <smbios mode='sysinfo'/>
Nov 29 16:20:19 user nova-compute[75245]:   </os>
Nov 29 16:20:19 user nova-compute[75245]:   <features>
Nov 29 16:20:19 user nova-compute[75245]:     <acpi/>
Nov 29 16:20:19 user nova-compute[75245]:     <apic/>
Nov 29 16:20:19 user nova-compute[75245]:     <vmcoreinfo state='on'/>
Nov 29 16:20:19 user nova-compute[75245]:   </features>
Nov 29 16:20:19 user nova-compute[75245]:   <cpu mode='custom' match='exact' check='full'>
Nov 29 16:20:19 user nova-compute[75245]:     <model fallback='forbid'>Nehalem</model>
Nov 29 16:20:19 user nova-compute[75245]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 29 16:20:19 user nova-compute[75245]:     <feature policy='require' name='vme'/>
Nov 29 16:20:19 user nova-compute[75245]:     <feature policy='require' name='x2apic'/>
Nov 29 16:20:19 user nova-compute[75245]:     <feature policy='require' name='hypervisor'/>
Nov 29 16:20:19 user nova-compute[75245]:   </cpu>
Nov 29 16:20:19 user nova-compute[75245]:   <clock offset='utc'>
Nov 29 16:20:19 user nova-compute[75245]:     <timer name='pit' tickpolicy='delay'/>
Nov 29 16:20:19 user nova-compute[75245]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 29 16:20:19 user nova-compute[75245]:     <timer name='hpet' present='no'/>
Nov 29 16:20:19 user nova-compute[75245]:   </clock>
Nov 29 16:20:19 user nova-compute[75245]:   <on_poweroff>destroy</on_poweroff>
Nov 29 16:20:19 user nova-compute[75245]:   <on_reboot>restart</on_reboot>
Nov 29 16:20:19 user nova-compute[75245]:   <on_crash>destroy</on_crash>
Nov 29 16:20:19 user nova-compute[75245]:   <devices>
Nov 29 16:20:19 user nova-compute[75245]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 29 16:20:19 user nova-compute[75245]:     <disk type='file' device='disk'>
Nov 29 16:20:19 user nova-compute[75245]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 29 16:20:19 user nova-compute[75245]:       <source file='/opt/stack/data/nova/instances/f6720dc3-07fc-43e1-ba91-75e3d26a4a0f/disk' index='2'/>
Nov 29 16:20:19 user nova-compute[75245]:       <backingStore type='file' index='3'>
Nov 29 16:20:19 user nova-compute[75245]:         <format type='raw'/>
Nov 29 16:20:19 user nova-compute[75245]:         <source file='/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8'/>
Nov 29 16:20:19 user nova-compute[75245]:         <backingStore/>
Nov 29 16:20:19 user nova-compute[75245]:       </backingStore>
Nov 29 16:20:19 user nova-compute[75245]:       <target dev='vda' bus='virtio'/>
Nov 29 16:20:19 user nova-compute[75245]:       <alias name='virtio-disk0'/>
Nov 29 16:20:19 user nova-compute[75245]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 29 16:20:19 user nova-compute[75245]:     </disk>
Nov 29 16:20:19 user nova-compute[75245]:     <disk type='file' device='cdrom'>
Nov 29 16:20:19 user nova-compute[75245]:       <driver name='qemu' type='raw' cache='none'/>
Nov 29 16:20:19 user nova-compute[75245]:       <source file='/opt/stack/data/nova/instances/f6720dc3-07fc-43e1-ba91-75e3d26a4a0f/disk.config' index='1'/>
Nov 29 16:20:19 user nova-compute[75245]:       <backingStore/>
Nov 29 16:20:19 user nova-compute[75245]:       <target dev='hda' bus='ide'/>
Nov 29 16:20:19 user nova-compute[75245]:       <readonly/>
Nov 29 16:20:19 user nova-compute[75245]:       <alias name='ide0-0-0'/>
Nov 29 16:20:19 user nova-compute[75245]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 29 16:20:19 user nova-compute[75245]:     </disk>
Nov 29 16:20:19 user nova-compute[75245]:     <controller type='usb' index='0' model='none'>
Nov 29 16:20:19 user nova-compute[75245]:       <alias name='usb'/>
Nov 29 16:20:19 user nova-compute[75245]:     </controller>
Nov 29 16:20:19 user nova-compute[75245]:     <controller type='pci' index='0' model='pci-root'>
Nov 29 16:20:19 user nova-compute[75245]:       <alias name='pci.0'/>
Nov 29 16:20:19 user nova-compute[75245]:     </controller>
Nov 29 16:20:19 user nova-compute[75245]:     <controller type='ide' index='0'>
Nov 29 16:20:19 user nova-compute[75245]:       <alias name='ide'/>
Nov 29 16:20:19 user nova-compute[75245]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 29 16:20:19 user nova-compute[75245]:     </controller>
Nov 29 16:20:19 user nova-compute[75245]:     <interface type='ethernet'>
Nov 29 16:20:19 user nova-compute[75245]:       <mac address='fa:16:3e:11:16:c3'/>
Nov 29 16:20:19 user nova-compute[75245]:       <target dev='tap80f91f45-78'/>
Nov 29 16:20:19 user nova-compute[75245]:       <model type='virtio'/>
Nov 29 16:20:19 user nova-compute[75245]:       <mtu size='1442'/>
Nov 29 16:20:19 user nova-compute[75245]:       <alias name='net0'/>
Nov 29 16:20:19 user nova-compute[75245]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 29 16:20:19 user nova-compute[75245]:     </interface>
Nov 29 16:20:19 user nova-compute[75245]:     <serial type='pty'>
Nov 29 16:20:19 user nova-compute[75245]:       <source path='/dev/pts/6'/>
Nov 29 16:20:19 user nova-compute[75245]:       <log file='/opt/stack/data/nova/instances/f6720dc3-07fc-43e1-ba91-75e3d26a4a0f/console.log' append='off'/>
Nov 29 16:20:19 user nova-compute[75245]:       <target type='isa-serial' port='0'>
Nov 29 16:20:19 user nova-compute[75245]:         <model name='isa-serial'/>
Nov 29 16:20:19 user nova-compute[75245]:       </target>
Nov 29 16:20:19 user nova-compute[75245]:       <alias name='serial0'/>
Nov 29 16:20:19 user nova-compute[75245]:     </serial>
Nov 29 16:20:19 user nova-compute[75245]:     <console type='pty' tty='/dev/pts/6'>
Nov 29 16:20:19 user nova-compute[75245]:       <source path='/dev/pts/6'/>
Nov 29 16:20:19 user nova-compute[75245]:       <log file='/opt/stack/data/nova/instances/f6720dc3-07fc-43e1-ba91-75e3d26a4a0f/console.log' append='off'/>
Nov 29 16:20:19 user nova-compute[75245]:       <target type='serial' port='0'/>
Nov 29 16:20:19 user nova-compute[75245]:       <alias name='serial0'/>
Nov 29 16:20:19 user nova-compute[75245]:     </console>
Nov 29 16:20:19 user nova-compute[75245]:     <input type='mouse' bus='ps2'>
Nov 29 16:20:19 user nova-compute[75245]:       <alias name='input0'/>
Nov 29 16:20:19 user nova-compute[75245]:     </input>
Nov 29 16:20:19 user nova-compute[75245]:     <input type='keyboard' bus='ps2'>
Nov 29 16:20:19 user nova-compute[75245]:       <alias name='input1'/>
Nov 29 16:20:19 user nova-compute[75245]:     </input>
Nov 29 16:20:19 user nova-compute[75245]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 29 16:20:19 user nova-compute[75245]:       <listen type='address' address='0.0.0.0'/>
Nov 29 16:20:19 user nova-compute[75245]:     </graphics>
Nov 29 16:20:19 user nova-compute[75245]:     <audio id='1' type='none'/>
Nov 29 16:20:19 user nova-compute[75245]:     <video>
Nov 29 16:20:19 user nova-compute[75245]:       <model type='virtio' heads='1' primary='yes'/>
Nov 29 16:20:19 user nova-compute[75245]:       <alias name='video0'/>
Nov 29 16:20:19 user nova-compute[75245]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 29 16:20:19 user nova-compute[75245]:     </video>
Nov 29 16:20:19 user nova-compute[75245]:     <memballoon model='virtio'>
Nov 29 16:20:19 user nova-compute[75245]:       <stats period='10'/>
Nov 29 16:20:19 user nova-compute[75245]:       <alias name='balloon0'/>
Nov 29 16:20:19 user nova-compute[75245]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 29 16:20:19 user nova-compute[75245]:     </memballoon>
Nov 29 16:20:19 user nova-compute[75245]:     <rng model='virtio'>
Nov 29 16:20:19 user nova-compute[75245]:       <backend model='random'>/dev/urandom</backend>
Nov 29 16:20:19 user nova-compute[75245]:       <alias name='rng0'/>
Nov 29 16:20:19 user nova-compute[75245]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 29 16:20:19 user nova-compute[75245]:     </rng>
Nov 29 16:20:19 user nova-compute[75245]:   </devices>
Nov 29 16:20:19 user nova-compute[75245]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 29 16:20:19 user nova-compute[75245]:     <label>libvirt-f6720dc3-07fc-43e1-ba91-75e3d26a4a0f</label>
Nov 29 16:20:19 user nova-compute[75245]:     <imagelabel>libvirt-f6720dc3-07fc-43e1-ba91-75e3d26a4a0f</imagelabel>
Nov 29 16:20:19 user nova-compute[75245]:   </seclabel>
Nov 29 16:20:19 user nova-compute[75245]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 29 16:20:19 user nova-compute[75245]:     <label>+64055:+108</label>
Nov 29 16:20:19 user nova-compute[75245]:     <imagelabel>+64055:+108</imagelabel>
Nov 29 16:20:19 user nova-compute[75245]:   </seclabel>
Nov 29 16:20:19 user nova-compute[75245]: </domain>
Nov 29 16:20:19 user nova-compute[75245]:  {{(pid=75245) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 29 16:20:19 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [req-ad2258c2-6fe7-4591-8e9e-4c707a0aafbf req-cdc54154-c6b5-4ce4-a17d-37862354bea1 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:87:e1:00"/><model type="virtio"/><mtu size="1442"/><target dev="tapf96864d7-90"/></interface> {{(pid=75245) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 29 16:20:19 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [req-ad2258c2-6fe7-4591-8e9e-4c707a0aafbf req-cdc54154-c6b5-4ce4-a17d-37862354bea1 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:87:e1:00"/><model type="virtio"/><mtu size="1442"/><target dev="tapf96864d7-90"/></interface>not found in domain: <domain type='kvm' id='21'>
Nov 29 16:20:19 user nova-compute[75245]:   <name>instance-00000012</name>
Nov 29 16:20:19 user nova-compute[75245]:   <uuid>f6720dc3-07fc-43e1-ba91-75e3d26a4a0f</uuid>
Nov 29 16:20:19 user nova-compute[75245]:   <metadata>
Nov 29 16:20:19 user nova-compute[75245]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 16:20:19 user nova-compute[75245]:   <nova:package version="0.0.0"/>
Nov 29 16:20:19 user nova-compute[75245]:   <nova:name>tempest-device-tagging-server-509169920</nova:name>
Nov 29 16:20:19 user nova-compute[75245]:   <nova:creationTime>2023-11-29 16:20:18</nova:creationTime>
Nov 29 16:20:19 user nova-compute[75245]:   <nova:flavor name="m1.tiny">
Nov 29 16:20:19 user nova-compute[75245]:     <nova:memory>512</nova:memory>
Nov 29 16:20:19 user nova-compute[75245]:     <nova:disk>1</nova:disk>
Nov 29 16:20:19 user nova-compute[75245]:     <nova:swap>0</nova:swap>
Nov 29 16:20:19 user nova-compute[75245]:     <nova:ephemeral>0</nova:ephemeral>
Nov 29 16:20:19 user nova-compute[75245]:     <nova:vcpus>1</nova:vcpus>
Nov 29 16:20:19 user nova-compute[75245]:   </nova:flavor>
Nov 29 16:20:19 user nova-compute[75245]:   <nova:owner>
Nov 29 16:20:19 user nova-compute[75245]:     <nova:user uuid="e746210be7104346bd8ed895b3f22cd9">tempest-TaggedAttachmentsTest-229817667-project-member</nova:user>
Nov 29 16:20:19 user nova-compute[75245]:     <nova:project uuid="77edb4b0a0024ef1a88cb67c11d51911">tempest-TaggedAttachmentsTest-229817667</nova:project>
Nov 29 16:20:19 user nova-compute[75245]:   </nova:owner>
Nov 29 16:20:19 user nova-compute[75245]:   <nova:root type="image" uuid="a291d9c3-be02-4c6c-9649-4b45c5b7f487"/>
Nov 29 16:20:19 user nova-compute[75245]:   <nova:ports>
Nov 29 16:20:19 user nova-compute[75245]:     <nova:port uuid="80f91f45-781d-452c-b2c0-de2584494644">
Nov 29 16:20:19 user nova-compute[75245]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 29 16:20:19 user nova-compute[75245]:     </nova:port>
Nov 29 16:20:19 user nova-compute[75245]:   </nova:ports>
Nov 29 16:20:19 user nova-compute[75245]: </nova:instance>
Nov 29 16:20:19 user nova-compute[75245]:   </metadata>
Nov 29 16:20:19 user nova-compute[75245]:   <memory unit='KiB'>524288</memory>
Nov 29 16:20:19 user nova-compute[75245]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 29 16:20:19 user nova-compute[75245]:   <vcpu placement='static'>1</vcpu>
Nov 29 16:20:19 user nova-compute[75245]:   <resource>
Nov 29 16:20:19 user nova-compute[75245]:     <partition>/machine</partition>
Nov 29 16:20:19 user nova-compute[75245]:   </resource>
Nov 29 16:20:19 user nova-compute[75245]:   <sysinfo type='smbios'>
Nov 29 16:20:19 user nova-compute[75245]:     <system>
Nov 29 16:20:19 user nova-compute[75245]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 29 16:20:19 user nova-compute[75245]:       <entry name='product'>OpenStack Nova</entry>
Nov 29 16:20:19 user nova-compute[75245]:       <entry name='version'>0.0.0</entry>
Nov 29 16:20:19 user nova-compute[75245]:       <entry name='serial'>f6720dc3-07fc-43e1-ba91-75e3d26a4a0f</entry>
Nov 29 16:20:19 user nova-compute[75245]:       <entry name='uuid'>f6720dc3-07fc-43e1-ba91-75e3d26a4a0f</entry>
Nov 29 16:20:19 user nova-compute[75245]:       <entry name='family'>Virtual Machine</entry>
Nov 29 16:20:19 user nova-compute[75245]:     </system>
Nov 29 16:20:19 user nova-compute[75245]:   </sysinfo>
Nov 29 16:20:19 user nova-compute[75245]:   <os>
Nov 29 16:20:19 user nova-compute[75245]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 29 16:20:19 user nova-compute[75245]:     <boot dev='hd'/>
Nov 29 16:20:19 user nova-compute[75245]:     <smbios mode='sysinfo'/>
Nov 29 16:20:19 user nova-compute[75245]:   </os>
Nov 29 16:20:19 user nova-compute[75245]:   <features>
Nov 29 16:20:19 user nova-compute[75245]:     <acpi/>
Nov 29 16:20:19 user nova-compute[75245]:     <apic/>
Nov 29 16:20:19 user nova-compute[75245]:     <vmcoreinfo state='on'/>
Nov 29 16:20:19 user nova-compute[75245]:   </features>
Nov 29 16:20:19 user nova-compute[75245]:   <cpu mode='custom' match='exact' check='full'>
Nov 29 16:20:19 user nova-compute[75245]:     <model fallback='forbid'>Nehalem</model>
Nov 29 16:20:19 user nova-compute[75245]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 29 16:20:19 user nova-compute[75245]:     <feature policy='require' name='vme'/>
Nov 29 16:20:19 user nova-compute[75245]:     <feature policy='require' name='x2apic'/>
Nov 29 16:20:19 user nova-compute[75245]:     <feature policy='require' name='hypervisor'/>
Nov 29 16:20:19 user nova-compute[75245]:   </cpu>
Nov 29 16:20:19 user nova-compute[75245]:   <clock offset='utc'>
Nov 29 16:20:19 user nova-compute[75245]:     <timer name='pit' tickpolicy='delay'/>
Nov 29 16:20:19 user nova-compute[75245]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 29 16:20:19 user nova-compute[75245]:     <timer name='hpet' present='no'/>
Nov 29 16:20:19 user nova-compute[75245]:   </clock>
Nov 29 16:20:19 user nova-compute[75245]:   <on_poweroff>destroy</on_poweroff>
Nov 29 16:20:19 user nova-compute[75245]:   <on_reboot>restart</on_reboot>
Nov 29 16:20:19 user nova-compute[75245]:   <on_crash>destroy</on_crash>
Nov 29 16:20:19 user nova-compute[75245]:   <devices>
Nov 29 16:20:19 user nova-compute[75245]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 29 16:20:19 user nova-compute[75245]:     <disk type='file' device='disk'>
Nov 29 16:20:19 user nova-compute[75245]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 29 16:20:19 user nova-compute[75245]:       <source file='/opt/stack/data/nova/instances/f6720dc3-07fc-43e1-ba91-75e3d26a4a0f/disk' index='2'/>
Nov 29 16:20:19 user nova-compute[75245]:       <backingStore type='file' index='3'>
Nov 29 16:20:19 user nova-compute[75245]:         <format type='raw'/>
Nov 29 16:20:19 user nova-compute[75245]:         <source file='/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8'/>
Nov 29 16:20:19 user nova-compute[75245]:         <backingStore/>
Nov 29 16:20:19 user nova-compute[75245]:       </backingStore>
Nov 29 16:20:19 user nova-compute[75245]:       <target dev='vda' bus='virtio'/>
Nov 29 16:20:19 user nova-compute[75245]:       <alias name='virtio-disk0'/>
Nov 29 16:20:19 user nova-compute[75245]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 29 16:20:19 user nova-compute[75245]:     </disk>
Nov 29 16:20:19 user nova-compute[75245]:     <disk type='file' device='cdrom'>
Nov 29 16:20:19 user nova-compute[75245]:       <driver name='qemu' type='raw' cache='none'/>
Nov 29 16:20:19 user nova-compute[75245]:       <source file='/opt/stack/data/nova/instances/f6720dc3-07fc-43e1-ba91-75e3d26a4a0f/disk.config' index='1'/>
Nov 29 16:20:19 user nova-compute[75245]:       <backingStore/>
Nov 29 16:20:19 user nova-compute[75245]:       <target dev='hda' bus='ide'/>
Nov 29 16:20:19 user nova-compute[75245]:       <readonly/>
Nov 29 16:20:19 user nova-compute[75245]:       <alias name='ide0-0-0'/>
Nov 29 16:20:19 user nova-compute[75245]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 29 16:20:19 user nova-compute[75245]:     </disk>
Nov 29 16:20:19 user nova-compute[75245]:     <controller type='usb' index='0' model='none'>
Nov 29 16:20:19 user nova-compute[75245]:       <alias name='usb'/>
Nov 29 16:20:19 user nova-compute[75245]:     </controller>
Nov 29 16:20:19 user nova-compute[75245]:     <controller type='pci' index='0' model='pci-root'>
Nov 29 16:20:19 user nova-compute[75245]:       <alias name='pci.0'/>
Nov 29 16:20:19 user nova-compute[75245]:     </controller>
Nov 29 16:20:19 user nova-compute[75245]:     <controller type='ide' index='0'>
Nov 29 16:20:19 user nova-compute[75245]:       <alias name='ide'/>
Nov 29 16:20:19 user nova-compute[75245]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 29 16:20:19 user nova-compute[75245]:     </controller>
Nov 29 16:20:19 user nova-compute[75245]:     <interface type='ethernet'>
Nov 29 16:20:19 user nova-compute[75245]:       <mac address='fa:16:3e:11:16:c3'/>
Nov 29 16:20:19 user nova-compute[75245]:       <target dev='tap80f91f45-78'/>
Nov 29 16:20:19 user nova-compute[75245]:       <model type='virtio'/>
Nov 29 16:20:19 user nova-compute[75245]:       <mtu size='1442'/>
Nov 29 16:20:19 user nova-compute[75245]:       <alias name='net0'/>
Nov 29 16:20:19 user nova-compute[75245]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 29 16:20:19 user nova-compute[75245]:     </interface>
Nov 29 16:20:19 user nova-compute[75245]:     <serial type='pty'>
Nov 29 16:20:19 user nova-compute[75245]:       <source path='/dev/pts/6'/>
Nov 29 16:20:19 user nova-compute[75245]:       <log file='/opt/stack/data/nova/instances/f6720dc3-07fc-43e1-ba91-75e3d26a4a0f/console.log' append='off'/>
Nov 29 16:20:19 user nova-compute[75245]:       <target type='isa-serial' port='0'>
Nov 29 16:20:19 user nova-compute[75245]:         <model name='isa-serial'/>
Nov 29 16:20:19 user nova-compute[75245]:       </target>
Nov 29 16:20:19 user nova-compute[75245]:       <alias name='serial0'/>
Nov 29 16:20:19 user nova-compute[75245]:     </serial>
Nov 29 16:20:19 user nova-compute[75245]:     <console type='pty' tty='/dev/pts/6'>
Nov 29 16:20:19 user nova-compute[75245]:       <source path='/dev/pts/6'/>
Nov 29 16:20:19 user nova-compute[75245]:       <log file='/opt/stack/data/nova/instances/f6720dc3-07fc-43e1-ba91-75e3d26a4a0f/console.log' append='off'/>
Nov 29 16:20:19 user nova-compute[75245]:       <target type='serial' port='0'/>
Nov 29 16:20:19 user nova-compute[75245]:       <alias name='serial0'/>
Nov 29 16:20:19 user nova-compute[75245]:     </console>
Nov 29 16:20:19 user nova-compute[75245]:     <input type='mouse' bus='ps2'>
Nov 29 16:20:19 user nova-compute[75245]:       <alias name='input0'/>
Nov 29 16:20:19 user nova-compute[75245]:     </input>
Nov 29 16:20:19 user nova-compute[75245]:     <input type='keyboard' bus='ps2'>
Nov 29 16:20:19 user nova-compute[75245]:       <alias name='input1'/>
Nov 29 16:20:19 user nova-compute[75245]:     </input>
Nov 29 16:20:19 user nova-compute[75245]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 29 16:20:19 user nova-compute[75245]:       <listen type='address' address='0.0.0.0'/>
Nov 29 16:20:19 user nova-compute[75245]:     </graphics>
Nov 29 16:20:19 user nova-compute[75245]:     <audio id='1' type='none'/>
Nov 29 16:20:19 user nova-compute[75245]:     <video>
Nov 29 16:20:19 user nova-compute[75245]:       <model type='virtio' heads='1' primary='yes'/>
Nov 29 16:20:19 user nova-compute[75245]:       <alias name='video0'/>
Nov 29 16:20:19 user nova-compute[75245]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 29 16:20:19 user nova-compute[75245]:     </video>
Nov 29 16:20:19 user nova-compute[75245]:     <memballoon model='virtio'>
Nov 29 16:20:19 user nova-compute[75245]:       <stats period='10'/>
Nov 29 16:20:19 user nova-compute[75245]:       <alias name='balloon0'/>
Nov 29 16:20:19 user nova-compute[75245]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 29 16:20:19 user nova-compute[75245]:     </memballoon>
Nov 29 16:20:19 user nova-compute[75245]:     <rng model='virtio'>
Nov 29 16:20:19 user nova-compute[75245]:       <backend model='random'>/dev/urandom</backend>
Nov 29 16:20:19 user nova-compute[75245]:       <alias name='rng0'/>
Nov 29 16:20:19 user nova-compute[75245]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 29 16:20:19 user nova-compute[75245]:     </rng>
Nov 29 16:20:19 user nova-compute[75245]:   </devices>
Nov 29 16:20:19 user nova-compute[75245]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 29 16:20:19 user nova-compute[75245]:     <label>libvirt-f6720dc3-07fc-43e1-ba91-75e3d26a4a0f</label>
Nov 29 16:20:19 user nova-compute[75245]:     <imagelabel>libvirt-f6720dc3-07fc-43e1-ba91-75e3d26a4a0f</imagelabel>
Nov 29 16:20:19 user nova-compute[75245]:   </seclabel>
Nov 29 16:20:19 user nova-compute[75245]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 29 16:20:19 user nova-compute[75245]:     <label>+64055:+108</label>
Nov 29 16:20:19 user nova-compute[75245]:     <imagelabel>+64055:+108</imagelabel>
Nov 29 16:20:19 user nova-compute[75245]:   </seclabel>
Nov 29 16:20:19 user nova-compute[75245]: </domain>
Nov 29 16:20:19 user nova-compute[75245]:  {{(pid=75245) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 29 16:20:19 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [req-ad2258c2-6fe7-4591-8e9e-4c707a0aafbf req-cdc54154-c6b5-4ce4-a17d-37862354bea1 service nova] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Detaching interface fa:16:3e:87:e1:00 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tapf96864d7-90' not found.
Nov 29 16:20:19 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [req-ad2258c2-6fe7-4591-8e9e-4c707a0aafbf req-cdc54154-c6b5-4ce4-a17d-37862354bea1 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T16:17:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-509169920',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-509169920',id=18,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBrxKq2a477G7fQ99CR3fI2bNDKuIY+WInOILJKOnZG664u+pIIu8QmsOdQ2tkxzkJGzMiOTR9GNSQO7MZOS3L5S3KmbXxtrzunCovcSXNCoaN7+W1BI3hrcIZ+N4h5Q6g==',key_name='tempest-keypair-1309950339',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:17:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='77edb4b0a0024ef1a88cb67c11d51911',ramdisk_id='',reservation_id='r-x0llsnrl',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-229817667',owner_user_name='tempest-TaggedAttachmentsTest-229817667-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:17:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e746210be7104346bd8ed895b3f22cd9',uuid=f6720dc3-07fc-43e1-ba91-75e3d26a4a0f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f96864d7-90bc-4830-a939-4ef48125e8ba", "address": "fa:16:3e:87:e1:00", "network": {"id": "e3acd9cb-1104-4bb7-904d-adf9c4de10bb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-338053759", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "77edb4b0a0024ef1a88cb67c11d51911", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf96864d7-90", "ovs_interfaceid": "f96864d7-90bc-4830-a939-4ef48125e8ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 16:20:19 user nova-compute[75245]: DEBUG nova.network.os_vif_util [req-ad2258c2-6fe7-4591-8e9e-4c707a0aafbf req-cdc54154-c6b5-4ce4-a17d-37862354bea1 service nova] Converting VIF {"id": "f96864d7-90bc-4830-a939-4ef48125e8ba", "address": "fa:16:3e:87:e1:00", "network": {"id": "e3acd9cb-1104-4bb7-904d-adf9c4de10bb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-338053759", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "77edb4b0a0024ef1a88cb67c11d51911", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf96864d7-90", "ovs_interfaceid": "f96864d7-90bc-4830-a939-4ef48125e8ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:20:19 user nova-compute[75245]: DEBUG nova.network.os_vif_util [req-ad2258c2-6fe7-4591-8e9e-4c707a0aafbf req-cdc54154-c6b5-4ce4-a17d-37862354bea1 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:e1:00,bridge_name='br-int',has_traffic_filtering=True,id=f96864d7-90bc-4830-a939-4ef48125e8ba,network=Network(e3acd9cb-1104-4bb7-904d-adf9c4de10bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf96864d7-90') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:20:19 user nova-compute[75245]: DEBUG os_vif [req-ad2258c2-6fe7-4591-8e9e-4c707a0aafbf req-cdc54154-c6b5-4ce4-a17d-37862354bea1 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:e1:00,bridge_name='br-int',has_traffic_filtering=True,id=f96864d7-90bc-4830-a939-4ef48125e8ba,network=Network(e3acd9cb-1104-4bb7-904d-adf9c4de10bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf96864d7-90') {{(pid=75245) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 16:20:19 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:20:19 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf96864d7-90, bridge=br-int, if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:20:19 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 16:20:19 user nova-compute[75245]: INFO os_vif [req-ad2258c2-6fe7-4591-8e9e-4c707a0aafbf req-cdc54154-c6b5-4ce4-a17d-37862354bea1 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:e1:00,bridge_name='br-int',has_traffic_filtering=True,id=f96864d7-90bc-4830-a939-4ef48125e8ba,network=Network(e3acd9cb-1104-4bb7-904d-adf9c4de10bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf96864d7-90')
Nov 29 16:20:19 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [req-ad2258c2-6fe7-4591-8e9e-4c707a0aafbf req-cdc54154-c6b5-4ce4-a17d-37862354bea1 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 16:20:19 user nova-compute[75245]:   <nova:package version="0.0.0"/>
Nov 29 16:20:19 user nova-compute[75245]:   <nova:name>tempest-device-tagging-server-509169920</nova:name>
Nov 29 16:20:19 user nova-compute[75245]:   <nova:creationTime>2023-11-29 16:20:19</nova:creationTime>
Nov 29 16:20:19 user nova-compute[75245]:   <nova:flavor name="m1.tiny">
Nov 29 16:20:19 user nova-compute[75245]:     <nova:memory>512</nova:memory>
Nov 29 16:20:19 user nova-compute[75245]:     <nova:disk>1</nova:disk>
Nov 29 16:20:19 user nova-compute[75245]:     <nova:swap>0</nova:swap>
Nov 29 16:20:19 user nova-compute[75245]:     <nova:ephemeral>0</nova:ephemeral>
Nov 29 16:20:19 user nova-compute[75245]:     <nova:vcpus>1</nova:vcpus>
Nov 29 16:20:19 user nova-compute[75245]:   </nova:flavor>
Nov 29 16:20:19 user nova-compute[75245]:   <nova:owner>
Nov 29 16:20:19 user nova-compute[75245]:     <nova:user uuid="e746210be7104346bd8ed895b3f22cd9">tempest-TaggedAttachmentsTest-229817667-project-member</nova:user>
Nov 29 16:20:19 user nova-compute[75245]:     <nova:project uuid="77edb4b0a0024ef1a88cb67c11d51911">tempest-TaggedAttachmentsTest-229817667</nova:project>
Nov 29 16:20:19 user nova-compute[75245]:   </nova:owner>
Nov 29 16:20:19 user nova-compute[75245]:   <nova:root type="image" uuid="a291d9c3-be02-4c6c-9649-4b45c5b7f487"/>
Nov 29 16:20:19 user nova-compute[75245]:   <nova:ports>
Nov 29 16:20:19 user nova-compute[75245]:     <nova:port uuid="80f91f45-781d-452c-b2c0-de2584494644">
Nov 29 16:20:19 user nova-compute[75245]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 29 16:20:19 user nova-compute[75245]:     </nova:port>
Nov 29 16:20:19 user nova-compute[75245]:   </nova:ports>
Nov 29 16:20:19 user nova-compute[75245]: </nova:instance>
Nov 29 16:20:19 user nova-compute[75245]:  {{(pid=75245) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 29 16:20:19 user nova-compute[75245]: INFO nova.network.neutron [None req-3590f4fa-73c3-4546-b9f9-55270b54b706 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Port f96864d7-90bc-4830-a939-4ef48125e8ba from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Nov 29 16:20:19 user nova-compute[75245]: DEBUG nova.network.neutron [None req-3590f4fa-73c3-4546-b9f9-55270b54b706 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Updating instance_info_cache with network_info: [{"id": "80f91f45-781d-452c-b2c0-de2584494644", "address": "fa:16:3e:11:16:c3", "network": {"id": "0c0d4e62-be12-42e1-878c-a4a07270c108", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2066574781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77edb4b0a0024ef1a88cb67c11d51911", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80f91f45-78", "ovs_interfaceid": "80f91f45-781d-452c-b2c0-de2584494644", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:20:19 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3590f4fa-73c3-4546-b9f9-55270b54b706 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Releasing lock "refresh_cache-f6720dc3-07fc-43e1-ba91-75e3d26a4a0f" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:20:19 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3590f4fa-73c3-4546-b9f9-55270b54b706 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Lock "interface-f6720dc3-07fc-43e1-ba91-75e3d26a4a0f-f96864d7-90bc-4830-a939-4ef48125e8ba" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.710s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:20:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:20:27 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:20:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:20:33 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:20:38 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:20:39 user nova-compute[75245]: DEBUG nova.compute.manager [None req-9589d7f6-c84c-4ce6-8a02-5202d048bd31 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:20:39 user nova-compute[75245]: INFO nova.compute.manager [None req-9589d7f6-c84c-4ce6-8a02-5202d048bd31 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] instance snapshotting
Nov 29 16:20:39 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-9589d7f6-c84c-4ce6-8a02-5202d048bd31 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Beginning live snapshot process
Nov 29 16:20:39 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-9589d7f6-c84c-4ce6-8a02-5202d048bd31 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json -f qcow2 {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:20:39 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-9589d7f6-c84c-4ce6-8a02-5202d048bd31 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json -f qcow2" returned: 0 in 0.195s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:20:39 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-9589d7f6-c84c-4ce6-8a02-5202d048bd31 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json -f qcow2 {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:20:39 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-9589d7f6-c84c-4ce6-8a02-5202d048bd31 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json -f qcow2" returned: 0 in 0.178s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:20:39 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-9589d7f6-c84c-4ce6-8a02-5202d048bd31 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:20:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-9589d7f6-c84c-4ce6-8a02-5202d048bd31 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.213s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:20:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-9589d7f6-c84c-4ce6-8a02-5202d048bd31 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpc58ainqe/e24c05b1cc654e17b449f05a45263748.delta 1073741824 {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:20:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-9589d7f6-c84c-4ce6-8a02-5202d048bd31 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpc58ainqe/e24c05b1cc654e17b449f05a45263748.delta 1073741824" returned: 0 in 0.049s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:20:40 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-9589d7f6-c84c-4ce6-8a02-5202d048bd31 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 29 16:20:40 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-9589d7f6-c84c-4ce6-8a02-5202d048bd31 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75245) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 16:20:41 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-9589d7f6-c84c-4ce6-8a02-5202d048bd31 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75245) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 16:20:41 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-9589d7f6-c84c-4ce6-8a02-5202d048bd31 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 29 16:20:41 user nova-compute[75245]: DEBUG nova.privsep.utils [None req-9589d7f6-c84c-4ce6-8a02-5202d048bd31 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75245) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 16:20:41 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-9589d7f6-c84c-4ce6-8a02-5202d048bd31 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpc58ainqe/e24c05b1cc654e17b449f05a45263748.delta /opt/stack/data/nova/instances/snapshots/tmpc58ainqe/e24c05b1cc654e17b449f05a45263748 {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:20:42 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-9589d7f6-c84c-4ce6-8a02-5202d048bd31 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpc58ainqe/e24c05b1cc654e17b449f05a45263748.delta /opt/stack/data/nova/instances/snapshots/tmpc58ainqe/e24c05b1cc654e17b449f05a45263748" returned: 0 in 0.511s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:20:42 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-9589d7f6-c84c-4ce6-8a02-5202d048bd31 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Snapshot extracted, beginning image upload
Nov 29 16:20:43 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:20:44 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-9589d7f6-c84c-4ce6-8a02-5202d048bd31 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Snapshot image upload complete
Nov 29 16:20:44 user nova-compute[75245]: INFO nova.compute.manager [None req-9589d7f6-c84c-4ce6-8a02-5202d048bd31 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Took 5.71 seconds to snapshot the instance on the hypervisor.
Nov 29 16:20:46 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:20:48 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:20:48 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:20:48 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:20:49 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4a481a53-9353-4c33-bc91-38fffea1d569 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Acquiring lock "f6720dc3-07fc-43e1-ba91-75e3d26a4a0f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:20:49 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4a481a53-9353-4c33-bc91-38fffea1d569 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Lock "f6720dc3-07fc-43e1-ba91-75e3d26a4a0f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:20:49 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4a481a53-9353-4c33-bc91-38fffea1d569 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Acquiring lock "f6720dc3-07fc-43e1-ba91-75e3d26a4a0f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:20:49 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4a481a53-9353-4c33-bc91-38fffea1d569 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Lock "f6720dc3-07fc-43e1-ba91-75e3d26a4a0f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:20:49 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4a481a53-9353-4c33-bc91-38fffea1d569 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Lock "f6720dc3-07fc-43e1-ba91-75e3d26a4a0f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:20:49 user nova-compute[75245]: INFO nova.compute.manager [None req-4a481a53-9353-4c33-bc91-38fffea1d569 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Terminating instance
Nov 29 16:20:49 user nova-compute[75245]: DEBUG nova.compute.manager [None req-4a481a53-9353-4c33-bc91-38fffea1d569 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Start destroying the instance on the hypervisor. {{(pid=75245) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 16:20:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:20:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:20:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:20:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:20:49 user nova-compute[75245]: DEBUG nova.compute.manager [req-250ff2dc-9ef0-400f-adf3-e532dac55279 req-213ec3cb-1226-462a-9ce0-9a5c9ac98b75 service nova] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Received event network-vif-unplugged-80f91f45-781d-452c-b2c0-de2584494644 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:20:49 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-250ff2dc-9ef0-400f-adf3-e532dac55279 req-213ec3cb-1226-462a-9ce0-9a5c9ac98b75 service nova] Acquiring lock "f6720dc3-07fc-43e1-ba91-75e3d26a4a0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:20:49 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-250ff2dc-9ef0-400f-adf3-e532dac55279 req-213ec3cb-1226-462a-9ce0-9a5c9ac98b75 service nova] Lock "f6720dc3-07fc-43e1-ba91-75e3d26a4a0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:20:49 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-250ff2dc-9ef0-400f-adf3-e532dac55279 req-213ec3cb-1226-462a-9ce0-9a5c9ac98b75 service nova] Lock "f6720dc3-07fc-43e1-ba91-75e3d26a4a0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:20:49 user nova-compute[75245]: DEBUG nova.compute.manager [req-250ff2dc-9ef0-400f-adf3-e532dac55279 req-213ec3cb-1226-462a-9ce0-9a5c9ac98b75 service nova] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] No waiting events found dispatching network-vif-unplugged-80f91f45-781d-452c-b2c0-de2584494644 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:20:49 user nova-compute[75245]: DEBUG nova.compute.manager [req-250ff2dc-9ef0-400f-adf3-e532dac55279 req-213ec3cb-1226-462a-9ce0-9a5c9ac98b75 service nova] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Received event network-vif-unplugged-80f91f45-781d-452c-b2c0-de2584494644 for instance with task_state deleting. {{(pid=75245) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 16:20:50 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Instance destroyed successfully.
Nov 29 16:20:50 user nova-compute[75245]: DEBUG nova.objects.instance [None req-4a481a53-9353-4c33-bc91-38fffea1d569 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Lazy-loading 'resources' on Instance uuid f6720dc3-07fc-43e1-ba91-75e3d26a4a0f {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:20:50 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-4a481a53-9353-4c33-bc91-38fffea1d569 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T16:17:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-509169920',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-509169920',id=18,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBrxKq2a477G7fQ99CR3fI2bNDKuIY+WInOILJKOnZG664u+pIIu8QmsOdQ2tkxzkJGzMiOTR9GNSQO7MZOS3L5S3KmbXxtrzunCovcSXNCoaN7+W1BI3hrcIZ+N4h5Q6g==',key_name='tempest-keypair-1309950339',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:17:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='77edb4b0a0024ef1a88cb67c11d51911',ramdisk_id='',reservation_id='r-x0llsnrl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-229817667',owner_user_name='tempest-TaggedAttachmentsTest-229817667-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:17:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e746210be7104346bd8ed895b3f22cd9',uuid=f6720dc3-07fc-43e1-ba91-75e3d26a4a0f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "80f91f45-781d-452c-b2c0-de2584494644", "address": "fa:16:3e:11:16:c3", "network": {"id": "0c0d4e62-be12-42e1-878c-a4a07270c108", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2066574781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77edb4b0a0024ef1a88cb67c11d51911", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80f91f45-78", "ovs_interfaceid": "80f91f45-781d-452c-b2c0-de2584494644", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 16:20:50 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-4a481a53-9353-4c33-bc91-38fffea1d569 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Converting VIF {"id": "80f91f45-781d-452c-b2c0-de2584494644", "address": "fa:16:3e:11:16:c3", "network": {"id": "0c0d4e62-be12-42e1-878c-a4a07270c108", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2066574781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77edb4b0a0024ef1a88cb67c11d51911", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80f91f45-78", "ovs_interfaceid": "80f91f45-781d-452c-b2c0-de2584494644", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:20:50 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-4a481a53-9353-4c33-bc91-38fffea1d569 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:11:16:c3,bridge_name='br-int',has_traffic_filtering=True,id=80f91f45-781d-452c-b2c0-de2584494644,network=Network(0c0d4e62-be12-42e1-878c-a4a07270c108),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80f91f45-78') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:20:50 user nova-compute[75245]: DEBUG os_vif [None req-4a481a53-9353-4c33-bc91-38fffea1d569 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:16:c3,bridge_name='br-int',has_traffic_filtering=True,id=80f91f45-781d-452c-b2c0-de2584494644,network=Network(0c0d4e62-be12-42e1-878c-a4a07270c108),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80f91f45-78') {{(pid=75245) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 16:20:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:20:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap80f91f45-78, bridge=br-int, if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:20:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:20:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:20:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:20:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0e440558-82f8-4efe-83c7-a406ede5fd58) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:20:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:20:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:20:50 user nova-compute[75245]: INFO os_vif [None req-4a481a53-9353-4c33-bc91-38fffea1d569 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:16:c3,bridge_name='br-int',has_traffic_filtering=True,id=80f91f45-781d-452c-b2c0-de2584494644,network=Network(0c0d4e62-be12-42e1-878c-a4a07270c108),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80f91f45-78')
Nov 29 16:20:50 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-4a481a53-9353-4c33-bc91-38fffea1d569 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Deleting instance files /opt/stack/data/nova/instances/f6720dc3-07fc-43e1-ba91-75e3d26a4a0f_del
Nov 29 16:20:50 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-4a481a53-9353-4c33-bc91-38fffea1d569 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Deletion of /opt/stack/data/nova/instances/f6720dc3-07fc-43e1-ba91-75e3d26a4a0f_del complete
Nov 29 16:20:50 user nova-compute[75245]: INFO nova.compute.manager [None req-4a481a53-9353-4c33-bc91-38fffea1d569 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Took 1.13 seconds to destroy the instance on the hypervisor.
Nov 29 16:20:50 user nova-compute[75245]: DEBUG oslo.service.loopingcall [None req-4a481a53-9353-4c33-bc91-38fffea1d569 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75245) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 16:20:50 user nova-compute[75245]: DEBUG nova.compute.manager [-] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Deallocating network for instance {{(pid=75245) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 16:20:50 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] deallocate_for_instance() {{(pid=75245) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 16:20:51 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:20:51 user nova-compute[75245]: DEBUG nova.compute.manager [req-61fbe474-83d6-49f7-8d65-fa8993effd8c req-904d15be-11f4-4482-a297-d0a90306cfe0 service nova] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Received event network-vif-deleted-80f91f45-781d-452c-b2c0-de2584494644 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:20:51 user nova-compute[75245]: INFO nova.compute.manager [req-61fbe474-83d6-49f7-8d65-fa8993effd8c req-904d15be-11f4-4482-a297-d0a90306cfe0 service nova] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Neutron deleted interface 80f91f45-781d-452c-b2c0-de2584494644; detaching it from the instance and deleting it from the info cache
Nov 29 16:20:51 user nova-compute[75245]: DEBUG nova.network.neutron [req-61fbe474-83d6-49f7-8d65-fa8993effd8c req-904d15be-11f4-4482-a297-d0a90306cfe0 service nova] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:20:51 user nova-compute[75245]: INFO nova.compute.manager [-] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Took 0.98 seconds to deallocate network for instance.
Nov 29 16:20:51 user nova-compute[75245]: DEBUG nova.compute.manager [req-61fbe474-83d6-49f7-8d65-fa8993effd8c req-904d15be-11f4-4482-a297-d0a90306cfe0 service nova] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Detach interface failed, port_id=80f91f45-781d-452c-b2c0-de2584494644, reason: Instance f6720dc3-07fc-43e1-ba91-75e3d26a4a0f could not be found. {{(pid=75245) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 16:20:51 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4a481a53-9353-4c33-bc91-38fffea1d569 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:20:51 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4a481a53-9353-4c33-bc91-38fffea1d569 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:20:51 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-4a481a53-9353-4c33-bc91-38fffea1d569 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:20:51 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-4a481a53-9353-4c33-bc91-38fffea1d569 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:20:51 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4a481a53-9353-4c33-bc91-38fffea1d569 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.179s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:20:51 user nova-compute[75245]: INFO nova.scheduler.client.report [None req-4a481a53-9353-4c33-bc91-38fffea1d569 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Deleted allocations for instance f6720dc3-07fc-43e1-ba91-75e3d26a4a0f
Nov 29 16:20:51 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4a481a53-9353-4c33-bc91-38fffea1d569 tempest-TaggedAttachmentsTest-229817667 tempest-TaggedAttachmentsTest-229817667-project-member] Lock "f6720dc3-07fc-43e1-ba91-75e3d26a4a0f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.512s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:20:51 user nova-compute[75245]: DEBUG nova.compute.manager [req-7bb6a760-a3e1-4821-b190-539f9367a487 req-c0511e63-99f5-4d44-bc21-ddb6679943a5 service nova] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Received event network-vif-plugged-80f91f45-781d-452c-b2c0-de2584494644 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:20:51 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-7bb6a760-a3e1-4821-b190-539f9367a487 req-c0511e63-99f5-4d44-bc21-ddb6679943a5 service nova] Acquiring lock "f6720dc3-07fc-43e1-ba91-75e3d26a4a0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:20:51 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-7bb6a760-a3e1-4821-b190-539f9367a487 req-c0511e63-99f5-4d44-bc21-ddb6679943a5 service nova] Lock "f6720dc3-07fc-43e1-ba91-75e3d26a4a0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:20:51 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-7bb6a760-a3e1-4821-b190-539f9367a487 req-c0511e63-99f5-4d44-bc21-ddb6679943a5 service nova] Lock "f6720dc3-07fc-43e1-ba91-75e3d26a4a0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:20:51 user nova-compute[75245]: DEBUG nova.compute.manager [req-7bb6a760-a3e1-4821-b190-539f9367a487 req-c0511e63-99f5-4d44-bc21-ddb6679943a5 service nova] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] No waiting events found dispatching network-vif-plugged-80f91f45-781d-452c-b2c0-de2584494644 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:20:51 user nova-compute[75245]: WARNING nova.compute.manager [req-7bb6a760-a3e1-4821-b190-539f9367a487 req-c0511e63-99f5-4d44-bc21-ddb6679943a5 service nova] [instance: f6720dc3-07fc-43e1-ba91-75e3d26a4a0f] Received unexpected event network-vif-plugged-80f91f45-781d-452c-b2c0-de2584494644 for instance with vm_state deleted and task_state None.
Nov 29 16:20:52 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:20:53 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:20:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:20:55 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:20:57 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:20:57 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Starting heal instance info cache {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 16:20:57 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Rebuilding the list of instances to heal {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 16:20:57 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "refresh_cache-ed9a6a4e-2e7d-443c-82ef-f14f11d32c81" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:20:57 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquired lock "refresh_cache-ed9a6a4e-2e7d-443c-82ef-f14f11d32c81" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:20:57 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] Forcefully refreshing network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 16:20:57 user nova-compute[75245]: DEBUG nova.objects.instance [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lazy-loading 'info_cache' on Instance uuid ed9a6a4e-2e7d-443c-82ef-f14f11d32c81 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:20:57 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] Updating instance_info_cache with network_info: [{"id": "c72edead-bad2-45c4-9ac8-90dd2a4f8ed5", "address": "fa:16:3e:bb:74:67", "network": {"id": "f1fac2f4-e789-443e-b6a5-1a3f829bc302", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1199431077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6b87e18ef1f48d19a6907b28cb54f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc72edead-ba", "ovs_interfaceid": "c72edead-bad2-45c4-9ac8-90dd2a4f8ed5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:20:58 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Releasing lock "refresh_cache-ed9a6a4e-2e7d-443c-82ef-f14f11d32c81" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:20:58 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] Updated the network info_cache for instance {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 16:20:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:20:58 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:20:59 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:21:00 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:21:01 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:21:01 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:21:01 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:21:01 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:21:01 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75245) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 16:21:01 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:01 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:01 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:01 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:01 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:02 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:02 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:02 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:02 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bae51e-2a85-442d-bbd2-fc89f30f40b7/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:02 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bae51e-2a85-442d-bbd2-fc89f30f40b7/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:02 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bae51e-2a85-442d-bbd2-fc89f30f40b7/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:02 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bae51e-2a85-442d-bbd2-fc89f30f40b7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:03 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:21:03 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:21:03 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Hypervisor/Node resource view: name=user free_ram=8588MB free_disk=25.422718048095703GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75245) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 16:21:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:21:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:21:03 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:21:03 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance ed9a6a4e-2e7d-443c-82ef-f14f11d32c81 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:21:03 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 84bae51e-2a85-442d-bbd2-fc89f30f40b7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:21:03 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 8785a3c2-5b7a-4382-b50d-cecd8743329c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:21:03 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 16:21:03 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 16:21:03 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Refreshing inventories for resource provider dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 16:21:03 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Updating ProviderTree inventory for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 16:21:03 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Updating inventory in ProviderTree for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 16:21:03 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Refreshing aggregate associations for resource provider dcc0ed27-167e-4f3a-a0de-183bb144a50c, aggregates: None {{(pid=75245) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 16:21:03 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Refreshing trait associations for resource provider dcc0ed27-167e-4f3a-a0de-183bb144a50c, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG {{(pid=75245) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 16:21:03 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:21:03 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:21:03 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Compute_service record updated for user:user {{(pid=75245) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 16:21:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.491s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:21:03 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:21:03 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Cleaning up deleted instances {{(pid=75245) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 16:21:03 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] There are 0 instances to clean {{(pid=75245) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 16:21:03 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:21:03 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75245) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 16:21:03 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:21:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Acquiring lock "4f7fb562-a698-4fc9-91b0-c786627f6d75" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:21:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Lock "4f7fb562-a698-4fc9-91b0-c786627f6d75" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:21:04 user nova-compute[75245]: DEBUG nova.compute.manager [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Starting instance... {{(pid=75245) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 16:21:04 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:21:04 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:21:04 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75245) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 16:21:04 user nova-compute[75245]: INFO nova.compute.claims [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Claim successful on node user
Nov 29 16:21:04 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:21:04 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:21:04 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.296s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:21:04 user nova-compute[75245]: DEBUG nova.compute.manager [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Start building networks asynchronously for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 16:21:04 user nova-compute[75245]: DEBUG nova.compute.manager [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Allocating IP information in the background. {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 16:21:04 user nova-compute[75245]: DEBUG nova.network.neutron [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] allocate_for_instance() {{(pid=75245) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 16:21:04 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 16:21:04 user nova-compute[75245]: DEBUG nova.compute.manager [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Start building block device mappings for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 16:21:04 user nova-compute[75245]: INFO nova.virt.block_device [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Booting with volume a87461eb-363d-43eb-94cb-4f69edc13024 at /dev/vda
Nov 29 16:21:04 user nova-compute[75245]: DEBUG nova.policy [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a271b4251cd64c5c8d5bf8e73e365624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd57c6933c04f5a9ec5e27eb8bce661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75245) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 16:21:04 user nova-compute[75245]: DEBUG os_brick.utils [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:21:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:04 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:21:04 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:21:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:04 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[9304a640-2882-4bc2-8aed-a598b6b43c55]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:69ed8ed87091\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:21:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:04 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe4ac04-4fb4-4ff4-989b-45e2985f55b6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:21:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:04 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba9ccd5-b67c-468b-b4c2-4bb136a40dd3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:21:04 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ae78d7-2c40-44f5-b332-538c3cff911e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:21:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Running cmd (subprocess): nvme version {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] 'nvme version' failed. Not Retrying. {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:21:04 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] nvme not present on system {{(pid=75245) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 16:21:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:21:04 user nova-compute[75245]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 16:21:04 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c13a2cc-674a-438e-a246-ebce5702a1fc]: (4, '') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:21:04 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75245) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 16:21:04 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 16:21:04 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] LIGHTOS: no hostnqn found. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 16:21:04 user nova-compute[75245]: DEBUG os_brick.utils [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:69ed8ed87091', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:21:04 user nova-compute[75245]: DEBUG nova.virt.block_device [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Updating existing volume attachment record: ec9ba0ab-ddb2-41eb-b3d4-c8729b505429 {{(pid=75245) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 16:21:05 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:21:05 user nova-compute[75245]: DEBUG nova.network.neutron [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Successfully created port: 467a0f1e-1ad6-4474-bbcb-dadad3ea69ab {{(pid=75245) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 16:21:05 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:21:05 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:21:05 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:21:05 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75245) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 16:21:05 user nova-compute[75245]: DEBUG nova.network.neutron [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Successfully updated port: 467a0f1e-1ad6-4474-bbcb-dadad3ea69ab {{(pid=75245) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 16:21:05 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Acquiring lock "refresh_cache-4f7fb562-a698-4fc9-91b0-c786627f6d75" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:21:05 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Acquired lock "refresh_cache-4f7fb562-a698-4fc9-91b0-c786627f6d75" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:21:05 user nova-compute[75245]: DEBUG nova.network.neutron [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 16:21:05 user nova-compute[75245]: DEBUG nova.compute.manager [req-400e4a1f-a89b-4e2f-98e1-e1e050058528 req-9e7ca88b-2ee4-4906-a1c3-a64a7409779b service nova] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Received event network-changed-467a0f1e-1ad6-4474-bbcb-dadad3ea69ab {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:21:05 user nova-compute[75245]: DEBUG nova.compute.manager [req-400e4a1f-a89b-4e2f-98e1-e1e050058528 req-9e7ca88b-2ee4-4906-a1c3-a64a7409779b service nova] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Refreshing instance network info cache due to event network-changed-467a0f1e-1ad6-4474-bbcb-dadad3ea69ab. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:21:05 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-400e4a1f-a89b-4e2f-98e1-e1e050058528 req-9e7ca88b-2ee4-4906-a1c3-a64a7409779b service nova] Acquiring lock "refresh_cache-4f7fb562-a698-4fc9-91b0-c786627f6d75" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:21:05 user nova-compute[75245]: DEBUG nova.network.neutron [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Instance cache missing network info. {{(pid=75245) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 16:21:06 user nova-compute[75245]: DEBUG nova.network.neutron [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Updating instance_info_cache with network_info: [{"id": "467a0f1e-1ad6-4474-bbcb-dadad3ea69ab", "address": "fa:16:3e:ab:27:73", "network": {"id": "1869d0f1-8115-44c6-b5d4-42e362716749", "bridge": "br-int", "label": "tempest-TestShelveInstance-1207362046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bd57c6933c04f5a9ec5e27eb8bce661", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap467a0f1e-1a", "ovs_interfaceid": "467a0f1e-1ad6-4474-bbcb-dadad3ea69ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:21:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Releasing lock "refresh_cache-4f7fb562-a698-4fc9-91b0-c786627f6d75" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:21:06 user nova-compute[75245]: DEBUG nova.compute.manager [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Instance network_info: |[{"id": "467a0f1e-1ad6-4474-bbcb-dadad3ea69ab", "address": "fa:16:3e:ab:27:73", "network": {"id": "1869d0f1-8115-44c6-b5d4-42e362716749", "bridge": "br-int", "label": "tempest-TestShelveInstance-1207362046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bd57c6933c04f5a9ec5e27eb8bce661", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap467a0f1e-1a", "ovs_interfaceid": "467a0f1e-1ad6-4474-bbcb-dadad3ea69ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 16:21:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-400e4a1f-a89b-4e2f-98e1-e1e050058528 req-9e7ca88b-2ee4-4906-a1c3-a64a7409779b service nova] Acquired lock "refresh_cache-4f7fb562-a698-4fc9-91b0-c786627f6d75" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:21:06 user nova-compute[75245]: DEBUG nova.network.neutron [req-400e4a1f-a89b-4e2f-98e1-e1e050058528 req-9e7ca88b-2ee4-4906-a1c3-a64a7409779b service nova] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Refreshing network info cache for port 467a0f1e-1ad6-4474-bbcb-dadad3ea69ab {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:21:06 user nova-compute[75245]: DEBUG nova.network.neutron [req-400e4a1f-a89b-4e2f-98e1-e1e050058528 req-9e7ca88b-2ee4-4906-a1c3-a64a7409779b service nova] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Updated VIF entry in instance network info cache for port 467a0f1e-1ad6-4474-bbcb-dadad3ea69ab. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:21:06 user nova-compute[75245]: DEBUG nova.network.neutron [req-400e4a1f-a89b-4e2f-98e1-e1e050058528 req-9e7ca88b-2ee4-4906-a1c3-a64a7409779b service nova] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Updating instance_info_cache with network_info: [{"id": "467a0f1e-1ad6-4474-bbcb-dadad3ea69ab", "address": "fa:16:3e:ab:27:73", "network": {"id": "1869d0f1-8115-44c6-b5d4-42e362716749", "bridge": "br-int", "label": "tempest-TestShelveInstance-1207362046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bd57c6933c04f5a9ec5e27eb8bce661", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap467a0f1e-1a", "ovs_interfaceid": "467a0f1e-1ad6-4474-bbcb-dadad3ea69ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:21:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-400e4a1f-a89b-4e2f-98e1-e1e050058528 req-9e7ca88b-2ee4-4906-a1c3-a64a7409779b service nova] Releasing lock "refresh_cache-4f7fb562-a698-4fc9-91b0-c786627f6d75" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:21:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:21:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:21:12 user nova-compute[75245]: DEBUG nova.compute.manager [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Start spawning the instance on the hypervisor. {{(pid=75245) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 16:21:12 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Creating instance directory {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 16:21:12 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Creating image(s)
Nov 29 16:21:12 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Did not create local disks {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 16:21:12 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Ensure instance console log exists: /opt/stack/data/nova/instances/4f7fb562-a698-4fc9-91b0-c786627f6d75/console.log {{(pid=75245) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 16:21:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:21:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:21:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:21:12 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Start _get_guest_xml network_info=[{"id": "467a0f1e-1ad6-4474-bbcb-dadad3ea69ab", "address": "fa:16:3e:ab:27:73", "network": {"id": "1869d0f1-8115-44c6-b5d4-42e362716749", "bridge": "br-int", "label": "tempest-TestShelveInstance-1207362046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bd57c6933c04f5a9ec5e27eb8bce661", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap467a0f1e-1a", "ovs_interfaceid": "467a0f1e-1ad6-4474-bbcb-dadad3ea69ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': 'ec9ba0ab-ddb2-41eb-b3d4-c8729b505429', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hfwlIuBG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4f7fb562-a698-4fc9-91b0-c786627f6d75', 'attached_at': '', 'detached_at': '', 'volume_id': 'a87461eb-363d-43eb-94cb-4f69edc13024', 'serial': 'a87461eb-363d-43eb-94cb-4f69edc13024'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'guest_format': None, 'volume_type': None} {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 16:21:12 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:21:12 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:21:12 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 16:21:12 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] CPU controller missing on host. {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 16:21:12 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 16:21:12 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] CPU controller found on host. {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 16:21:12 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75245) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 16:21:12 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T16:06:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 16:21:12 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Flavor limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 16:21:12 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Image limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 16:21:12 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Flavor pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 16:21:12 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Image pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 16:21:12 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 16:21:12 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 16:21:12 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 16:21:12 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Got 1 possible topologies {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 16:21:12 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 16:21:12 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 16:21:12 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Calling os-brick to attach iSCSI Volume {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 16:21:12 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hfwlIuBG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:21:12 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:21:12 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:21:12 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:21:12 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:21:12 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:21:12 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:21:12 user nova-compute[75245]: INFO os_brick.initiator.connectors.iscsi [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 16:21:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 -p 172.16.0.220:3260 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:12 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac98643-4f48-4865-a844-ae98eca01565]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:21:12 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 16:21:12 user nova-compute[75245]:  {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:21:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 -p 172.16.0.220:3260 --interface default --op new {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:12 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[854da034-7975-47d4-8bc3-71cdf76d009b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024] added\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:21:12 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024] added
Nov 29 16:21:12 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:21:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:12 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[9177e747-2916-4fd0-8a15-ee7b046afb00]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:21:12 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:21:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.128s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:12 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[290c83dd-9853-402a-8d86-ea09fbeb2d0a]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:21:12 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:21:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hfwlIuBG {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hfwlIuBG" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:12 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[78dbc2ad-4096-4f48-921b-53cb46fd8311]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:21:12 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hfwlIuBG'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:21:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:12 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65348e1-90bc-4d18-808c-f8b4ab46f755]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:21:12 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:21:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:12 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69b3913-b2a9-4078-8c3e-aba9895f4468]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:21:12 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 16:21:12 user nova-compute[75245]:  {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:21:12 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 16:21:12 user nova-compute[75245]:  {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:21:12 user nova-compute[75245]: WARNING os_brick.initiator.connectors.iscsi [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 16:21:12 user nova-compute[75245]: 
Nov 29 16:21:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 -p 172.16.0.220:3260 --login {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:12 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc0604a5-f33a-423b-b3cb-62cbf7f2c95a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:21:12 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024, portal: 172.16.0.220,3260]
Nov 29 16:21:12 user nova-compute[75245]: Login to [iface: default, target: iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024, portal: 172.16.0.220,3260] successful.
Nov 29 16:21:12 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:21:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:12 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5d8e80-4074-4224-b29c-342619f264f1]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:21:12 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:21:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:12 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea9a4c65-65a3-4b73-ab8c-e1534ac92802]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:21:12 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 (non-flash)
Nov 29 16:21:12 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:21:12 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 (non-flash)
Nov 29 16:21:12 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:21:12 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.368s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:21:12 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Connected to 172.16.0.220:3260 {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 16:21:12 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] HCTL ('33', '-', '-', 0) found on session 26 with lun 0 {{(pid=75245) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 16:21:12 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75245) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 16:21:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.014s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:12 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb3d23bb-52fa-4795-9e46-a43992c4f0e0]: (4, ('- - 0', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:21:12 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Searching for a device in session 26 and hctl ['33', '*', '*', 0] yield: None {{(pid=75245) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 16:21:13 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Searching for a device in session 26 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75245) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 16:21:13 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hfwlIuBG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 16:21:13 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.396s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:21:13 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] <== connect_volume: return (1397ms) {'type': 'block', 'scsi_wwn': '26361356134653339', 'path': '/dev/sdb'} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:21:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26361356134653339', 'path': '/dev/sdb'} {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 16:21:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:21:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1369972773',display_name='tempest-TestShelveInstance-server-1369972773',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1369972773',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLE7nr47G8CHHLOTmQq/XixPARJFpOT+HvuTUIzQWMmpzlpPoy+l6Oj2zJ7pst+CAggF8656bQlmnmYfbIcrkf9PnEB/N+Dql4y/VnBwqBg2qMznC5qDYlg7sEsaYBgGjA==',key_name='tempest-TestShelveInstance-1582200683',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5bd57c6933c04f5a9ec5e27eb8bce661',ramdisk_id='',reservation_id='r-058m537p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1248422115',owner_user_name='tempest-TestShelveInstance-1248422115-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:21:05Z,user_data=None,user_id='a271b4251cd64c5c8d5bf8e73e365624',uuid=4f7fb562-a698-4fc9-91b0-c786627f6d75,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "467a0f1e-1ad6-4474-bbcb-dadad3ea69ab", "address": "fa:16:3e:ab:27:73", "network": {"id": "1869d0f1-8115-44c6-b5d4-42e362716749", "bridge": "br-int", "label": "tempest-TestShelveInstance-1207362046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bd57c6933c04f5a9ec5e27eb8bce661", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap467a0f1e-1a", "ovs_interfaceid": "467a0f1e-1ad6-4474-bbcb-dadad3ea69ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:21:13 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Converting VIF {"id": "467a0f1e-1ad6-4474-bbcb-dadad3ea69ab", "address": "fa:16:3e:ab:27:73", "network": {"id": "1869d0f1-8115-44c6-b5d4-42e362716749", "bridge": "br-int", "label": "tempest-TestShelveInstance-1207362046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bd57c6933c04f5a9ec5e27eb8bce661", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap467a0f1e-1a", "ovs_interfaceid": "467a0f1e-1ad6-4474-bbcb-dadad3ea69ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:21:13 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:27:73,bridge_name='br-int',has_traffic_filtering=True,id=467a0f1e-1ad6-4474-bbcb-dadad3ea69ab,network=Network(1869d0f1-8115-44c6-b5d4-42e362716749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap467a0f1e-1a') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:21:13 user nova-compute[75245]: DEBUG nova.objects.instance [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Lazy-loading 'pci_devices' on Instance uuid 4f7fb562-a698-4fc9-91b0-c786627f6d75 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:21:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] End _get_guest_xml xml=<domain type="kvm">
Nov 29 16:21:13 user nova-compute[75245]:   <uuid>4f7fb562-a698-4fc9-91b0-c786627f6d75</uuid>
Nov 29 16:21:13 user nova-compute[75245]:   <name>instance-00000016</name>
Nov 29 16:21:13 user nova-compute[75245]:   <memory>524288</memory>
Nov 29 16:21:13 user nova-compute[75245]:   <vcpu>1</vcpu>
Nov 29 16:21:13 user nova-compute[75245]:   <metadata>
Nov 29 16:21:13 user nova-compute[75245]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 16:21:13 user nova-compute[75245]:       <nova:package version="0.0.0"/>
Nov 29 16:21:13 user nova-compute[75245]:       <nova:name>tempest-TestShelveInstance-server-1369972773</nova:name>
Nov 29 16:21:13 user nova-compute[75245]:       <nova:creationTime>2023-11-29 16:21:12</nova:creationTime>
Nov 29 16:21:13 user nova-compute[75245]:       <nova:flavor name="m1.tiny">
Nov 29 16:21:13 user nova-compute[75245]:         <nova:memory>512</nova:memory>
Nov 29 16:21:13 user nova-compute[75245]:         <nova:disk>1</nova:disk>
Nov 29 16:21:13 user nova-compute[75245]:         <nova:swap>0</nova:swap>
Nov 29 16:21:13 user nova-compute[75245]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 16:21:13 user nova-compute[75245]:         <nova:vcpus>1</nova:vcpus>
Nov 29 16:21:13 user nova-compute[75245]:       </nova:flavor>
Nov 29 16:21:13 user nova-compute[75245]:       <nova:owner>
Nov 29 16:21:13 user nova-compute[75245]:         <nova:user uuid="a271b4251cd64c5c8d5bf8e73e365624">tempest-TestShelveInstance-1248422115-project-member</nova:user>
Nov 29 16:21:13 user nova-compute[75245]:         <nova:project uuid="5bd57c6933c04f5a9ec5e27eb8bce661">tempest-TestShelveInstance-1248422115</nova:project>
Nov 29 16:21:13 user nova-compute[75245]:       </nova:owner>
Nov 29 16:21:13 user nova-compute[75245]:       <nova:ports>
Nov 29 16:21:13 user nova-compute[75245]:         <nova:port uuid="467a0f1e-1ad6-4474-bbcb-dadad3ea69ab">
Nov 29 16:21:13 user nova-compute[75245]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 29 16:21:13 user nova-compute[75245]:         </nova:port>
Nov 29 16:21:13 user nova-compute[75245]:       </nova:ports>
Nov 29 16:21:13 user nova-compute[75245]:     </nova:instance>
Nov 29 16:21:13 user nova-compute[75245]:   </metadata>
Nov 29 16:21:13 user nova-compute[75245]:   <sysinfo type="smbios">
Nov 29 16:21:13 user nova-compute[75245]:     <system>
Nov 29 16:21:13 user nova-compute[75245]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 16:21:13 user nova-compute[75245]:       <entry name="product">OpenStack Nova</entry>
Nov 29 16:21:13 user nova-compute[75245]:       <entry name="version">0.0.0</entry>
Nov 29 16:21:13 user nova-compute[75245]:       <entry name="serial">4f7fb562-a698-4fc9-91b0-c786627f6d75</entry>
Nov 29 16:21:13 user nova-compute[75245]:       <entry name="uuid">4f7fb562-a698-4fc9-91b0-c786627f6d75</entry>
Nov 29 16:21:13 user nova-compute[75245]:       <entry name="family">Virtual Machine</entry>
Nov 29 16:21:13 user nova-compute[75245]:     </system>
Nov 29 16:21:13 user nova-compute[75245]:   </sysinfo>
Nov 29 16:21:13 user nova-compute[75245]:   <os>
Nov 29 16:21:13 user nova-compute[75245]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 16:21:13 user nova-compute[75245]:     <boot dev="hd"/>
Nov 29 16:21:13 user nova-compute[75245]:     <smbios mode="sysinfo"/>
Nov 29 16:21:13 user nova-compute[75245]:   </os>
Nov 29 16:21:13 user nova-compute[75245]:   <features>
Nov 29 16:21:13 user nova-compute[75245]:     <acpi/>
Nov 29 16:21:13 user nova-compute[75245]:     <apic/>
Nov 29 16:21:13 user nova-compute[75245]:     <vmcoreinfo/>
Nov 29 16:21:13 user nova-compute[75245]:   </features>
Nov 29 16:21:13 user nova-compute[75245]:   <clock offset="utc">
Nov 29 16:21:13 user nova-compute[75245]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 16:21:13 user nova-compute[75245]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 16:21:13 user nova-compute[75245]:     <timer name="hpet" present="no"/>
Nov 29 16:21:13 user nova-compute[75245]:   </clock>
Nov 29 16:21:13 user nova-compute[75245]:   <cpu mode="custom" match="exact">
Nov 29 16:21:13 user nova-compute[75245]:     <model>Nehalem</model>
Nov 29 16:21:13 user nova-compute[75245]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 16:21:13 user nova-compute[75245]:   </cpu>
Nov 29 16:21:13 user nova-compute[75245]:   <devices>
Nov 29 16:21:13 user nova-compute[75245]:     <disk type="block" device="disk">
Nov 29 16:21:13 user nova-compute[75245]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:21:13 user nova-compute[75245]:       <source dev="/dev/sdb"/>
Nov 29 16:21:13 user nova-compute[75245]:       <target dev="vda" bus="virtio"/>
Nov 29 16:21:13 user nova-compute[75245]:       <serial>a87461eb-363d-43eb-94cb-4f69edc13024</serial>
Nov 29 16:21:13 user nova-compute[75245]:     </disk>
Nov 29 16:21:13 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 16:21:13 user nova-compute[75245]:       <mac address="fa:16:3e:ab:27:73"/>
Nov 29 16:21:13 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:21:13 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 16:21:13 user nova-compute[75245]:       <target dev="tap467a0f1e-1a"/>
Nov 29 16:21:13 user nova-compute[75245]:     </interface>
Nov 29 16:21:13 user nova-compute[75245]:     <serial type="pty">
Nov 29 16:21:13 user nova-compute[75245]:       <log file="/opt/stack/data/nova/instances/4f7fb562-a698-4fc9-91b0-c786627f6d75/console.log" append="off"/>
Nov 29 16:21:13 user nova-compute[75245]:     </serial>
Nov 29 16:21:13 user nova-compute[75245]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 16:21:13 user nova-compute[75245]:     <video>
Nov 29 16:21:13 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:21:13 user nova-compute[75245]:     </video>
Nov 29 16:21:13 user nova-compute[75245]:     <rng model="virtio">
Nov 29 16:21:13 user nova-compute[75245]:       <backend model="random">/dev/urandom</backend>
Nov 29 16:21:13 user nova-compute[75245]:     </rng>
Nov 29 16:21:13 user nova-compute[75245]:     <controller type="usb" index="0" model="none"/>
Nov 29 16:21:13 user nova-compute[75245]:     <memballoon model="virtio">
Nov 29 16:21:13 user nova-compute[75245]:       <stats period="10"/>
Nov 29 16:21:13 user nova-compute[75245]:     </memballoon>
Nov 29 16:21:13 user nova-compute[75245]:   </devices>
Nov 29 16:21:13 user nova-compute[75245]: </domain>
Nov 29 16:21:13 user nova-compute[75245]:  {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 16:21:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:21:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1369972773',display_name='tempest-TestShelveInstance-server-1369972773',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1369972773',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLE7nr47G8CHHLOTmQq/XixPARJFpOT+HvuTUIzQWMmpzlpPoy+l6Oj2zJ7pst+CAggF8656bQlmnmYfbIcrkf9PnEB/N+Dql4y/VnBwqBg2qMznC5qDYlg7sEsaYBgGjA==',key_name='tempest-TestShelveInstance-1582200683',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5bd57c6933c04f5a9ec5e27eb8bce661',ramdisk_id='',reservation_id='r-058m537p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1248422115',owner_user_name='tempest-TestShelveInstance-1248422115-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:21:05Z,user_data=None,user_id='a271b4251cd64c5c8d5bf8e73e365624',uuid=4f7fb562-a698-4fc9-91b0-c786627f6d75,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "467a0f1e-1ad6-4474-bbcb-dadad3ea69ab", "address": "fa:16:3e:ab:27:73", "network": {"id": "1869d0f1-8115-44c6-b5d4-42e362716749", "bridge": "br-int", "label": "tempest-TestShelveInstance-1207362046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bd57c6933c04f5a9ec5e27eb8bce661", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap467a0f1e-1a", "ovs_interfaceid": "467a0f1e-1ad6-4474-bbcb-dadad3ea69ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 16:21:13 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Converting VIF {"id": "467a0f1e-1ad6-4474-bbcb-dadad3ea69ab", "address": "fa:16:3e:ab:27:73", "network": {"id": "1869d0f1-8115-44c6-b5d4-42e362716749", "bridge": "br-int", "label": "tempest-TestShelveInstance-1207362046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bd57c6933c04f5a9ec5e27eb8bce661", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap467a0f1e-1a", "ovs_interfaceid": "467a0f1e-1ad6-4474-bbcb-dadad3ea69ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:21:13 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:27:73,bridge_name='br-int',has_traffic_filtering=True,id=467a0f1e-1ad6-4474-bbcb-dadad3ea69ab,network=Network(1869d0f1-8115-44c6-b5d4-42e362716749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap467a0f1e-1a') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:21:13 user nova-compute[75245]: DEBUG os_vif [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:27:73,bridge_name='br-int',has_traffic_filtering=True,id=467a0f1e-1ad6-4474-bbcb-dadad3ea69ab,network=Network(1869d0f1-8115-44c6-b5d4-42e362716749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap467a0f1e-1a') {{(pid=75245) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 16:21:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:21:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:21:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 16:21:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:21:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '50d25e14-a04d-5892-a859-10b88a1b405c', '_type': 'linux-noop'}}, row=False) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:21:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:21:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:21:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:21:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap467a0f1e-1a, may_exist=True, interface_attrs={}) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:21:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap467a0f1e-1a, col_values=(('qos', UUID('f33e4d5f-6a89-4ca9-b1f2-5b682310a1e6')),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:21:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap467a0f1e-1a, col_values=(('external_ids', {'iface-id': '467a0f1e-1ad6-4474-bbcb-dadad3ea69ab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ab:27:73', 'vm-uuid': '4f7fb562-a698-4fc9-91b0-c786627f6d75'}),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:21:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:21:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:21:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:21:13 user nova-compute[75245]: INFO os_vif [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:27:73,bridge_name='br-int',has_traffic_filtering=True,id=467a0f1e-1ad6-4474-bbcb-dadad3ea69ab,network=Network(1869d0f1-8115-44c6-b5d4-42e362716749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap467a0f1e-1a')
Nov 29 16:21:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:21:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] No VIF found with MAC fa:16:3e:ab:27:73, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:21:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:21:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:21:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:21:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:21:15 user nova-compute[75245]: DEBUG nova.compute.manager [req-a83debf0-b5fe-4713-8393-a5e8fdca4e76 req-b2258003-378f-4a3c-b7d9-30cabfe7742a service nova] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Received event network-vif-plugged-467a0f1e-1ad6-4474-bbcb-dadad3ea69ab {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:21:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a83debf0-b5fe-4713-8393-a5e8fdca4e76 req-b2258003-378f-4a3c-b7d9-30cabfe7742a service nova] Acquiring lock "4f7fb562-a698-4fc9-91b0-c786627f6d75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:21:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a83debf0-b5fe-4713-8393-a5e8fdca4e76 req-b2258003-378f-4a3c-b7d9-30cabfe7742a service nova] Lock "4f7fb562-a698-4fc9-91b0-c786627f6d75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:21:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a83debf0-b5fe-4713-8393-a5e8fdca4e76 req-b2258003-378f-4a3c-b7d9-30cabfe7742a service nova] Lock "4f7fb562-a698-4fc9-91b0-c786627f6d75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:21:15 user nova-compute[75245]: DEBUG nova.compute.manager [req-a83debf0-b5fe-4713-8393-a5e8fdca4e76 req-b2258003-378f-4a3c-b7d9-30cabfe7742a service nova] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] No waiting events found dispatching network-vif-plugged-467a0f1e-1ad6-4474-bbcb-dadad3ea69ab {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:21:15 user nova-compute[75245]: WARNING nova.compute.manager [req-a83debf0-b5fe-4713-8393-a5e8fdca4e76 req-b2258003-378f-4a3c-b7d9-30cabfe7742a service nova] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Received unexpected event network-vif-plugged-467a0f1e-1ad6-4474-bbcb-dadad3ea69ab for instance with vm_state building and task_state spawning.
Nov 29 16:21:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:21:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:21:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:21:16 user nova-compute[75245]: DEBUG nova.compute.manager [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Instance event wait completed in 0 seconds for  {{(pid=75245) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 16:21:16 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Guest created on hypervisor {{(pid=75245) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 16:21:16 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Instance spawned successfully.
Nov 29 16:21:16 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 16:21:16 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Found default for hw_cdrom_bus of ide {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:21:16 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Found default for hw_disk_bus of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:21:16 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Found default for hw_input_bus of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:21:16 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Found default for hw_pointer_model of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:21:16 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Found default for hw_video_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:21:16 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Found default for hw_vif_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:21:17 user nova-compute[75245]: INFO nova.compute.manager [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Took 5.04 seconds to spawn the instance on the hypervisor.
Nov 29 16:21:17 user nova-compute[75245]: DEBUG nova.compute.manager [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:21:17 user nova-compute[75245]: INFO nova.compute.manager [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Took 13.06 seconds to build instance.
Nov 29 16:21:17 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-b6292686-6963-4255-b6b3-b8d3c9537f03 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Lock "4f7fb562-a698-4fc9-91b0-c786627f6d75" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.163s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:21:17 user nova-compute[75245]: DEBUG nova.compute.manager [req-fe6cc716-7bcb-42b1-99e9-939b8517a2bb req-65610420-3a76-41c5-ad1e-84a608bed010 service nova] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Received event network-vif-plugged-467a0f1e-1ad6-4474-bbcb-dadad3ea69ab {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:21:17 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-fe6cc716-7bcb-42b1-99e9-939b8517a2bb req-65610420-3a76-41c5-ad1e-84a608bed010 service nova] Acquiring lock "4f7fb562-a698-4fc9-91b0-c786627f6d75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:21:17 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-fe6cc716-7bcb-42b1-99e9-939b8517a2bb req-65610420-3a76-41c5-ad1e-84a608bed010 service nova] Lock "4f7fb562-a698-4fc9-91b0-c786627f6d75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:21:17 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-fe6cc716-7bcb-42b1-99e9-939b8517a2bb req-65610420-3a76-41c5-ad1e-84a608bed010 service nova] Lock "4f7fb562-a698-4fc9-91b0-c786627f6d75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:21:17 user nova-compute[75245]: DEBUG nova.compute.manager [req-fe6cc716-7bcb-42b1-99e9-939b8517a2bb req-65610420-3a76-41c5-ad1e-84a608bed010 service nova] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] No waiting events found dispatching network-vif-plugged-467a0f1e-1ad6-4474-bbcb-dadad3ea69ab {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:21:17 user nova-compute[75245]: WARNING nova.compute.manager [req-fe6cc716-7bcb-42b1-99e9-939b8517a2bb req-65610420-3a76-41c5-ad1e-84a608bed010 service nova] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Received unexpected event network-vif-plugged-467a0f1e-1ad6-4474-bbcb-dadad3ea69ab for instance with vm_state active and task_state None.
Nov 29 16:21:17 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Acquiring lock "43ead766-eeb0-4c7a-a03a-6d4daf7106af" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:21:17 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lock "43ead766-eeb0-4c7a-a03a-6d4daf7106af" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:21:17 user nova-compute[75245]: INFO nova.compute.manager [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Unshelving
Nov 29 16:21:17 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:21:17 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:21:17 user nova-compute[75245]: DEBUG nova.objects.instance [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lazy-loading 'pci_requests' on Instance uuid 43ead766-eeb0-4c7a-a03a-6d4daf7106af {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:21:17 user nova-compute[75245]: DEBUG nova.objects.instance [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lazy-loading 'numa_topology' on Instance uuid 43ead766-eeb0-4c7a-a03a-6d4daf7106af {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:21:17 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75245) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 16:21:17 user nova-compute[75245]: INFO nova.compute.claims [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Claim successful on node user
Nov 29 16:21:17 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:21:17 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:21:17 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.296s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:21:17 user nova-compute[75245]: INFO nova.network.neutron [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Updating port 4aefd86e-7753-4693-9cbd-6ee2178443b5 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 29 16:21:18 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:21:18 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Acquiring lock "refresh_cache-43ead766-eeb0-4c7a-a03a-6d4daf7106af" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:21:18 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Acquired lock "refresh_cache-43ead766-eeb0-4c7a-a03a-6d4daf7106af" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:21:18 user nova-compute[75245]: DEBUG nova.network.neutron [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 16:21:18 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:21:18 user nova-compute[75245]: DEBUG nova.compute.manager [req-2fdefe6d-999c-4537-adc4-ecb3205e2ad3 req-8bf38e1f-1145-41d8-bc2c-0d2de6642bdf service nova] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Received event network-changed-4aefd86e-7753-4693-9cbd-6ee2178443b5 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:21:18 user nova-compute[75245]: DEBUG nova.compute.manager [req-2fdefe6d-999c-4537-adc4-ecb3205e2ad3 req-8bf38e1f-1145-41d8-bc2c-0d2de6642bdf service nova] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Refreshing instance network info cache due to event network-changed-4aefd86e-7753-4693-9cbd-6ee2178443b5. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:21:18 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-2fdefe6d-999c-4537-adc4-ecb3205e2ad3 req-8bf38e1f-1145-41d8-bc2c-0d2de6642bdf service nova] Acquiring lock "refresh_cache-43ead766-eeb0-4c7a-a03a-6d4daf7106af" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:21:18 user nova-compute[75245]: DEBUG nova.network.neutron [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Updating instance_info_cache with network_info: [{"id": "4aefd86e-7753-4693-9cbd-6ee2178443b5", "address": "fa:16:3e:d1:0a:c7", "network": {"id": "7f978dee-8a5e-4218-b6fc-2d550c0d7b5d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-53637364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd22948fbd074a7c94d8ad7614fbc220", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aefd86e-77", "ovs_interfaceid": "4aefd86e-7753-4693-9cbd-6ee2178443b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:21:18 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Releasing lock "refresh_cache-43ead766-eeb0-4c7a-a03a-6d4daf7106af" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:21:18 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Creating instance directory {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 16:21:18 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Creating image(s)
Nov 29 16:21:18 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Acquiring lock "/opt/stack/data/nova/instances/43ead766-eeb0-4c7a-a03a-6d4daf7106af/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:21:18 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lock "/opt/stack/data/nova/instances/43ead766-eeb0-4c7a-a03a-6d4daf7106af/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:21:18 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lock "/opt/stack/data/nova/instances/43ead766-eeb0-4c7a-a03a-6d4daf7106af/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:21:18 user nova-compute[75245]: DEBUG nova.objects.instance [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lazy-loading 'trusted_certs' on Instance uuid 43ead766-eeb0-4c7a-a03a-6d4daf7106af {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:21:18 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-2fdefe6d-999c-4537-adc4-ecb3205e2ad3 req-8bf38e1f-1145-41d8-bc2c-0d2de6642bdf service nova] Acquired lock "refresh_cache-43ead766-eeb0-4c7a-a03a-6d4daf7106af" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:21:18 user nova-compute[75245]: DEBUG nova.network.neutron [req-2fdefe6d-999c-4537-adc4-ecb3205e2ad3 req-8bf38e1f-1145-41d8-bc2c-0d2de6642bdf service nova] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Refreshing network info cache for port 4aefd86e-7753-4693-9cbd-6ee2178443b5 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:21:18 user nova-compute[75245]: DEBUG nova.objects.base [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Object Instance<43ead766-eeb0-4c7a-a03a-6d4daf7106af> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75245) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 16:21:18 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Acquiring lock "932d53ba158621cdac285967046ddc39b8b49ae9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:21:18 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lock "932d53ba158621cdac285967046ddc39b8b49ae9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.003s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:21:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932d53ba158621cdac285967046ddc39b8b49ae9.part --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932d53ba158621cdac285967046ddc39b8b49ae9.part --force-share --output=json" returned: 0 in 0.203s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:20 user nova-compute[75245]: DEBUG nova.virt.images [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] 13f64672-2403-41c9-bc86-f40febafc109 was qcow2, converting to raw {{(pid=75245) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 16:21:20 user nova-compute[75245]: DEBUG nova.privsep.utils [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75245) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 16:21:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/932d53ba158621cdac285967046ddc39b8b49ae9.part /opt/stack/data/nova/instances/_base/932d53ba158621cdac285967046ddc39b8b49ae9.converted {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:20 user nova-compute[75245]: DEBUG nova.network.neutron [req-2fdefe6d-999c-4537-adc4-ecb3205e2ad3 req-8bf38e1f-1145-41d8-bc2c-0d2de6642bdf service nova] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Updated VIF entry in instance network info cache for port 4aefd86e-7753-4693-9cbd-6ee2178443b5. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:21:20 user nova-compute[75245]: DEBUG nova.network.neutron [req-2fdefe6d-999c-4537-adc4-ecb3205e2ad3 req-8bf38e1f-1145-41d8-bc2c-0d2de6642bdf service nova] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Updating instance_info_cache with network_info: [{"id": "4aefd86e-7753-4693-9cbd-6ee2178443b5", "address": "fa:16:3e:d1:0a:c7", "network": {"id": "7f978dee-8a5e-4218-b6fc-2d550c0d7b5d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-53637364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd22948fbd074a7c94d8ad7614fbc220", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aefd86e-77", "ovs_interfaceid": "4aefd86e-7753-4693-9cbd-6ee2178443b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:21:20 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-2fdefe6d-999c-4537-adc4-ecb3205e2ad3 req-8bf38e1f-1145-41d8-bc2c-0d2de6642bdf service nova] Releasing lock "refresh_cache-43ead766-eeb0-4c7a-a03a-6d4daf7106af" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:21:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/932d53ba158621cdac285967046ddc39b8b49ae9.part /opt/stack/data/nova/instances/_base/932d53ba158621cdac285967046ddc39b8b49ae9.converted" returned: 0 in 0.434s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932d53ba158621cdac285967046ddc39b8b49ae9.converted --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932d53ba158621cdac285967046ddc39b8b49ae9.converted --force-share --output=json" returned: 0 in 0.184s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:20 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lock "932d53ba158621cdac285967046ddc39b8b49ae9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.980s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:21:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932d53ba158621cdac285967046ddc39b8b49ae9 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932d53ba158621cdac285967046ddc39b8b49ae9 --force-share --output=json" returned: 0 in 0.177s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Acquiring lock "932d53ba158621cdac285967046ddc39b8b49ae9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:21:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lock "932d53ba158621cdac285967046ddc39b8b49ae9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:21:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932d53ba158621cdac285967046ddc39b8b49ae9 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932d53ba158621cdac285967046ddc39b8b49ae9 --force-share --output=json" returned: 0 in 0.173s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932d53ba158621cdac285967046ddc39b8b49ae9,backing_fmt=raw /opt/stack/data/nova/instances/43ead766-eeb0-4c7a-a03a-6d4daf7106af/disk 1073741824 {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932d53ba158621cdac285967046ddc39b8b49ae9,backing_fmt=raw /opt/stack/data/nova/instances/43ead766-eeb0-4c7a-a03a-6d4daf7106af/disk 1073741824" returned: 0 in 0.055s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lock "932d53ba158621cdac285967046ddc39b8b49ae9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:21:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932d53ba158621cdac285967046ddc39b8b49ae9 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932d53ba158621cdac285967046ddc39b8b49ae9 --force-share --output=json" returned: 0 in 0.176s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:21 user nova-compute[75245]: DEBUG nova.objects.instance [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lazy-loading 'migration_context' on Instance uuid 43ead766-eeb0-4c7a-a03a-6d4daf7106af {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:21:21 user nova-compute[75245]: DEBUG nova.objects.base [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Object Instance<43ead766-eeb0-4c7a-a03a-6d4daf7106af> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75245) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 16:21:21 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Rebasing disk image.
Nov 29 16:21:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.185s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 -F raw /opt/stack/data/nova/instances/43ead766-eeb0-4c7a-a03a-6d4daf7106af/disk {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:21:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 -F raw /opt/stack/data/nova/instances/43ead766-eeb0-4c7a-a03a-6d4daf7106af/disk" returned: 0 in 2.222s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:24 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Created local disks {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 16:21:24 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Ensure instance console log exists: /opt/stack/data/nova/instances/43ead766-eeb0-4c7a-a03a-6d4daf7106af/console.log {{(pid=75245) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 16:21:24 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:21:24 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:21:24 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:21:24 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Start _get_guest_xml network_info=[{"id": "4aefd86e-7753-4693-9cbd-6ee2178443b5", "address": "fa:16:3e:d1:0a:c7", "network": {"id": "7f978dee-8a5e-4218-b6fc-2d550c0d7b5d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-53637364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd22948fbd074a7c94d8ad7614fbc220", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aefd86e-77", "ovs_interfaceid": "4aefd86e-7753-4693-9cbd-6ee2178443b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='38605aeea5126344121377ab208a080a',container_format='bare',created_at=2023-11-29T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=13f64672-2403-41c9-bc86-f40febafc109,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1984176240-shelved',owner='fd22948fbd074a7c94d8ad7614fbc220',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-29T16:19:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'a291d9c3-be02-4c6c-9649-4b45c5b7f487'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 16:21:24 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:21:24 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:21:24 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 16:21:24 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] CPU controller missing on host. {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 16:21:24 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 16:21:24 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] CPU controller found on host. {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 16:21:24 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75245) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 16:21:24 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T16:06:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='38605aeea5126344121377ab208a080a',container_format='bare',created_at=2023-11-29T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=13f64672-2403-41c9-bc86-f40febafc109,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1984176240-shelved',owner='fd22948fbd074a7c94d8ad7614fbc220',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-29T16:19:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 16:21:24 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Flavor limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 16:21:24 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Image limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 16:21:24 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Flavor pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 16:21:24 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Image pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 16:21:24 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 16:21:24 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 16:21:24 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 16:21:24 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Got 1 possible topologies {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 16:21:24 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 16:21:24 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 16:21:24 user nova-compute[75245]: DEBUG nova.objects.instance [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lazy-loading 'vcpu_model' on Instance uuid 43ead766-eeb0-4c7a-a03a-6d4daf7106af {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:21:24 user nova-compute[75245]: DEBUG nova.objects.base [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Object Instance<43ead766-eeb0-4c7a-a03a-6d4daf7106af> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75245) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 16:21:24 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T16:17:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1984176240',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1984176240',id=19,image_ref='13f64672-2403-41c9-bc86-f40febafc109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-572815760',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:17:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='fd22948fbd074a7c94d8ad7614fbc220',ramdisk_id='',reservation_id='r-48eaewao',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1524245296',owner_user_name='tempest-AttachVolumeShelveTestJSON-1524245296-project-member',shelved_at='2023-11-29T16:19:29.502137',shelved_host='user',shelved_image_id='13f64672-2403-41c9-bc86-f40febafc109'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:21:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c4942f948584702a8c8b93248694a65',uuid=43ead766-eeb0-4c7a-a03a-6d4daf7106af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "4aefd86e-7753-4693-9cbd-6ee2178443b5", "address": "fa:16:3e:d1:0a:c7", "network": {"id": "7f978dee-8a5e-4218-b6fc-2d550c0d7b5d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-53637364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd22948fbd074a7c94d8ad7614fbc220", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aefd86e-77", "ovs_interfaceid": "4aefd86e-7753-4693-9cbd-6ee2178443b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:21:24 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Converting VIF {"id": "4aefd86e-7753-4693-9cbd-6ee2178443b5", "address": "fa:16:3e:d1:0a:c7", "network": {"id": "7f978dee-8a5e-4218-b6fc-2d550c0d7b5d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-53637364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd22948fbd074a7c94d8ad7614fbc220", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aefd86e-77", "ovs_interfaceid": "4aefd86e-7753-4693-9cbd-6ee2178443b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:21:24 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:0a:c7,bridge_name='br-int',has_traffic_filtering=True,id=4aefd86e-7753-4693-9cbd-6ee2178443b5,network=Network(7f978dee-8a5e-4218-b6fc-2d550c0d7b5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4aefd86e-77') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:21:24 user nova-compute[75245]: DEBUG nova.objects.instance [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lazy-loading 'pci_devices' on Instance uuid 43ead766-eeb0-4c7a-a03a-6d4daf7106af {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:21:24 user nova-compute[75245]: DEBUG nova.objects.base [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Object Instance<43ead766-eeb0-4c7a-a03a-6d4daf7106af> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75245) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 16:21:24 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] End _get_guest_xml xml=<domain type="kvm">
Nov 29 16:21:24 user nova-compute[75245]:   <uuid>43ead766-eeb0-4c7a-a03a-6d4daf7106af</uuid>
Nov 29 16:21:24 user nova-compute[75245]:   <name>instance-00000013</name>
Nov 29 16:21:24 user nova-compute[75245]:   <memory>524288</memory>
Nov 29 16:21:24 user nova-compute[75245]:   <vcpu>1</vcpu>
Nov 29 16:21:24 user nova-compute[75245]:   <metadata>
Nov 29 16:21:24 user nova-compute[75245]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 16:21:24 user nova-compute[75245]:       <nova:package version="0.0.0"/>
Nov 29 16:21:24 user nova-compute[75245]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1984176240</nova:name>
Nov 29 16:21:24 user nova-compute[75245]:       <nova:creationTime>2023-11-29 16:21:24</nova:creationTime>
Nov 29 16:21:24 user nova-compute[75245]:       <nova:flavor name="m1.tiny">
Nov 29 16:21:24 user nova-compute[75245]:         <nova:memory>512</nova:memory>
Nov 29 16:21:24 user nova-compute[75245]:         <nova:disk>1</nova:disk>
Nov 29 16:21:24 user nova-compute[75245]:         <nova:swap>0</nova:swap>
Nov 29 16:21:24 user nova-compute[75245]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 16:21:24 user nova-compute[75245]:         <nova:vcpus>1</nova:vcpus>
Nov 29 16:21:24 user nova-compute[75245]:       </nova:flavor>
Nov 29 16:21:24 user nova-compute[75245]:       <nova:owner>
Nov 29 16:21:24 user nova-compute[75245]:         <nova:user uuid="7c4942f948584702a8c8b93248694a65">tempest-AttachVolumeShelveTestJSON-1524245296-project-member</nova:user>
Nov 29 16:21:24 user nova-compute[75245]:         <nova:project uuid="fd22948fbd074a7c94d8ad7614fbc220">tempest-AttachVolumeShelveTestJSON-1524245296</nova:project>
Nov 29 16:21:24 user nova-compute[75245]:       </nova:owner>
Nov 29 16:21:24 user nova-compute[75245]:       <nova:root type="image" uuid="13f64672-2403-41c9-bc86-f40febafc109"/>
Nov 29 16:21:24 user nova-compute[75245]:       <nova:ports>
Nov 29 16:21:24 user nova-compute[75245]:         <nova:port uuid="4aefd86e-7753-4693-9cbd-6ee2178443b5">
Nov 29 16:21:24 user nova-compute[75245]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 16:21:24 user nova-compute[75245]:         </nova:port>
Nov 29 16:21:24 user nova-compute[75245]:       </nova:ports>
Nov 29 16:21:24 user nova-compute[75245]:     </nova:instance>
Nov 29 16:21:24 user nova-compute[75245]:   </metadata>
Nov 29 16:21:24 user nova-compute[75245]:   <sysinfo type="smbios">
Nov 29 16:21:24 user nova-compute[75245]:     <system>
Nov 29 16:21:24 user nova-compute[75245]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 16:21:24 user nova-compute[75245]:       <entry name="product">OpenStack Nova</entry>
Nov 29 16:21:24 user nova-compute[75245]:       <entry name="version">0.0.0</entry>
Nov 29 16:21:24 user nova-compute[75245]:       <entry name="serial">43ead766-eeb0-4c7a-a03a-6d4daf7106af</entry>
Nov 29 16:21:24 user nova-compute[75245]:       <entry name="uuid">43ead766-eeb0-4c7a-a03a-6d4daf7106af</entry>
Nov 29 16:21:24 user nova-compute[75245]:       <entry name="family">Virtual Machine</entry>
Nov 29 16:21:24 user nova-compute[75245]:     </system>
Nov 29 16:21:24 user nova-compute[75245]:   </sysinfo>
Nov 29 16:21:24 user nova-compute[75245]:   <os>
Nov 29 16:21:24 user nova-compute[75245]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 16:21:24 user nova-compute[75245]:     <boot dev="hd"/>
Nov 29 16:21:24 user nova-compute[75245]:     <smbios mode="sysinfo"/>
Nov 29 16:21:24 user nova-compute[75245]:   </os>
Nov 29 16:21:24 user nova-compute[75245]:   <features>
Nov 29 16:21:24 user nova-compute[75245]:     <acpi/>
Nov 29 16:21:24 user nova-compute[75245]:     <apic/>
Nov 29 16:21:24 user nova-compute[75245]:     <vmcoreinfo/>
Nov 29 16:21:24 user nova-compute[75245]:   </features>
Nov 29 16:21:24 user nova-compute[75245]:   <clock offset="utc">
Nov 29 16:21:24 user nova-compute[75245]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 16:21:24 user nova-compute[75245]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 16:21:24 user nova-compute[75245]:     <timer name="hpet" present="no"/>
Nov 29 16:21:24 user nova-compute[75245]:   </clock>
Nov 29 16:21:24 user nova-compute[75245]:   <cpu mode="custom" match="exact">
Nov 29 16:21:24 user nova-compute[75245]:     <model>Nehalem</model>
Nov 29 16:21:24 user nova-compute[75245]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 16:21:24 user nova-compute[75245]:   </cpu>
Nov 29 16:21:24 user nova-compute[75245]:   <devices>
Nov 29 16:21:24 user nova-compute[75245]:     <disk type="file" device="disk">
Nov 29 16:21:24 user nova-compute[75245]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 16:21:24 user nova-compute[75245]:       <source file="/opt/stack/data/nova/instances/43ead766-eeb0-4c7a-a03a-6d4daf7106af/disk"/>
Nov 29 16:21:24 user nova-compute[75245]:       <target dev="vda" bus="virtio"/>
Nov 29 16:21:24 user nova-compute[75245]:     </disk>
Nov 29 16:21:24 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 16:21:24 user nova-compute[75245]:       <mac address="fa:16:3e:d1:0a:c7"/>
Nov 29 16:21:24 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:21:24 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 16:21:24 user nova-compute[75245]:       <target dev="tap4aefd86e-77"/>
Nov 29 16:21:24 user nova-compute[75245]:     </interface>
Nov 29 16:21:24 user nova-compute[75245]:     <serial type="pty">
Nov 29 16:21:24 user nova-compute[75245]:       <log file="/opt/stack/data/nova/instances/43ead766-eeb0-4c7a-a03a-6d4daf7106af/console.log" append="off"/>
Nov 29 16:21:24 user nova-compute[75245]:     </serial>
Nov 29 16:21:24 user nova-compute[75245]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 16:21:24 user nova-compute[75245]:     <video>
Nov 29 16:21:24 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:21:24 user nova-compute[75245]:     </video>
Nov 29 16:21:24 user nova-compute[75245]:     <rng model="virtio">
Nov 29 16:21:24 user nova-compute[75245]:       <backend model="random">/dev/urandom</backend>
Nov 29 16:21:24 user nova-compute[75245]:     </rng>
Nov 29 16:21:24 user nova-compute[75245]:     <controller type="usb" index="0" model="none"/>
Nov 29 16:21:24 user nova-compute[75245]:     <memballoon model="virtio">
Nov 29 16:21:24 user nova-compute[75245]:       <stats period="10"/>
Nov 29 16:21:24 user nova-compute[75245]:     </memballoon>
Nov 29 16:21:24 user nova-compute[75245]:   </devices>
Nov 29 16:21:24 user nova-compute[75245]: </domain>
Nov 29 16:21:24 user nova-compute[75245]:  {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 16:21:24 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T16:17:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1984176240',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1984176240',id=19,image_ref='13f64672-2403-41c9-bc86-f40febafc109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-572815760',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:17:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='fd22948fbd074a7c94d8ad7614fbc220',ramdisk_id='',reservation_id='r-48eaewao',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1524245296',owner_user_name='tempest-AttachVolumeShelveTestJSON-1524245296-project-member',shelved_at='2023-11-29T16:19:29.502137',shelved_host='user',shelved_image_id='13f64672-2403-41c9-bc86-f40febafc109'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:21:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c4942f948584702a8c8b93248694a65',uuid=43ead766-eeb0-4c7a-a03a-6d4daf7106af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "4aefd86e-7753-4693-9cbd-6ee2178443b5", "address": "fa:16:3e:d1:0a:c7", "network": {"id": "7f978dee-8a5e-4218-b6fc-2d550c0d7b5d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-53637364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd22948fbd074a7c94d8ad7614fbc220", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aefd86e-77", "ovs_interfaceid": "4aefd86e-7753-4693-9cbd-6ee2178443b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 16:21:24 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Converting VIF {"id": "4aefd86e-7753-4693-9cbd-6ee2178443b5", "address": "fa:16:3e:d1:0a:c7", "network": {"id": "7f978dee-8a5e-4218-b6fc-2d550c0d7b5d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-53637364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd22948fbd074a7c94d8ad7614fbc220", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aefd86e-77", "ovs_interfaceid": "4aefd86e-7753-4693-9cbd-6ee2178443b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:21:24 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:0a:c7,bridge_name='br-int',has_traffic_filtering=True,id=4aefd86e-7753-4693-9cbd-6ee2178443b5,network=Network(7f978dee-8a5e-4218-b6fc-2d550c0d7b5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4aefd86e-77') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:21:24 user nova-compute[75245]: DEBUG os_vif [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:0a:c7,bridge_name='br-int',has_traffic_filtering=True,id=4aefd86e-7753-4693-9cbd-6ee2178443b5,network=Network(7f978dee-8a5e-4218-b6fc-2d550c0d7b5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4aefd86e-77') {{(pid=75245) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 16:21:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:21:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:21:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 16:21:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:21:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'eb7a32ce-b097-5a12-beb7-548fe3b8490b', '_type': 'linux-noop'}}, row=False) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:21:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:21:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:21:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:21:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4aefd86e-77, may_exist=True, interface_attrs={}) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:21:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4aefd86e-77, col_values=(('qos', UUID('0d31ca3f-d587-4072-b00b-2b488922a95d')),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:21:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4aefd86e-77, col_values=(('external_ids', {'iface-id': '4aefd86e-7753-4693-9cbd-6ee2178443b5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:0a:c7', 'vm-uuid': '43ead766-eeb0-4c7a-a03a-6d4daf7106af'}),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:21:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:21:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:21:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:21:24 user nova-compute[75245]: INFO os_vif [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:0a:c7,bridge_name='br-int',has_traffic_filtering=True,id=4aefd86e-7753-4693-9cbd-6ee2178443b5,network=Network(7f978dee-8a5e-4218-b6fc-2d550c0d7b5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4aefd86e-77')
Nov 29 16:21:24 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:21:24 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] No VIF found with MAC fa:16:3e:d1:0a:c7, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:21:25 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:21:25 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:21:25 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:21:26 user nova-compute[75245]: DEBUG nova.compute.manager [req-0010fc33-1e3c-497a-810d-d669cf38b661 req-2e245bc1-eb3f-4f80-85f6-6b23c538cca4 service nova] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Received event network-vif-plugged-4aefd86e-7753-4693-9cbd-6ee2178443b5 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:21:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-0010fc33-1e3c-497a-810d-d669cf38b661 req-2e245bc1-eb3f-4f80-85f6-6b23c538cca4 service nova] Acquiring lock "43ead766-eeb0-4c7a-a03a-6d4daf7106af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:21:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-0010fc33-1e3c-497a-810d-d669cf38b661 req-2e245bc1-eb3f-4f80-85f6-6b23c538cca4 service nova] Lock "43ead766-eeb0-4c7a-a03a-6d4daf7106af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:21:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-0010fc33-1e3c-497a-810d-d669cf38b661 req-2e245bc1-eb3f-4f80-85f6-6b23c538cca4 service nova] Lock "43ead766-eeb0-4c7a-a03a-6d4daf7106af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:21:26 user nova-compute[75245]: DEBUG nova.compute.manager [req-0010fc33-1e3c-497a-810d-d669cf38b661 req-2e245bc1-eb3f-4f80-85f6-6b23c538cca4 service nova] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] No waiting events found dispatching network-vif-plugged-4aefd86e-7753-4693-9cbd-6ee2178443b5 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:21:26 user nova-compute[75245]: WARNING nova.compute.manager [req-0010fc33-1e3c-497a-810d-d669cf38b661 req-2e245bc1-eb3f-4f80-85f6-6b23c538cca4 service nova] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Received unexpected event network-vif-plugged-4aefd86e-7753-4693-9cbd-6ee2178443b5 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 29 16:21:26 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:21:26 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:21:26 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:21:26 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:21:26 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:21:28 user nova-compute[75245]: DEBUG nova.compute.manager [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Instance event wait completed in 0 seconds for  {{(pid=75245) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 16:21:28 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Guest created on hypervisor {{(pid=75245) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 16:21:28 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Instance spawned successfully.
Nov 29 16:21:28 user nova-compute[75245]: DEBUG nova.compute.manager [req-2ce3f5cc-3642-4729-a3fd-112c0c7ad906 req-8ef60ca1-96e6-430f-b3f3-b454349e2832 service nova] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Received event network-vif-plugged-4aefd86e-7753-4693-9cbd-6ee2178443b5 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:21:28 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-2ce3f5cc-3642-4729-a3fd-112c0c7ad906 req-8ef60ca1-96e6-430f-b3f3-b454349e2832 service nova] Acquiring lock "43ead766-eeb0-4c7a-a03a-6d4daf7106af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:21:28 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-2ce3f5cc-3642-4729-a3fd-112c0c7ad906 req-8ef60ca1-96e6-430f-b3f3-b454349e2832 service nova] Lock "43ead766-eeb0-4c7a-a03a-6d4daf7106af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:21:28 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-2ce3f5cc-3642-4729-a3fd-112c0c7ad906 req-8ef60ca1-96e6-430f-b3f3-b454349e2832 service nova] Lock "43ead766-eeb0-4c7a-a03a-6d4daf7106af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:21:28 user nova-compute[75245]: DEBUG nova.compute.manager [req-2ce3f5cc-3642-4729-a3fd-112c0c7ad906 req-8ef60ca1-96e6-430f-b3f3-b454349e2832 service nova] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] No waiting events found dispatching network-vif-plugged-4aefd86e-7753-4693-9cbd-6ee2178443b5 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:21:28 user nova-compute[75245]: WARNING nova.compute.manager [req-2ce3f5cc-3642-4729-a3fd-112c0c7ad906 req-8ef60ca1-96e6-430f-b3f3-b454349e2832 service nova] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Received unexpected event network-vif-plugged-4aefd86e-7753-4693-9cbd-6ee2178443b5 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 29 16:21:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:21:28 user nova-compute[75245]: DEBUG nova.compute.manager [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:21:28 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4c57b730-6ab4-45dd-8fcc-06fcca4f3008 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lock "43ead766-eeb0-4c7a-a03a-6d4daf7106af" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.008s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:21:29 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:21:32 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-0f437b86-4fc7-4d62-959b-27028cd223fa tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Acquiring lock "84bae51e-2a85-442d-bbd2-fc89f30f40b7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:21:32 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-0f437b86-4fc7-4d62-959b-27028cd223fa tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Lock "84bae51e-2a85-442d-bbd2-fc89f30f40b7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:21:32 user nova-compute[75245]: DEBUG nova.objects.instance [None req-0f437b86-4fc7-4d62-959b-27028cd223fa tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Lazy-loading 'flavor' on Instance uuid 84bae51e-2a85-442d-bbd2-fc89f30f40b7 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:21:32 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-0f437b86-4fc7-4d62-959b-27028cd223fa tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Lock "84bae51e-2a85-442d-bbd2-fc89f30f40b7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.081s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:21:32 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-0f437b86-4fc7-4d62-959b-27028cd223fa tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Acquiring lock "84bae51e-2a85-442d-bbd2-fc89f30f40b7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:21:32 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-0f437b86-4fc7-4d62-959b-27028cd223fa tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Lock "84bae51e-2a85-442d-bbd2-fc89f30f40b7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:21:32 user nova-compute[75245]: INFO nova.compute.manager [None req-0f437b86-4fc7-4d62-959b-27028cd223fa tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Attaching volume 0534d649-6af0-440a-86de-eadff936597e to /dev/vdb
Nov 29 16:21:32 user nova-compute[75245]: DEBUG os_brick.utils [None req-0f437b86-4fc7-4d62-959b-27028cd223fa tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:21:32 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:32 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:32 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf0cea1b-a0d7-44a3-96b4-3a3afb5412ad]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:69ed8ed87091\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:21:32 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:32 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:32 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a46223c-eafa-436f-af1b-1e58751224aa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:21:32 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:32 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:32 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b3f364-d67a-4676-bdea-e6b4b7d56a77]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:21:32 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[a99e7bf5-8afd-4cda-825e-7d70ba9e92b3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:21:32 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-0f437b86-4fc7-4d62-959b-27028cd223fa tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Running cmd (subprocess): nvme version {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:32 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-0f437b86-4fc7-4d62-959b-27028cd223fa tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] 'nvme version' failed. Not Retrying. {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:21:32 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0f437b86-4fc7-4d62-959b-27028cd223fa tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] nvme not present on system {{(pid=75245) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 16:21:32 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:32 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:21:32 user nova-compute[75245]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 16:21:32 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[f839767a-b6be-465a-a8f0-081a98bf4d7f]: (4, '') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:21:32 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-0f437b86-4fc7-4d62-959b-27028cd223fa tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75245) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 16:21:32 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-0f437b86-4fc7-4d62-959b-27028cd223fa tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 16:21:32 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-0f437b86-4fc7-4d62-959b-27028cd223fa tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] LIGHTOS: no hostnqn found. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 16:21:32 user nova-compute[75245]: DEBUG os_brick.utils [None req-0f437b86-4fc7-4d62-959b-27028cd223fa tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:69ed8ed87091', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:21:32 user nova-compute[75245]: DEBUG nova.virt.block_device [None req-0f437b86-4fc7-4d62-959b-27028cd223fa tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Updating existing volume attachment record: b8c7f385-62f3-4493-b6b1-a823f9060a0b {{(pid=75245) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 16:21:33 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:21:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:21:35 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Acquiring lock "d42fa9b3-91c3-4216-91f1-655ce140425f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:21:35 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "d42fa9b3-91c3-4216-91f1-655ce140425f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:21:35 user nova-compute[75245]: DEBUG nova.compute.manager [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Starting instance... {{(pid=75245) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 16:21:36 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:21:36 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:21:36 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75245) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 16:21:36 user nova-compute[75245]: INFO nova.compute.claims [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Claim successful on node user
Nov 29 16:21:36 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:21:36 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:21:36 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.448s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:21:36 user nova-compute[75245]: DEBUG nova.compute.manager [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Start building networks asynchronously for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 16:21:36 user nova-compute[75245]: DEBUG nova.compute.manager [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Allocating IP information in the background. {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 16:21:36 user nova-compute[75245]: DEBUG nova.network.neutron [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] allocate_for_instance() {{(pid=75245) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 16:21:36 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 16:21:36 user nova-compute[75245]: DEBUG nova.compute.manager [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Start building block device mappings for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 16:21:36 user nova-compute[75245]: DEBUG nova.policy [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'be595c3f7084413180f2ab86e9c56a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6b87e18ef1f48d19a6907b28cb54f04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75245) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 16:21:36 user nova-compute[75245]: INFO nova.virt.block_device [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Booting with volume e8b52560-8036-45ee-a78b-c74351f1495f at /dev/vda
Nov 29 16:21:36 user nova-compute[75245]: DEBUG os_brick.utils [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:21:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:36 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc362d8-f684-4110-9966-19f5235d1316]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:69ed8ed87091\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:21:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:36 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[c48d9fbb-85ee-4596-81ec-6fbf2bc4509d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:21:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:36 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f6d2fb1-009b-49a6-822d-b932ba6ce762]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:21:36 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b3675b8-f07f-49c5-ac1c-2c3e1dc68ba2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:21:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Running cmd (subprocess): nvme version {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] 'nvme version' failed. Not Retrying. {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:21:36 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.nvmeof [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] nvme not present on system {{(pid=75245) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 16:21:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:21:36 user nova-compute[75245]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 16:21:36 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85a4f1f-bf0a-4a6d-9b34-ff6f9c78519c]: (4, '') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:21:36 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75245) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 16:21:36 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 16:21:36 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] LIGHTOS: no hostnqn found. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 16:21:36 user nova-compute[75245]: DEBUG os_brick.utils [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:69ed8ed87091', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:21:36 user nova-compute[75245]: DEBUG nova.virt.block_device [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Updating existing volume attachment record: 9f4a78ce-1331-47d9-ac0e-40bbc1c40e52 {{(pid=75245) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 16:21:37 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:21:37 user nova-compute[75245]: DEBUG nova.network.neutron [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Successfully created port: 497aee0b-487f-4138-9394-a68c8bd55e61 {{(pid=75245) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 16:21:38 user nova-compute[75245]: DEBUG nova.network.neutron [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Successfully updated port: 497aee0b-487f-4138-9394-a68c8bd55e61 {{(pid=75245) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 16:21:38 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Acquiring lock "refresh_cache-d42fa9b3-91c3-4216-91f1-655ce140425f" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:21:38 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Acquired lock "refresh_cache-d42fa9b3-91c3-4216-91f1-655ce140425f" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:21:38 user nova-compute[75245]: DEBUG nova.network.neutron [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 16:21:38 user nova-compute[75245]: DEBUG nova.compute.manager [req-ec974e7f-e74b-4eb1-97bd-25f7d90aba1d req-de41aa87-f9af-4ba6-ba2b-d831e52a57eb service nova] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Received event network-changed-497aee0b-487f-4138-9394-a68c8bd55e61 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:21:38 user nova-compute[75245]: DEBUG nova.compute.manager [req-ec974e7f-e74b-4eb1-97bd-25f7d90aba1d req-de41aa87-f9af-4ba6-ba2b-d831e52a57eb service nova] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Refreshing instance network info cache due to event network-changed-497aee0b-487f-4138-9394-a68c8bd55e61. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:21:38 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-ec974e7f-e74b-4eb1-97bd-25f7d90aba1d req-de41aa87-f9af-4ba6-ba2b-d831e52a57eb service nova] Acquiring lock "refresh_cache-d42fa9b3-91c3-4216-91f1-655ce140425f" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:21:38 user nova-compute[75245]: DEBUG nova.network.neutron [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Instance cache missing network info. {{(pid=75245) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 16:21:38 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:21:38 user nova-compute[75245]: DEBUG nova.network.neutron [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Updating instance_info_cache with network_info: [{"id": "497aee0b-487f-4138-9394-a68c8bd55e61", "address": "fa:16:3e:09:ba:94", "network": {"id": "f1fac2f4-e789-443e-b6a5-1a3f829bc302", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1199431077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6b87e18ef1f48d19a6907b28cb54f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap497aee0b-48", "ovs_interfaceid": "497aee0b-487f-4138-9394-a68c8bd55e61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:21:38 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Releasing lock "refresh_cache-d42fa9b3-91c3-4216-91f1-655ce140425f" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:21:38 user nova-compute[75245]: DEBUG nova.compute.manager [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Instance network_info: |[{"id": "497aee0b-487f-4138-9394-a68c8bd55e61", "address": "fa:16:3e:09:ba:94", "network": {"id": "f1fac2f4-e789-443e-b6a5-1a3f829bc302", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1199431077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6b87e18ef1f48d19a6907b28cb54f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap497aee0b-48", "ovs_interfaceid": "497aee0b-487f-4138-9394-a68c8bd55e61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 16:21:38 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-ec974e7f-e74b-4eb1-97bd-25f7d90aba1d req-de41aa87-f9af-4ba6-ba2b-d831e52a57eb service nova] Acquired lock "refresh_cache-d42fa9b3-91c3-4216-91f1-655ce140425f" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:21:38 user nova-compute[75245]: DEBUG nova.network.neutron [req-ec974e7f-e74b-4eb1-97bd-25f7d90aba1d req-de41aa87-f9af-4ba6-ba2b-d831e52a57eb service nova] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Refreshing network info cache for port 497aee0b-487f-4138-9394-a68c8bd55e61 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:21:39 user nova-compute[75245]: DEBUG nova.network.neutron [req-ec974e7f-e74b-4eb1-97bd-25f7d90aba1d req-de41aa87-f9af-4ba6-ba2b-d831e52a57eb service nova] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Updated VIF entry in instance network info cache for port 497aee0b-487f-4138-9394-a68c8bd55e61. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:21:39 user nova-compute[75245]: DEBUG nova.network.neutron [req-ec974e7f-e74b-4eb1-97bd-25f7d90aba1d req-de41aa87-f9af-4ba6-ba2b-d831e52a57eb service nova] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Updating instance_info_cache with network_info: [{"id": "497aee0b-487f-4138-9394-a68c8bd55e61", "address": "fa:16:3e:09:ba:94", "network": {"id": "f1fac2f4-e789-443e-b6a5-1a3f829bc302", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1199431077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6b87e18ef1f48d19a6907b28cb54f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap497aee0b-48", "ovs_interfaceid": "497aee0b-487f-4138-9394-a68c8bd55e61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:21:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-ec974e7f-e74b-4eb1-97bd-25f7d90aba1d req-de41aa87-f9af-4ba6-ba2b-d831e52a57eb service nova] Releasing lock "refresh_cache-d42fa9b3-91c3-4216-91f1-655ce140425f" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:21:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:21:40 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f437b86-4fc7-4d62-959b-27028cd223fa tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Calling os-brick to attach iSCSI Volume {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 16:21:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f437b86-4fc7-4d62-959b-27028cd223fa tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UPxkSWMT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:21:40 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-0f437b86-4fc7-4d62-959b-27028cd223fa tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:21:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-0f437b86-4fc7-4d62-959b-27028cd223fa tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:21:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-0f437b86-4fc7-4d62-959b-27028cd223fa tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:21:40 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-0f437b86-4fc7-4d62-959b-27028cd223fa tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:21:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-0f437b86-4fc7-4d62-959b-27028cd223fa tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:21:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-0f437b86-4fc7-4d62-959b-27028cd223fa tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:21:40 user nova-compute[75245]: INFO os_brick.initiator.connectors.iscsi [None req-0f437b86-4fc7-4d62-959b-27028cd223fa tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 16:21:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e -p 172.16.0.220:3260 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:40 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[329cb5f6-c4bc-4cd2-b290-a7603408b46a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:21:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f437b86-4fc7-4d62-959b-27028cd223fa tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 16:21:40 user nova-compute[75245]:  {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:21:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e -p 172.16.0.220:3260 --interface default --op new {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:40 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[f46c98c3-c1f2-41bb-9be0-edabd89e3a11]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e] added\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:21:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f437b86-4fc7-4d62-959b-27028cd223fa tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e] added
Nov 29 16:21:40 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:21:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:40 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a5a23ff-467d-416c-ad50-20e0cf67d223]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:21:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f437b86-4fc7-4d62-959b-27028cd223fa tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:21:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:40 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[9363c3ad-78fb-47b8-9586-322ff037a6c4]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:21:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f437b86-4fc7-4d62-959b-27028cd223fa tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:21:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UPxkSWMT {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UPxkSWMT" returned: 0 in 0.023s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:40 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e67636c-7bd8-48bc-bd47-e07ec4d9d43d]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:21:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f437b86-4fc7-4d62-959b-27028cd223fa tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UPxkSWMT'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:21:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:40 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ad2185-f348-4396-8e2c-9149e1d969b5]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:21:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f437b86-4fc7-4d62-959b-27028cd223fa tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:21:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:40 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[4924c522-3533-4491-863c-e5cf29ff6db0]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:21:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f437b86-4fc7-4d62-959b-27028cd223fa tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 (non-flash)
Nov 29 16:21:40 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:21:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f437b86-4fc7-4d62-959b-27028cd223fa tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 (non-flash)
Nov 29 16:21:40 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:21:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e -p 172.16.0.220:3260 --login {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:40 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df655c4-d31e-485d-a9be-a7bc3f5f8af9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:21:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f437b86-4fc7-4d62-959b-27028cd223fa tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e, portal: 172.16.0.220,3260]
Nov 29 16:21:40 user nova-compute[75245]: Login to [iface: default, target: iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e, portal: 172.16.0.220,3260] successful.
Nov 29 16:21:40 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:21:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:40 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a46c0a1-0017-4728-a56d-77efc1427af6]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:21:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f437b86-4fc7-4d62-959b-27028cd223fa tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:21:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:40 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5416864-5b68-41c4-9811-2ccb52605957]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:21:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f437b86-4fc7-4d62-959b-27028cd223fa tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 (non-flash)
Nov 29 16:21:40 user nova-compute[75245]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e (non-flash)
Nov 29 16:21:40 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:21:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f437b86-4fc7-4d62-959b-27028cd223fa tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 (non-flash)
Nov 29 16:21:40 user nova-compute[75245]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e (non-flash)
Nov 29 16:21:40 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:21:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-0f437b86-4fc7-4d62-959b-27028cd223fa tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:21:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f437b86-4fc7-4d62-959b-27028cd223fa tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Connected to 172.16.0.220:3260 {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 16:21:40 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-0f437b86-4fc7-4d62-959b-27028cd223fa tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] HCTL ('34', '-', '-', 0) found on session 27 with lun 0 {{(pid=75245) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 16:21:40 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-0f437b86-4fc7-4d62-959b-27028cd223fa tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75245) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 16:21:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:40 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[38565c4b-3325-4aab-914e-c168f76c529e]: (4, ('- - 0', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:21:40 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-0f437b86-4fc7-4d62-959b-27028cd223fa tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Searching for a device in session 27 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75245) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 16:21:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f437b86-4fc7-4d62-959b-27028cd223fa tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UPxkSWMT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 16:21:41 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-0f437b86-4fc7-4d62-959b-27028cd223fa tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:21:41 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f437b86-4fc7-4d62-959b-27028cd223fa tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '23933616436303938', 'path': '/dev/sdc'} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:21:41 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f437b86-4fc7-4d62-959b-27028cd223fa tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23933616436303938', 'path': '/dev/sdc'} {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 16:21:41 user nova-compute[75245]: DEBUG nova.objects.instance [None req-0f437b86-4fc7-4d62-959b-27028cd223fa tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Lazy-loading 'flavor' on Instance uuid 84bae51e-2a85-442d-bbd2-fc89f30f40b7 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:21:41 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-0f437b86-4fc7-4d62-959b-27028cd223fa tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 16:21:41 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:21:41 user nova-compute[75245]:   <source dev="/dev/sdc"/>
Nov 29 16:21:41 user nova-compute[75245]:   <target dev="vdb" bus="virtio"/>
Nov 29 16:21:41 user nova-compute[75245]:   <serial>0534d649-6af0-440a-86de-eadff936597e</serial>
Nov 29 16:21:41 user nova-compute[75245]: </disk>
Nov 29 16:21:41 user nova-compute[75245]:  {{(pid=75245) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 16:21:42 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-0f437b86-4fc7-4d62-959b-27028cd223fa tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:21:42 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-0f437b86-4fc7-4d62-959b-27028cd223fa tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:21:42 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-0f437b86-4fc7-4d62-959b-27028cd223fa tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] No VIF found with MAC fa:16:3e:d1:e4:30, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:21:42 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-0f437b86-4fc7-4d62-959b-27028cd223fa tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Lock "84bae51e-2a85-442d-bbd2-fc89f30f40b7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.026s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:21:43 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:21:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:21:44 user nova-compute[75245]: DEBUG nova.compute.manager [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Stashing vm_state: active {{(pid=75245) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 29 16:21:44 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:21:44 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75245) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 16:21:45 user nova-compute[75245]: INFO nova.compute.claims [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Claim successful on node user
Nov 29 16:21:45 user nova-compute[75245]: INFO nova.compute.resource_tracker [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Updating resource usage from migration c238ecef-960e-49e6-9c78-1b39bc8f90c0
Nov 29 16:21:45 user nova-compute[75245]: DEBUG nova.compute.manager [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Start spawning the instance on the hypervisor. {{(pid=75245) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Creating instance directory {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 16:21:45 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Creating image(s)
Nov 29 16:21:45 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Did not create local disks {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Ensure instance console log exists: /opt/stack/data/nova/instances/d42fa9b3-91c3-4216-91f1-655ce140425f/console.log {{(pid=75245) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Start _get_guest_xml network_info=[{"id": "497aee0b-487f-4138-9394-a68c8bd55e61", "address": "fa:16:3e:09:ba:94", "network": {"id": "f1fac2f4-e789-443e-b6a5-1a3f829bc302", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1199431077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6b87e18ef1f48d19a6907b28cb54f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap497aee0b-48", "ovs_interfaceid": "497aee0b-487f-4138-9394-a68c8bd55e61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '9f4a78ce-1331-47d9-ac0e-40bbc1c40e52', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zpXHZUKQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd42fa9b3-91c3-4216-91f1-655ce140425f', 'attached_at': '', 'detached_at': '', 'volume_id': 'e8b52560-8036-45ee-a78b-c74351f1495f', 'serial': 'e8b52560-8036-45ee-a78b-c74351f1495f'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'guest_format': None, 'volume_type': None} {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:21:45 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:21:45 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:21:45 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] CPU controller missing on host. {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] CPU controller found on host. {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75245) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T16:06:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Flavor limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Image limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Flavor pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Image pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Got 1 possible topologies {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Calling os-brick to attach iSCSI Volume {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zpXHZUKQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:21:45 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:21:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:21:45 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:21:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:21:45 user nova-compute[75245]: INFO os_brick.initiator.connectors.iscsi [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 16:21:45 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.375s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:21:45 user nova-compute[75245]: INFO nova.compute.manager [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Migrating
Nov 29 16:21:45 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f -p 172.16.0.220:3260 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:45 user nova-compute[75245]: INFO nova.compute.rpcapi [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 29 16:21:45 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb0628f-47fb-4a89-86a4-b113bf8b7377]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 16:21:45 user nova-compute[75245]:  {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f -p 172.16.0.220:3260 --interface default --op new {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[53896fd8-74f1-4abc-ba09-05744bfbd039]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f] added\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f] added
Nov 29 16:21:45 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Acquiring lock "refresh_cache-84bae51e-2a85-442d-bbd2-fc89f30f40b7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Acquired lock "refresh_cache-84bae51e-2a85-442d-bbd2-fc89f30f40b7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG nova.network.neutron [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[a76d0f9b-1659-4712-bca6-249c6c8e5d0b]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[a76124eb-cc5c-4572-a112-f54097db431f]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zpXHZUKQ {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zpXHZUKQ" returned: 0 in 0.023s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc0e032-6f91-42ee-9ef8-4b496a20b897]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zpXHZUKQ'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[e14cb2b6-c5cc-46ec-854e-76912ee94d3b]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[4673a1b6-811a-46cd-9c39-ea8dcc524b98]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 (non-flash)
Nov 29 16:21:45 user nova-compute[75245]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e (non-flash)
Nov 29 16:21:45 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 (non-flash)
Nov 29 16:21:45 user nova-compute[75245]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e (non-flash)
Nov 29 16:21:45 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f -p 172.16.0.220:3260 --login {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9655a4-4c1b-42fa-acb6-558a8e282261]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f, portal: 172.16.0.220,3260]
Nov 29 16:21:45 user nova-compute[75245]: Login to [iface: default, target: iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f, portal: 172.16.0.220,3260] successful.
Nov 29 16:21:45 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc217919-5937-4196-9607-a2643efea54b]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8dd9ab-d588-4753-8b55-0922c7f806f0]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 (non-flash)
Nov 29 16:21:45 user nova-compute[75245]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e (non-flash)
Nov 29 16:21:45 user nova-compute[75245]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f (non-flash)
Nov 29 16:21:45 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 (non-flash)
Nov 29 16:21:45 user nova-compute[75245]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e (non-flash)
Nov 29 16:21:45 user nova-compute[75245]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f (non-flash)
Nov 29 16:21:45 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Connected to 172.16.0.220:3260 {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] HCTL ('35', '-', '-', 0) found on session 28 with lun 0 {{(pid=75245) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75245) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[87582106-ce98-4014-97fe-b232f1cb68f5]: (4, ('- - 0', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Searching for a device in session 28 and hctl ['35', '*', '*', 0] yield: None {{(pid=75245) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG nova.network.neutron [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Updating instance_info_cache with network_info: [{"id": "27fc0374-0770-4171-a730-6696b09362eb", "address": "fa:16:3e:d1:e4:30", "network": {"id": "e38d9eed-b29b-4a4c-b084-876554dc5263", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1284740336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c018212e0654c4db442ca65a386f397", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27fc0374-07", "ovs_interfaceid": "27fc0374-0770-4171-a730-6696b09362eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:21:45 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Releasing lock "refresh_cache-84bae51e-2a85-442d-bbd2-fc89f30f40b7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:21:46 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Starting migrate_disk_and_power_off {{(pid=75245) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11484}}
Nov 29 16:21:46 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:21:46 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:21:46 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:21:46 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:21:46 user nova-compute[75245]: DEBUG nova.compute.manager [req-db984906-1998-4d60-bcc4-3f7eea83e8db req-82623b97-a038-4c06-9993-b45486fa1ab3 service nova] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Received event network-vif-unplugged-27fc0374-0770-4171-a730-6696b09362eb {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:21:46 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-db984906-1998-4d60-bcc4-3f7eea83e8db req-82623b97-a038-4c06-9993-b45486fa1ab3 service nova] Acquiring lock "84bae51e-2a85-442d-bbd2-fc89f30f40b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:21:46 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-db984906-1998-4d60-bcc4-3f7eea83e8db req-82623b97-a038-4c06-9993-b45486fa1ab3 service nova] Lock "84bae51e-2a85-442d-bbd2-fc89f30f40b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:21:46 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-db984906-1998-4d60-bcc4-3f7eea83e8db req-82623b97-a038-4c06-9993-b45486fa1ab3 service nova] Lock "84bae51e-2a85-442d-bbd2-fc89f30f40b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:21:46 user nova-compute[75245]: DEBUG nova.compute.manager [req-db984906-1998-4d60-bcc4-3f7eea83e8db req-82623b97-a038-4c06-9993-b45486fa1ab3 service nova] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] No waiting events found dispatching network-vif-unplugged-27fc0374-0770-4171-a730-6696b09362eb {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:21:46 user nova-compute[75245]: WARNING nova.compute.manager [req-db984906-1998-4d60-bcc4-3f7eea83e8db req-82623b97-a038-4c06-9993-b45486fa1ab3 service nova] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Received unexpected event network-vif-unplugged-27fc0374-0770-4171-a730-6696b09362eb for instance with vm_state active and task_state resize_migrating.
Nov 29 16:21:46 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Searching for a device in session 28 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75245) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 16:21:46 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zpXHZUKQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 16:21:46 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:21:46 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '23465333932326266', 'path': '/dev/sdd'} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:21:46 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23465333932326266', 'path': '/dev/sdd'} {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 16:21:46 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:21:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-398720439',display_name='tempest-ServerActionsTestOtherA-server-398720439',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-398720439',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBlv185nmJa9KBQWtd25ahGt24w8RxLoAajuGL7vBUTHaz3jTQraFsqx3MIOXaCnGwG9vPuUxlhI7TdDBUzC5IxITSYROv0nohB5+qOZUd0Imt2qi6DOpY2ZQc/HDcV0+g==',key_name='tempest-keypair-7729748',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6b87e18ef1f48d19a6907b28cb54f04',ramdisk_id='',reservation_id='r-bs0pty7s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1840344781',owner_user_name='tempest-ServerActionsTestOtherA-1840344781-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:21:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be595c3f7084413180f2ab86e9c56a64',uuid=d42fa9b3-91c3-4216-91f1-655ce140425f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "497aee0b-487f-4138-9394-a68c8bd55e61", "address": "fa:16:3e:09:ba:94", "network": {"id": "f1fac2f4-e789-443e-b6a5-1a3f829bc302", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1199431077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6b87e18ef1f48d19a6907b28cb54f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap497aee0b-48", "ovs_interfaceid": "497aee0b-487f-4138-9394-a68c8bd55e61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:21:46 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Converting VIF {"id": "497aee0b-487f-4138-9394-a68c8bd55e61", "address": "fa:16:3e:09:ba:94", "network": {"id": "f1fac2f4-e789-443e-b6a5-1a3f829bc302", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1199431077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6b87e18ef1f48d19a6907b28cb54f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap497aee0b-48", "ovs_interfaceid": "497aee0b-487f-4138-9394-a68c8bd55e61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:21:46 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:ba:94,bridge_name='br-int',has_traffic_filtering=True,id=497aee0b-487f-4138-9394-a68c8bd55e61,network=Network(f1fac2f4-e789-443e-b6a5-1a3f829bc302),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap497aee0b-48') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:21:46 user nova-compute[75245]: DEBUG nova.objects.instance [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lazy-loading 'pci_devices' on Instance uuid d42fa9b3-91c3-4216-91f1-655ce140425f {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:21:46 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] End _get_guest_xml xml=<domain type="kvm">
Nov 29 16:21:46 user nova-compute[75245]:   <uuid>d42fa9b3-91c3-4216-91f1-655ce140425f</uuid>
Nov 29 16:21:46 user nova-compute[75245]:   <name>instance-00000017</name>
Nov 29 16:21:46 user nova-compute[75245]:   <memory>524288</memory>
Nov 29 16:21:46 user nova-compute[75245]:   <vcpu>1</vcpu>
Nov 29 16:21:46 user nova-compute[75245]:   <metadata>
Nov 29 16:21:46 user nova-compute[75245]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 16:21:46 user nova-compute[75245]:       <nova:package version="0.0.0"/>
Nov 29 16:21:46 user nova-compute[75245]:       <nova:name>tempest-ServerActionsTestOtherA-server-398720439</nova:name>
Nov 29 16:21:46 user nova-compute[75245]:       <nova:creationTime>2023-11-29 16:21:45</nova:creationTime>
Nov 29 16:21:46 user nova-compute[75245]:       <nova:flavor name="m1.tiny">
Nov 29 16:21:46 user nova-compute[75245]:         <nova:memory>512</nova:memory>
Nov 29 16:21:46 user nova-compute[75245]:         <nova:disk>1</nova:disk>
Nov 29 16:21:46 user nova-compute[75245]:         <nova:swap>0</nova:swap>
Nov 29 16:21:46 user nova-compute[75245]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 16:21:46 user nova-compute[75245]:         <nova:vcpus>1</nova:vcpus>
Nov 29 16:21:46 user nova-compute[75245]:       </nova:flavor>
Nov 29 16:21:46 user nova-compute[75245]:       <nova:owner>
Nov 29 16:21:46 user nova-compute[75245]:         <nova:user uuid="be595c3f7084413180f2ab86e9c56a64">tempest-ServerActionsTestOtherA-1840344781-project-member</nova:user>
Nov 29 16:21:46 user nova-compute[75245]:         <nova:project uuid="c6b87e18ef1f48d19a6907b28cb54f04">tempest-ServerActionsTestOtherA-1840344781</nova:project>
Nov 29 16:21:46 user nova-compute[75245]:       </nova:owner>
Nov 29 16:21:46 user nova-compute[75245]:       <nova:ports>
Nov 29 16:21:46 user nova-compute[75245]:         <nova:port uuid="497aee0b-487f-4138-9394-a68c8bd55e61">
Nov 29 16:21:46 user nova-compute[75245]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 29 16:21:46 user nova-compute[75245]:         </nova:port>
Nov 29 16:21:46 user nova-compute[75245]:       </nova:ports>
Nov 29 16:21:46 user nova-compute[75245]:     </nova:instance>
Nov 29 16:21:46 user nova-compute[75245]:   </metadata>
Nov 29 16:21:46 user nova-compute[75245]:   <sysinfo type="smbios">
Nov 29 16:21:46 user nova-compute[75245]:     <system>
Nov 29 16:21:46 user nova-compute[75245]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 16:21:46 user nova-compute[75245]:       <entry name="product">OpenStack Nova</entry>
Nov 29 16:21:46 user nova-compute[75245]:       <entry name="version">0.0.0</entry>
Nov 29 16:21:46 user nova-compute[75245]:       <entry name="serial">d42fa9b3-91c3-4216-91f1-655ce140425f</entry>
Nov 29 16:21:46 user nova-compute[75245]:       <entry name="uuid">d42fa9b3-91c3-4216-91f1-655ce140425f</entry>
Nov 29 16:21:46 user nova-compute[75245]:       <entry name="family">Virtual Machine</entry>
Nov 29 16:21:46 user nova-compute[75245]:     </system>
Nov 29 16:21:46 user nova-compute[75245]:   </sysinfo>
Nov 29 16:21:46 user nova-compute[75245]:   <os>
Nov 29 16:21:46 user nova-compute[75245]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 16:21:46 user nova-compute[75245]:     <boot dev="hd"/>
Nov 29 16:21:46 user nova-compute[75245]:     <smbios mode="sysinfo"/>
Nov 29 16:21:46 user nova-compute[75245]:   </os>
Nov 29 16:21:46 user nova-compute[75245]:   <features>
Nov 29 16:21:46 user nova-compute[75245]:     <acpi/>
Nov 29 16:21:46 user nova-compute[75245]:     <apic/>
Nov 29 16:21:46 user nova-compute[75245]:     <vmcoreinfo/>
Nov 29 16:21:46 user nova-compute[75245]:   </features>
Nov 29 16:21:46 user nova-compute[75245]:   <clock offset="utc">
Nov 29 16:21:46 user nova-compute[75245]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 16:21:46 user nova-compute[75245]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 16:21:46 user nova-compute[75245]:     <timer name="hpet" present="no"/>
Nov 29 16:21:46 user nova-compute[75245]:   </clock>
Nov 29 16:21:46 user nova-compute[75245]:   <cpu mode="custom" match="exact">
Nov 29 16:21:46 user nova-compute[75245]:     <model>Nehalem</model>
Nov 29 16:21:46 user nova-compute[75245]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 16:21:46 user nova-compute[75245]:   </cpu>
Nov 29 16:21:46 user nova-compute[75245]:   <devices>
Nov 29 16:21:46 user nova-compute[75245]:     <disk type="block" device="disk">
Nov 29 16:21:46 user nova-compute[75245]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:21:46 user nova-compute[75245]:       <source dev="/dev/sdd"/>
Nov 29 16:21:46 user nova-compute[75245]:       <target dev="vda" bus="virtio"/>
Nov 29 16:21:46 user nova-compute[75245]:       <serial>e8b52560-8036-45ee-a78b-c74351f1495f</serial>
Nov 29 16:21:46 user nova-compute[75245]:     </disk>
Nov 29 16:21:46 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 16:21:46 user nova-compute[75245]:       <mac address="fa:16:3e:09:ba:94"/>
Nov 29 16:21:46 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:21:46 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 16:21:46 user nova-compute[75245]:       <target dev="tap497aee0b-48"/>
Nov 29 16:21:46 user nova-compute[75245]:     </interface>
Nov 29 16:21:46 user nova-compute[75245]:     <serial type="pty">
Nov 29 16:21:46 user nova-compute[75245]:       <log file="/opt/stack/data/nova/instances/d42fa9b3-91c3-4216-91f1-655ce140425f/console.log" append="off"/>
Nov 29 16:21:46 user nova-compute[75245]:     </serial>
Nov 29 16:21:46 user nova-compute[75245]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 16:21:46 user nova-compute[75245]:     <video>
Nov 29 16:21:46 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:21:46 user nova-compute[75245]:     </video>
Nov 29 16:21:46 user nova-compute[75245]:     <rng model="virtio">
Nov 29 16:21:46 user nova-compute[75245]:       <backend model="random">/dev/urandom</backend>
Nov 29 16:21:46 user nova-compute[75245]:     </rng>
Nov 29 16:21:46 user nova-compute[75245]:     <controller type="usb" index="0" model="none"/>
Nov 29 16:21:46 user nova-compute[75245]:     <memballoon model="virtio">
Nov 29 16:21:46 user nova-compute[75245]:       <stats period="10"/>
Nov 29 16:21:46 user nova-compute[75245]:     </memballoon>
Nov 29 16:21:46 user nova-compute[75245]:   </devices>
Nov 29 16:21:46 user nova-compute[75245]: </domain>
Nov 29 16:21:46 user nova-compute[75245]:  {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 16:21:46 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:21:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-398720439',display_name='tempest-ServerActionsTestOtherA-server-398720439',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-398720439',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBlv185nmJa9KBQWtd25ahGt24w8RxLoAajuGL7vBUTHaz3jTQraFsqx3MIOXaCnGwG9vPuUxlhI7TdDBUzC5IxITSYROv0nohB5+qOZUd0Imt2qi6DOpY2ZQc/HDcV0+g==',key_name='tempest-keypair-7729748',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6b87e18ef1f48d19a6907b28cb54f04',ramdisk_id='',reservation_id='r-bs0pty7s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1840344781',owner_user_name='tempest-ServerActionsTestOtherA-1840344781-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:21:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be595c3f7084413180f2ab86e9c56a64',uuid=d42fa9b3-91c3-4216-91f1-655ce140425f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "497aee0b-487f-4138-9394-a68c8bd55e61", "address": "fa:16:3e:09:ba:94", "network": {"id": "f1fac2f4-e789-443e-b6a5-1a3f829bc302", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1199431077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6b87e18ef1f48d19a6907b28cb54f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap497aee0b-48", "ovs_interfaceid": "497aee0b-487f-4138-9394-a68c8bd55e61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 16:21:46 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Converting VIF {"id": "497aee0b-487f-4138-9394-a68c8bd55e61", "address": "fa:16:3e:09:ba:94", "network": {"id": "f1fac2f4-e789-443e-b6a5-1a3f829bc302", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1199431077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6b87e18ef1f48d19a6907b28cb54f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap497aee0b-48", "ovs_interfaceid": "497aee0b-487f-4138-9394-a68c8bd55e61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:21:46 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:ba:94,bridge_name='br-int',has_traffic_filtering=True,id=497aee0b-487f-4138-9394-a68c8bd55e61,network=Network(f1fac2f4-e789-443e-b6a5-1a3f829bc302),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap497aee0b-48') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:21:46 user nova-compute[75245]: DEBUG os_vif [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:ba:94,bridge_name='br-int',has_traffic_filtering=True,id=497aee0b-487f-4138-9394-a68c8bd55e61,network=Network(f1fac2f4-e789-443e-b6a5-1a3f829bc302),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap497aee0b-48') {{(pid=75245) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 16:21:46 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:21:46 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:21:46 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 16:21:46 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:21:46 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c0ff478c-4d0c-5336-93ef-1f6de03a59aa', '_type': 'linux-noop'}}, row=False) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:21:46 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:21:46 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:21:46 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:21:46 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:21:46 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap497aee0b-48, may_exist=True, interface_attrs={}) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:21:46 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap497aee0b-48, col_values=(('qos', UUID('da551510-3a51-4bd7-93ef-9ff044874daa')),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:21:46 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap497aee0b-48, col_values=(('external_ids', {'iface-id': '497aee0b-487f-4138-9394-a68c8bd55e61', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:ba:94', 'vm-uuid': 'd42fa9b3-91c3-4216-91f1-655ce140425f'}),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:21:46 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:21:46 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:21:46 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Instance destroyed successfully.
Nov 29 16:21:46 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:17:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-185985516',display_name='tempest-ServerActionsTestOtherB-server-185985516',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-185985516',id=20,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMGVVYk91CF4EJNlPGJ16B9aebX0g0461zoNkayBpAbBcPtumcB5nsUcunIZSLwTkPZC3DIGJ81mZLNGLk1xqtQ18lArBUMtmLGCUS7pb+CbAh4z22M0J6OlcUXZFjAglA==',key_name='tempest-keypair-1103342865',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:17:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3c018212e0654c4db442ca65a386f397',ramdisk_id='',reservation_id='r-rarysz12',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1446057763',owner_user_name='tempest-ServerActionsTestOtherB-1446057763-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:21:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecd08c449e8643c2b0eb4b2dc8cd7780',uuid=84bae51e-2a85-442d-bbd2-fc89f30f40b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "27fc0374-0770-4171-a730-6696b09362eb", "address": "fa:16:3e:d1:e4:30", "network": {"id": "e38d9eed-b29b-4a4c-b084-876554dc5263", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1284740336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1284740336-network", "vif_mac": "fa:16:3e:d1:e4:30"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c018212e0654c4db442ca65a386f397", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27fc0374-07", "ovs_interfaceid": "27fc0374-0770-4171-a730-6696b09362eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 16:21:46 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Converting VIF {"id": "27fc0374-0770-4171-a730-6696b09362eb", "address": "fa:16:3e:d1:e4:30", "network": {"id": "e38d9eed-b29b-4a4c-b084-876554dc5263", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1284740336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1284740336-network", "vif_mac": "fa:16:3e:d1:e4:30"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c018212e0654c4db442ca65a386f397", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27fc0374-07", "ovs_interfaceid": "27fc0374-0770-4171-a730-6696b09362eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:21:46 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d1:e4:30,bridge_name='br-int',has_traffic_filtering=True,id=27fc0374-0770-4171-a730-6696b09362eb,network=Network(e38d9eed-b29b-4a4c-b084-876554dc5263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27fc0374-07') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:21:46 user nova-compute[75245]: DEBUG os_vif [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:e4:30,bridge_name='br-int',has_traffic_filtering=True,id=27fc0374-0770-4171-a730-6696b09362eb,network=Network(e38d9eed-b29b-4a4c-b084-876554dc5263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27fc0374-07') {{(pid=75245) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 16:21:46 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:21:46 user nova-compute[75245]: INFO os_vif [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:ba:94,bridge_name='br-int',has_traffic_filtering=True,id=497aee0b-487f-4138-9394-a68c8bd55e61,network=Network(f1fac2f4-e789-443e-b6a5-1a3f829bc302),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap497aee0b-48')
Nov 29 16:21:46 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:21:46 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap27fc0374-07, bridge=br-int, if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:21:46 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:21:46 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:21:46 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:21:46 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:21:46 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dbce8307-8fb1-459b-b185-17942287f4dd) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:21:46 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:21:46 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:21:46 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:21:46 user nova-compute[75245]: INFO os_vif [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:e4:30,bridge_name='br-int',has_traffic_filtering=True,id=27fc0374-0770-4171-a730-6696b09362eb,network=Network(e38d9eed-b29b-4a4c-b084-876554dc5263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27fc0374-07')
Nov 29 16:21:46 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] calling os-brick to detach iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 16:21:46 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, {'target_iqn': 'iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UPxkSWMT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:21:46 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:21:46 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:21:46 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:21:46 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:46 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:46 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[378189a7-f1d5-4b01-97b2-2840aa0bf410]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:21:46 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 16:21:46 user nova-compute[75245]: No targets found.
Nov 29 16:21:46 user nova-compute[75245]: iSNS:
Nov 29 16:21:46 user nova-compute[75245]: No targets found.
Nov 29 16:21:46 user nova-compute[75245]: STATIC:
Nov 29 16:21:46 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e
Nov 29 16:21:46 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:21:46 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:21:46 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024
Nov 29 16:21:46 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:21:46 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:21:46 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f
Nov 29 16:21:46 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:21:46 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:21:46 user nova-compute[75245]: FIRMWARE:
Nov 29 16:21:46 user nova-compute[75245]: No targets found.
Nov 29 16:21:46 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:21:46 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 16:21:46 user nova-compute[75245]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 16:21:46 user nova-compute[75245]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75245) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 16:21:46 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e', 0)] {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 16:21:46 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:46 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:21:46 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] No VIF found with MAC fa:16:3e:09:ba:94, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:21:46 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:46 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[32542d54-e4ae-47de-aa6e-89b18f7b6dac]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:21:46 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:46 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:46 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f263b9-b227-4402-944f-75e88d719e6f]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:21:46 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 (non-flash)
Nov 29 16:21:46 user nova-compute[75245]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e (non-flash)
Nov 29 16:21:46 user nova-compute[75245]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f (non-flash)
Nov 29 16:21:46 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:21:46 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 (non-flash)
Nov 29 16:21:46 user nova-compute[75245]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e (non-flash)
Nov 29 16:21:46 user nova-compute[75245]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f (non-flash)
Nov 29 16:21:46 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:21:46 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0d441c12d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e'): ({'sdc'}, set())}) {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 16:21:46 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Removing single pathed devices sdc {{(pid=75245) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 16:21:46 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:46 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:46 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f72e24d-1562-40df-9de7-e7fbbc2e4c06]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:21:46 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:46 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:46 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb31a55-ae3f-45a8-be7d-8efb2ab664ab]: (4, ('ok\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:21:46 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Flushing IO for device /dev/sdc {{(pid=75245) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 16:21:46 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:47 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[b026110e-8a5a-4c54-b884-8fd652b1a816]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:21:47 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75245) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 16:21:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:47 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff376f46-3070-4345-8666-3f20c86877e5]: (4, ('1', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:21:47 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 16:21:47 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] SCSI volumes sdc have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 16:21:47 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e')] {{(pid=75245) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 16:21:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:47 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[a56e7af8-bbc2-443e-a9b3-9c29e9e6da76]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:21:47 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:21:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e -p 172.16.0.220:3260 --logout {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:47 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ea4234-8163-490f-8820-6cd069076e89]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:21:47 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e, portal: 172.16.0.220,3260]
Nov 29 16:21:47 user nova-compute[75245]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e, portal: 172.16.0.220,3260] successful.
Nov 29 16:21:47 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:21:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e -p 172.16.0.220:3260 --op delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:47 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0906714-adc3-4625-9ed3-013814a481d6]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:21:47 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:21:47 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:21:47 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] <== disconnect_volume: return (309ms) None {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:21:47 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Disconnected iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 16:21:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bae51e-2a85-442d-bbd2-fc89f30f40b7/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:47 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Acquiring lock "5de7e10c-f216-46b3-8f74-57bac6ab7e56" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:21:47 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "5de7e10c-f216-46b3-8f74-57bac6ab7e56" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:21:47 user nova-compute[75245]: DEBUG nova.compute.manager [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Starting instance... {{(pid=75245) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 16:21:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bae51e-2a85-442d-bbd2-fc89f30f40b7/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bae51e-2a85-442d-bbd2-fc89f30f40b7/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:47 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:21:47 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:21:47 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75245) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 16:21:47 user nova-compute[75245]: INFO nova.compute.claims [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Claim successful on node user
Nov 29 16:21:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bae51e-2a85-442d-bbd2-fc89f30f40b7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:47 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:21:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/84bae51e-2a85-442d-bbd2-fc89f30f40b7_resize/disk /opt/stack/data/nova/instances/84bae51e-2a85-442d-bbd2-fc89f30f40b7/disk {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:47 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:21:47 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:21:47 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.433s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:21:47 user nova-compute[75245]: DEBUG nova.compute.manager [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Start building networks asynchronously for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 16:21:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] CMD "cp -r /opt/stack/data/nova/instances/84bae51e-2a85-442d-bbd2-fc89f30f40b7_resize/disk /opt/stack/data/nova/instances/84bae51e-2a85-442d-bbd2-fc89f30f40b7/disk" returned: 0 in 0.356s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/84bae51e-2a85-442d-bbd2-fc89f30f40b7_resize/disk.info /opt/stack/data/nova/instances/84bae51e-2a85-442d-bbd2-fc89f30f40b7/disk.info {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] CMD "cp -r /opt/stack/data/nova/instances/84bae51e-2a85-442d-bbd2-fc89f30f40b7_resize/disk.info /opt/stack/data/nova/instances/84bae51e-2a85-442d-bbd2-fc89f30f40b7/disk.info" returned: 0 in 0.035s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:47 user nova-compute[75245]: DEBUG nova.compute.manager [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Allocating IP information in the background. {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 16:21:47 user nova-compute[75245]: DEBUG nova.network.neutron [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] allocate_for_instance() {{(pid=75245) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 16:21:48 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 16:21:48 user nova-compute[75245]: DEBUG nova.compute.manager [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Start building block device mappings for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 16:21:48 user nova-compute[75245]: INFO nova.virt.block_device [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Booting with blank volume at /dev/vda
Nov 29 16:21:48 user nova-compute[75245]: DEBUG nova.policy [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4f20e7c9ae22462ea6bc623c93697fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d52776451e947f5a9ef3fa44ac8acbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75245) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 16:21:48 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:21:48 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:21:48 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:21:48 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:21:48 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:21:48 user nova-compute[75245]: DEBUG nova.compute.manager [req-c531b777-c385-44bb-8e5d-97cb4cd9a185 req-b99d5c00-2a6b-41fb-9010-4f62734ee2b6 service nova] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Received event network-vif-plugged-497aee0b-487f-4138-9394-a68c8bd55e61 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:21:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-c531b777-c385-44bb-8e5d-97cb4cd9a185 req-b99d5c00-2a6b-41fb-9010-4f62734ee2b6 service nova] Acquiring lock "d42fa9b3-91c3-4216-91f1-655ce140425f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:21:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-c531b777-c385-44bb-8e5d-97cb4cd9a185 req-b99d5c00-2a6b-41fb-9010-4f62734ee2b6 service nova] Lock "d42fa9b3-91c3-4216-91f1-655ce140425f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:21:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-c531b777-c385-44bb-8e5d-97cb4cd9a185 req-b99d5c00-2a6b-41fb-9010-4f62734ee2b6 service nova] Lock "d42fa9b3-91c3-4216-91f1-655ce140425f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:21:48 user nova-compute[75245]: DEBUG nova.compute.manager [req-c531b777-c385-44bb-8e5d-97cb4cd9a185 req-b99d5c00-2a6b-41fb-9010-4f62734ee2b6 service nova] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] No waiting events found dispatching network-vif-plugged-497aee0b-487f-4138-9394-a68c8bd55e61 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:21:48 user nova-compute[75245]: WARNING nova.compute.manager [req-c531b777-c385-44bb-8e5d-97cb4cd9a185 req-b99d5c00-2a6b-41fb-9010-4f62734ee2b6 service nova] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Received unexpected event network-vif-plugged-497aee0b-487f-4138-9394-a68c8bd55e61 for instance with vm_state building and task_state spawning.
Nov 29 16:21:48 user nova-compute[75245]: DEBUG nova.compute.manager [req-754cf086-af5d-4f3f-b271-f3634aedf181 req-8ebc43a6-c048-4453-b5f5-455610aa8b14 service nova] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Received event network-vif-plugged-27fc0374-0770-4171-a730-6696b09362eb {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:21:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-754cf086-af5d-4f3f-b271-f3634aedf181 req-8ebc43a6-c048-4453-b5f5-455610aa8b14 service nova] Acquiring lock "84bae51e-2a85-442d-bbd2-fc89f30f40b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:21:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-754cf086-af5d-4f3f-b271-f3634aedf181 req-8ebc43a6-c048-4453-b5f5-455610aa8b14 service nova] Lock "84bae51e-2a85-442d-bbd2-fc89f30f40b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:21:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-754cf086-af5d-4f3f-b271-f3634aedf181 req-8ebc43a6-c048-4453-b5f5-455610aa8b14 service nova] Lock "84bae51e-2a85-442d-bbd2-fc89f30f40b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:21:48 user nova-compute[75245]: DEBUG nova.compute.manager [req-754cf086-af5d-4f3f-b271-f3634aedf181 req-8ebc43a6-c048-4453-b5f5-455610aa8b14 service nova] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] No waiting events found dispatching network-vif-plugged-27fc0374-0770-4171-a730-6696b09362eb {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:21:48 user nova-compute[75245]: WARNING nova.compute.manager [req-754cf086-af5d-4f3f-b271-f3634aedf181 req-8ebc43a6-c048-4453-b5f5-455610aa8b14 service nova] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Received unexpected event network-vif-plugged-27fc0374-0770-4171-a730-6696b09362eb for instance with vm_state active and task_state resize_migrating.
Nov 29 16:21:48 user nova-compute[75245]: DEBUG nova.network.neutron [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Successfully created port: 116d08d0-5549-4438-b689-0bbda3a5934f {{(pid=75245) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 16:21:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:21:49 user nova-compute[75245]: DEBUG nova.network.neutron [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Port 27fc0374-0770-4171-a730-6696b09362eb binding to destination host user is already ACTIVE {{(pid=75245) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 29 16:21:49 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Acquiring lock "84bae51e-2a85-442d-bbd2-fc89f30f40b7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:21:49 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Lock "84bae51e-2a85-442d-bbd2-fc89f30f40b7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:21:49 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Lock "84bae51e-2a85-442d-bbd2-fc89f30f40b7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:21:49 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Acquiring lock "refresh_cache-84bae51e-2a85-442d-bbd2-fc89f30f40b7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:21:49 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Acquired lock "refresh_cache-84bae51e-2a85-442d-bbd2-fc89f30f40b7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:21:49 user nova-compute[75245]: DEBUG nova.network.neutron [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 16:21:49 user nova-compute[75245]: DEBUG nova.network.neutron [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Successfully updated port: 116d08d0-5549-4438-b689-0bbda3a5934f {{(pid=75245) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 16:21:49 user nova-compute[75245]: DEBUG nova.compute.manager [req-6eb19fd2-64a0-4476-a56a-b9d5dc5ce8c9 req-b01bc9e0-6f77-4a6a-b7c1-0f0ba6dc60b3 service nova] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Received event network-changed-116d08d0-5549-4438-b689-0bbda3a5934f {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:21:49 user nova-compute[75245]: DEBUG nova.compute.manager [req-6eb19fd2-64a0-4476-a56a-b9d5dc5ce8c9 req-b01bc9e0-6f77-4a6a-b7c1-0f0ba6dc60b3 service nova] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Refreshing instance network info cache due to event network-changed-116d08d0-5549-4438-b689-0bbda3a5934f. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:21:49 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-6eb19fd2-64a0-4476-a56a-b9d5dc5ce8c9 req-b01bc9e0-6f77-4a6a-b7c1-0f0ba6dc60b3 service nova] Acquiring lock "refresh_cache-5de7e10c-f216-46b3-8f74-57bac6ab7e56" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:21:49 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-6eb19fd2-64a0-4476-a56a-b9d5dc5ce8c9 req-b01bc9e0-6f77-4a6a-b7c1-0f0ba6dc60b3 service nova] Acquired lock "refresh_cache-5de7e10c-f216-46b3-8f74-57bac6ab7e56" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:21:49 user nova-compute[75245]: DEBUG nova.network.neutron [req-6eb19fd2-64a0-4476-a56a-b9d5dc5ce8c9 req-b01bc9e0-6f77-4a6a-b7c1-0f0ba6dc60b3 service nova] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Refreshing network info cache for port 116d08d0-5549-4438-b689-0bbda3a5934f {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:21:49 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Acquiring lock "refresh_cache-5de7e10c-f216-46b3-8f74-57bac6ab7e56" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:21:49 user nova-compute[75245]: DEBUG nova.network.neutron [req-6eb19fd2-64a0-4476-a56a-b9d5dc5ce8c9 req-b01bc9e0-6f77-4a6a-b7c1-0f0ba6dc60b3 service nova] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Instance cache missing network info. {{(pid=75245) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 16:21:50 user nova-compute[75245]: DEBUG nova.network.neutron [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Updating instance_info_cache with network_info: [{"id": "27fc0374-0770-4171-a730-6696b09362eb", "address": "fa:16:3e:d1:e4:30", "network": {"id": "e38d9eed-b29b-4a4c-b084-876554dc5263", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1284740336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c018212e0654c4db442ca65a386f397", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27fc0374-07", "ovs_interfaceid": "27fc0374-0770-4171-a730-6696b09362eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:21:50 user nova-compute[75245]: DEBUG nova.network.neutron [req-6eb19fd2-64a0-4476-a56a-b9d5dc5ce8c9 req-b01bc9e0-6f77-4a6a-b7c1-0f0ba6dc60b3 service nova] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:21:50 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-6eb19fd2-64a0-4476-a56a-b9d5dc5ce8c9 req-b01bc9e0-6f77-4a6a-b7c1-0f0ba6dc60b3 service nova] Releasing lock "refresh_cache-5de7e10c-f216-46b3-8f74-57bac6ab7e56" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:21:50 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Acquired lock "refresh_cache-5de7e10c-f216-46b3-8f74-57bac6ab7e56" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:21:50 user nova-compute[75245]: DEBUG nova.network.neutron [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 16:21:50 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Releasing lock "refresh_cache-84bae51e-2a85-442d-bbd2-fc89f30f40b7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:21:50 user nova-compute[75245]: DEBUG nova.network.neutron [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Instance cache missing network info. {{(pid=75245) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 16:21:50 user nova-compute[75245]: DEBUG os_brick.utils [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:21:50 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:50 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:50 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b689d6-44c1-48e1-b13f-864de13698db]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:69ed8ed87091\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:21:50 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:50 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:50 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[096deb19-8af0-4d9d-8f80-058fdd124ecf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:21:50 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:50 user nova-compute[75245]: DEBUG nova.compute.manager [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Instance event wait completed in 0 seconds for  {{(pid=75245) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 16:21:50 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Guest created on hypervisor {{(pid=75245) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 16:21:50 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:50 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5867085-71e1-49b6-9e69-4de8caee093d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:21:50 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3221824-8ac6-463b-a508-7ea338981931]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:21:50 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Running cmd (subprocess): nvme version {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:50 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] 'nvme version' failed. Not Retrying. {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:21:50 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Instance spawned successfully.
Nov 29 16:21:50 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.nvmeof [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] nvme not present on system {{(pid=75245) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 16:21:50 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 16:21:50 user nova-compute[75245]: DEBUG nova.compute.manager [req-fc917919-f24e-42ff-8d8e-04bb806d6d1d req-1122204d-c1a4-40f6-bf09-4c67c6489007 service nova] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Received event network-vif-plugged-497aee0b-487f-4138-9394-a68c8bd55e61 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:21:50 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-fc917919-f24e-42ff-8d8e-04bb806d6d1d req-1122204d-c1a4-40f6-bf09-4c67c6489007 service nova] Acquiring lock "d42fa9b3-91c3-4216-91f1-655ce140425f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:21:50 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-fc917919-f24e-42ff-8d8e-04bb806d6d1d req-1122204d-c1a4-40f6-bf09-4c67c6489007 service nova] Lock "d42fa9b3-91c3-4216-91f1-655ce140425f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:21:50 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-fc917919-f24e-42ff-8d8e-04bb806d6d1d req-1122204d-c1a4-40f6-bf09-4c67c6489007 service nova] Lock "d42fa9b3-91c3-4216-91f1-655ce140425f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:21:50 user nova-compute[75245]: DEBUG nova.compute.manager [req-fc917919-f24e-42ff-8d8e-04bb806d6d1d req-1122204d-c1a4-40f6-bf09-4c67c6489007 service nova] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] No waiting events found dispatching network-vif-plugged-497aee0b-487f-4138-9394-a68c8bd55e61 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:21:50 user nova-compute[75245]: WARNING nova.compute.manager [req-fc917919-f24e-42ff-8d8e-04bb806d6d1d req-1122204d-c1a4-40f6-bf09-4c67c6489007 service nova] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Received unexpected event network-vif-plugged-497aee0b-487f-4138-9394-a68c8bd55e61 for instance with vm_state building and task_state spawning.
Nov 29 16:21:50 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:50 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:21:50 user nova-compute[75245]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 16:21:50 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c60af8-b933-408e-baa4-fccea6eab801]: (4, '') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:21:50 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75245) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 16:21:50 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 16:21:50 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] LIGHTOS: no hostnqn found. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 16:21:50 user nova-compute[75245]: DEBUG os_brick.utils [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:69ed8ed87091', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:21:50 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Found default for hw_cdrom_bus of ide {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:21:50 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Found default for hw_disk_bus of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:21:50 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Found default for hw_input_bus of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:21:50 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Found default for hw_pointer_model of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:21:50 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Found default for hw_video_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:21:50 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Found default for hw_vif_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:21:50 user nova-compute[75245]: INFO nova.compute.manager [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Took 5.52 seconds to spawn the instance on the hypervisor.
Nov 29 16:21:50 user nova-compute[75245]: DEBUG nova.compute.manager [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:21:50 user nova-compute[75245]: INFO nova.compute.manager [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Took 14.87 seconds to build instance.
Nov 29 16:21:50 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-710333fe-527f-4a7d-8ade-58f4a90dd6d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "d42fa9b3-91c3-4216-91f1-655ce140425f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:21:50 user nova-compute[75245]: DEBUG nova.network.neutron [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Updating instance_info_cache with network_info: [{"id": "116d08d0-5549-4438-b689-0bbda3a5934f", "address": "fa:16:3e:97:fb:c7", "network": {"id": "6a7f7426-b595-4aa3-bf80-cc92ba7ce15e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-917300903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d52776451e947f5a9ef3fa44ac8acbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap116d08d0-55", "ovs_interfaceid": "116d08d0-5549-4438-b689-0bbda3a5934f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:21:50 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Releasing lock "refresh_cache-5de7e10c-f216-46b3-8f74-57bac6ab7e56" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:21:50 user nova-compute[75245]: DEBUG nova.compute.manager [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Instance network_info: |[{"id": "116d08d0-5549-4438-b689-0bbda3a5934f", "address": "fa:16:3e:97:fb:c7", "network": {"id": "6a7f7426-b595-4aa3-bf80-cc92ba7ce15e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-917300903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d52776451e947f5a9ef3fa44ac8acbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap116d08d0-55", "ovs_interfaceid": "116d08d0-5549-4438-b689-0bbda3a5934f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 16:21:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:21:52 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:21:53 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:21:53 user nova-compute[75245]: DEBUG os_brick.utils [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:21:53 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:53 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:53 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[c02fc60a-ad3a-4911-b5b4-416f7540e275]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:69ed8ed87091\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:21:53 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:53 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:53 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b58267-2f23-4b2d-99b8-25bc9519d8ab]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:21:53 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:53 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:53 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ba79dc-4750-4282-af8b-e282046dbae1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:21:53 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[414f5b1e-ef34-4cff-b5d5-f44cf70379c0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:21:53 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Running cmd (subprocess): nvme version {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:53 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] 'nvme version' failed. Not Retrying. {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:21:53 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] nvme not present on system {{(pid=75245) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 16:21:53 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:53 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:21:53 user nova-compute[75245]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 16:21:53 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3c964a-67c7-4a66-b185-fa132fe5c6bf]: (4, '') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:21:53 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75245) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 16:21:53 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 16:21:53 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] LIGHTOS: no hostnqn found. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 16:21:53 user nova-compute[75245]: DEBUG os_brick.utils [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:69ed8ed87091', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:21:53 user nova-compute[75245]: DEBUG nova.virt.block_device [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Updating existing volume attachment record: 44cf4c75-fc30-4192-9d06-8bfd65b51e0f {{(pid=75245) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 16:21:56 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:21:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:21:58 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Starting finish_migration {{(pid=75245) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11671}}
Nov 29 16:21:58 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Instance directory exists: not creating {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 16:21:58 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Creating image(s)
Nov 29 16:21:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.182s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Checking if we can resize image /opt/stack/data/nova/instances/84bae51e-2a85-442d-bbd2-fc89f30f40b7/disk. size=21474836480 {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bae51e-2a85-442d-bbd2-fc89f30f40b7/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bae51e-2a85-442d-bbd2-fc89f30f40b7/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/84bae51e-2a85-442d-bbd2-fc89f30f40b7/disk 21474836480 {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/84bae51e-2a85-442d-bbd2-fc89f30f40b7/disk 21474836480" returned: 0 in 0.074s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Did not create local disks {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Ensure instance console log exists: /opt/stack/data/nova/instances/84bae51e-2a85-442d-bbd2-fc89f30f40b7/console.log {{(pid=75245) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Start _get_guest_xml network_info=[{"id": "27fc0374-0770-4171-a730-6696b09362eb", "address": "fa:16:3e:d1:e4:30", "network": {"id": "e38d9eed-b29b-4a4c-b084-876554dc5263", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1284740336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1284740336-network", "vif_mac": "fa:16:3e:d1:e4:30"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c018212e0654c4db442ca65a386f397", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27fc0374-07", "ovs_interfaceid": "27fc0374-0770-4171-a730-6696b09362eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'a291d9c3-be02-4c6c-9649-4b45c5b7f487'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'attachment_id': 'a39ba919-c685-4a53-bb9e-9ffd6a3bc03d', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UPxkSWMT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '84bae51e-2a85-442d-bbd2-fc89f30f40b7', 'attached_at': '2023-11-29T16:21:59.000000', 'detached_at': '', 'volume_id': '0534d649-6af0-440a-86de-eadff936597e', 'serial': '0534d649-6af0-440a-86de-eadff936597e'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'guest_format': None, 'volume_type': None} {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Starting heal instance info cache {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 16:21:59 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:21:59 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:21:59 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] CPU controller missing on host. {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] CPU controller found on host. {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75245) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T16:06:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Flavor limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Image limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Flavor pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Image pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Got 1 possible topologies {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Calling os-brick to attach iSCSI Volume {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UPxkSWMT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:21:59 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:21:59 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:21:59 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:21:59 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:21:59 user nova-compute[75245]: INFO os_brick.initiator.connectors.iscsi [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 16:21:59 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "refresh_cache-84bae51e-2a85-442d-bbd2-fc89f30f40b7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquired lock "refresh_cache-84bae51e-2a85-442d-bbd2-fc89f30f40b7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Forcefully refreshing network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e -p 172.16.0.220:3260 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf31b11-f526-454d-a25a-eb01027d11d4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 16:21:59 user nova-compute[75245]:  {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e -p 172.16.0.220:3260 --interface default --op new {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[54061fb5-728f-4c11-bd79-b4129f2b11c3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e] added\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e] added
Nov 29 16:21:59 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[85db7ab9-fa64-4f5f-ad3b-f5c17c6b75e8]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[6882ea7e-f42a-45c2-9d23-fb52bafca5f8]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UPxkSWMT {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UPxkSWMT" returned: 0 in 0.025s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[f67ff3ab-c537-4059-b626-8c63aba83ab7]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UPxkSWMT'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f404d4-a8f6-4690-9897-6d4ffa3e88b1]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[c41a6eb3-67e7-43d9-b444-f451536a481f]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 (non-flash)
Nov 29 16:21:59 user nova-compute[75245]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f (non-flash)
Nov 29 16:21:59 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 (non-flash)
Nov 29 16:21:59 user nova-compute[75245]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f (non-flash)
Nov 29 16:21:59 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e -p 172.16.0.220:3260 --login {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca6c0796-d3e5-4428-9d63-81b1cf6010db]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e, portal: 172.16.0.220,3260]
Nov 29 16:21:59 user nova-compute[75245]: Login to [iface: default, target: iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e, portal: 172.16.0.220,3260] successful.
Nov 29 16:21:59 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[103c3d46-8dc5-4887-842f-bdccc1a5d331]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c84386-a0d0-401f-ac0b-bcd7c7def5f6]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 (non-flash)
Nov 29 16:21:59 user nova-compute[75245]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f (non-flash)
Nov 29 16:21:59 user nova-compute[75245]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e (non-flash)
Nov 29 16:21:59 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 (non-flash)
Nov 29 16:21:59 user nova-compute[75245]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f (non-flash)
Nov 29 16:21:59 user nova-compute[75245]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e (non-flash)
Nov 29 16:21:59 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Connected to 172.16.0.220:3260 {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] HCTL ('34', '-', '-', 0) found on session 29 with lun 0 {{(pid=75245) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75245) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f518ff-f15b-4994-9cc9-0f6a9cbb9b3e]: (4, ('- - 0', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Searching for a device in session 29 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75245) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 16:21:59 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UPxkSWMT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 16:22:00 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Updating instance_info_cache with network_info: [{"id": "27fc0374-0770-4171-a730-6696b09362eb", "address": "fa:16:3e:d1:e4:30", "network": {"id": "e38d9eed-b29b-4a4c-b084-876554dc5263", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1284740336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c018212e0654c4db442ca65a386f397", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27fc0374-07", "ovs_interfaceid": "27fc0374-0770-4171-a730-6696b09362eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:22:00 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Releasing lock "refresh_cache-84bae51e-2a85-442d-bbd2-fc89f30f40b7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:22:00 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Updated the network info_cache for instance {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 16:22:00 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:22:00 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:22:00 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.360s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:22:00 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '23933616436303938', 'path': '/dev/sdc'} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:22:00 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23933616436303938', 'path': '/dev/sdc'} {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 16:22:00 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:17:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-185985516',display_name='tempest-ServerActionsTestOtherB-server-185985516',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-185985516',id=20,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMGVVYk91CF4EJNlPGJ16B9aebX0g0461zoNkayBpAbBcPtumcB5nsUcunIZSLwTkPZC3DIGJ81mZLNGLk1xqtQ18lArBUMtmLGCUS7pb+CbAh4z22M0J6OlcUXZFjAglA==',key_name='tempest-keypair-1103342865',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:17:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3c018212e0654c4db442ca65a386f397',ramdisk_id='',reservation_id='r-rarysz12',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1446057763',owner_user_name='tempest-ServerActionsTestOtherB-1446057763-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:21:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecd08c449e8643c2b0eb4b2dc8cd7780',uuid=84bae51e-2a85-442d-bbd2-fc89f30f40b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "27fc0374-0770-4171-a730-6696b09362eb", "address": "fa:16:3e:d1:e4:30", "network": {"id": "e38d9eed-b29b-4a4c-b084-876554dc5263", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1284740336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1284740336-network", "vif_mac": "fa:16:3e:d1:e4:30"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c018212e0654c4db442ca65a386f397", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27fc0374-07", "ovs_interfaceid": "27fc0374-0770-4171-a730-6696b09362eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:22:00 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Converting VIF {"id": "27fc0374-0770-4171-a730-6696b09362eb", "address": "fa:16:3e:d1:e4:30", "network": {"id": "e38d9eed-b29b-4a4c-b084-876554dc5263", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1284740336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1284740336-network", "vif_mac": "fa:16:3e:d1:e4:30"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c018212e0654c4db442ca65a386f397", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27fc0374-07", "ovs_interfaceid": "27fc0374-0770-4171-a730-6696b09362eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:22:00 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:e4:30,bridge_name='br-int',has_traffic_filtering=True,id=27fc0374-0770-4171-a730-6696b09362eb,network=Network(e38d9eed-b29b-4a4c-b084-876554dc5263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27fc0374-07') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:22:00 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] End _get_guest_xml xml=<domain type="kvm">
Nov 29 16:22:00 user nova-compute[75245]:   <uuid>84bae51e-2a85-442d-bbd2-fc89f30f40b7</uuid>
Nov 29 16:22:00 user nova-compute[75245]:   <name>instance-00000014</name>
Nov 29 16:22:00 user nova-compute[75245]:   <memory>2097152</memory>
Nov 29 16:22:00 user nova-compute[75245]:   <vcpu>1</vcpu>
Nov 29 16:22:00 user nova-compute[75245]:   <metadata>
Nov 29 16:22:00 user nova-compute[75245]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 16:22:00 user nova-compute[75245]:       <nova:package version="0.0.0"/>
Nov 29 16:22:00 user nova-compute[75245]:       <nova:name>tempest-ServerActionsTestOtherB-server-185985516</nova:name>
Nov 29 16:22:00 user nova-compute[75245]:       <nova:creationTime>2023-11-29 16:21:59</nova:creationTime>
Nov 29 16:22:00 user nova-compute[75245]:       <nova:flavor name="m1.small">
Nov 29 16:22:00 user nova-compute[75245]:         <nova:memory>2048</nova:memory>
Nov 29 16:22:00 user nova-compute[75245]:         <nova:disk>20</nova:disk>
Nov 29 16:22:00 user nova-compute[75245]:         <nova:swap>0</nova:swap>
Nov 29 16:22:00 user nova-compute[75245]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 16:22:00 user nova-compute[75245]:         <nova:vcpus>1</nova:vcpus>
Nov 29 16:22:00 user nova-compute[75245]:       </nova:flavor>
Nov 29 16:22:00 user nova-compute[75245]:       <nova:owner>
Nov 29 16:22:00 user nova-compute[75245]:         <nova:user uuid="ecd08c449e8643c2b0eb4b2dc8cd7780">tempest-ServerActionsTestOtherB-1446057763-project-member</nova:user>
Nov 29 16:22:00 user nova-compute[75245]:         <nova:project uuid="3c018212e0654c4db442ca65a386f397">tempest-ServerActionsTestOtherB-1446057763</nova:project>
Nov 29 16:22:00 user nova-compute[75245]:       </nova:owner>
Nov 29 16:22:00 user nova-compute[75245]:       <nova:root type="image" uuid="a291d9c3-be02-4c6c-9649-4b45c5b7f487"/>
Nov 29 16:22:00 user nova-compute[75245]:       <nova:ports>
Nov 29 16:22:00 user nova-compute[75245]:         <nova:port uuid="27fc0374-0770-4171-a730-6696b09362eb">
Nov 29 16:22:00 user nova-compute[75245]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 16:22:00 user nova-compute[75245]:         </nova:port>
Nov 29 16:22:00 user nova-compute[75245]:       </nova:ports>
Nov 29 16:22:00 user nova-compute[75245]:     </nova:instance>
Nov 29 16:22:00 user nova-compute[75245]:   </metadata>
Nov 29 16:22:00 user nova-compute[75245]:   <sysinfo type="smbios">
Nov 29 16:22:00 user nova-compute[75245]:     <system>
Nov 29 16:22:00 user nova-compute[75245]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 16:22:00 user nova-compute[75245]:       <entry name="product">OpenStack Nova</entry>
Nov 29 16:22:00 user nova-compute[75245]:       <entry name="version">0.0.0</entry>
Nov 29 16:22:00 user nova-compute[75245]:       <entry name="serial">84bae51e-2a85-442d-bbd2-fc89f30f40b7</entry>
Nov 29 16:22:00 user nova-compute[75245]:       <entry name="uuid">84bae51e-2a85-442d-bbd2-fc89f30f40b7</entry>
Nov 29 16:22:00 user nova-compute[75245]:       <entry name="family">Virtual Machine</entry>
Nov 29 16:22:00 user nova-compute[75245]:     </system>
Nov 29 16:22:00 user nova-compute[75245]:   </sysinfo>
Nov 29 16:22:00 user nova-compute[75245]:   <os>
Nov 29 16:22:00 user nova-compute[75245]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 16:22:00 user nova-compute[75245]:     <boot dev="hd"/>
Nov 29 16:22:00 user nova-compute[75245]:     <smbios mode="sysinfo"/>
Nov 29 16:22:00 user nova-compute[75245]:   </os>
Nov 29 16:22:00 user nova-compute[75245]:   <features>
Nov 29 16:22:00 user nova-compute[75245]:     <acpi/>
Nov 29 16:22:00 user nova-compute[75245]:     <apic/>
Nov 29 16:22:00 user nova-compute[75245]:     <vmcoreinfo/>
Nov 29 16:22:00 user nova-compute[75245]:   </features>
Nov 29 16:22:00 user nova-compute[75245]:   <clock offset="utc">
Nov 29 16:22:00 user nova-compute[75245]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 16:22:00 user nova-compute[75245]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 16:22:00 user nova-compute[75245]:     <timer name="hpet" present="no"/>
Nov 29 16:22:00 user nova-compute[75245]:   </clock>
Nov 29 16:22:00 user nova-compute[75245]:   <cpu mode="custom" match="exact">
Nov 29 16:22:00 user nova-compute[75245]:     <model>Nehalem</model>
Nov 29 16:22:00 user nova-compute[75245]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 16:22:00 user nova-compute[75245]:   </cpu>
Nov 29 16:22:00 user nova-compute[75245]:   <devices>
Nov 29 16:22:00 user nova-compute[75245]:     <disk type="file" device="disk">
Nov 29 16:22:00 user nova-compute[75245]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 16:22:00 user nova-compute[75245]:       <source file="/opt/stack/data/nova/instances/84bae51e-2a85-442d-bbd2-fc89f30f40b7/disk"/>
Nov 29 16:22:00 user nova-compute[75245]:       <target dev="vda" bus="virtio"/>
Nov 29 16:22:00 user nova-compute[75245]:     </disk>
Nov 29 16:22:00 user nova-compute[75245]:     <disk type="block" device="disk">
Nov 29 16:22:00 user nova-compute[75245]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:22:00 user nova-compute[75245]:       <source dev="/dev/sdc"/>
Nov 29 16:22:00 user nova-compute[75245]:       <target dev="vdb" bus="virtio"/>
Nov 29 16:22:00 user nova-compute[75245]:       <serial>0534d649-6af0-440a-86de-eadff936597e</serial>
Nov 29 16:22:00 user nova-compute[75245]:     </disk>
Nov 29 16:22:00 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 16:22:00 user nova-compute[75245]:       <mac address="fa:16:3e:d1:e4:30"/>
Nov 29 16:22:00 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:22:00 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 16:22:00 user nova-compute[75245]:       <target dev="tap27fc0374-07"/>
Nov 29 16:22:00 user nova-compute[75245]:     </interface>
Nov 29 16:22:00 user nova-compute[75245]:     <serial type="pty">
Nov 29 16:22:00 user nova-compute[75245]:       <log file="/opt/stack/data/nova/instances/84bae51e-2a85-442d-bbd2-fc89f30f40b7/console.log" append="off"/>
Nov 29 16:22:00 user nova-compute[75245]:     </serial>
Nov 29 16:22:00 user nova-compute[75245]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 16:22:00 user nova-compute[75245]:     <video>
Nov 29 16:22:00 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:22:00 user nova-compute[75245]:     </video>
Nov 29 16:22:00 user nova-compute[75245]:     <rng model="virtio">
Nov 29 16:22:00 user nova-compute[75245]:       <backend model="random">/dev/urandom</backend>
Nov 29 16:22:00 user nova-compute[75245]:     </rng>
Nov 29 16:22:00 user nova-compute[75245]:     <controller type="usb" index="0" model="none"/>
Nov 29 16:22:00 user nova-compute[75245]:     <memballoon model="virtio">
Nov 29 16:22:00 user nova-compute[75245]:       <stats period="10"/>
Nov 29 16:22:00 user nova-compute[75245]:     </memballoon>
Nov 29 16:22:00 user nova-compute[75245]:   </devices>
Nov 29 16:22:00 user nova-compute[75245]: </domain>
Nov 29 16:22:00 user nova-compute[75245]:  {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 16:22:01 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:17:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-185985516',display_name='tempest-ServerActionsTestOtherB-server-185985516',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-185985516',id=20,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMGVVYk91CF4EJNlPGJ16B9aebX0g0461zoNkayBpAbBcPtumcB5nsUcunIZSLwTkPZC3DIGJ81mZLNGLk1xqtQ18lArBUMtmLGCUS7pb+CbAh4z22M0J6OlcUXZFjAglA==',key_name='tempest-keypair-1103342865',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:17:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3c018212e0654c4db442ca65a386f397',ramdisk_id='',reservation_id='r-rarysz12',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1446057763',owner_user_name='tempest-ServerActionsTestOtherB-1446057763-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:21:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecd08c449e8643c2b0eb4b2dc8cd7780',uuid=84bae51e-2a85-442d-bbd2-fc89f30f40b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "27fc0374-0770-4171-a730-6696b09362eb", "address": "fa:16:3e:d1:e4:30", "network": {"id": "e38d9eed-b29b-4a4c-b084-876554dc5263", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1284740336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1284740336-network", "vif_mac": "fa:16:3e:d1:e4:30"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c018212e0654c4db442ca65a386f397", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27fc0374-07", "ovs_interfaceid": "27fc0374-0770-4171-a730-6696b09362eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 16:22:01 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Converting VIF {"id": "27fc0374-0770-4171-a730-6696b09362eb", "address": "fa:16:3e:d1:e4:30", "network": {"id": "e38d9eed-b29b-4a4c-b084-876554dc5263", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1284740336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1284740336-network", "vif_mac": "fa:16:3e:d1:e4:30"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c018212e0654c4db442ca65a386f397", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27fc0374-07", "ovs_interfaceid": "27fc0374-0770-4171-a730-6696b09362eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:22:01 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:e4:30,bridge_name='br-int',has_traffic_filtering=True,id=27fc0374-0770-4171-a730-6696b09362eb,network=Network(e38d9eed-b29b-4a4c-b084-876554dc5263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27fc0374-07') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:22:01 user nova-compute[75245]: DEBUG os_vif [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:e4:30,bridge_name='br-int',has_traffic_filtering=True,id=27fc0374-0770-4171-a730-6696b09362eb,network=Network(e38d9eed-b29b-4a4c-b084-876554dc5263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27fc0374-07') {{(pid=75245) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 16:22:01 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:22:01 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:22:01 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 16:22:01 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:22:01 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fb342857-b7c7-5f40-b45a-63f3fe5e782f', '_type': 'linux-noop'}}, row=False) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:22:01 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:22:01 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:22:01 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:22:01 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap27fc0374-07, may_exist=True, interface_attrs={}) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:22:01 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap27fc0374-07, col_values=(('qos', UUID('1d46548e-6fc0-4dd1-ab38-d689e53a3630')),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:22:01 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap27fc0374-07, col_values=(('external_ids', {'iface-id': '27fc0374-0770-4171-a730-6696b09362eb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:e4:30', 'vm-uuid': '84bae51e-2a85-442d-bbd2-fc89f30f40b7'}),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:22:01 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:22:01 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:22:01 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:22:01 user nova-compute[75245]: INFO os_vif [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:e4:30,bridge_name='br-int',has_traffic_filtering=True,id=27fc0374-0770-4171-a730-6696b09362eb,network=Network(e38d9eed-b29b-4a4c-b084-876554dc5263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27fc0374-07')
Nov 29 16:22:01 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:22:01 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:22:01 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] No VIF found with MAC fa:16:3e:d1:e4:30, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:22:01 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:22:01 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:22:01 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:22:01 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:22:01 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75245) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 16:22:01 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:22:02 user nova-compute[75245]: DEBUG nova.compute.manager [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Start spawning the instance on the hypervisor. {{(pid=75245) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 16:22:02 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Creating instance directory {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 16:22:02 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Creating image(s)
Nov 29 16:22:02 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Did not create local disks {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 16:22:02 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Ensure instance console log exists: /opt/stack/data/nova/instances/5de7e10c-f216-46b3-8f74-57bac6ab7e56/console.log {{(pid=75245) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 16:22:02 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:22:02 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:22:02 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:22:02 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Start _get_guest_xml network_info=[{"id": "116d08d0-5549-4438-b689-0bbda3a5934f", "address": "fa:16:3e:97:fb:c7", "network": {"id": "6a7f7426-b595-4aa3-bf80-cc92ba7ce15e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-917300903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d52776451e947f5a9ef3fa44ac8acbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap116d08d0-55", "ovs_interfaceid": "116d08d0-5549-4438-b689-0bbda3a5934f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '44cf4c75-fc30-4192-9d06-8bfd65b51e0f', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TlHrZFpQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5de7e10c-f216-46b3-8f74-57bac6ab7e56', 'attached_at': '', 'detached_at': '', 'volume_id': '02359d7f-e8f6-408e-961c-64d566ea0eed', 'serial': '02359d7f-e8f6-408e-961c-64d566ea0eed'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'guest_format': None, 'volume_type': None} {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 16:22:02 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:22:02 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:22:02 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 16:22:02 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] CPU controller missing on host. {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 16:22:02 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 16:22:02 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] CPU controller found on host. {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 16:22:02 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75245) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 16:22:02 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T16:06:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 16:22:02 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Flavor limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 16:22:02 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Image limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 16:22:02 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Flavor pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 16:22:02 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Image pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 16:22:02 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 16:22:02 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 16:22:02 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 16:22:02 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Got 1 possible topologies {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 16:22:02 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 16:22:02 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 16:22:02 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Calling os-brick to attach iSCSI Volume {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 16:22:02 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TlHrZFpQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:22:02 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:22:02 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:22:02 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:22:02 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:22:02 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:22:02 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:22:02 user nova-compute[75245]: INFO os_brick.initiator.connectors.iscsi [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 16:22:02 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed -p 172.16.0.220:3260 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:22:02 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:22:02 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[11849da7-75f9-4c3f-9e96-3b8d5f9edcee]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:22:02 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 16:22:02 user nova-compute[75245]:  {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:22:02 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed -p 172.16.0.220:3260 --interface default --op new {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:22:02 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:22:02 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64452f0-5cec-4c3b-a51f-16a878e15b1b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed] added\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:22:02 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed] added
Nov 29 16:22:02 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:22:02 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:22:02 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:22:02 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef9009a-61f5-4306-b033-f4d34c407b07]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:22:02 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:22:02 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:22:02 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:22:02 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac40e07a-a359-4755-8840-0cdbc41aa238]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:22:02 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:22:02 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TlHrZFpQ {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:22:02 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TlHrZFpQ" returned: 0 in 0.022s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:22:02 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4170cd-b8fe-477b-8c4a-1fbcfd64931e]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:22:02 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TlHrZFpQ'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:22:02 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:22:02 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:22:02 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7120ff-95a8-4e8b-94dc-f7c2f00b737d]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:22:02 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:22:02 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:22:02 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:22:02 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f34b936-c6d9-463b-9984-be7747b1f7c7]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:22:02 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 (non-flash)
Nov 29 16:22:02 user nova-compute[75245]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f (non-flash)
Nov 29 16:22:02 user nova-compute[75245]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e (non-flash)
Nov 29 16:22:02 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:22:02 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 (non-flash)
Nov 29 16:22:02 user nova-compute[75245]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f (non-flash)
Nov 29 16:22:02 user nova-compute[75245]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e (non-flash)
Nov 29 16:22:02 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:22:02 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed -p 172.16.0.220:3260 --login {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:22:02 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:22:02 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:22:02 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:22:02 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d685f1-76ce-45f8-bbaa-7f9d02312549]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:22:02 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed, portal: 172.16.0.220,3260]
Nov 29 16:22:02 user nova-compute[75245]: Login to [iface: default, target: iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed, portal: 172.16.0.220,3260] successful.
Nov 29 16:22:02 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:22:02 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:22:02 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:22:02 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:22:02 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[574690f9-cfae-410e-bc1e-2c0e8fa05a08]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:22:02 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:22:02 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:22:02 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:22:02 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c4c14a4-e3c6-47e7-95a1-687416978f11]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:22:02 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 (non-flash)
Nov 29 16:22:02 user nova-compute[75245]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f (non-flash)
Nov 29 16:22:02 user nova-compute[75245]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e (non-flash)
Nov 29 16:22:02 user nova-compute[75245]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)
Nov 29 16:22:02 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:22:02 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 (non-flash)
Nov 29 16:22:02 user nova-compute[75245]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f (non-flash)
Nov 29 16:22:02 user nova-compute[75245]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e (non-flash)
Nov 29 16:22:02 user nova-compute[75245]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)
Nov 29 16:22:02 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:22:02 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.353s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:22:02 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Connected to 172.16.0.220:3260 {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 16:22:02 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] HCTL ('36', '-', '-', 0) found on session 30 with lun 0 {{(pid=75245) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 16:22:02 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75245) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 16:22:02 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:22:02 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.024s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:22:02 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9936a08-afc4-45e8-874b-38863d991196]: (4, ('- - 0', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:22:02 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Searching for a device in session 30 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75245) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 16:22:02 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TlHrZFpQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 16:22:03 user nova-compute[75245]: DEBUG nova.compute.manager [req-dd598b25-58d8-4eb9-b966-5d629a50735e req-12ce720b-fa8c-4e2a-8b04-c0237e9c8ca3 service nova] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Received event network-vif-plugged-27fc0374-0770-4171-a730-6696b09362eb {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:22:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-dd598b25-58d8-4eb9-b966-5d629a50735e req-12ce720b-fa8c-4e2a-8b04-c0237e9c8ca3 service nova] Acquiring lock "84bae51e-2a85-442d-bbd2-fc89f30f40b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:22:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-dd598b25-58d8-4eb9-b966-5d629a50735e req-12ce720b-fa8c-4e2a-8b04-c0237e9c8ca3 service nova] Lock "84bae51e-2a85-442d-bbd2-fc89f30f40b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:22:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-dd598b25-58d8-4eb9-b966-5d629a50735e req-12ce720b-fa8c-4e2a-8b04-c0237e9c8ca3 service nova] Lock "84bae51e-2a85-442d-bbd2-fc89f30f40b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:22:03 user nova-compute[75245]: DEBUG nova.compute.manager [req-dd598b25-58d8-4eb9-b966-5d629a50735e req-12ce720b-fa8c-4e2a-8b04-c0237e9c8ca3 service nova] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] No waiting events found dispatching network-vif-plugged-27fc0374-0770-4171-a730-6696b09362eb {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:22:03 user nova-compute[75245]: WARNING nova.compute.manager [req-dd598b25-58d8-4eb9-b966-5d629a50735e req-12ce720b-fa8c-4e2a-8b04-c0237e9c8ca3 service nova] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Received unexpected event network-vif-plugged-27fc0374-0770-4171-a730-6696b09362eb for instance with vm_state active and task_state resize_finish.
Nov 29 16:22:03 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:22:03 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:22:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:22:03 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:22:03 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:22:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:22:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:22:03 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:22:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:22:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:22:03 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.399s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:22:03 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] <== connect_volume: return (1404ms) {'type': 'block', 'scsi_wwn': '23231386461326565', 'path': '/dev/sde'} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:22:03 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23231386461326565', 'path': '/dev/sde'} {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 16:22:03 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:21:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1389384608',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1389384608',id=24,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d52776451e947f5a9ef3fa44ac8acbb',ramdisk_id='',reservation_id='r-l3dmntgm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1780163218',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:21:48Z,user_data=None,user_id='4f20e7c9ae22462ea6bc623c93697fce',uuid=5de7e10c-f216-46b3-8f74-57bac6ab7e56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "116d08d0-5549-4438-b689-0bbda3a5934f", "address": "fa:16:3e:97:fb:c7", "network": {"id": "6a7f7426-b595-4aa3-bf80-cc92ba7ce15e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-917300903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d52776451e947f5a9ef3fa44ac8acbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap116d08d0-55", "ovs_interfaceid": "116d08d0-5549-4438-b689-0bbda3a5934f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:22:03 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Converting VIF {"id": "116d08d0-5549-4438-b689-0bbda3a5934f", "address": "fa:16:3e:97:fb:c7", "network": {"id": "6a7f7426-b595-4aa3-bf80-cc92ba7ce15e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-917300903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d52776451e947f5a9ef3fa44ac8acbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap116d08d0-55", "ovs_interfaceid": "116d08d0-5549-4438-b689-0bbda3a5934f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:22:03 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:fb:c7,bridge_name='br-int',has_traffic_filtering=True,id=116d08d0-5549-4438-b689-0bbda3a5934f,network=Network(6a7f7426-b595-4aa3-bf80-cc92ba7ce15e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap116d08d0-55') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:22:03 user nova-compute[75245]: DEBUG nova.objects.instance [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lazy-loading 'pci_devices' on Instance uuid 5de7e10c-f216-46b3-8f74-57bac6ab7e56 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:22:03 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] End _get_guest_xml xml=<domain type="kvm">
Nov 29 16:22:03 user nova-compute[75245]:   <uuid>5de7e10c-f216-46b3-8f74-57bac6ab7e56</uuid>
Nov 29 16:22:03 user nova-compute[75245]:   <name>instance-00000018</name>
Nov 29 16:22:03 user nova-compute[75245]:   <memory>524288</memory>
Nov 29 16:22:03 user nova-compute[75245]:   <vcpu>1</vcpu>
Nov 29 16:22:03 user nova-compute[75245]:   <metadata>
Nov 29 16:22:03 user nova-compute[75245]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 16:22:03 user nova-compute[75245]:       <nova:package version="0.0.0"/>
Nov 29 16:22:03 user nova-compute[75245]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1389384608</nova:name>
Nov 29 16:22:03 user nova-compute[75245]:       <nova:creationTime>2023-11-29 16:22:02</nova:creationTime>
Nov 29 16:22:03 user nova-compute[75245]:       <nova:flavor name="m1.tiny">
Nov 29 16:22:03 user nova-compute[75245]:         <nova:memory>512</nova:memory>
Nov 29 16:22:03 user nova-compute[75245]:         <nova:disk>1</nova:disk>
Nov 29 16:22:03 user nova-compute[75245]:         <nova:swap>0</nova:swap>
Nov 29 16:22:03 user nova-compute[75245]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 16:22:03 user nova-compute[75245]:         <nova:vcpus>1</nova:vcpus>
Nov 29 16:22:03 user nova-compute[75245]:       </nova:flavor>
Nov 29 16:22:03 user nova-compute[75245]:       <nova:owner>
Nov 29 16:22:03 user nova-compute[75245]:         <nova:user uuid="4f20e7c9ae22462ea6bc623c93697fce">tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member</nova:user>
Nov 29 16:22:03 user nova-compute[75245]:         <nova:project uuid="1d52776451e947f5a9ef3fa44ac8acbb">tempest-ServerBootFromVolumeStableRescueTest-1780163218</nova:project>
Nov 29 16:22:03 user nova-compute[75245]:       </nova:owner>
Nov 29 16:22:03 user nova-compute[75245]:       <nova:root type="image" uuid="a291d9c3-be02-4c6c-9649-4b45c5b7f487"/>
Nov 29 16:22:03 user nova-compute[75245]:       <nova:ports>
Nov 29 16:22:03 user nova-compute[75245]:         <nova:port uuid="116d08d0-5549-4438-b689-0bbda3a5934f">
Nov 29 16:22:03 user nova-compute[75245]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 29 16:22:03 user nova-compute[75245]:         </nova:port>
Nov 29 16:22:03 user nova-compute[75245]:       </nova:ports>
Nov 29 16:22:03 user nova-compute[75245]:     </nova:instance>
Nov 29 16:22:03 user nova-compute[75245]:   </metadata>
Nov 29 16:22:03 user nova-compute[75245]:   <sysinfo type="smbios">
Nov 29 16:22:03 user nova-compute[75245]:     <system>
Nov 29 16:22:03 user nova-compute[75245]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 16:22:03 user nova-compute[75245]:       <entry name="product">OpenStack Nova</entry>
Nov 29 16:22:03 user nova-compute[75245]:       <entry name="version">0.0.0</entry>
Nov 29 16:22:03 user nova-compute[75245]:       <entry name="serial">5de7e10c-f216-46b3-8f74-57bac6ab7e56</entry>
Nov 29 16:22:03 user nova-compute[75245]:       <entry name="uuid">5de7e10c-f216-46b3-8f74-57bac6ab7e56</entry>
Nov 29 16:22:03 user nova-compute[75245]:       <entry name="family">Virtual Machine</entry>
Nov 29 16:22:03 user nova-compute[75245]:     </system>
Nov 29 16:22:03 user nova-compute[75245]:   </sysinfo>
Nov 29 16:22:03 user nova-compute[75245]:   <os>
Nov 29 16:22:03 user nova-compute[75245]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 16:22:03 user nova-compute[75245]:     <boot dev="hd"/>
Nov 29 16:22:03 user nova-compute[75245]:     <smbios mode="sysinfo"/>
Nov 29 16:22:03 user nova-compute[75245]:   </os>
Nov 29 16:22:03 user nova-compute[75245]:   <features>
Nov 29 16:22:03 user nova-compute[75245]:     <acpi/>
Nov 29 16:22:03 user nova-compute[75245]:     <apic/>
Nov 29 16:22:03 user nova-compute[75245]:     <vmcoreinfo/>
Nov 29 16:22:03 user nova-compute[75245]:   </features>
Nov 29 16:22:03 user nova-compute[75245]:   <clock offset="utc">
Nov 29 16:22:03 user nova-compute[75245]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 16:22:03 user nova-compute[75245]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 16:22:03 user nova-compute[75245]:     <timer name="hpet" present="no"/>
Nov 29 16:22:03 user nova-compute[75245]:   </clock>
Nov 29 16:22:03 user nova-compute[75245]:   <cpu mode="custom" match="exact">
Nov 29 16:22:03 user nova-compute[75245]:     <model>Nehalem</model>
Nov 29 16:22:03 user nova-compute[75245]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 16:22:03 user nova-compute[75245]:   </cpu>
Nov 29 16:22:03 user nova-compute[75245]:   <devices>
Nov 29 16:22:03 user nova-compute[75245]:     <disk type="block" device="disk">
Nov 29 16:22:03 user nova-compute[75245]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:22:03 user nova-compute[75245]:       <source dev="/dev/sde"/>
Nov 29 16:22:03 user nova-compute[75245]:       <target dev="vda" bus="virtio"/>
Nov 29 16:22:03 user nova-compute[75245]:       <serial>02359d7f-e8f6-408e-961c-64d566ea0eed</serial>
Nov 29 16:22:03 user nova-compute[75245]:     </disk>
Nov 29 16:22:03 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 16:22:03 user nova-compute[75245]:       <mac address="fa:16:3e:97:fb:c7"/>
Nov 29 16:22:03 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:22:03 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 16:22:03 user nova-compute[75245]:       <target dev="tap116d08d0-55"/>
Nov 29 16:22:03 user nova-compute[75245]:     </interface>
Nov 29 16:22:03 user nova-compute[75245]:     <serial type="pty">
Nov 29 16:22:03 user nova-compute[75245]:       <log file="/opt/stack/data/nova/instances/5de7e10c-f216-46b3-8f74-57bac6ab7e56/console.log" append="off"/>
Nov 29 16:22:03 user nova-compute[75245]:     </serial>
Nov 29 16:22:03 user nova-compute[75245]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 16:22:03 user nova-compute[75245]:     <video>
Nov 29 16:22:03 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:22:03 user nova-compute[75245]:     </video>
Nov 29 16:22:03 user nova-compute[75245]:     <rng model="virtio">
Nov 29 16:22:03 user nova-compute[75245]:       <backend model="random">/dev/urandom</backend>
Nov 29 16:22:03 user nova-compute[75245]:     </rng>
Nov 29 16:22:03 user nova-compute[75245]:     <controller type="usb" index="0" model="none"/>
Nov 29 16:22:03 user nova-compute[75245]:     <memballoon model="virtio">
Nov 29 16:22:03 user nova-compute[75245]:       <stats period="10"/>
Nov 29 16:22:03 user nova-compute[75245]:     </memballoon>
Nov 29 16:22:03 user nova-compute[75245]:   </devices>
Nov 29 16:22:03 user nova-compute[75245]: </domain>
Nov 29 16:22:03 user nova-compute[75245]:  {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 16:22:03 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:21:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1389384608',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1389384608',id=24,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d52776451e947f5a9ef3fa44ac8acbb',ramdisk_id='',reservation_id='r-l3dmntgm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1780163218',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:21:48Z,user_data=None,user_id='4f20e7c9ae22462ea6bc623c93697fce',uuid=5de7e10c-f216-46b3-8f74-57bac6ab7e56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "116d08d0-5549-4438-b689-0bbda3a5934f", "address": "fa:16:3e:97:fb:c7", "network": {"id": "6a7f7426-b595-4aa3-bf80-cc92ba7ce15e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-917300903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d52776451e947f5a9ef3fa44ac8acbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap116d08d0-55", "ovs_interfaceid": "116d08d0-5549-4438-b689-0bbda3a5934f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 16:22:03 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Converting VIF {"id": "116d08d0-5549-4438-b689-0bbda3a5934f", "address": "fa:16:3e:97:fb:c7", "network": {"id": "6a7f7426-b595-4aa3-bf80-cc92ba7ce15e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-917300903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d52776451e947f5a9ef3fa44ac8acbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap116d08d0-55", "ovs_interfaceid": "116d08d0-5549-4438-b689-0bbda3a5934f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:22:03 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:fb:c7,bridge_name='br-int',has_traffic_filtering=True,id=116d08d0-5549-4438-b689-0bbda3a5934f,network=Network(6a7f7426-b595-4aa3-bf80-cc92ba7ce15e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap116d08d0-55') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:22:03 user nova-compute[75245]: DEBUG os_vif [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:fb:c7,bridge_name='br-int',has_traffic_filtering=True,id=116d08d0-5549-4438-b689-0bbda3a5934f,network=Network(6a7f7426-b595-4aa3-bf80-cc92ba7ce15e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap116d08d0-55') {{(pid=75245) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 16:22:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Acquiring lock "35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:22:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lock "35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:22:03 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:22:03 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:22:03 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 16:22:03 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:22:03 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9b2ff6c6-6881-5797-8750-85f31ab425a3', '_type': 'linux-noop'}}, row=False) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:22:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:22:03 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:22:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:22:03 user nova-compute[75245]: DEBUG nova.compute.manager [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Starting instance... {{(pid=75245) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 16:22:03 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:22:03 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:22:03 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap116d08d0-55, may_exist=True, interface_attrs={}) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:22:03 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap116d08d0-55, col_values=(('qos', UUID('fea86118-525e-469c-bf2f-45edeb853a1d')),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:22:03 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap116d08d0-55, col_values=(('external_ids', {'iface-id': '116d08d0-5549-4438-b689-0bbda3a5934f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:fb:c7', 'vm-uuid': '5de7e10c-f216-46b3-8f74-57bac6ab7e56'}),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:22:03 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:22:03 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:22:03 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:22:03 user nova-compute[75245]: INFO os_vif [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:fb:c7,bridge_name='br-int',has_traffic_filtering=True,id=116d08d0-5549-4438-b689-0bbda3a5934f,network=Network(6a7f7426-b595-4aa3-bf80-cc92ba7ce15e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap116d08d0-55')
Nov 29 16:22:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:22:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:22:03 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:22:03 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] No VIF found with MAC fa:16:3e:97:fb:c7, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:22:03 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75245) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 16:22:03 user nova-compute[75245]: INFO nova.compute.claims [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Claim successful on node user
Nov 29 16:22:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:22:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43ead766-eeb0-4c7a-a03a-6d4daf7106af/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:22:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43ead766-eeb0-4c7a-a03a-6d4daf7106af/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:22:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43ead766-eeb0-4c7a-a03a-6d4daf7106af/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:22:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43ead766-eeb0-4c7a-a03a-6d4daf7106af/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:22:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bae51e-2a85-442d-bbd2-fc89f30f40b7/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:22:04 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:22:04 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:22:04 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Acquiring lock "ed9d1ad5-f5d0-4a68-a073-e7a83be772ea" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:22:04 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lock "ed9d1ad5-f5d0-4a68-a073-e7a83be772ea" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:22:04 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.601s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:22:04 user nova-compute[75245]: DEBUG nova.compute.manager [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Start building networks asynchronously for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 16:22:04 user nova-compute[75245]: DEBUG nova.compute.manager [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Starting instance... {{(pid=75245) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 16:22:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bae51e-2a85-442d-bbd2-fc89f30f40b7/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:22:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bae51e-2a85-442d-bbd2-fc89f30f40b7/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:22:04 user nova-compute[75245]: DEBUG nova.compute.manager [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Allocating IP information in the background. {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 16:22:04 user nova-compute[75245]: DEBUG nova.network.neutron [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] allocate_for_instance() {{(pid=75245) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 16:22:04 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 16:22:04 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:22:04 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:22:04 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75245) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 16:22:04 user nova-compute[75245]: INFO nova.compute.claims [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Claim successful on node user
Nov 29 16:22:04 user nova-compute[75245]: DEBUG nova.compute.manager [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Start building block device mappings for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 16:22:04 user nova-compute[75245]: DEBUG nova.policy [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd876b1e244b14a29ad5b4b422135336b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e12002e1a11f4caf8953371e66e6652e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75245) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 16:22:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bae51e-2a85-442d-bbd2-fc89f30f40b7/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:22:04 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:22:05 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:22:05 user nova-compute[75245]: DEBUG nova.compute.manager [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Start spawning the instance on the hypervisor. {{(pid=75245) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 16:22:05 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Creating instance directory {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 16:22:05 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Creating image(s)
Nov 29 16:22:05 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Acquiring lock "/opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:22:05 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lock "/opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:22:05 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lock "/opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:22:05 user nova-compute[75245]: DEBUG nova.compute.manager [req-d887b802-9317-4ca8-a6af-10b77d64afd9 req-ea57261a-b186-4451-8fce-0476d67694ec service nova] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Received event network-vif-plugged-27fc0374-0770-4171-a730-6696b09362eb {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:22:05 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d887b802-9317-4ca8-a6af-10b77d64afd9 req-ea57261a-b186-4451-8fce-0476d67694ec service nova] Acquiring lock "84bae51e-2a85-442d-bbd2-fc89f30f40b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:22:05 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d887b802-9317-4ca8-a6af-10b77d64afd9 req-ea57261a-b186-4451-8fce-0476d67694ec service nova] Lock "84bae51e-2a85-442d-bbd2-fc89f30f40b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:22:05 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d887b802-9317-4ca8-a6af-10b77d64afd9 req-ea57261a-b186-4451-8fce-0476d67694ec service nova] Lock "84bae51e-2a85-442d-bbd2-fc89f30f40b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:22:05 user nova-compute[75245]: DEBUG nova.compute.manager [req-d887b802-9317-4ca8-a6af-10b77d64afd9 req-ea57261a-b186-4451-8fce-0476d67694ec service nova] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] No waiting events found dispatching network-vif-plugged-27fc0374-0770-4171-a730-6696b09362eb {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:22:05 user nova-compute[75245]: WARNING nova.compute.manager [req-d887b802-9317-4ca8-a6af-10b77d64afd9 req-ea57261a-b186-4451-8fce-0476d67694ec service nova] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Received unexpected event network-vif-plugged-27fc0374-0770-4171-a730-6696b09362eb for instance with vm_state active and task_state resize_finish.
Nov 29 16:22:05 user nova-compute[75245]: DEBUG nova.compute.manager [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Instance event wait completed in 0 seconds for  {{(pid=75245) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 16:22:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:22:05 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:22:05 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:22:05 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Hypervisor/Node resource view: name=user free_ram=8302MB free_disk=25.356002807617188GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75245) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 16:22:05 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:22:05 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Instance running successfully.
Nov 29 16:22:05 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Failed to set time: agent not configured {{(pid=75245) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 29 16:22:05 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-67bcfd3c-af9e-470f-89db-c527b303f372 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] finish_migration finished successfully. {{(pid=75245) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11766}}
Nov 29 16:22:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.207s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:22:05 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Acquiring lock "d654f7206043e05d3525550b0fc885556eb999f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:22:05 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:22:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:22:05 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:22:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.256s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:22:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk 1073741824 {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:22:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk 1073741824" returned: 0 in 0.064s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:22:05 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.325s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:22:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:22:05 user nova-compute[75245]: DEBUG nova.network.neutron [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Successfully created port: 545bae30-b03e-41ac-8dd9-f86e85b590d1 {{(pid=75245) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 16:22:06 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:22:06 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:22:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.385s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:22:06 user nova-compute[75245]: DEBUG nova.compute.manager [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Start building networks asynchronously for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 16:22:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.605s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:22:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.194s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:22:06 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Checking if we can resize image /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk. size=1073741824 {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 16:22:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:22:06 user nova-compute[75245]: DEBUG nova.compute.manager [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Allocating IP information in the background. {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 16:22:06 user nova-compute[75245]: DEBUG nova.network.neutron [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] allocate_for_instance() {{(pid=75245) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 16:22:06 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 16:22:06 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Applying migration context for instance 84bae51e-2a85-442d-bbd2-fc89f30f40b7 as it has an incoming, in-progress migration c238ecef-960e-49e6-9c78-1b39bc8f90c0. Migration status is finished {{(pid=75245) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 29 16:22:06 user nova-compute[75245]: INFO nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Updating resource usage from migration c238ecef-960e-49e6-9c78-1b39bc8f90c0
Nov 29 16:22:06 user nova-compute[75245]: DEBUG nova.compute.manager [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Start building block device mappings for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 16:22:06 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance ed9a6a4e-2e7d-443c-82ef-f14f11d32c81 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:22:06 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 8785a3c2-5b7a-4382-b50d-cecd8743329c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:22:06 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 4f7fb562-a698-4fc9-91b0-c786627f6d75 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:22:06 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 43ead766-eeb0-4c7a-a03a-6d4daf7106af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:22:06 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance d42fa9b3-91c3-4216-91f1-655ce140425f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:22:06 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Migration c238ecef-960e-49e6-9c78-1b39bc8f90c0 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 29 16:22:06 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 84bae51e-2a85-442d-bbd2-fc89f30f40b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:22:06 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 5de7e10c-f216-46b3-8f74-57bac6ab7e56 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:22:06 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:22:06 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance ed9d1ad5-f5d0-4a68-a073-e7a83be772ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:22:06 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 16:22:06 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=26GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 16:22:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:22:06 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Cannot resize image /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk to a smaller size. {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 16:22:06 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Created local disks {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 16:22:06 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Ensure instance console log exists: /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/console.log {{(pid=75245) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 16:22:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:22:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:22:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:22:06 user nova-compute[75245]: DEBUG nova.policy [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd876b1e244b14a29ad5b4b422135336b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e12002e1a11f4caf8953371e66e6652e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75245) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 16:22:06 user nova-compute[75245]: DEBUG nova.compute.manager [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Start spawning the instance on the hypervisor. {{(pid=75245) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 16:22:06 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Creating instance directory {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 16:22:06 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Creating image(s)
Nov 29 16:22:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Acquiring lock "/opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:22:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lock "/opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:22:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lock "/opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.012s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:22:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:22:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.195s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:22:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Acquiring lock "d654f7206043e05d3525550b0fc885556eb999f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:22:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:22:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:22:06 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:22:06 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:22:06 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Compute_service record updated for user:user {{(pid=75245) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 16:22:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.661s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:22:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.197s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:22:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk 1073741824 {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:22:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk 1073741824" returned: 0 in 0.049s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:22:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:22:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.209s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk. size=1073741824 {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG nova.network.neutron [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Successfully updated port: 545bae30-b03e-41ac-8dd9-f86e85b590d1 {{(pid=75245) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Acquiring lock "refresh_cache-35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Acquired lock "refresh_cache-35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG nova.network.neutron [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG nova.compute.manager [req-3b5e8cd0-40c9-47ba-8140-9fe3a3cc640b req-75b52f30-cc28-4ce8-b277-5e34bd2c4648 service nova] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Received event network-vif-plugged-116d08d0-5549-4438-b689-0bbda3a5934f {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-3b5e8cd0-40c9-47ba-8140-9fe3a3cc640b req-75b52f30-cc28-4ce8-b277-5e34bd2c4648 service nova] Acquiring lock "5de7e10c-f216-46b3-8f74-57bac6ab7e56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-3b5e8cd0-40c9-47ba-8140-9fe3a3cc640b req-75b52f30-cc28-4ce8-b277-5e34bd2c4648 service nova] Lock "5de7e10c-f216-46b3-8f74-57bac6ab7e56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-3b5e8cd0-40c9-47ba-8140-9fe3a3cc640b req-75b52f30-cc28-4ce8-b277-5e34bd2c4648 service nova] Lock "5de7e10c-f216-46b3-8f74-57bac6ab7e56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG nova.compute.manager [req-3b5e8cd0-40c9-47ba-8140-9fe3a3cc640b req-75b52f30-cc28-4ce8-b277-5e34bd2c4648 service nova] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] No waiting events found dispatching network-vif-plugged-116d08d0-5549-4438-b689-0bbda3a5934f {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:22:07 user nova-compute[75245]: WARNING nova.compute.manager [req-3b5e8cd0-40c9-47ba-8140-9fe3a3cc640b req-75b52f30-cc28-4ce8-b277-5e34bd2c4648 service nova] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Received unexpected event network-vif-plugged-116d08d0-5549-4438-b689-0bbda3a5934f for instance with vm_state building and task_state spawning.
Nov 29 16:22:07 user nova-compute[75245]: DEBUG nova.compute.manager [req-3b5e8cd0-40c9-47ba-8140-9fe3a3cc640b req-75b52f30-cc28-4ce8-b277-5e34bd2c4648 service nova] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Received event network-vif-plugged-116d08d0-5549-4438-b689-0bbda3a5934f {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-3b5e8cd0-40c9-47ba-8140-9fe3a3cc640b req-75b52f30-cc28-4ce8-b277-5e34bd2c4648 service nova] Acquiring lock "5de7e10c-f216-46b3-8f74-57bac6ab7e56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-3b5e8cd0-40c9-47ba-8140-9fe3a3cc640b req-75b52f30-cc28-4ce8-b277-5e34bd2c4648 service nova] Lock "5de7e10c-f216-46b3-8f74-57bac6ab7e56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-3b5e8cd0-40c9-47ba-8140-9fe3a3cc640b req-75b52f30-cc28-4ce8-b277-5e34bd2c4648 service nova] Lock "5de7e10c-f216-46b3-8f74-57bac6ab7e56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG nova.compute.manager [req-3b5e8cd0-40c9-47ba-8140-9fe3a3cc640b req-75b52f30-cc28-4ce8-b277-5e34bd2c4648 service nova] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] No waiting events found dispatching network-vif-plugged-116d08d0-5549-4438-b689-0bbda3a5934f {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:22:07 user nova-compute[75245]: WARNING nova.compute.manager [req-3b5e8cd0-40c9-47ba-8140-9fe3a3cc640b req-75b52f30-cc28-4ce8-b277-5e34bd2c4648 service nova] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Received unexpected event network-vif-plugged-116d08d0-5549-4438-b689-0bbda3a5934f for instance with vm_state building and task_state spawning.
Nov 29 16:22:07 user nova-compute[75245]: DEBUG nova.compute.manager [req-4ed339d4-4564-4dc8-8b9b-37beab3991fb req-6fd08096-8f52-4c45-93a7-551bbbd7a8a2 service nova] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Received event network-changed-545bae30-b03e-41ac-8dd9-f86e85b590d1 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG nova.compute.manager [req-4ed339d4-4564-4dc8-8b9b-37beab3991fb req-6fd08096-8f52-4c45-93a7-551bbbd7a8a2 service nova] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Refreshing instance network info cache due to event network-changed-545bae30-b03e-41ac-8dd9-f86e85b590d1. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-4ed339d4-4564-4dc8-8b9b-37beab3991fb req-6fd08096-8f52-4c45-93a7-551bbbd7a8a2 service nova] Acquiring lock "refresh_cache-35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG nova.network.neutron [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Instance cache missing network info. {{(pid=75245) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG nova.network.neutron [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Successfully created port: 592b836b-e112-414f-b9a9-60e5f65b8f98 {{(pid=75245) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Cannot resize image /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk to a smaller size. {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Created local disks {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Ensure instance console log exists: /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/console.log {{(pid=75245) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG nova.compute.manager [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Instance event wait completed in 0 seconds for  {{(pid=75245) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Guest created on hypervisor {{(pid=75245) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 16:22:07 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Instance spawned successfully.
Nov 29 16:22:07 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG nova.network.neutron [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Updating instance_info_cache with network_info: [{"id": "545bae30-b03e-41ac-8dd9-f86e85b590d1", "address": "fa:16:3e:26:46:35", "network": {"id": "02098e86-68f8-464e-84ee-bf2fb09b881b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085418471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e12002e1a11f4caf8953371e66e6652e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap545bae30-b0", "ovs_interfaceid": "545bae30-b03e-41ac-8dd9-f86e85b590d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Found default for hw_cdrom_bus of ide {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Found default for hw_disk_bus of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Found default for hw_input_bus of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Found default for hw_pointer_model of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Found default for hw_video_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Found default for hw_vif_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Releasing lock "refresh_cache-35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG nova.compute.manager [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Instance network_info: |[{"id": "545bae30-b03e-41ac-8dd9-f86e85b590d1", "address": "fa:16:3e:26:46:35", "network": {"id": "02098e86-68f8-464e-84ee-bf2fb09b881b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085418471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e12002e1a11f4caf8953371e66e6652e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap545bae30-b0", "ovs_interfaceid": "545bae30-b03e-41ac-8dd9-f86e85b590d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-4ed339d4-4564-4dc8-8b9b-37beab3991fb req-6fd08096-8f52-4c45-93a7-551bbbd7a8a2 service nova] Acquired lock "refresh_cache-35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG nova.network.neutron [req-4ed339d4-4564-4dc8-8b9b-37beab3991fb req-6fd08096-8f52-4c45-93a7-551bbbd7a8a2 service nova] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Refreshing network info cache for port 545bae30-b03e-41ac-8dd9-f86e85b590d1 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Start _get_guest_xml network_info=[{"id": "545bae30-b03e-41ac-8dd9-f86e85b590d1", "address": "fa:16:3e:26:46:35", "network": {"id": "02098e86-68f8-464e-84ee-bf2fb09b881b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085418471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e12002e1a11f4caf8953371e66e6652e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap545bae30-b0", "ovs_interfaceid": "545bae30-b03e-41ac-8dd9-f86e85b590d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'a291d9c3-be02-4c6c-9649-4b45c5b7f487'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 16:22:07 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:22:07 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:22:07 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] CPU controller missing on host. {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] CPU controller found on host. {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75245) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T16:06:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Flavor limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Image limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Flavor pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Image pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Got 1 possible topologies {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:22:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1012702765',display_name='tempest-ServerRescueNegativeTestJSON-server-1012702765',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1012702765',id=25,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e12002e1a11f4caf8953371e66e6652e',ramdisk_id='',reservation_id='r-vzx9ywrd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1013090395',owner_user_name='tempest-ServerRescueNegativeTestJSON-1013090395-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:22:05Z,user_data=None,user_id='d876b1e244b14a29ad5b4b422135336b',uuid=35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "545bae30-b03e-41ac-8dd9-f86e85b590d1", "address": "fa:16:3e:26:46:35", "network": {"id": "02098e86-68f8-464e-84ee-bf2fb09b881b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085418471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e12002e1a11f4caf8953371e66e6652e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap545bae30-b0", "ovs_interfaceid": "545bae30-b03e-41ac-8dd9-f86e85b590d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Converting VIF {"id": "545bae30-b03e-41ac-8dd9-f86e85b590d1", "address": "fa:16:3e:26:46:35", "network": {"id": "02098e86-68f8-464e-84ee-bf2fb09b881b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085418471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e12002e1a11f4caf8953371e66e6652e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap545bae30-b0", "ovs_interfaceid": "545bae30-b03e-41ac-8dd9-f86e85b590d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:46:35,bridge_name='br-int',has_traffic_filtering=True,id=545bae30-b03e-41ac-8dd9-f86e85b590d1,network=Network(02098e86-68f8-464e-84ee-bf2fb09b881b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap545bae30-b0') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG nova.objects.instance [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lazy-loading 'pci_devices' on Instance uuid 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:22:07 user nova-compute[75245]: INFO nova.compute.manager [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Took 5.55 seconds to spawn the instance on the hypervisor.
Nov 29 16:22:07 user nova-compute[75245]: DEBUG nova.compute.manager [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] End _get_guest_xml xml=<domain type="kvm">
Nov 29 16:22:07 user nova-compute[75245]:   <uuid>35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8</uuid>
Nov 29 16:22:07 user nova-compute[75245]:   <name>instance-00000019</name>
Nov 29 16:22:07 user nova-compute[75245]:   <memory>524288</memory>
Nov 29 16:22:07 user nova-compute[75245]:   <vcpu>1</vcpu>
Nov 29 16:22:07 user nova-compute[75245]:   <metadata>
Nov 29 16:22:07 user nova-compute[75245]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 16:22:07 user nova-compute[75245]:       <nova:package version="0.0.0"/>
Nov 29 16:22:07 user nova-compute[75245]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1012702765</nova:name>
Nov 29 16:22:07 user nova-compute[75245]:       <nova:creationTime>2023-11-29 16:22:07</nova:creationTime>
Nov 29 16:22:07 user nova-compute[75245]:       <nova:flavor name="m1.tiny">
Nov 29 16:22:07 user nova-compute[75245]:         <nova:memory>512</nova:memory>
Nov 29 16:22:07 user nova-compute[75245]:         <nova:disk>1</nova:disk>
Nov 29 16:22:07 user nova-compute[75245]:         <nova:swap>0</nova:swap>
Nov 29 16:22:07 user nova-compute[75245]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 16:22:07 user nova-compute[75245]:         <nova:vcpus>1</nova:vcpus>
Nov 29 16:22:07 user nova-compute[75245]:       </nova:flavor>
Nov 29 16:22:07 user nova-compute[75245]:       <nova:owner>
Nov 29 16:22:07 user nova-compute[75245]:         <nova:user uuid="d876b1e244b14a29ad5b4b422135336b">tempest-ServerRescueNegativeTestJSON-1013090395-project-member</nova:user>
Nov 29 16:22:07 user nova-compute[75245]:         <nova:project uuid="e12002e1a11f4caf8953371e66e6652e">tempest-ServerRescueNegativeTestJSON-1013090395</nova:project>
Nov 29 16:22:07 user nova-compute[75245]:       </nova:owner>
Nov 29 16:22:07 user nova-compute[75245]:       <nova:root type="image" uuid="a291d9c3-be02-4c6c-9649-4b45c5b7f487"/>
Nov 29 16:22:07 user nova-compute[75245]:       <nova:ports>
Nov 29 16:22:07 user nova-compute[75245]:         <nova:port uuid="545bae30-b03e-41ac-8dd9-f86e85b590d1">
Nov 29 16:22:07 user nova-compute[75245]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 29 16:22:07 user nova-compute[75245]:         </nova:port>
Nov 29 16:22:07 user nova-compute[75245]:       </nova:ports>
Nov 29 16:22:07 user nova-compute[75245]:     </nova:instance>
Nov 29 16:22:07 user nova-compute[75245]:   </metadata>
Nov 29 16:22:07 user nova-compute[75245]:   <sysinfo type="smbios">
Nov 29 16:22:07 user nova-compute[75245]:     <system>
Nov 29 16:22:07 user nova-compute[75245]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 16:22:07 user nova-compute[75245]:       <entry name="product">OpenStack Nova</entry>
Nov 29 16:22:07 user nova-compute[75245]:       <entry name="version">0.0.0</entry>
Nov 29 16:22:07 user nova-compute[75245]:       <entry name="serial">35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8</entry>
Nov 29 16:22:07 user nova-compute[75245]:       <entry name="uuid">35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8</entry>
Nov 29 16:22:07 user nova-compute[75245]:       <entry name="family">Virtual Machine</entry>
Nov 29 16:22:07 user nova-compute[75245]:     </system>
Nov 29 16:22:07 user nova-compute[75245]:   </sysinfo>
Nov 29 16:22:07 user nova-compute[75245]:   <os>
Nov 29 16:22:07 user nova-compute[75245]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 16:22:07 user nova-compute[75245]:     <boot dev="hd"/>
Nov 29 16:22:07 user nova-compute[75245]:     <smbios mode="sysinfo"/>
Nov 29 16:22:07 user nova-compute[75245]:   </os>
Nov 29 16:22:07 user nova-compute[75245]:   <features>
Nov 29 16:22:07 user nova-compute[75245]:     <acpi/>
Nov 29 16:22:07 user nova-compute[75245]:     <apic/>
Nov 29 16:22:07 user nova-compute[75245]:     <vmcoreinfo/>
Nov 29 16:22:07 user nova-compute[75245]:   </features>
Nov 29 16:22:07 user nova-compute[75245]:   <clock offset="utc">
Nov 29 16:22:07 user nova-compute[75245]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 16:22:07 user nova-compute[75245]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 16:22:07 user nova-compute[75245]:     <timer name="hpet" present="no"/>
Nov 29 16:22:07 user nova-compute[75245]:   </clock>
Nov 29 16:22:07 user nova-compute[75245]:   <cpu mode="custom" match="exact">
Nov 29 16:22:07 user nova-compute[75245]:     <model>Nehalem</model>
Nov 29 16:22:07 user nova-compute[75245]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 16:22:07 user nova-compute[75245]:   </cpu>
Nov 29 16:22:07 user nova-compute[75245]:   <devices>
Nov 29 16:22:07 user nova-compute[75245]:     <disk type="file" device="disk">
Nov 29 16:22:07 user nova-compute[75245]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 16:22:07 user nova-compute[75245]:       <source file="/opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk"/>
Nov 29 16:22:07 user nova-compute[75245]:       <target dev="vda" bus="virtio"/>
Nov 29 16:22:07 user nova-compute[75245]:     </disk>
Nov 29 16:22:07 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 16:22:07 user nova-compute[75245]:       <mac address="fa:16:3e:26:46:35"/>
Nov 29 16:22:07 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:22:07 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 16:22:07 user nova-compute[75245]:       <target dev="tap545bae30-b0"/>
Nov 29 16:22:07 user nova-compute[75245]:     </interface>
Nov 29 16:22:07 user nova-compute[75245]:     <serial type="pty">
Nov 29 16:22:07 user nova-compute[75245]:       <log file="/opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/console.log" append="off"/>
Nov 29 16:22:07 user nova-compute[75245]:     </serial>
Nov 29 16:22:07 user nova-compute[75245]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 16:22:07 user nova-compute[75245]:     <video>
Nov 29 16:22:07 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:22:07 user nova-compute[75245]:     </video>
Nov 29 16:22:07 user nova-compute[75245]:     <rng model="virtio">
Nov 29 16:22:07 user nova-compute[75245]:       <backend model="random">/dev/urandom</backend>
Nov 29 16:22:07 user nova-compute[75245]:     </rng>
Nov 29 16:22:07 user nova-compute[75245]:     <controller type="usb" index="0" model="none"/>
Nov 29 16:22:07 user nova-compute[75245]:     <memballoon model="virtio">
Nov 29 16:22:07 user nova-compute[75245]:       <stats period="10"/>
Nov 29 16:22:07 user nova-compute[75245]:     </memballoon>
Nov 29 16:22:07 user nova-compute[75245]:   </devices>
Nov 29 16:22:07 user nova-compute[75245]: </domain>
Nov 29 16:22:07 user nova-compute[75245]:  {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:22:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1012702765',display_name='tempest-ServerRescueNegativeTestJSON-server-1012702765',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1012702765',id=25,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e12002e1a11f4caf8953371e66e6652e',ramdisk_id='',reservation_id='r-vzx9ywrd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1013090395',owner_user_name='tempest-ServerRescueNegativeTestJSON-1013090395-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:22:05Z,user_data=None,user_id='d876b1e244b14a29ad5b4b422135336b',uuid=35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "545bae30-b03e-41ac-8dd9-f86e85b590d1", "address": "fa:16:3e:26:46:35", "network": {"id": "02098e86-68f8-464e-84ee-bf2fb09b881b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085418471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e12002e1a11f4caf8953371e66e6652e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap545bae30-b0", "ovs_interfaceid": "545bae30-b03e-41ac-8dd9-f86e85b590d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Converting VIF {"id": "545bae30-b03e-41ac-8dd9-f86e85b590d1", "address": "fa:16:3e:26:46:35", "network": {"id": "02098e86-68f8-464e-84ee-bf2fb09b881b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085418471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e12002e1a11f4caf8953371e66e6652e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap545bae30-b0", "ovs_interfaceid": "545bae30-b03e-41ac-8dd9-f86e85b590d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:46:35,bridge_name='br-int',has_traffic_filtering=True,id=545bae30-b03e-41ac-8dd9-f86e85b590d1,network=Network(02098e86-68f8-464e-84ee-bf2fb09b881b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap545bae30-b0') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG os_vif [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:46:35,bridge_name='br-int',has_traffic_filtering=True,id=545bae30-b03e-41ac-8dd9-f86e85b590d1,network=Network(02098e86-68f8-464e-84ee-bf2fb09b881b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap545bae30-b0') {{(pid=75245) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'eeb93a3b-ed9f-58a6-8c5d-b73f277fa227', '_type': 'linux-noop'}}, row=False) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap545bae30-b0, may_exist=True, interface_attrs={}) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap545bae30-b0, col_values=(('qos', UUID('e5e81aef-a5db-4a5e-8ae2-f21ef512e3b6')),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap545bae30-b0, col_values=(('external_ids', {'iface-id': '545bae30-b03e-41ac-8dd9-f86e85b590d1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:46:35', 'vm-uuid': '35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8'}),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:22:07 user nova-compute[75245]: INFO os_vif [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:46:35,bridge_name='br-int',has_traffic_filtering=True,id=545bae30-b03e-41ac-8dd9-f86e85b590d1,network=Network(02098e86-68f8-464e-84ee-bf2fb09b881b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap545bae30-b0')
Nov 29 16:22:07 user nova-compute[75245]: INFO nova.compute.manager [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Took 20.44 seconds to build instance.
Nov 29 16:22:07 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] No VIF found with MAC fa:16:3e:26:46:35, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:22:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-cc9facc8-309d-4e6d-900a-cfb5049f738a tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "5de7e10c-f216-46b3-8f74-57bac6ab7e56" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.619s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:22:08 user nova-compute[75245]: DEBUG nova.network.neutron [req-4ed339d4-4564-4dc8-8b9b-37beab3991fb req-6fd08096-8f52-4c45-93a7-551bbbd7a8a2 service nova] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Updated VIF entry in instance network info cache for port 545bae30-b03e-41ac-8dd9-f86e85b590d1. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:22:08 user nova-compute[75245]: DEBUG nova.network.neutron [req-4ed339d4-4564-4dc8-8b9b-37beab3991fb req-6fd08096-8f52-4c45-93a7-551bbbd7a8a2 service nova] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Updating instance_info_cache with network_info: [{"id": "545bae30-b03e-41ac-8dd9-f86e85b590d1", "address": "fa:16:3e:26:46:35", "network": {"id": "02098e86-68f8-464e-84ee-bf2fb09b881b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085418471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e12002e1a11f4caf8953371e66e6652e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap545bae30-b0", "ovs_interfaceid": "545bae30-b03e-41ac-8dd9-f86e85b590d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:22:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:22:08 user nova-compute[75245]: DEBUG nova.network.neutron [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Successfully updated port: 592b836b-e112-414f-b9a9-60e5f65b8f98 {{(pid=75245) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 16:22:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-4ed339d4-4564-4dc8-8b9b-37beab3991fb req-6fd08096-8f52-4c45-93a7-551bbbd7a8a2 service nova] Releasing lock "refresh_cache-35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:22:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Acquiring lock "refresh_cache-ed9d1ad5-f5d0-4a68-a073-e7a83be772ea" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:22:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Acquired lock "refresh_cache-ed9d1ad5-f5d0-4a68-a073-e7a83be772ea" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:22:08 user nova-compute[75245]: DEBUG nova.network.neutron [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 16:22:08 user nova-compute[75245]: DEBUG nova.network.neutron [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Instance cache missing network info. {{(pid=75245) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 16:22:08 user nova-compute[75245]: DEBUG nova.network.neutron [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Updating instance_info_cache with network_info: [{"id": "592b836b-e112-414f-b9a9-60e5f65b8f98", "address": "fa:16:3e:90:86:e1", "network": {"id": "02098e86-68f8-464e-84ee-bf2fb09b881b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085418471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e12002e1a11f4caf8953371e66e6652e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592b836b-e1", "ovs_interfaceid": "592b836b-e112-414f-b9a9-60e5f65b8f98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:22:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Releasing lock "refresh_cache-ed9d1ad5-f5d0-4a68-a073-e7a83be772ea" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:22:08 user nova-compute[75245]: DEBUG nova.compute.manager [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Instance network_info: |[{"id": "592b836b-e112-414f-b9a9-60e5f65b8f98", "address": "fa:16:3e:90:86:e1", "network": {"id": "02098e86-68f8-464e-84ee-bf2fb09b881b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085418471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e12002e1a11f4caf8953371e66e6652e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592b836b-e1", "ovs_interfaceid": "592b836b-e112-414f-b9a9-60e5f65b8f98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 16:22:08 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Start _get_guest_xml network_info=[{"id": "592b836b-e112-414f-b9a9-60e5f65b8f98", "address": "fa:16:3e:90:86:e1", "network": {"id": "02098e86-68f8-464e-84ee-bf2fb09b881b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085418471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e12002e1a11f4caf8953371e66e6652e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592b836b-e1", "ovs_interfaceid": "592b836b-e112-414f-b9a9-60e5f65b8f98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'a291d9c3-be02-4c6c-9649-4b45c5b7f487'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 16:22:08 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:22:08 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:22:08 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 16:22:08 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] CPU controller missing on host. {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 16:22:08 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 16:22:08 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] CPU controller found on host. {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 16:22:08 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75245) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 16:22:08 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T16:06:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 16:22:08 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Flavor limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 16:22:08 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Image limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 16:22:08 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Flavor pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 16:22:08 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Image pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 16:22:08 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 16:22:08 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 16:22:08 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 16:22:08 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Got 1 possible topologies {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 16:22:08 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 16:22:08 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 16:22:08 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:22:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1973964224',display_name='tempest-ServerRescueNegativeTestJSON-server-1973964224',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1973964224',id=26,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e12002e1a11f4caf8953371e66e6652e',ramdisk_id='',reservation_id='r-z1a05ozn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1013090395',owner_user_name='tempest-ServerRescueNegativeTestJSON-1013090395-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:22:06Z,user_data=None,user_id='d876b1e244b14a29ad5b4b422135336b',uuid=ed9d1ad5-f5d0-4a68-a073-e7a83be772ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "592b836b-e112-414f-b9a9-60e5f65b8f98", "address": "fa:16:3e:90:86:e1", "network": {"id": "02098e86-68f8-464e-84ee-bf2fb09b881b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085418471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e12002e1a11f4caf8953371e66e6652e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592b836b-e1", "ovs_interfaceid": "592b836b-e112-414f-b9a9-60e5f65b8f98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:22:08 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Converting VIF {"id": "592b836b-e112-414f-b9a9-60e5f65b8f98", "address": "fa:16:3e:90:86:e1", "network": {"id": "02098e86-68f8-464e-84ee-bf2fb09b881b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085418471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e12002e1a11f4caf8953371e66e6652e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592b836b-e1", "ovs_interfaceid": "592b836b-e112-414f-b9a9-60e5f65b8f98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:22:08 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:86:e1,bridge_name='br-int',has_traffic_filtering=True,id=592b836b-e112-414f-b9a9-60e5f65b8f98,network=Network(02098e86-68f8-464e-84ee-bf2fb09b881b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap592b836b-e1') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:22:08 user nova-compute[75245]: DEBUG nova.objects.instance [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lazy-loading 'pci_devices' on Instance uuid ed9d1ad5-f5d0-4a68-a073-e7a83be772ea {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:22:08 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] End _get_guest_xml xml=<domain type="kvm">
Nov 29 16:22:08 user nova-compute[75245]:   <uuid>ed9d1ad5-f5d0-4a68-a073-e7a83be772ea</uuid>
Nov 29 16:22:08 user nova-compute[75245]:   <name>instance-0000001a</name>
Nov 29 16:22:08 user nova-compute[75245]:   <memory>524288</memory>
Nov 29 16:22:08 user nova-compute[75245]:   <vcpu>1</vcpu>
Nov 29 16:22:08 user nova-compute[75245]:   <metadata>
Nov 29 16:22:08 user nova-compute[75245]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 16:22:08 user nova-compute[75245]:       <nova:package version="0.0.0"/>
Nov 29 16:22:08 user nova-compute[75245]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1973964224</nova:name>
Nov 29 16:22:08 user nova-compute[75245]:       <nova:creationTime>2023-11-29 16:22:08</nova:creationTime>
Nov 29 16:22:08 user nova-compute[75245]:       <nova:flavor name="m1.tiny">
Nov 29 16:22:08 user nova-compute[75245]:         <nova:memory>512</nova:memory>
Nov 29 16:22:08 user nova-compute[75245]:         <nova:disk>1</nova:disk>
Nov 29 16:22:08 user nova-compute[75245]:         <nova:swap>0</nova:swap>
Nov 29 16:22:08 user nova-compute[75245]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 16:22:08 user nova-compute[75245]:         <nova:vcpus>1</nova:vcpus>
Nov 29 16:22:08 user nova-compute[75245]:       </nova:flavor>
Nov 29 16:22:08 user nova-compute[75245]:       <nova:owner>
Nov 29 16:22:08 user nova-compute[75245]:         <nova:user uuid="d876b1e244b14a29ad5b4b422135336b">tempest-ServerRescueNegativeTestJSON-1013090395-project-member</nova:user>
Nov 29 16:22:08 user nova-compute[75245]:         <nova:project uuid="e12002e1a11f4caf8953371e66e6652e">tempest-ServerRescueNegativeTestJSON-1013090395</nova:project>
Nov 29 16:22:08 user nova-compute[75245]:       </nova:owner>
Nov 29 16:22:08 user nova-compute[75245]:       <nova:root type="image" uuid="a291d9c3-be02-4c6c-9649-4b45c5b7f487"/>
Nov 29 16:22:08 user nova-compute[75245]:       <nova:ports>
Nov 29 16:22:08 user nova-compute[75245]:         <nova:port uuid="592b836b-e112-414f-b9a9-60e5f65b8f98">
Nov 29 16:22:08 user nova-compute[75245]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 29 16:22:08 user nova-compute[75245]:         </nova:port>
Nov 29 16:22:08 user nova-compute[75245]:       </nova:ports>
Nov 29 16:22:08 user nova-compute[75245]:     </nova:instance>
Nov 29 16:22:08 user nova-compute[75245]:   </metadata>
Nov 29 16:22:08 user nova-compute[75245]:   <sysinfo type="smbios">
Nov 29 16:22:08 user nova-compute[75245]:     <system>
Nov 29 16:22:08 user nova-compute[75245]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 16:22:08 user nova-compute[75245]:       <entry name="product">OpenStack Nova</entry>
Nov 29 16:22:08 user nova-compute[75245]:       <entry name="version">0.0.0</entry>
Nov 29 16:22:08 user nova-compute[75245]:       <entry name="serial">ed9d1ad5-f5d0-4a68-a073-e7a83be772ea</entry>
Nov 29 16:22:08 user nova-compute[75245]:       <entry name="uuid">ed9d1ad5-f5d0-4a68-a073-e7a83be772ea</entry>
Nov 29 16:22:08 user nova-compute[75245]:       <entry name="family">Virtual Machine</entry>
Nov 29 16:22:08 user nova-compute[75245]:     </system>
Nov 29 16:22:08 user nova-compute[75245]:   </sysinfo>
Nov 29 16:22:08 user nova-compute[75245]:   <os>
Nov 29 16:22:08 user nova-compute[75245]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 16:22:08 user nova-compute[75245]:     <boot dev="hd"/>
Nov 29 16:22:08 user nova-compute[75245]:     <smbios mode="sysinfo"/>
Nov 29 16:22:08 user nova-compute[75245]:   </os>
Nov 29 16:22:08 user nova-compute[75245]:   <features>
Nov 29 16:22:08 user nova-compute[75245]:     <acpi/>
Nov 29 16:22:08 user nova-compute[75245]:     <apic/>
Nov 29 16:22:08 user nova-compute[75245]:     <vmcoreinfo/>
Nov 29 16:22:08 user nova-compute[75245]:   </features>
Nov 29 16:22:08 user nova-compute[75245]:   <clock offset="utc">
Nov 29 16:22:08 user nova-compute[75245]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 16:22:08 user nova-compute[75245]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 16:22:08 user nova-compute[75245]:     <timer name="hpet" present="no"/>
Nov 29 16:22:08 user nova-compute[75245]:   </clock>
Nov 29 16:22:08 user nova-compute[75245]:   <cpu mode="custom" match="exact">
Nov 29 16:22:08 user nova-compute[75245]:     <model>Nehalem</model>
Nov 29 16:22:08 user nova-compute[75245]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 16:22:08 user nova-compute[75245]:   </cpu>
Nov 29 16:22:08 user nova-compute[75245]:   <devices>
Nov 29 16:22:08 user nova-compute[75245]:     <disk type="file" device="disk">
Nov 29 16:22:08 user nova-compute[75245]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 16:22:08 user nova-compute[75245]:       <source file="/opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk"/>
Nov 29 16:22:08 user nova-compute[75245]:       <target dev="vda" bus="virtio"/>
Nov 29 16:22:08 user nova-compute[75245]:     </disk>
Nov 29 16:22:08 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 16:22:08 user nova-compute[75245]:       <mac address="fa:16:3e:90:86:e1"/>
Nov 29 16:22:08 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:22:08 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 16:22:08 user nova-compute[75245]:       <target dev="tap592b836b-e1"/>
Nov 29 16:22:08 user nova-compute[75245]:     </interface>
Nov 29 16:22:08 user nova-compute[75245]:     <serial type="pty">
Nov 29 16:22:08 user nova-compute[75245]:       <log file="/opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/console.log" append="off"/>
Nov 29 16:22:08 user nova-compute[75245]:     </serial>
Nov 29 16:22:08 user nova-compute[75245]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 16:22:08 user nova-compute[75245]:     <video>
Nov 29 16:22:08 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:22:08 user nova-compute[75245]:     </video>
Nov 29 16:22:08 user nova-compute[75245]:     <rng model="virtio">
Nov 29 16:22:08 user nova-compute[75245]:       <backend model="random">/dev/urandom</backend>
Nov 29 16:22:08 user nova-compute[75245]:     </rng>
Nov 29 16:22:08 user nova-compute[75245]:     <controller type="usb" index="0" model="none"/>
Nov 29 16:22:08 user nova-compute[75245]:     <memballoon model="virtio">
Nov 29 16:22:08 user nova-compute[75245]:       <stats period="10"/>
Nov 29 16:22:08 user nova-compute[75245]:     </memballoon>
Nov 29 16:22:08 user nova-compute[75245]:   </devices>
Nov 29 16:22:08 user nova-compute[75245]: </domain>
Nov 29 16:22:08 user nova-compute[75245]:  {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 16:22:08 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:22:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1973964224',display_name='tempest-ServerRescueNegativeTestJSON-server-1973964224',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1973964224',id=26,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e12002e1a11f4caf8953371e66e6652e',ramdisk_id='',reservation_id='r-z1a05ozn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1013090395',owner_user_name='tempest-ServerRescueNegativeTestJSON-1013090395-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:22:06Z,user_data=None,user_id='d876b1e244b14a29ad5b4b422135336b',uuid=ed9d1ad5-f5d0-4a68-a073-e7a83be772ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "592b836b-e112-414f-b9a9-60e5f65b8f98", "address": "fa:16:3e:90:86:e1", "network": {"id": "02098e86-68f8-464e-84ee-bf2fb09b881b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085418471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e12002e1a11f4caf8953371e66e6652e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592b836b-e1", "ovs_interfaceid": "592b836b-e112-414f-b9a9-60e5f65b8f98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 16:22:08 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Converting VIF {"id": "592b836b-e112-414f-b9a9-60e5f65b8f98", "address": "fa:16:3e:90:86:e1", "network": {"id": "02098e86-68f8-464e-84ee-bf2fb09b881b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085418471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e12002e1a11f4caf8953371e66e6652e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592b836b-e1", "ovs_interfaceid": "592b836b-e112-414f-b9a9-60e5f65b8f98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:22:08 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:86:e1,bridge_name='br-int',has_traffic_filtering=True,id=592b836b-e112-414f-b9a9-60e5f65b8f98,network=Network(02098e86-68f8-464e-84ee-bf2fb09b881b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap592b836b-e1') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:22:08 user nova-compute[75245]: DEBUG os_vif [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:86:e1,bridge_name='br-int',has_traffic_filtering=True,id=592b836b-e112-414f-b9a9-60e5f65b8f98,network=Network(02098e86-68f8-464e-84ee-bf2fb09b881b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap592b836b-e1') {{(pid=75245) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 16:22:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:22:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:22:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 16:22:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:22:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0520c058-a3fa-5e5f-ae50-c2ddcf00215b', '_type': 'linux-noop'}}, row=False) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:22:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:22:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:22:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:22:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap592b836b-e1, may_exist=True, interface_attrs={}) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:22:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap592b836b-e1, col_values=(('qos', UUID('7cd241ce-b35b-4e50-bfce-5540a27e3ddf')),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:22:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap592b836b-e1, col_values=(('external_ids', {'iface-id': '592b836b-e112-414f-b9a9-60e5f65b8f98', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:90:86:e1', 'vm-uuid': 'ed9d1ad5-f5d0-4a68-a073-e7a83be772ea'}),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:22:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:22:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:22:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:22:08 user nova-compute[75245]: INFO os_vif [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:86:e1,bridge_name='br-int',has_traffic_filtering=True,id=592b836b-e112-414f-b9a9-60e5f65b8f98,network=Network(02098e86-68f8-464e-84ee-bf2fb09b881b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap592b836b-e1')
Nov 29 16:22:08 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:22:08 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] No VIF found with MAC fa:16:3e:90:86:e1, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:22:09 user nova-compute[75245]: DEBUG nova.compute.manager [req-906e4a0c-988c-4d5c-a7df-43cd273691e5 req-9d1505a3-d830-44d8-a541-e1fe79b3a7ab service nova] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Received event network-changed-592b836b-e112-414f-b9a9-60e5f65b8f98 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:22:09 user nova-compute[75245]: DEBUG nova.compute.manager [req-906e4a0c-988c-4d5c-a7df-43cd273691e5 req-9d1505a3-d830-44d8-a541-e1fe79b3a7ab service nova] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Refreshing instance network info cache due to event network-changed-592b836b-e112-414f-b9a9-60e5f65b8f98. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:22:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-906e4a0c-988c-4d5c-a7df-43cd273691e5 req-9d1505a3-d830-44d8-a541-e1fe79b3a7ab service nova] Acquiring lock "refresh_cache-ed9d1ad5-f5d0-4a68-a073-e7a83be772ea" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:22:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-906e4a0c-988c-4d5c-a7df-43cd273691e5 req-9d1505a3-d830-44d8-a541-e1fe79b3a7ab service nova] Acquired lock "refresh_cache-ed9d1ad5-f5d0-4a68-a073-e7a83be772ea" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:22:09 user nova-compute[75245]: DEBUG nova.network.neutron [req-906e4a0c-988c-4d5c-a7df-43cd273691e5 req-9d1505a3-d830-44d8-a541-e1fe79b3a7ab service nova] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Refreshing network info cache for port 592b836b-e112-414f-b9a9-60e5f65b8f98 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:22:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:22:09 user nova-compute[75245]: DEBUG nova.network.neutron [req-906e4a0c-988c-4d5c-a7df-43cd273691e5 req-9d1505a3-d830-44d8-a541-e1fe79b3a7ab service nova] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Updated VIF entry in instance network info cache for port 592b836b-e112-414f-b9a9-60e5f65b8f98. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:22:09 user nova-compute[75245]: DEBUG nova.network.neutron [req-906e4a0c-988c-4d5c-a7df-43cd273691e5 req-9d1505a3-d830-44d8-a541-e1fe79b3a7ab service nova] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Updating instance_info_cache with network_info: [{"id": "592b836b-e112-414f-b9a9-60e5f65b8f98", "address": "fa:16:3e:90:86:e1", "network": {"id": "02098e86-68f8-464e-84ee-bf2fb09b881b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085418471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e12002e1a11f4caf8953371e66e6652e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592b836b-e1", "ovs_interfaceid": "592b836b-e112-414f-b9a9-60e5f65b8f98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:22:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-906e4a0c-988c-4d5c-a7df-43cd273691e5 req-9d1505a3-d830-44d8-a541-e1fe79b3a7ab service nova] Releasing lock "refresh_cache-ed9d1ad5-f5d0-4a68-a073-e7a83be772ea" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:22:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:22:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:22:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:22:09 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:22:09 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:22:09 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:22:09 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:22:09 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:22:09 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:22:09 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75245) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 16:22:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:22:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:22:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:22:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:22:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:22:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:22:11 user nova-compute[75245]: DEBUG nova.compute.manager [req-25639151-9f31-41b6-b1e6-963e6a33c92b req-74ddc9ad-1362-4006-8bd9-a104679e184b service nova] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Received event network-vif-plugged-592b836b-e112-414f-b9a9-60e5f65b8f98 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:22:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-25639151-9f31-41b6-b1e6-963e6a33c92b req-74ddc9ad-1362-4006-8bd9-a104679e184b service nova] Acquiring lock "ed9d1ad5-f5d0-4a68-a073-e7a83be772ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:22:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-25639151-9f31-41b6-b1e6-963e6a33c92b req-74ddc9ad-1362-4006-8bd9-a104679e184b service nova] Lock "ed9d1ad5-f5d0-4a68-a073-e7a83be772ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:22:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-25639151-9f31-41b6-b1e6-963e6a33c92b req-74ddc9ad-1362-4006-8bd9-a104679e184b service nova] Lock "ed9d1ad5-f5d0-4a68-a073-e7a83be772ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:22:11 user nova-compute[75245]: DEBUG nova.compute.manager [req-25639151-9f31-41b6-b1e6-963e6a33c92b req-74ddc9ad-1362-4006-8bd9-a104679e184b service nova] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] No waiting events found dispatching network-vif-plugged-592b836b-e112-414f-b9a9-60e5f65b8f98 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:22:11 user nova-compute[75245]: WARNING nova.compute.manager [req-25639151-9f31-41b6-b1e6-963e6a33c92b req-74ddc9ad-1362-4006-8bd9-a104679e184b service nova] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Received unexpected event network-vif-plugged-592b836b-e112-414f-b9a9-60e5f65b8f98 for instance with vm_state building and task_state spawning.
Nov 29 16:22:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:22:11 user nova-compute[75245]: DEBUG nova.compute.manager [req-da4af071-4cad-4c47-ab6f-8cf90544e8f8 req-47d5b269-7c28-420c-826f-f325c322b870 service nova] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Received event network-vif-plugged-545bae30-b03e-41ac-8dd9-f86e85b590d1 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:22:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-da4af071-4cad-4c47-ab6f-8cf90544e8f8 req-47d5b269-7c28-420c-826f-f325c322b870 service nova] Acquiring lock "35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:22:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-da4af071-4cad-4c47-ab6f-8cf90544e8f8 req-47d5b269-7c28-420c-826f-f325c322b870 service nova] Lock "35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:22:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-da4af071-4cad-4c47-ab6f-8cf90544e8f8 req-47d5b269-7c28-420c-826f-f325c322b870 service nova] Lock "35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:22:11 user nova-compute[75245]: DEBUG nova.compute.manager [req-da4af071-4cad-4c47-ab6f-8cf90544e8f8 req-47d5b269-7c28-420c-826f-f325c322b870 service nova] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] No waiting events found dispatching network-vif-plugged-545bae30-b03e-41ac-8dd9-f86e85b590d1 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:22:11 user nova-compute[75245]: WARNING nova.compute.manager [req-da4af071-4cad-4c47-ab6f-8cf90544e8f8 req-47d5b269-7c28-420c-826f-f325c322b870 service nova] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Received unexpected event network-vif-plugged-545bae30-b03e-41ac-8dd9-f86e85b590d1 for instance with vm_state building and task_state spawning.
Nov 29 16:22:11 user nova-compute[75245]: DEBUG nova.compute.manager [req-da4af071-4cad-4c47-ab6f-8cf90544e8f8 req-47d5b269-7c28-420c-826f-f325c322b870 service nova] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Received event network-vif-plugged-545bae30-b03e-41ac-8dd9-f86e85b590d1 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:22:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-da4af071-4cad-4c47-ab6f-8cf90544e8f8 req-47d5b269-7c28-420c-826f-f325c322b870 service nova] Acquiring lock "35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:22:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-da4af071-4cad-4c47-ab6f-8cf90544e8f8 req-47d5b269-7c28-420c-826f-f325c322b870 service nova] Lock "35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:22:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-da4af071-4cad-4c47-ab6f-8cf90544e8f8 req-47d5b269-7c28-420c-826f-f325c322b870 service nova] Lock "35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:22:11 user nova-compute[75245]: DEBUG nova.compute.manager [req-da4af071-4cad-4c47-ab6f-8cf90544e8f8 req-47d5b269-7c28-420c-826f-f325c322b870 service nova] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] No waiting events found dispatching network-vif-plugged-545bae30-b03e-41ac-8dd9-f86e85b590d1 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:22:11 user nova-compute[75245]: WARNING nova.compute.manager [req-da4af071-4cad-4c47-ab6f-8cf90544e8f8 req-47d5b269-7c28-420c-826f-f325c322b870 service nova] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Received unexpected event network-vif-plugged-545bae30-b03e-41ac-8dd9-f86e85b590d1 for instance with vm_state building and task_state spawning.
Nov 29 16:22:13 user nova-compute[75245]: DEBUG nova.compute.manager [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Instance event wait completed in 0 seconds for  {{(pid=75245) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 16:22:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Guest created on hypervisor {{(pid=75245) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 16:22:13 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Instance spawned successfully.
Nov 29 16:22:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 16:22:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Found default for hw_cdrom_bus of ide {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:22:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Found default for hw_disk_bus of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:22:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Found default for hw_input_bus of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:22:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Found default for hw_pointer_model of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:22:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Found default for hw_video_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:22:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Found default for hw_vif_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:22:13 user nova-compute[75245]: DEBUG nova.compute.manager [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Instance event wait completed in 0 seconds for  {{(pid=75245) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 16:22:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Guest created on hypervisor {{(pid=75245) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 16:22:13 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Instance spawned successfully.
Nov 29 16:22:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 16:22:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Found default for hw_cdrom_bus of ide {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:22:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Found default for hw_disk_bus of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:22:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Found default for hw_input_bus of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:22:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Found default for hw_pointer_model of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:22:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Found default for hw_video_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:22:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Found default for hw_vif_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:22:13 user nova-compute[75245]: INFO nova.compute.manager [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Took 7.80 seconds to spawn the instance on the hypervisor.
Nov 29 16:22:13 user nova-compute[75245]: DEBUG nova.compute.manager [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:22:13 user nova-compute[75245]: DEBUG nova.compute.manager [req-a05ddcf2-086b-4b33-b553-b9aeb23e5256 req-af2cc89f-1d81-4e50-b343-19af10273b9a service nova] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Received event network-vif-plugged-592b836b-e112-414f-b9a9-60e5f65b8f98 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:22:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a05ddcf2-086b-4b33-b553-b9aeb23e5256 req-af2cc89f-1d81-4e50-b343-19af10273b9a service nova] Acquiring lock "ed9d1ad5-f5d0-4a68-a073-e7a83be772ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:22:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a05ddcf2-086b-4b33-b553-b9aeb23e5256 req-af2cc89f-1d81-4e50-b343-19af10273b9a service nova] Lock "ed9d1ad5-f5d0-4a68-a073-e7a83be772ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:22:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a05ddcf2-086b-4b33-b553-b9aeb23e5256 req-af2cc89f-1d81-4e50-b343-19af10273b9a service nova] Lock "ed9d1ad5-f5d0-4a68-a073-e7a83be772ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:22:13 user nova-compute[75245]: DEBUG nova.compute.manager [req-a05ddcf2-086b-4b33-b553-b9aeb23e5256 req-af2cc89f-1d81-4e50-b343-19af10273b9a service nova] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] No waiting events found dispatching network-vif-plugged-592b836b-e112-414f-b9a9-60e5f65b8f98 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:22:13 user nova-compute[75245]: WARNING nova.compute.manager [req-a05ddcf2-086b-4b33-b553-b9aeb23e5256 req-af2cc89f-1d81-4e50-b343-19af10273b9a service nova] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Received unexpected event network-vif-plugged-592b836b-e112-414f-b9a9-60e5f65b8f98 for instance with vm_state building and task_state spawning.
Nov 29 16:22:13 user nova-compute[75245]: INFO nova.compute.manager [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Took 6.86 seconds to spawn the instance on the hypervisor.
Nov 29 16:22:13 user nova-compute[75245]: DEBUG nova.compute.manager [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:22:13 user nova-compute[75245]: INFO nova.compute.manager [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Took 9.38 seconds to build instance.
Nov 29 16:22:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4a680b6d-a875-4e15-99c1-791398e10468 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lock "35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.556s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:22:13 user nova-compute[75245]: INFO nova.compute.manager [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Took 8.69 seconds to build instance.
Nov 29 16:22:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-78285c7e-712e-494c-a443-af008dafd21b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lock "ed9d1ad5-f5d0-4a68-a073-e7a83be772ea" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.828s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:22:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:22:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:22:18 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:22:18 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:22:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:22:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:22:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:22:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:22:33 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:22:33 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:22:38 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:22:38 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:22:43 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:22:43 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:22:48 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:22:48 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:22:53 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:22:53 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:22:53 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75245) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 16:22:53 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:22:53 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:22:53 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:22:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:22:55 user nova-compute[75245]: DEBUG nova.compute.manager [req-ac01dd60-f02d-43bb-b823-4d67b1524b24 req-3e09a3db-b7e3-49bd-8e2c-496feffe8dd5 service nova] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Received event network-changed-467a0f1e-1ad6-4474-bbcb-dadad3ea69ab {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:22:55 user nova-compute[75245]: DEBUG nova.compute.manager [req-ac01dd60-f02d-43bb-b823-4d67b1524b24 req-3e09a3db-b7e3-49bd-8e2c-496feffe8dd5 service nova] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Refreshing instance network info cache due to event network-changed-467a0f1e-1ad6-4474-bbcb-dadad3ea69ab. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:22:55 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-ac01dd60-f02d-43bb-b823-4d67b1524b24 req-3e09a3db-b7e3-49bd-8e2c-496feffe8dd5 service nova] Acquiring lock "refresh_cache-4f7fb562-a698-4fc9-91b0-c786627f6d75" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:22:55 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-ac01dd60-f02d-43bb-b823-4d67b1524b24 req-3e09a3db-b7e3-49bd-8e2c-496feffe8dd5 service nova] Acquired lock "refresh_cache-4f7fb562-a698-4fc9-91b0-c786627f6d75" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:22:55 user nova-compute[75245]: DEBUG nova.network.neutron [req-ac01dd60-f02d-43bb-b823-4d67b1524b24 req-3e09a3db-b7e3-49bd-8e2c-496feffe8dd5 service nova] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Refreshing network info cache for port 467a0f1e-1ad6-4474-bbcb-dadad3ea69ab {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:22:56 user nova-compute[75245]: DEBUG nova.network.neutron [req-ac01dd60-f02d-43bb-b823-4d67b1524b24 req-3e09a3db-b7e3-49bd-8e2c-496feffe8dd5 service nova] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Updated VIF entry in instance network info cache for port 467a0f1e-1ad6-4474-bbcb-dadad3ea69ab. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:22:56 user nova-compute[75245]: DEBUG nova.network.neutron [req-ac01dd60-f02d-43bb-b823-4d67b1524b24 req-3e09a3db-b7e3-49bd-8e2c-496feffe8dd5 service nova] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Updating instance_info_cache with network_info: [{"id": "467a0f1e-1ad6-4474-bbcb-dadad3ea69ab", "address": "fa:16:3e:ab:27:73", "network": {"id": "1869d0f1-8115-44c6-b5d4-42e362716749", "bridge": "br-int", "label": "tempest-TestShelveInstance-1207362046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bd57c6933c04f5a9ec5e27eb8bce661", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap467a0f1e-1a", "ovs_interfaceid": "467a0f1e-1ad6-4474-bbcb-dadad3ea69ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:22:56 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-ac01dd60-f02d-43bb-b823-4d67b1524b24 req-3e09a3db-b7e3-49bd-8e2c-496feffe8dd5 service nova] Releasing lock "refresh_cache-4f7fb562-a698-4fc9-91b0-c786627f6d75" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:22:56 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-40a60a0d-cf12-4b77-8144-39ca1d414448 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Acquiring lock "4f7fb562-a698-4fc9-91b0-c786627f6d75" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:22:56 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-40a60a0d-cf12-4b77-8144-39ca1d414448 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Lock "4f7fb562-a698-4fc9-91b0-c786627f6d75" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:22:56 user nova-compute[75245]: INFO nova.compute.manager [None req-40a60a0d-cf12-4b77-8144-39ca1d414448 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Shelve offloading
Nov 29 16:22:56 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:22:56 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:22:56 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:22:56 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:22:56 user nova-compute[75245]: DEBUG nova.compute.manager [req-a92248df-a1d8-4767-83ea-86643a822519 req-547d4cab-175d-4bc6-a1e6-fa6db01bd236 service nova] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Received event network-vif-unplugged-467a0f1e-1ad6-4474-bbcb-dadad3ea69ab {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:22:56 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a92248df-a1d8-4767-83ea-86643a822519 req-547d4cab-175d-4bc6-a1e6-fa6db01bd236 service nova] Acquiring lock "4f7fb562-a698-4fc9-91b0-c786627f6d75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:22:56 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a92248df-a1d8-4767-83ea-86643a822519 req-547d4cab-175d-4bc6-a1e6-fa6db01bd236 service nova] Lock "4f7fb562-a698-4fc9-91b0-c786627f6d75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:22:56 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a92248df-a1d8-4767-83ea-86643a822519 req-547d4cab-175d-4bc6-a1e6-fa6db01bd236 service nova] Lock "4f7fb562-a698-4fc9-91b0-c786627f6d75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:22:56 user nova-compute[75245]: DEBUG nova.compute.manager [req-a92248df-a1d8-4767-83ea-86643a822519 req-547d4cab-175d-4bc6-a1e6-fa6db01bd236 service nova] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] No waiting events found dispatching network-vif-unplugged-467a0f1e-1ad6-4474-bbcb-dadad3ea69ab {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:22:56 user nova-compute[75245]: WARNING nova.compute.manager [req-a92248df-a1d8-4767-83ea-86643a822519 req-547d4cab-175d-4bc6-a1e6-fa6db01bd236 service nova] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Received unexpected event network-vif-unplugged-467a0f1e-1ad6-4474-bbcb-dadad3ea69ab for instance with vm_state active and task_state shelving.
Nov 29 16:22:57 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Instance destroyed successfully.
Nov 29 16:22:57 user nova-compute[75245]: DEBUG nova.compute.manager [None req-40a60a0d-cf12-4b77-8144-39ca1d414448 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:22:57 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-40a60a0d-cf12-4b77-8144-39ca1d414448 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Acquiring lock "refresh_cache-4f7fb562-a698-4fc9-91b0-c786627f6d75" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:22:57 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-40a60a0d-cf12-4b77-8144-39ca1d414448 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Acquired lock "refresh_cache-4f7fb562-a698-4fc9-91b0-c786627f6d75" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:22:57 user nova-compute[75245]: DEBUG nova.network.neutron [None req-40a60a0d-cf12-4b77-8144-39ca1d414448 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 16:22:57 user nova-compute[75245]: DEBUG nova.network.neutron [None req-40a60a0d-cf12-4b77-8144-39ca1d414448 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Updating instance_info_cache with network_info: [{"id": "467a0f1e-1ad6-4474-bbcb-dadad3ea69ab", "address": "fa:16:3e:ab:27:73", "network": {"id": "1869d0f1-8115-44c6-b5d4-42e362716749", "bridge": "br-int", "label": "tempest-TestShelveInstance-1207362046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bd57c6933c04f5a9ec5e27eb8bce661", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap467a0f1e-1a", "ovs_interfaceid": "467a0f1e-1ad6-4474-bbcb-dadad3ea69ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:22:58 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-40a60a0d-cf12-4b77-8144-39ca1d414448 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Releasing lock "refresh_cache-4f7fb562-a698-4fc9-91b0-c786627f6d75" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:22:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:22:58 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Instance destroyed successfully.
Nov 29 16:22:58 user nova-compute[75245]: DEBUG nova.objects.instance [None req-40a60a0d-cf12-4b77-8144-39ca1d414448 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Lazy-loading 'resources' on Instance uuid 4f7fb562-a698-4fc9-91b0-c786627f6d75 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:22:58 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-40a60a0d-cf12-4b77-8144-39ca1d414448 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:21:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1369972773',display_name='tempest-TestShelveInstance-server-1369972773',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1369972773',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLE7nr47G8CHHLOTmQq/XixPARJFpOT+HvuTUIzQWMmpzlpPoy+l6Oj2zJ7pst+CAggF8656bQlmnmYfbIcrkf9PnEB/N+Dql4y/VnBwqBg2qMznC5qDYlg7sEsaYBgGjA==',key_name='tempest-TestShelveInstance-1582200683',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:21:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5bd57c6933c04f5a9ec5e27eb8bce661',ramdisk_id='',reservation_id='r-058m537p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1248422115',owner_user_name='tempest-TestShelveInstance-1248422115-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:21:17Z,user_data=None,user_id='a271b4251cd64c5c8d5bf8e73e365624',uuid=4f7fb562-a698-4fc9-91b0-c786627f6d75,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "467a0f1e-1ad6-4474-bbcb-dadad3ea69ab", "address": "fa:16:3e:ab:27:73", "network": {"id": "1869d0f1-8115-44c6-b5d4-42e362716749", "bridge": "br-int", "label": "tempest-TestShelveInstance-1207362046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bd57c6933c04f5a9ec5e27eb8bce661", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap467a0f1e-1a", "ovs_interfaceid": "467a0f1e-1ad6-4474-bbcb-dadad3ea69ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 16:22:58 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-40a60a0d-cf12-4b77-8144-39ca1d414448 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Converting VIF {"id": "467a0f1e-1ad6-4474-bbcb-dadad3ea69ab", "address": "fa:16:3e:ab:27:73", "network": {"id": "1869d0f1-8115-44c6-b5d4-42e362716749", "bridge": "br-int", "label": "tempest-TestShelveInstance-1207362046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bd57c6933c04f5a9ec5e27eb8bce661", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap467a0f1e-1a", "ovs_interfaceid": "467a0f1e-1ad6-4474-bbcb-dadad3ea69ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:22:58 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-40a60a0d-cf12-4b77-8144-39ca1d414448 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:27:73,bridge_name='br-int',has_traffic_filtering=True,id=467a0f1e-1ad6-4474-bbcb-dadad3ea69ab,network=Network(1869d0f1-8115-44c6-b5d4-42e362716749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap467a0f1e-1a') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:22:58 user nova-compute[75245]: DEBUG os_vif [None req-40a60a0d-cf12-4b77-8144-39ca1d414448 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:27:73,bridge_name='br-int',has_traffic_filtering=True,id=467a0f1e-1ad6-4474-bbcb-dadad3ea69ab,network=Network(1869d0f1-8115-44c6-b5d4-42e362716749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap467a0f1e-1a') {{(pid=75245) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 16:22:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:22:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap467a0f1e-1a, bridge=br-int, if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:22:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:22:58 user nova-compute[75245]: DEBUG nova.compute.manager [req-6e7f407f-f19f-40f3-963d-455baf051dfc req-2030f867-b971-462b-8063-bef2f6a4a108 service nova] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Received event network-changed-467a0f1e-1ad6-4474-bbcb-dadad3ea69ab {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:22:58 user nova-compute[75245]: DEBUG nova.compute.manager [req-6e7f407f-f19f-40f3-963d-455baf051dfc req-2030f867-b971-462b-8063-bef2f6a4a108 service nova] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Refreshing instance network info cache due to event network-changed-467a0f1e-1ad6-4474-bbcb-dadad3ea69ab. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:22:58 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-6e7f407f-f19f-40f3-963d-455baf051dfc req-2030f867-b971-462b-8063-bef2f6a4a108 service nova] Acquiring lock "refresh_cache-4f7fb562-a698-4fc9-91b0-c786627f6d75" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:22:58 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-6e7f407f-f19f-40f3-963d-455baf051dfc req-2030f867-b971-462b-8063-bef2f6a4a108 service nova] Acquired lock "refresh_cache-4f7fb562-a698-4fc9-91b0-c786627f6d75" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:22:58 user nova-compute[75245]: DEBUG nova.network.neutron [req-6e7f407f-f19f-40f3-963d-455baf051dfc req-2030f867-b971-462b-8063-bef2f6a4a108 service nova] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Refreshing network info cache for port 467a0f1e-1ad6-4474-bbcb-dadad3ea69ab {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:22:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:22:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:22:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f33e4d5f-6a89-4ca9-b1f2-5b682310a1e6) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:22:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:22:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:22:58 user nova-compute[75245]: INFO os_vif [None req-40a60a0d-cf12-4b77-8144-39ca1d414448 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:27:73,bridge_name='br-int',has_traffic_filtering=True,id=467a0f1e-1ad6-4474-bbcb-dadad3ea69ab,network=Network(1869d0f1-8115-44c6-b5d4-42e362716749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap467a0f1e-1a')
Nov 29 16:22:58 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40a60a0d-cf12-4b77-8144-39ca1d414448 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] calling os-brick to detach iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 16:22:58 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a60a0d-cf12-4b77-8144-39ca1d414448 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, {'target_iqn': 'iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hfwlIuBG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:22:58 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-40a60a0d-cf12-4b77-8144-39ca1d414448 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:22:58 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-40a60a0d-cf12-4b77-8144-39ca1d414448 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:22:58 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-40a60a0d-cf12-4b77-8144-39ca1d414448 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:22:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:22:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:22:58 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a12b43a-4fbf-4e05-b7f5-dc05d243dadf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:22:58 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a60a0d-cf12-4b77-8144-39ca1d414448 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 16:22:58 user nova-compute[75245]: No targets found.
Nov 29 16:22:58 user nova-compute[75245]: iSNS:
Nov 29 16:22:58 user nova-compute[75245]: No targets found.
Nov 29 16:22:58 user nova-compute[75245]: STATIC:
Nov 29 16:22:58 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e
Nov 29 16:22:58 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:22:58 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:22:58 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024
Nov 29 16:22:58 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:22:58 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:22:58 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed
Nov 29 16:22:58 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:22:58 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:22:58 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f
Nov 29 16:22:58 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:22:58 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:22:58 user nova-compute[75245]: FIRMWARE:
Nov 29 16:22:58 user nova-compute[75245]: No targets found.
Nov 29 16:22:58 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:22:58 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a60a0d-cf12-4b77-8144-39ca1d414448 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 16:22:58 user nova-compute[75245]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 16:22:58 user nova-compute[75245]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75245) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 16:22:58 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a60a0d-cf12-4b77-8144-39ca1d414448 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024', 0)] {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 16:22:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:22:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:22:58 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[826a4cbb-df08-4dbd-8af4-e968701c745d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:22:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:22:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:22:58 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[6288b070-0a22-427d-b2ef-5f05524be990]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:22:58 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a60a0d-cf12-4b77-8144-39ca1d414448 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 (non-flash)
Nov 29 16:22:58 user nova-compute[75245]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f (non-flash)
Nov 29 16:22:58 user nova-compute[75245]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e (non-flash)
Nov 29 16:22:58 user nova-compute[75245]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)
Nov 29 16:22:58 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:22:58 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a60a0d-cf12-4b77-8144-39ca1d414448 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 (non-flash)
Nov 29 16:22:58 user nova-compute[75245]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f (non-flash)
Nov 29 16:22:58 user nova-compute[75245]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e (non-flash)
Nov 29 16:22:58 user nova-compute[75245]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)
Nov 29 16:22:58 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:22:58 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a60a0d-cf12-4b77-8144-39ca1d414448 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0d4c386830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024'): ({'sdb'}, set())}) {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 16:22:58 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-40a60a0d-cf12-4b77-8144-39ca1d414448 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Removing single pathed devices sdb {{(pid=75245) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 16:22:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:22:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:22:58 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[7139f3e3-6392-44f3-bbd1-14aa5a42f7d7]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:22:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:22:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:22:58 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee530522-a372-460a-8107-031efebef5bf]: (4, ('ok\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:22:58 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-40a60a0d-cf12-4b77-8144-39ca1d414448 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Flushing IO for device /dev/sdb {{(pid=75245) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 16:22:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:22:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:22:58 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e39ee46-aa5c-4bf2-88be-1d65250e04f7]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:22:58 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-40a60a0d-cf12-4b77-8144-39ca1d414448 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75245) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 16:22:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:22:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:22:58 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[952e6514-fbc7-4a11-9368-60089db16642]: (4, ('1', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:22:58 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-40a60a0d-cf12-4b77-8144-39ca1d414448 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 16:22:58 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-40a60a0d-cf12-4b77-8144-39ca1d414448 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] SCSI volumes sdb have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 16:22:58 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a60a0d-cf12-4b77-8144-39ca1d414448 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024')] {{(pid=75245) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 16:22:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:22:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:22:58 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[05895d6f-1572-4408-a587-8553a2da289e]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:22:58 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a60a0d-cf12-4b77-8144-39ca1d414448 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:22:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 -p 172.16.0.220:3260 --logout {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:22:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:22:58 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[305b97b7-3508-4ee4-9ecf-f790db29af47]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:22:58 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a60a0d-cf12-4b77-8144-39ca1d414448 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024, portal: 172.16.0.220,3260]
Nov 29 16:22:58 user nova-compute[75245]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024, portal: 172.16.0.220,3260] successful.
Nov 29 16:22:58 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:22:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 -p 172.16.0.220:3260 --op delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:22:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:22:58 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[f17588fe-6c19-416f-95a4-9952aeb09a13]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:22:58 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a60a0d-cf12-4b77-8144-39ca1d414448 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:22:58 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-40a60a0d-cf12-4b77-8144-39ca1d414448 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:22:58 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a60a0d-cf12-4b77-8144-39ca1d414448 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] <== disconnect_volume: return (310ms) None {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:22:58 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40a60a0d-cf12-4b77-8144-39ca1d414448 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Disconnected iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 16:22:58 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-40a60a0d-cf12-4b77-8144-39ca1d414448 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Deleting instance files /opt/stack/data/nova/instances/4f7fb562-a698-4fc9-91b0-c786627f6d75_del
Nov 29 16:22:58 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-40a60a0d-cf12-4b77-8144-39ca1d414448 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Deletion of /opt/stack/data/nova/instances/4f7fb562-a698-4fc9-91b0-c786627f6d75_del complete
Nov 29 16:22:58 user nova-compute[75245]: DEBUG nova.network.neutron [req-6e7f407f-f19f-40f3-963d-455baf051dfc req-2030f867-b971-462b-8063-bef2f6a4a108 service nova] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Updated VIF entry in instance network info cache for port 467a0f1e-1ad6-4474-bbcb-dadad3ea69ab. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:22:58 user nova-compute[75245]: DEBUG nova.network.neutron [req-6e7f407f-f19f-40f3-963d-455baf051dfc req-2030f867-b971-462b-8063-bef2f6a4a108 service nova] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Updating instance_info_cache with network_info: [{"id": "467a0f1e-1ad6-4474-bbcb-dadad3ea69ab", "address": "fa:16:3e:ab:27:73", "network": {"id": "1869d0f1-8115-44c6-b5d4-42e362716749", "bridge": null, "label": "tempest-TestShelveInstance-1207362046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bd57c6933c04f5a9ec5e27eb8bce661", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap467a0f1e-1a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:22:58 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-6e7f407f-f19f-40f3-963d-455baf051dfc req-2030f867-b971-462b-8063-bef2f6a4a108 service nova] Releasing lock "refresh_cache-4f7fb562-a698-4fc9-91b0-c786627f6d75" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:22:59 user nova-compute[75245]: DEBUG nova.compute.manager [req-f0d07ef8-98f4-4906-9770-67f47a609a8b req-89bc5683-36ef-481f-a66c-939f5e6d68b4 service nova] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Received event network-vif-plugged-467a0f1e-1ad6-4474-bbcb-dadad3ea69ab {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:22:59 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-f0d07ef8-98f4-4906-9770-67f47a609a8b req-89bc5683-36ef-481f-a66c-939f5e6d68b4 service nova] Acquiring lock "4f7fb562-a698-4fc9-91b0-c786627f6d75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:22:59 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-f0d07ef8-98f4-4906-9770-67f47a609a8b req-89bc5683-36ef-481f-a66c-939f5e6d68b4 service nova] Lock "4f7fb562-a698-4fc9-91b0-c786627f6d75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:22:59 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-f0d07ef8-98f4-4906-9770-67f47a609a8b req-89bc5683-36ef-481f-a66c-939f5e6d68b4 service nova] Lock "4f7fb562-a698-4fc9-91b0-c786627f6d75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:22:59 user nova-compute[75245]: DEBUG nova.compute.manager [req-f0d07ef8-98f4-4906-9770-67f47a609a8b req-89bc5683-36ef-481f-a66c-939f5e6d68b4 service nova] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] No waiting events found dispatching network-vif-plugged-467a0f1e-1ad6-4474-bbcb-dadad3ea69ab {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:22:59 user nova-compute[75245]: WARNING nova.compute.manager [req-f0d07ef8-98f4-4906-9770-67f47a609a8b req-89bc5683-36ef-481f-a66c-939f5e6d68b4 service nova] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Received unexpected event network-vif-plugged-467a0f1e-1ad6-4474-bbcb-dadad3ea69ab for instance with vm_state active and task_state shelving.
Nov 29 16:22:59 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:22:59 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Starting heal instance info cache {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 16:22:59 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "refresh_cache-8785a3c2-5b7a-4382-b50d-cecd8743329c" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:22:59 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquired lock "refresh_cache-8785a3c2-5b7a-4382-b50d-cecd8743329c" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:22:59 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Forcefully refreshing network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 16:23:00 user nova-compute[75245]: INFO nova.scheduler.client.report [None req-40a60a0d-cf12-4b77-8144-39ca1d414448 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Deleted allocations for instance 4f7fb562-a698-4fc9-91b0-c786627f6d75
Nov 29 16:23:00 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-40a60a0d-cf12-4b77-8144-39ca1d414448 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:23:00 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-40a60a0d-cf12-4b77-8144-39ca1d414448 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:23:00 user nova-compute[75245]: DEBUG nova.objects.instance [None req-40a60a0d-cf12-4b77-8144-39ca1d414448 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Lazy-loading 'numa_topology' on Instance uuid 4f7fb562-a698-4fc9-91b0-c786627f6d75 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:23:00 user nova-compute[75245]: DEBUG nova.objects.base [None req-40a60a0d-cf12-4b77-8144-39ca1d414448 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Object Instance<4f7fb562-a698-4fc9-91b0-c786627f6d75> lazy-loaded attributes: resources,numa_topology {{(pid=75245) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 16:23:00 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Updating instance_info_cache with network_info: [{"id": "8c7418c2-2459-4bc3-acfb-16df97c78f67", "address": "fa:16:3e:82:d0:d8", "network": {"id": "6a7f7426-b595-4aa3-bf80-cc92ba7ce15e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-917300903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d52776451e947f5a9ef3fa44ac8acbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7418c2-24", "ovs_interfaceid": "8c7418c2-2459-4bc3-acfb-16df97c78f67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:23:00 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Releasing lock "refresh_cache-8785a3c2-5b7a-4382-b50d-cecd8743329c" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:23:00 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Updated the network info_cache for instance {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 16:23:00 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-40a60a0d-cf12-4b77-8144-39ca1d414448 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:23:00 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-40a60a0d-cf12-4b77-8144-39ca1d414448 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:23:00 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-40a60a0d-cf12-4b77-8144-39ca1d414448 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.290s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:23:00 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-40a60a0d-cf12-4b77-8144-39ca1d414448 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Lock "4f7fb562-a698-4fc9-91b0-c786627f6d75" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.829s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:23:00 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:23:01 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:23:01 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:23:01 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:23:01 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:23:01 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:23:01 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75245) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 16:23:01 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43ead766-eeb0-4c7a-a03a-6d4daf7106af/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:23:01 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43ead766-eeb0-4c7a-a03a-6d4daf7106af/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:23:01 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43ead766-eeb0-4c7a-a03a-6d4daf7106af/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:23:02 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43ead766-eeb0-4c7a-a03a-6d4daf7106af/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:23:02 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bae51e-2a85-442d-bbd2-fc89f30f40b7/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:23:02 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bae51e-2a85-442d-bbd2-fc89f30f40b7/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:23:02 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bae51e-2a85-442d-bbd2-fc89f30f40b7/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:23:02 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bae51e-2a85-442d-bbd2-fc89f30f40b7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:23:02 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:23:02 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:23:02 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:23:02 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:23:02 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:23:02 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:23:02 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:23:02 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:23:02 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:23:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:23:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:23:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:23:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:23:03 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:23:03 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:23:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:23:03 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:23:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:23:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:23:04 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:23:04 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:23:04 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Hypervisor/Node resource view: name=user free_ram=7880MB free_disk=25.295574188232422GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75245) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 16:23:04 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:23:04 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:23:04 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Applying migration context for instance 84bae51e-2a85-442d-bbd2-fc89f30f40b7 as it has an incoming, in-progress migration c238ecef-960e-49e6-9c78-1b39bc8f90c0. Migration status is finished {{(pid=75245) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 29 16:23:04 user nova-compute[75245]: INFO nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Updating resource usage from migration c238ecef-960e-49e6-9c78-1b39bc8f90c0
Nov 29 16:23:04 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance ed9a6a4e-2e7d-443c-82ef-f14f11d32c81 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:23:04 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 8785a3c2-5b7a-4382-b50d-cecd8743329c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:23:04 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 43ead766-eeb0-4c7a-a03a-6d4daf7106af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:23:04 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance d42fa9b3-91c3-4216-91f1-655ce140425f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:23:04 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Migration c238ecef-960e-49e6-9c78-1b39bc8f90c0 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 29 16:23:04 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 84bae51e-2a85-442d-bbd2-fc89f30f40b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:23:04 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 5de7e10c-f216-46b3-8f74-57bac6ab7e56 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:23:04 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:23:04 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance ed9d1ad5-f5d0-4a68-a073-e7a83be772ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:23:04 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 16:23:04 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=26GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 16:23:04 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:23:04 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:23:04 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Compute_service record updated for user:user {{(pid=75245) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 16:23:04 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.442s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:23:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1fd16dd4-f2a4-44eb-bf13-e053b26c9873 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Acquiring lock "43ead766-eeb0-4c7a-a03a-6d4daf7106af" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:23:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1fd16dd4-f2a4-44eb-bf13-e053b26c9873 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lock "43ead766-eeb0-4c7a-a03a-6d4daf7106af" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:23:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1fd16dd4-f2a4-44eb-bf13-e053b26c9873 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Acquiring lock "43ead766-eeb0-4c7a-a03a-6d4daf7106af-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:23:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1fd16dd4-f2a4-44eb-bf13-e053b26c9873 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lock "43ead766-eeb0-4c7a-a03a-6d4daf7106af-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:23:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1fd16dd4-f2a4-44eb-bf13-e053b26c9873 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lock "43ead766-eeb0-4c7a-a03a-6d4daf7106af-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:23:07 user nova-compute[75245]: INFO nova.compute.manager [None req-1fd16dd4-f2a4-44eb-bf13-e053b26c9873 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Terminating instance
Nov 29 16:23:07 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1fd16dd4-f2a4-44eb-bf13-e053b26c9873 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Start destroying the instance on the hypervisor. {{(pid=75245) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 16:23:07 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:07 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:07 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:07 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:23:07 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:23:07 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:23:07 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:23:07 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75245) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 16:23:07 user nova-compute[75245]: DEBUG nova.compute.manager [req-5e88497e-700a-4c19-b3fb-97d0fac0407d req-da19a268-49bd-401f-8abc-d3230f406732 service nova] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Received event network-vif-unplugged-4aefd86e-7753-4693-9cbd-6ee2178443b5 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:23:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-5e88497e-700a-4c19-b3fb-97d0fac0407d req-da19a268-49bd-401f-8abc-d3230f406732 service nova] Acquiring lock "43ead766-eeb0-4c7a-a03a-6d4daf7106af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:23:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-5e88497e-700a-4c19-b3fb-97d0fac0407d req-da19a268-49bd-401f-8abc-d3230f406732 service nova] Lock "43ead766-eeb0-4c7a-a03a-6d4daf7106af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:23:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-5e88497e-700a-4c19-b3fb-97d0fac0407d req-da19a268-49bd-401f-8abc-d3230f406732 service nova] Lock "43ead766-eeb0-4c7a-a03a-6d4daf7106af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:23:07 user nova-compute[75245]: DEBUG nova.compute.manager [req-5e88497e-700a-4c19-b3fb-97d0fac0407d req-da19a268-49bd-401f-8abc-d3230f406732 service nova] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] No waiting events found dispatching network-vif-unplugged-4aefd86e-7753-4693-9cbd-6ee2178443b5 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:23:07 user nova-compute[75245]: DEBUG nova.compute.manager [req-5e88497e-700a-4c19-b3fb-97d0fac0407d req-da19a268-49bd-401f-8abc-d3230f406732 service nova] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Received event network-vif-unplugged-4aefd86e-7753-4693-9cbd-6ee2178443b5 for instance with task_state deleting. {{(pid=75245) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 16:23:08 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Instance destroyed successfully.
Nov 29 16:23:08 user nova-compute[75245]: DEBUG nova.objects.instance [None req-1fd16dd4-f2a4-44eb-bf13-e053b26c9873 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lazy-loading 'resources' on Instance uuid 43ead766-eeb0-4c7a-a03a-6d4daf7106af {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:23:08 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-1fd16dd4-f2a4-44eb-bf13-e053b26c9873 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T16:17:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1984176240',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1984176240',id=19,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH74Z8eiyypbz1l5JPvqoE7mN6kpBjtN9LGqUH9Jk8PAY58RfZ7MUKhgrCMNHi/qzGIKNjocBtHkdxwKxLqCEmWTXuOZM9njdSqlsEwUOIVVwyojf8wouSpxuKrMcUkPaA==',key_name='tempest-keypair-572815760',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:21:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fd22948fbd074a7c94d8ad7614fbc220',ramdisk_id='',reservation_id='r-48eaewao',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1524245296',owner_user_name='tempest-AttachVolumeShelveTestJSON-1524245296-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:21:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c4942f948584702a8c8b93248694a65',uuid=43ead766-eeb0-4c7a-a03a-6d4daf7106af,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4aefd86e-7753-4693-9cbd-6ee2178443b5", "address": "fa:16:3e:d1:0a:c7", "network": {"id": "7f978dee-8a5e-4218-b6fc-2d550c0d7b5d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-53637364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd22948fbd074a7c94d8ad7614fbc220", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aefd86e-77", "ovs_interfaceid": "4aefd86e-7753-4693-9cbd-6ee2178443b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 16:23:08 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-1fd16dd4-f2a4-44eb-bf13-e053b26c9873 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Converting VIF {"id": "4aefd86e-7753-4693-9cbd-6ee2178443b5", "address": "fa:16:3e:d1:0a:c7", "network": {"id": "7f978dee-8a5e-4218-b6fc-2d550c0d7b5d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-53637364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd22948fbd074a7c94d8ad7614fbc220", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aefd86e-77", "ovs_interfaceid": "4aefd86e-7753-4693-9cbd-6ee2178443b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:23:08 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-1fd16dd4-f2a4-44eb-bf13-e053b26c9873 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:0a:c7,bridge_name='br-int',has_traffic_filtering=True,id=4aefd86e-7753-4693-9cbd-6ee2178443b5,network=Network(7f978dee-8a5e-4218-b6fc-2d550c0d7b5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4aefd86e-77') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:23:08 user nova-compute[75245]: DEBUG os_vif [None req-1fd16dd4-f2a4-44eb-bf13-e053b26c9873 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:0a:c7,bridge_name='br-int',has_traffic_filtering=True,id=4aefd86e-7753-4693-9cbd-6ee2178443b5,network=Network(7f978dee-8a5e-4218-b6fc-2d550c0d7b5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4aefd86e-77') {{(pid=75245) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 16:23:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4aefd86e-77, bridge=br-int, if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:23:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:23:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0d31ca3f-d587-4072-b00b-2b488922a95d) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:23:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:23:08 user nova-compute[75245]: INFO os_vif [None req-1fd16dd4-f2a4-44eb-bf13-e053b26c9873 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:0a:c7,bridge_name='br-int',has_traffic_filtering=True,id=4aefd86e-7753-4693-9cbd-6ee2178443b5,network=Network(7f978dee-8a5e-4218-b6fc-2d550c0d7b5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4aefd86e-77')
Nov 29 16:23:08 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-1fd16dd4-f2a4-44eb-bf13-e053b26c9873 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Deleting instance files /opt/stack/data/nova/instances/43ead766-eeb0-4c7a-a03a-6d4daf7106af_del
Nov 29 16:23:08 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-1fd16dd4-f2a4-44eb-bf13-e053b26c9873 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Deletion of /opt/stack/data/nova/instances/43ead766-eeb0-4c7a-a03a-6d4daf7106af_del complete
Nov 29 16:23:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:08 user nova-compute[75245]: INFO nova.compute.manager [None req-1fd16dd4-f2a4-44eb-bf13-e053b26c9873 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 29 16:23:08 user nova-compute[75245]: DEBUG oslo.service.loopingcall [None req-1fd16dd4-f2a4-44eb-bf13-e053b26c9873 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75245) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 16:23:08 user nova-compute[75245]: DEBUG nova.compute.manager [-] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Deallocating network for instance {{(pid=75245) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 16:23:08 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] deallocate_for_instance() {{(pid=75245) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 16:23:08 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:23:09 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:23:09 user nova-compute[75245]: INFO nova.compute.manager [-] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Took 0.65 seconds to deallocate network for instance.
Nov 29 16:23:09 user nova-compute[75245]: DEBUG nova.compute.manager [req-021317ed-b05c-46ed-89d8-f66cd9efa027 req-4d9b12a4-a797-4b9a-8664-b01ae83f5342 service nova] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Received event network-vif-deleted-4aefd86e-7753-4693-9cbd-6ee2178443b5 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:23:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1fd16dd4-f2a4-44eb-bf13-e053b26c9873 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:23:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1fd16dd4-f2a4-44eb-bf13-e053b26c9873 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:23:09 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1fd16dd4-f2a4-44eb-bf13-e053b26c9873 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:23:09 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1fd16dd4-f2a4-44eb-bf13-e053b26c9873 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:23:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1fd16dd4-f2a4-44eb-bf13-e053b26c9873 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.279s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:23:09 user nova-compute[75245]: INFO nova.scheduler.client.report [None req-1fd16dd4-f2a4-44eb-bf13-e053b26c9873 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Deleted allocations for instance 43ead766-eeb0-4c7a-a03a-6d4daf7106af
Nov 29 16:23:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1fd16dd4-f2a4-44eb-bf13-e053b26c9873 tempest-AttachVolumeShelveTestJSON-1524245296 tempest-AttachVolumeShelveTestJSON-1524245296-project-member] Lock "43ead766-eeb0-4c7a-a03a-6d4daf7106af" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.983s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:23:09 user nova-compute[75245]: DEBUG nova.compute.manager [req-a05b980d-471c-4509-9d82-254a5debf4d9 req-9be6c3c6-c44f-461a-80d6-dc63dac42558 service nova] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Received event network-vif-plugged-4aefd86e-7753-4693-9cbd-6ee2178443b5 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:23:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a05b980d-471c-4509-9d82-254a5debf4d9 req-9be6c3c6-c44f-461a-80d6-dc63dac42558 service nova] Acquiring lock "43ead766-eeb0-4c7a-a03a-6d4daf7106af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:23:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a05b980d-471c-4509-9d82-254a5debf4d9 req-9be6c3c6-c44f-461a-80d6-dc63dac42558 service nova] Lock "43ead766-eeb0-4c7a-a03a-6d4daf7106af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:23:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a05b980d-471c-4509-9d82-254a5debf4d9 req-9be6c3c6-c44f-461a-80d6-dc63dac42558 service nova] Lock "43ead766-eeb0-4c7a-a03a-6d4daf7106af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:23:09 user nova-compute[75245]: DEBUG nova.compute.manager [req-a05b980d-471c-4509-9d82-254a5debf4d9 req-9be6c3c6-c44f-461a-80d6-dc63dac42558 service nova] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] No waiting events found dispatching network-vif-plugged-4aefd86e-7753-4693-9cbd-6ee2178443b5 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:23:09 user nova-compute[75245]: WARNING nova.compute.manager [req-a05b980d-471c-4509-9d82-254a5debf4d9 req-9be6c3c6-c44f-461a-80d6-dc63dac42558 service nova] [instance: 43ead766-eeb0-4c7a-a03a-6d4daf7106af] Received unexpected event network-vif-plugged-4aefd86e-7753-4693-9cbd-6ee2178443b5 for instance with vm_state deleted and task_state None.
Nov 29 16:23:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:18 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:23:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75245) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 16:23:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:23:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:23:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:26 user nova-compute[75245]: DEBUG nova.compute.manager [req-97dd8d27-76ef-4362-a471-839fb807f85f req-a1dad7f3-6ede-429e-82f7-684b5aa4714e service nova] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] Received event network-changed-c72edead-bad2-45c4-9ac8-90dd2a4f8ed5 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:23:26 user nova-compute[75245]: DEBUG nova.compute.manager [req-97dd8d27-76ef-4362-a471-839fb807f85f req-a1dad7f3-6ede-429e-82f7-684b5aa4714e service nova] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] Refreshing instance network info cache due to event network-changed-c72edead-bad2-45c4-9ac8-90dd2a4f8ed5. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:23:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-97dd8d27-76ef-4362-a471-839fb807f85f req-a1dad7f3-6ede-429e-82f7-684b5aa4714e service nova] Acquiring lock "refresh_cache-ed9a6a4e-2e7d-443c-82ef-f14f11d32c81" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:23:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-97dd8d27-76ef-4362-a471-839fb807f85f req-a1dad7f3-6ede-429e-82f7-684b5aa4714e service nova] Acquired lock "refresh_cache-ed9a6a4e-2e7d-443c-82ef-f14f11d32c81" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:23:26 user nova-compute[75245]: DEBUG nova.network.neutron [req-97dd8d27-76ef-4362-a471-839fb807f85f req-a1dad7f3-6ede-429e-82f7-684b5aa4714e service nova] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] Refreshing network info cache for port c72edead-bad2-45c4-9ac8-90dd2a4f8ed5 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:23:27 user nova-compute[75245]: DEBUG nova.network.neutron [req-97dd8d27-76ef-4362-a471-839fb807f85f req-a1dad7f3-6ede-429e-82f7-684b5aa4714e service nova] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] Updated VIF entry in instance network info cache for port c72edead-bad2-45c4-9ac8-90dd2a4f8ed5. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:23:27 user nova-compute[75245]: DEBUG nova.network.neutron [req-97dd8d27-76ef-4362-a471-839fb807f85f req-a1dad7f3-6ede-429e-82f7-684b5aa4714e service nova] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] Updating instance_info_cache with network_info: [{"id": "c72edead-bad2-45c4-9ac8-90dd2a4f8ed5", "address": "fa:16:3e:bb:74:67", "network": {"id": "f1fac2f4-e789-443e-b6a5-1a3f829bc302", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1199431077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6b87e18ef1f48d19a6907b28cb54f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc72edead-ba", "ovs_interfaceid": "c72edead-bad2-45c4-9ac8-90dd2a4f8ed5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:23:27 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-97dd8d27-76ef-4362-a471-839fb807f85f req-a1dad7f3-6ede-429e-82f7-684b5aa4714e service nova] Releasing lock "refresh_cache-ed9a6a4e-2e7d-443c-82ef-f14f11d32c81" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:23:27 user nova-compute[75245]: DEBUG nova.compute.manager [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Stashing vm_state: active {{(pid=75245) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 29 16:23:27 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:23:27 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:23:27 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75245) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 16:23:27 user nova-compute[75245]: INFO nova.compute.claims [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Claim successful on node user
Nov 29 16:23:27 user nova-compute[75245]: INFO nova.compute.resource_tracker [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Updating resource usage from migration 5086ee39-8d43-4f62-b55b-269f7ca7eb37
Nov 29 16:23:28 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:23:28 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:23:28 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.352s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:23:28 user nova-compute[75245]: INFO nova.compute.manager [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Migrating
Nov 29 16:23:28 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Acquiring lock "refresh_cache-d42fa9b3-91c3-4216-91f1-655ce140425f" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:23:28 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Acquired lock "refresh_cache-d42fa9b3-91c3-4216-91f1-655ce140425f" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:23:28 user nova-compute[75245]: DEBUG nova.network.neutron [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 16:23:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:23:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:28 user nova-compute[75245]: DEBUG nova.network.neutron [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Updating instance_info_cache with network_info: [{"id": "497aee0b-487f-4138-9394-a68c8bd55e61", "address": "fa:16:3e:09:ba:94", "network": {"id": "f1fac2f4-e789-443e-b6a5-1a3f829bc302", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1199431077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6b87e18ef1f48d19a6907b28cb54f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap497aee0b-48", "ovs_interfaceid": "497aee0b-487f-4138-9394-a68c8bd55e61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:23:28 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Releasing lock "refresh_cache-d42fa9b3-91c3-4216-91f1-655ce140425f" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:23:28 user nova-compute[75245]: DEBUG nova.compute.manager [req-926497d7-7b93-4c5e-8a65-525dd48c6a7f req-4b7933c3-1de5-43fc-a29f-1972a0469853 service nova] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Received event network-changed-497aee0b-487f-4138-9394-a68c8bd55e61 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:23:28 user nova-compute[75245]: DEBUG nova.compute.manager [req-926497d7-7b93-4c5e-8a65-525dd48c6a7f req-4b7933c3-1de5-43fc-a29f-1972a0469853 service nova] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Refreshing instance network info cache due to event network-changed-497aee0b-487f-4138-9394-a68c8bd55e61. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:23:28 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-926497d7-7b93-4c5e-8a65-525dd48c6a7f req-4b7933c3-1de5-43fc-a29f-1972a0469853 service nova] Acquiring lock "refresh_cache-d42fa9b3-91c3-4216-91f1-655ce140425f" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:23:28 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-926497d7-7b93-4c5e-8a65-525dd48c6a7f req-4b7933c3-1de5-43fc-a29f-1972a0469853 service nova] Acquired lock "refresh_cache-d42fa9b3-91c3-4216-91f1-655ce140425f" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:23:28 user nova-compute[75245]: DEBUG nova.network.neutron [req-926497d7-7b93-4c5e-8a65-525dd48c6a7f req-4b7933c3-1de5-43fc-a29f-1972a0469853 service nova] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Refreshing network info cache for port 497aee0b-487f-4138-9394-a68c8bd55e61 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:23:28 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Starting migrate_disk_and_power_off {{(pid=75245) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11484}}
Nov 29 16:23:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:29 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:29 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:29 user nova-compute[75245]: DEBUG nova.network.neutron [req-926497d7-7b93-4c5e-8a65-525dd48c6a7f req-4b7933c3-1de5-43fc-a29f-1972a0469853 service nova] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Updated VIF entry in instance network info cache for port 497aee0b-487f-4138-9394-a68c8bd55e61. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:23:29 user nova-compute[75245]: DEBUG nova.network.neutron [req-926497d7-7b93-4c5e-8a65-525dd48c6a7f req-4b7933c3-1de5-43fc-a29f-1972a0469853 service nova] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Updating instance_info_cache with network_info: [{"id": "497aee0b-487f-4138-9394-a68c8bd55e61", "address": "fa:16:3e:09:ba:94", "network": {"id": "f1fac2f4-e789-443e-b6a5-1a3f829bc302", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1199431077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6b87e18ef1f48d19a6907b28cb54f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap497aee0b-48", "ovs_interfaceid": "497aee0b-487f-4138-9394-a68c8bd55e61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:23:29 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-926497d7-7b93-4c5e-8a65-525dd48c6a7f req-4b7933c3-1de5-43fc-a29f-1972a0469853 service nova] Releasing lock "refresh_cache-d42fa9b3-91c3-4216-91f1-655ce140425f" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:23:29 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:29 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:29 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Instance destroyed successfully.
Nov 29 16:23:29 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:21:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-398720439',display_name='tempest-ServerActionsTestOtherA-server-398720439',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-398720439',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBlv185nmJa9KBQWtd25ahGt24w8RxLoAajuGL7vBUTHaz3jTQraFsqx3MIOXaCnGwG9vPuUxlhI7TdDBUzC5IxITSYROv0nohB5+qOZUd0Imt2qi6DOpY2ZQc/HDcV0+g==',key_name='tempest-keypair-7729748',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:21:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c6b87e18ef1f48d19a6907b28cb54f04',ramdisk_id='',reservation_id='r-bs0pty7s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1840344781',owner_user_name='tempest-ServerActionsTestOtherA-1840344781-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:23:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be595c3f7084413180f2ab86e9c56a64',uuid=d42fa9b3-91c3-4216-91f1-655ce140425f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "497aee0b-487f-4138-9394-a68c8bd55e61", "address": "fa:16:3e:09:ba:94", "network": {"id": "f1fac2f4-e789-443e-b6a5-1a3f829bc302", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1199431077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1199431077-network", "vif_mac": "fa:16:3e:09:ba:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6b87e18ef1f48d19a6907b28cb54f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap497aee0b-48", "ovs_interfaceid": "497aee0b-487f-4138-9394-a68c8bd55e61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 16:23:29 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Converting VIF {"id": "497aee0b-487f-4138-9394-a68c8bd55e61", "address": "fa:16:3e:09:ba:94", "network": {"id": "f1fac2f4-e789-443e-b6a5-1a3f829bc302", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1199431077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1199431077-network", "vif_mac": "fa:16:3e:09:ba:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6b87e18ef1f48d19a6907b28cb54f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap497aee0b-48", "ovs_interfaceid": "497aee0b-487f-4138-9394-a68c8bd55e61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:23:29 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:09:ba:94,bridge_name='br-int',has_traffic_filtering=True,id=497aee0b-487f-4138-9394-a68c8bd55e61,network=Network(f1fac2f4-e789-443e-b6a5-1a3f829bc302),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap497aee0b-48') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:23:29 user nova-compute[75245]: DEBUG os_vif [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:ba:94,bridge_name='br-int',has_traffic_filtering=True,id=497aee0b-487f-4138-9394-a68c8bd55e61,network=Network(f1fac2f4-e789-443e-b6a5-1a3f829bc302),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap497aee0b-48') {{(pid=75245) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 16:23:29 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:29 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap497aee0b-48, bridge=br-int, if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:23:29 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:29 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:23:29 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:29 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=da551510-3a51-4bd7-93ef-9ff044874daa) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:23:29 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:29 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:29 user nova-compute[75245]: INFO os_vif [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:ba:94,bridge_name='br-int',has_traffic_filtering=True,id=497aee0b-487f-4138-9394-a68c8bd55e61,network=Network(f1fac2f4-e789-443e-b6a5-1a3f829bc302),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap497aee0b-48')
Nov 29 16:23:29 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] calling os-brick to detach iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 16:23:29 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, {'target_iqn': 'iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zpXHZUKQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:23:29 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:23:29 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:23:29 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:23:29 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:23:29 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:23:29 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[513bbfc5-f157-4e4b-81f4-0b6bb5f9827c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:23:29 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 16:23:29 user nova-compute[75245]: No targets found.
Nov 29 16:23:29 user nova-compute[75245]: iSNS:
Nov 29 16:23:29 user nova-compute[75245]: No targets found.
Nov 29 16:23:29 user nova-compute[75245]: STATIC:
Nov 29 16:23:29 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e
Nov 29 16:23:29 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:23:29 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:23:29 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed
Nov 29 16:23:29 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:23:29 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:23:29 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f
Nov 29 16:23:29 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:23:29 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:23:29 user nova-compute[75245]: FIRMWARE:
Nov 29 16:23:29 user nova-compute[75245]: No targets found.
Nov 29 16:23:29 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:23:29 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 16:23:29 user nova-compute[75245]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 16:23:29 user nova-compute[75245]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75245) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 16:23:29 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f', 0)] {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 16:23:29 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:23:29 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:23:29 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c58fd6e-14d1-43fd-8a66-61f5efd327dc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:23:29 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:23:29 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:23:29 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[70baaa20-1aa8-432d-99d9-c695faf3e830]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:23:29 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f (non-flash)
Nov 29 16:23:29 user nova-compute[75245]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e (non-flash)
Nov 29 16:23:29 user nova-compute[75245]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)
Nov 29 16:23:29 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:23:29 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f (non-flash)
Nov 29 16:23:29 user nova-compute[75245]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e (non-flash)
Nov 29 16:23:29 user nova-compute[75245]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)
Nov 29 16:23:29 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:23:29 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0d4416d360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f'): ({'sdd'}, set())}) {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 16:23:29 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Removing single pathed devices sdd {{(pid=75245) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 16:23:29 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:23:29 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:23:29 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ecf7e6-9231-452e-8f42-7ce103bf7a2a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:23:29 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:23:29 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:23:29 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d99106-7075-490c-b131-783927a1c044]: (4, ('ok\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:23:29 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Flushing IO for device /dev/sdd {{(pid=75245) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 16:23:29 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:23:29 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:23:29 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcddc7e9-5f3f-4d3a-8014-d53188e2765a]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:23:29 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75245) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 16:23:29 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:23:29 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.052s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:23:29 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ea158f-cbd8-45b7-81d4-820b0418ae80]: (4, ('1', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:23:29 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 16:23:29 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] SCSI volumes sdd have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 16:23:29 user nova-compute[75245]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_be8cd36b', '/dev/disk/by-id/scsi-23465333932326266', '/dev/disk/by-id/scsi-1SCST_BIObe8cd36b-4e3922bf6640c185') {{(pid=86166) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 29 16:23:29 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d48791-6996-437e-bee8-8e9061845d9c]: (4, None) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:23:29 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f')] {{(pid=75245) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 16:23:29 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:23:29 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:23:29 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e243ab-1b24-4cdc-afc8-a2268c41ab33]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:23:29 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:23:29 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f -p 172.16.0.220:3260 --logout {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:23:29 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:23:29 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dcf16c3-d5a1-4548-b5ec-f594bc5ad6ae]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:23:29 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f, portal: 172.16.0.220,3260]
Nov 29 16:23:29 user nova-compute[75245]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f, portal: 172.16.0.220,3260] successful.
Nov 29 16:23:29 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:23:29 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f -p 172.16.0.220:3260 --op delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:23:29 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:23:29 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[d80bc148-6460-4376-89b8-05e89c34b6b7]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:23:29 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:23:29 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:23:29 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] <== disconnect_volume: return (328ms) None {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:23:29 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Disconnected iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 16:23:29 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:23:30 user nova-compute[75245]: DEBUG nova.compute.manager [req-dfa3f553-d3ce-4df4-a4bd-9b57fa75bca0 req-519cef3b-629d-4c74-b9f9-a8315ea7381a service nova] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Received event network-vif-unplugged-497aee0b-487f-4138-9394-a68c8bd55e61 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:23:30 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-dfa3f553-d3ce-4df4-a4bd-9b57fa75bca0 req-519cef3b-629d-4c74-b9f9-a8315ea7381a service nova] Acquiring lock "d42fa9b3-91c3-4216-91f1-655ce140425f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:23:30 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-dfa3f553-d3ce-4df4-a4bd-9b57fa75bca0 req-519cef3b-629d-4c74-b9f9-a8315ea7381a service nova] Lock "d42fa9b3-91c3-4216-91f1-655ce140425f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:23:30 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-dfa3f553-d3ce-4df4-a4bd-9b57fa75bca0 req-519cef3b-629d-4c74-b9f9-a8315ea7381a service nova] Lock "d42fa9b3-91c3-4216-91f1-655ce140425f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:23:30 user nova-compute[75245]: DEBUG nova.compute.manager [req-dfa3f553-d3ce-4df4-a4bd-9b57fa75bca0 req-519cef3b-629d-4c74-b9f9-a8315ea7381a service nova] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] No waiting events found dispatching network-vif-unplugged-497aee0b-487f-4138-9394-a68c8bd55e61 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:23:30 user nova-compute[75245]: WARNING nova.compute.manager [req-dfa3f553-d3ce-4df4-a4bd-9b57fa75bca0 req-519cef3b-629d-4c74-b9f9-a8315ea7381a service nova] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Received unexpected event network-vif-unplugged-497aee0b-487f-4138-9394-a68c8bd55e61 for instance with vm_state active and task_state resize_migrating.
Nov 29 16:23:30 user nova-compute[75245]: DEBUG nova.compute.manager [req-dfa3f553-d3ce-4df4-a4bd-9b57fa75bca0 req-519cef3b-629d-4c74-b9f9-a8315ea7381a service nova] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Received event network-vif-plugged-497aee0b-487f-4138-9394-a68c8bd55e61 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:23:30 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-dfa3f553-d3ce-4df4-a4bd-9b57fa75bca0 req-519cef3b-629d-4c74-b9f9-a8315ea7381a service nova] Acquiring lock "d42fa9b3-91c3-4216-91f1-655ce140425f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:23:30 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-dfa3f553-d3ce-4df4-a4bd-9b57fa75bca0 req-519cef3b-629d-4c74-b9f9-a8315ea7381a service nova] Lock "d42fa9b3-91c3-4216-91f1-655ce140425f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:23:30 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-dfa3f553-d3ce-4df4-a4bd-9b57fa75bca0 req-519cef3b-629d-4c74-b9f9-a8315ea7381a service nova] Lock "d42fa9b3-91c3-4216-91f1-655ce140425f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:23:30 user nova-compute[75245]: DEBUG nova.compute.manager [req-dfa3f553-d3ce-4df4-a4bd-9b57fa75bca0 req-519cef3b-629d-4c74-b9f9-a8315ea7381a service nova] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] No waiting events found dispatching network-vif-plugged-497aee0b-487f-4138-9394-a68c8bd55e61 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:23:30 user nova-compute[75245]: WARNING nova.compute.manager [req-dfa3f553-d3ce-4df4-a4bd-9b57fa75bca0 req-519cef3b-629d-4c74-b9f9-a8315ea7381a service nova] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Received unexpected event network-vif-plugged-497aee0b-487f-4138-9394-a68c8bd55e61 for instance with vm_state active and task_state resize_migrating.
Nov 29 16:23:31 user nova-compute[75245]: DEBUG nova.network.neutron [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Port 497aee0b-487f-4138-9394-a68c8bd55e61 binding to destination host user is already ACTIVE {{(pid=75245) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 29 16:23:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Acquiring lock "d42fa9b3-91c3-4216-91f1-655ce140425f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:23:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "d42fa9b3-91c3-4216-91f1-655ce140425f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:23:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "d42fa9b3-91c3-4216-91f1-655ce140425f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:23:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Acquiring lock "refresh_cache-d42fa9b3-91c3-4216-91f1-655ce140425f" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:23:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Acquired lock "refresh_cache-d42fa9b3-91c3-4216-91f1-655ce140425f" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:23:31 user nova-compute[75245]: DEBUG nova.network.neutron [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 16:23:31 user nova-compute[75245]: DEBUG nova.network.neutron [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Updating instance_info_cache with network_info: [{"id": "497aee0b-487f-4138-9394-a68c8bd55e61", "address": "fa:16:3e:09:ba:94", "network": {"id": "f1fac2f4-e789-443e-b6a5-1a3f829bc302", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1199431077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6b87e18ef1f48d19a6907b28cb54f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap497aee0b-48", "ovs_interfaceid": "497aee0b-487f-4138-9394-a68c8bd55e61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:23:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Releasing lock "refresh_cache-d42fa9b3-91c3-4216-91f1-655ce140425f" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:23:31 user nova-compute[75245]: DEBUG os_brick.utils [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:23:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:23:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:23:31 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d4803c-9815-4538-b6c7-66430e71dad3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:69ed8ed87091\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:23:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:23:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:23:31 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d93beb-2acf-4efd-8ffe-0657c3cf6bd1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:23:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:23:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:23:31 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b3fa988-1167-458e-8322-a540a660ec96]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:23:31 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[c38afc4e-49a8-49ef-bf96-051f79fa5fe2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:23:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Running cmd (subprocess): nvme version {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:23:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] 'nvme version' failed. Not Retrying. {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:23:31 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.nvmeof [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] nvme not present on system {{(pid=75245) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 16:23:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:23:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:23:31 user nova-compute[75245]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 16:23:31 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc5ce458-fc74-4252-8f77-5d6e984e959e]: (4, '') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:23:31 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75245) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 16:23:31 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 16:23:31 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] LIGHTOS: no hostnqn found. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 16:23:31 user nova-compute[75245]: DEBUG os_brick.utils [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:69ed8ed87091', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:23:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:34 user nova-compute[75245]: DEBUG nova.network.neutron [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Port 27fc0374-0770-4171-a730-6696b09362eb binding to destination host user is already ACTIVE {{(pid=75245) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 29 16:23:34 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Acquiring lock "refresh_cache-84bae51e-2a85-442d-bbd2-fc89f30f40b7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:23:34 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Acquired lock "refresh_cache-84bae51e-2a85-442d-bbd2-fc89f30f40b7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:23:34 user nova-compute[75245]: DEBUG nova.network.neutron [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 16:23:35 user nova-compute[75245]: DEBUG nova.network.neutron [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Updating instance_info_cache with network_info: [{"id": "27fc0374-0770-4171-a730-6696b09362eb", "address": "fa:16:3e:d1:e4:30", "network": {"id": "e38d9eed-b29b-4a4c-b084-876554dc5263", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1284740336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c018212e0654c4db442ca65a386f397", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27fc0374-07", "ovs_interfaceid": "27fc0374-0770-4171-a730-6696b09362eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:23:35 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Releasing lock "refresh_cache-84bae51e-2a85-442d-bbd2-fc89f30f40b7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:23:35 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Creating tmpfile /opt/stack/data/nova/instances/84bae51e-2a85-442d-bbd2-fc89f30f40b7/tmp366u_e1x to verify with other compute node that the instance is on the same shared storage. {{(pid=75245) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9625}}
Nov 29 16:23:35 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:35 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:35 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:35 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:35 user nova-compute[75245]: DEBUG nova.compute.manager [req-d6319ba7-15f2-4c12-ac4c-9ee8530ca827 req-0cfcee02-496f-49bb-98c0-aefb7e545116 service nova] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Received event network-vif-unplugged-27fc0374-0770-4171-a730-6696b09362eb {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:23:35 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d6319ba7-15f2-4c12-ac4c-9ee8530ca827 req-0cfcee02-496f-49bb-98c0-aefb7e545116 service nova] Acquiring lock "84bae51e-2a85-442d-bbd2-fc89f30f40b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:23:35 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d6319ba7-15f2-4c12-ac4c-9ee8530ca827 req-0cfcee02-496f-49bb-98c0-aefb7e545116 service nova] Lock "84bae51e-2a85-442d-bbd2-fc89f30f40b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:23:35 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d6319ba7-15f2-4c12-ac4c-9ee8530ca827 req-0cfcee02-496f-49bb-98c0-aefb7e545116 service nova] Lock "84bae51e-2a85-442d-bbd2-fc89f30f40b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:23:35 user nova-compute[75245]: DEBUG nova.compute.manager [req-d6319ba7-15f2-4c12-ac4c-9ee8530ca827 req-0cfcee02-496f-49bb-98c0-aefb7e545116 service nova] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] No waiting events found dispatching network-vif-unplugged-27fc0374-0770-4171-a730-6696b09362eb {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:23:35 user nova-compute[75245]: WARNING nova.compute.manager [req-d6319ba7-15f2-4c12-ac4c-9ee8530ca827 req-0cfcee02-496f-49bb-98c0-aefb7e545116 service nova] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Received unexpected event network-vif-unplugged-27fc0374-0770-4171-a730-6696b09362eb for instance with vm_state resized and task_state resize_reverting.
Nov 29 16:23:36 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Instance destroyed successfully.
Nov 29 16:23:36 user nova-compute[75245]: DEBUG nova.objects.instance [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Lazy-loading 'resources' on Instance uuid 84bae51e-2a85-442d-bbd2-fc89f30f40b7 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:23:36 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:17:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-185985516',display_name='tempest-ServerActionsTestOtherB-server-185985516',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-185985516',id=20,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMGVVYk91CF4EJNlPGJ16B9aebX0g0461zoNkayBpAbBcPtumcB5nsUcunIZSLwTkPZC3DIGJ81mZLNGLk1xqtQ18lArBUMtmLGCUS7pb+CbAh4z22M0J6OlcUXZFjAglA==',key_name='tempest-keypair-1103342865',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:22:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3c018212e0654c4db442ca65a386f397',ramdisk_id='',reservation_id='r-rarysz12',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1446057763',owner_user_name='tempest-ServerActionsTestOtherB-1446057763-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:22:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecd08c449e8643c2b0eb4b2dc8cd7780',uuid=84bae51e-2a85-442d-bbd2-fc89f30f40b7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "27fc0374-0770-4171-a730-6696b09362eb", "address": "fa:16:3e:d1:e4:30", "network": {"id": "e38d9eed-b29b-4a4c-b084-876554dc5263", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1284740336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c018212e0654c4db442ca65a386f397", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27fc0374-07", "ovs_interfaceid": "27fc0374-0770-4171-a730-6696b09362eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 16:23:36 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Converting VIF {"id": "27fc0374-0770-4171-a730-6696b09362eb", "address": "fa:16:3e:d1:e4:30", "network": {"id": "e38d9eed-b29b-4a4c-b084-876554dc5263", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1284740336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c018212e0654c4db442ca65a386f397", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27fc0374-07", "ovs_interfaceid": "27fc0374-0770-4171-a730-6696b09362eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:23:36 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d1:e4:30,bridge_name='br-int',has_traffic_filtering=True,id=27fc0374-0770-4171-a730-6696b09362eb,network=Network(e38d9eed-b29b-4a4c-b084-876554dc5263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27fc0374-07') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:23:36 user nova-compute[75245]: DEBUG os_vif [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:e4:30,bridge_name='br-int',has_traffic_filtering=True,id=27fc0374-0770-4171-a730-6696b09362eb,network=Network(e38d9eed-b29b-4a4c-b084-876554dc5263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27fc0374-07') {{(pid=75245) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 16:23:36 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:36 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap27fc0374-07, bridge=br-int, if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:23:36 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:23:36 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:36 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1d46548e-6fc0-4dd1-ab38-d689e53a3630) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:23:36 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:36 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:23:36 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:36 user nova-compute[75245]: INFO os_vif [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:e4:30,bridge_name='br-int',has_traffic_filtering=True,id=27fc0374-0770-4171-a730-6696b09362eb,network=Network(e38d9eed-b29b-4a4c-b084-876554dc5263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27fc0374-07')
Nov 29 16:23:36 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] calling os-brick to detach iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 16:23:36 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, {'target_iqn': 'iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UPxkSWMT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:23:36 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:23:36 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:23:36 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:23:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:23:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:23:36 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b3c982-e714-4f4c-adb4-3365c5afcf71]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:23:36 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 16:23:36 user nova-compute[75245]: No targets found.
Nov 29 16:23:36 user nova-compute[75245]: iSNS:
Nov 29 16:23:36 user nova-compute[75245]: No targets found.
Nov 29 16:23:36 user nova-compute[75245]: STATIC:
Nov 29 16:23:36 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e
Nov 29 16:23:36 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:23:36 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:23:36 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed
Nov 29 16:23:36 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:23:36 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:23:36 user nova-compute[75245]: FIRMWARE:
Nov 29 16:23:36 user nova-compute[75245]: No targets found.
Nov 29 16:23:36 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:23:36 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 16:23:36 user nova-compute[75245]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 16:23:36 user nova-compute[75245]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75245) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 16:23:36 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e', 0)] {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 16:23:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:23:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:23:36 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[0313f351-40c9-422e-8f9b-8fe34cfdcda5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:23:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:23:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:23:36 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e5f3b8-a50c-4cb1-9681-7048f3d3eb12]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:23:36 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e (non-flash)
Nov 29 16:23:36 user nova-compute[75245]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)
Nov 29 16:23:36 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:23:36 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e (non-flash)
Nov 29 16:23:36 user nova-compute[75245]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)
Nov 29 16:23:36 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:23:36 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0d561df910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e'): ({'sdc'}, set())}) {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 16:23:36 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Removing single pathed devices sdc {{(pid=75245) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 16:23:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:23:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:23:36 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc7bed68-7d8f-40b4-a005-c817ec191f89]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:23:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:23:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:23:36 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[015254ce-6705-46b7-84b0-dc0a8957b244]: (4, ('ok\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:23:36 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Flushing IO for device /dev/sdc {{(pid=75245) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 16:23:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:23:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:23:36 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab3bd20-b3ea-4865-ae16-450fd0a4ea8d]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:23:36 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75245) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 16:23:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:23:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:23:36 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[92680a9d-e523-45ee-95f0-8baee601bdee]: (4, ('1', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:23:36 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 16:23:36 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] SCSI volumes sdc have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 16:23:36 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e')] {{(pid=75245) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 16:23:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:23:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:23:36 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b8905e-b2ff-44a3-a8fd-929c39a6d218]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:23:36 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:23:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e -p 172.16.0.220:3260 --logout {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:23:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:23:36 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[1648f97d-f5e0-4457-937d-ccc96867e175]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:23:36 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e, portal: 172.16.0.220,3260]
Nov 29 16:23:36 user nova-compute[75245]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e, portal: 172.16.0.220,3260] successful.
Nov 29 16:23:36 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:23:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e -p 172.16.0.220:3260 --op delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:23:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:23:36 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0154b7-8ec6-4444-ada2-d8a77e955b97]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:23:36 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:23:36 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:23:36 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] <== disconnect_volume: return (316ms) None {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:23:36 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Disconnected iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 16:23:37 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:23:37 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:23:37 user nova-compute[75245]: DEBUG nova.objects.instance [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Lazy-loading 'migration_context' on Instance uuid 84bae51e-2a85-442d-bbd2-fc89f30f40b7 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:23:37 user nova-compute[75245]: DEBUG nova.objects.base [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Object Instance<84bae51e-2a85-442d-bbd2-fc89f30f40b7> lazy-loaded attributes: resources,migration_context {{(pid=75245) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 16:23:37 user nova-compute[75245]: DEBUG nova.compute.manager [req-a37a88f2-09c4-4db4-bfca-f89688c9c227 req-effb5b2e-6aac-4c5b-bef4-5a3e192a02fd service nova] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Received event network-vif-plugged-27fc0374-0770-4171-a730-6696b09362eb {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:23:37 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a37a88f2-09c4-4db4-bfca-f89688c9c227 req-effb5b2e-6aac-4c5b-bef4-5a3e192a02fd service nova] Acquiring lock "84bae51e-2a85-442d-bbd2-fc89f30f40b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:23:37 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a37a88f2-09c4-4db4-bfca-f89688c9c227 req-effb5b2e-6aac-4c5b-bef4-5a3e192a02fd service nova] Lock "84bae51e-2a85-442d-bbd2-fc89f30f40b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:23:37 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a37a88f2-09c4-4db4-bfca-f89688c9c227 req-effb5b2e-6aac-4c5b-bef4-5a3e192a02fd service nova] Lock "84bae51e-2a85-442d-bbd2-fc89f30f40b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:23:37 user nova-compute[75245]: DEBUG nova.compute.manager [req-a37a88f2-09c4-4db4-bfca-f89688c9c227 req-effb5b2e-6aac-4c5b-bef4-5a3e192a02fd service nova] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] No waiting events found dispatching network-vif-plugged-27fc0374-0770-4171-a730-6696b09362eb {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:23:37 user nova-compute[75245]: WARNING nova.compute.manager [req-a37a88f2-09c4-4db4-bfca-f89688c9c227 req-effb5b2e-6aac-4c5b-bef4-5a3e192a02fd service nova] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Received unexpected event network-vif-plugged-27fc0374-0770-4171-a730-6696b09362eb for instance with vm_state resized and task_state resize_reverting.
Nov 29 16:23:37 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:23:37 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:23:37 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.428s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:23:37 user nova-compute[75245]: INFO nova.compute.manager [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Swapping old allocation on dict_keys(['dcc0ed27-167e-4f3a-a0de-183bb144a50c']) held by migration c238ecef-960e-49e6-9c78-1b39bc8f90c0 for instance
Nov 29 16:23:38 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Overwriting current allocation {'allocations': {'dcc0ed27-167e-4f3a-a0de-183bb144a50c': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 34}}, 'project_id': '3c018212e0654c4db442ca65a386f397', 'user_id': 'ecd08c449e8643c2b0eb4b2dc8cd7780', 'consumer_generation': 1} on consumer 84bae51e-2a85-442d-bbd2-fc89f30f40b7 {{(pid=75245) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 29 16:23:38 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Acquiring lock "refresh_cache-84bae51e-2a85-442d-bbd2-fc89f30f40b7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:23:38 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Acquired lock "refresh_cache-84bae51e-2a85-442d-bbd2-fc89f30f40b7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:23:38 user nova-compute[75245]: DEBUG nova.network.neutron [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 16:23:38 user nova-compute[75245]: INFO nova.compute.manager [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Rescuing
Nov 29 16:23:38 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Acquiring lock "refresh_cache-5de7e10c-f216-46b3-8f74-57bac6ab7e56" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:23:38 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Acquired lock "refresh_cache-5de7e10c-f216-46b3-8f74-57bac6ab7e56" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:23:38 user nova-compute[75245]: DEBUG nova.network.neutron [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 16:23:38 user nova-compute[75245]: DEBUG nova.network.neutron [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Updating instance_info_cache with network_info: [{"id": "27fc0374-0770-4171-a730-6696b09362eb", "address": "fa:16:3e:d1:e4:30", "network": {"id": "e38d9eed-b29b-4a4c-b084-876554dc5263", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1284740336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c018212e0654c4db442ca65a386f397", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27fc0374-07", "ovs_interfaceid": "27fc0374-0770-4171-a730-6696b09362eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:23:39 user nova-compute[75245]: DEBUG nova.network.neutron [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Updating instance_info_cache with network_info: [{"id": "116d08d0-5549-4438-b689-0bbda3a5934f", "address": "fa:16:3e:97:fb:c7", "network": {"id": "6a7f7426-b595-4aa3-bf80-cc92ba7ce15e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-917300903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d52776451e947f5a9ef3fa44ac8acbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap116d08d0-55", "ovs_interfaceid": "116d08d0-5549-4438-b689-0bbda3a5934f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:23:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Releasing lock "refresh_cache-84bae51e-2a85-442d-bbd2-fc89f30f40b7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:23:39 user nova-compute[75245]: DEBUG os_brick.utils [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:23:39 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:23:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Releasing lock "refresh_cache-5de7e10c-f216-46b3-8f74-57bac6ab7e56" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:23:39 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:23:39 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece0ed3d-b3a9-4d48-832a-459d6546d093]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:69ed8ed87091\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:23:39 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:23:39 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:23:39 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15852b9-9d6a-4b8e-a442-b140aa8f5ddc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:23:39 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:23:39 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:23:39 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f8e2dca-ef60-496f-a54e-74c50862bf0f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:23:39 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a33b0fa-cd32-42de-80fe-a95c294d8dc2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:23:39 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Running cmd (subprocess): nvme version {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:23:39 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] 'nvme version' failed. Not Retrying. {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:23:39 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] nvme not present on system {{(pid=75245) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 16:23:39 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:23:39 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:23:39 user nova-compute[75245]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 16:23:39 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[007eb787-897f-4d1f-a30d-6b95213e5a45]: (4, '') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:23:39 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75245) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 16:23:39 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 16:23:39 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] LIGHTOS: no hostnqn found. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 16:23:39 user nova-compute[75245]: DEBUG os_brick.utils [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:69ed8ed87091', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:23:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:39 user nova-compute[75245]: DEBUG nova.compute.manager [req-70421e7b-fba0-4fb2-8329-12a31fe5001c req-e3a747c6-4daa-43aa-bdb7-fa3aebab1329 service nova] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Received event network-vif-unplugged-116d08d0-5549-4438-b689-0bbda3a5934f {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:23:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-70421e7b-fba0-4fb2-8329-12a31fe5001c req-e3a747c6-4daa-43aa-bdb7-fa3aebab1329 service nova] Acquiring lock "5de7e10c-f216-46b3-8f74-57bac6ab7e56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:23:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-70421e7b-fba0-4fb2-8329-12a31fe5001c req-e3a747c6-4daa-43aa-bdb7-fa3aebab1329 service nova] Lock "5de7e10c-f216-46b3-8f74-57bac6ab7e56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:23:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-70421e7b-fba0-4fb2-8329-12a31fe5001c req-e3a747c6-4daa-43aa-bdb7-fa3aebab1329 service nova] Lock "5de7e10c-f216-46b3-8f74-57bac6ab7e56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:23:39 user nova-compute[75245]: DEBUG nova.compute.manager [req-70421e7b-fba0-4fb2-8329-12a31fe5001c req-e3a747c6-4daa-43aa-bdb7-fa3aebab1329 service nova] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] No waiting events found dispatching network-vif-unplugged-116d08d0-5549-4438-b689-0bbda3a5934f {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:23:39 user nova-compute[75245]: WARNING nova.compute.manager [req-70421e7b-fba0-4fb2-8329-12a31fe5001c req-e3a747c6-4daa-43aa-bdb7-fa3aebab1329 service nova] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Received unexpected event network-vif-unplugged-116d08d0-5549-4438-b689-0bbda3a5934f for instance with vm_state active and task_state rescuing.
Nov 29 16:23:39 user nova-compute[75245]: DEBUG nova.compute.manager [req-70421e7b-fba0-4fb2-8329-12a31fe5001c req-e3a747c6-4daa-43aa-bdb7-fa3aebab1329 service nova] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Received event network-vif-plugged-116d08d0-5549-4438-b689-0bbda3a5934f {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:23:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-70421e7b-fba0-4fb2-8329-12a31fe5001c req-e3a747c6-4daa-43aa-bdb7-fa3aebab1329 service nova] Acquiring lock "5de7e10c-f216-46b3-8f74-57bac6ab7e56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:23:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-70421e7b-fba0-4fb2-8329-12a31fe5001c req-e3a747c6-4daa-43aa-bdb7-fa3aebab1329 service nova] Lock "5de7e10c-f216-46b3-8f74-57bac6ab7e56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:23:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-70421e7b-fba0-4fb2-8329-12a31fe5001c req-e3a747c6-4daa-43aa-bdb7-fa3aebab1329 service nova] Lock "5de7e10c-f216-46b3-8f74-57bac6ab7e56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:23:39 user nova-compute[75245]: DEBUG nova.compute.manager [req-70421e7b-fba0-4fb2-8329-12a31fe5001c req-e3a747c6-4daa-43aa-bdb7-fa3aebab1329 service nova] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] No waiting events found dispatching network-vif-plugged-116d08d0-5549-4438-b689-0bbda3a5934f {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:23:39 user nova-compute[75245]: WARNING nova.compute.manager [req-70421e7b-fba0-4fb2-8329-12a31fe5001c req-e3a747c6-4daa-43aa-bdb7-fa3aebab1329 service nova] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Received unexpected event network-vif-plugged-116d08d0-5549-4438-b689-0bbda3a5934f for instance with vm_state active and task_state rescuing.
Nov 29 16:23:39 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Starting finish_migration {{(pid=75245) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11671}}
Nov 29 16:23:39 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Instance directory exists: not creating {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 16:23:39 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Creating image(s)
Nov 29 16:23:39 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Did not create local disks {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 16:23:39 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Ensure instance console log exists: /opt/stack/data/nova/instances/d42fa9b3-91c3-4216-91f1-655ce140425f/console.log {{(pid=75245) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 16:23:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:23:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:23:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:23:39 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Start _get_guest_xml network_info=[{"id": "497aee0b-487f-4138-9394-a68c8bd55e61", "address": "fa:16:3e:09:ba:94", "network": {"id": "f1fac2f4-e789-443e-b6a5-1a3f829bc302", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1199431077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1199431077-network", "vif_mac": "fa:16:3e:09:ba:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6b87e18ef1f48d19a6907b28cb54f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap497aee0b-48", "ovs_interfaceid": "497aee0b-487f-4138-9394-a68c8bd55e61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '5bf76f5f-9164-4a07-9dad-5c85b1773e5b', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zpXHZUKQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'd42fa9b3-91c3-4216-91f1-655ce140425f', 'attached_at': '2023-11-29T16:23:40.000000', 'detached_at': '', 'volume_id': 'e8b52560-8036-45ee-a78b-c74351f1495f', 'serial': 'e8b52560-8036-45ee-a78b-c74351f1495f'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'guest_format': None, 'volume_type': None} {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 16:23:39 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:23:39 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:23:39 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 16:23:39 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] CPU controller missing on host. {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 16:23:39 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 16:23:39 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] CPU controller found on host. {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 16:23:39 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75245) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 16:23:39 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T16:06:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 16:23:39 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Flavor limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 16:23:39 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Image limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 16:23:39 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Flavor pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 16:23:39 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Image pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 16:23:39 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 16:23:39 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 16:23:39 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 16:23:39 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Got 1 possible topologies {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 16:23:39 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 16:23:39 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 16:23:39 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Calling os-brick to attach iSCSI Volume {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 16:23:39 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zpXHZUKQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:23:39 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:23:39 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:23:39 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:23:39 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:23:39 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:23:39 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:23:39 user nova-compute[75245]: INFO os_brick.initiator.connectors.iscsi [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 16:23:39 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f -p 172.16.0.220:3260 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:23:39 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Instance destroyed successfully.
Nov 29 16:23:39 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Attempting a stable device rescue
Nov 29 16:23:39 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:23:39 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[61dc5f87-24c8-4e03-803e-de70c4958169]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:23:39 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 16:23:39 user nova-compute[75245]:  {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:23:39 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f -p 172.16.0.220:3260 --interface default --op new {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:23:39 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:23:39 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ff5068-9210-49ab-9b16-b9e1e638c817]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f] added\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:23:39 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75245) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 29 16:23:39 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f] added
Nov 29 16:23:39 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:23:39 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:23:39 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Instance directory exists: not creating {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 16:23:39 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Creating image(s)
Nov 29 16:23:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Acquiring lock "/opt/stack/data/nova/instances/5de7e10c-f216-46b3-8f74-57bac6ab7e56/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:23:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "/opt/stack/data/nova/instances/5de7e10c-f216-46b3-8f74-57bac6ab7e56/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:23:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "/opt/stack/data/nova/instances/5de7e10c-f216-46b3-8f74-57bac6ab7e56/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:23:39 user nova-compute[75245]: DEBUG nova.objects.instance [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5de7e10c-f216-46b3-8f74-57bac6ab7e56 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:23:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Acquiring lock "1fe4e30e7d34178cb5f15ed957023dfad042ea33" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:23:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "1fe4e30e7d34178cb5f15ed957023dfad042ea33" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:23:39 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:23:39 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[5725fd40-a8e4-4a91-87bd-7034d1bd8a79]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:23:39 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:23:39 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:23:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:23:40 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[0821d1df-7581-4bda-940b-49316227d0ea]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:23:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:23:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zpXHZUKQ {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:23:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zpXHZUKQ" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:23:40 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4119fa-c1da-4a7e-b531-3511f3614335]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:23:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zpXHZUKQ'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:23:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:23:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:23:40 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd59015-c672-4742-b0e8-2907253063dd]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:23:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:23:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:23:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:23:40 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a957dc-943b-4dd9-a43a-205edcf15906]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:23:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)
Nov 29 16:23:40 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:23:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)
Nov 29 16:23:40 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:23:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f -p 172.16.0.220:3260 --login {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:23:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:23:40 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca173198-5b3c-4f2e-a152-4b4cbc2fe2f2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:23:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f, portal: 172.16.0.220,3260]
Nov 29 16:23:40 user nova-compute[75245]: Login to [iface: default, target: iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f, portal: 172.16.0.220,3260] successful.
Nov 29 16:23:40 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:23:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:23:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:23:40 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[440770d5-66db-494e-8e93-485f15b3b791]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:23:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:23:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:23:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:23:40 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[a625c170-dec4-41c7-980b-6f0c06bc893e]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:23:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)
Nov 29 16:23:40 user nova-compute[75245]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f (non-flash)
Nov 29 16:23:40 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:23:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)
Nov 29 16:23:40 user nova-compute[75245]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f (non-flash)
Nov 29 16:23:40 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:23:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:23:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Connected to 172.16.0.220:3260 {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 16:23:40 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] HCTL ('33', '-', '-', 0) found on session 31 with lun 0 {{(pid=75245) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 16:23:40 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75245) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 16:23:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:23:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:23:40 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde1f4f1-229f-4b5d-b3fd-98220002a30d]: (4, ('- - 0', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:23:40 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Searching for a device in session 31 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75245) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 16:23:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zpXHZUKQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 16:23:41 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fe4e30e7d34178cb5f15ed957023dfad042ea33.part --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:23:41 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.477s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:23:41 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] <== connect_volume: return (1481ms) {'type': 'block', 'scsi_wwn': '23465333932326266', 'path': '/dev/sdb'} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:23:41 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23465333932326266', 'path': '/dev/sdb'} {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 16:23:41 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:41 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:21:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-398720439',display_name='tempest-ServerActionsTestOtherA-server-398720439',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-398720439',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBlv185nmJa9KBQWtd25ahGt24w8RxLoAajuGL7vBUTHaz3jTQraFsqx3MIOXaCnGwG9vPuUxlhI7TdDBUzC5IxITSYROv0nohB5+qOZUd0Imt2qi6DOpY2ZQc/HDcV0+g==',key_name='tempest-keypair-7729748',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:21:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c6b87e18ef1f48d19a6907b28cb54f04',ramdisk_id='',reservation_id='r-bs0pty7s',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1840344781',owner_user_name='tempest-ServerActionsTestOtherA-1840344781-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:23:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be595c3f7084413180f2ab86e9c56a64',uuid=d42fa9b3-91c3-4216-91f1-655ce140425f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "497aee0b-487f-4138-9394-a68c8bd55e61", "address": "fa:16:3e:09:ba:94", "network": {"id": "f1fac2f4-e789-443e-b6a5-1a3f829bc302", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1199431077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1199431077-network", "vif_mac": "fa:16:3e:09:ba:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6b87e18ef1f48d19a6907b28cb54f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap497aee0b-48", "ovs_interfaceid": "497aee0b-487f-4138-9394-a68c8bd55e61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:23:41 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Converting VIF {"id": "497aee0b-487f-4138-9394-a68c8bd55e61", "address": "fa:16:3e:09:ba:94", "network": {"id": "f1fac2f4-e789-443e-b6a5-1a3f829bc302", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1199431077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1199431077-network", "vif_mac": "fa:16:3e:09:ba:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6b87e18ef1f48d19a6907b28cb54f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap497aee0b-48", "ovs_interfaceid": "497aee0b-487f-4138-9394-a68c8bd55e61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:23:41 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:ba:94,bridge_name='br-int',has_traffic_filtering=True,id=497aee0b-487f-4138-9394-a68c8bd55e61,network=Network(f1fac2f4-e789-443e-b6a5-1a3f829bc302),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap497aee0b-48') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:23:41 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] End _get_guest_xml xml=<domain type="kvm">
Nov 29 16:23:41 user nova-compute[75245]:   <uuid>d42fa9b3-91c3-4216-91f1-655ce140425f</uuid>
Nov 29 16:23:41 user nova-compute[75245]:   <name>instance-00000017</name>
Nov 29 16:23:41 user nova-compute[75245]:   <memory>2097152</memory>
Nov 29 16:23:41 user nova-compute[75245]:   <vcpu>1</vcpu>
Nov 29 16:23:41 user nova-compute[75245]:   <metadata>
Nov 29 16:23:41 user nova-compute[75245]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 16:23:41 user nova-compute[75245]:       <nova:package version="0.0.0"/>
Nov 29 16:23:41 user nova-compute[75245]:       <nova:name>tempest-ServerActionsTestOtherA-server-398720439</nova:name>
Nov 29 16:23:41 user nova-compute[75245]:       <nova:creationTime>2023-11-29 16:23:39</nova:creationTime>
Nov 29 16:23:41 user nova-compute[75245]:       <nova:flavor name="m1.small">
Nov 29 16:23:41 user nova-compute[75245]:         <nova:memory>2048</nova:memory>
Nov 29 16:23:41 user nova-compute[75245]:         <nova:disk>20</nova:disk>
Nov 29 16:23:41 user nova-compute[75245]:         <nova:swap>0</nova:swap>
Nov 29 16:23:41 user nova-compute[75245]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 16:23:41 user nova-compute[75245]:         <nova:vcpus>1</nova:vcpus>
Nov 29 16:23:41 user nova-compute[75245]:       </nova:flavor>
Nov 29 16:23:41 user nova-compute[75245]:       <nova:owner>
Nov 29 16:23:41 user nova-compute[75245]:         <nova:user uuid="be595c3f7084413180f2ab86e9c56a64">tempest-ServerActionsTestOtherA-1840344781-project-member</nova:user>
Nov 29 16:23:41 user nova-compute[75245]:         <nova:project uuid="c6b87e18ef1f48d19a6907b28cb54f04">tempest-ServerActionsTestOtherA-1840344781</nova:project>
Nov 29 16:23:41 user nova-compute[75245]:       </nova:owner>
Nov 29 16:23:41 user nova-compute[75245]:       <nova:ports>
Nov 29 16:23:41 user nova-compute[75245]:         <nova:port uuid="497aee0b-487f-4138-9394-a68c8bd55e61">
Nov 29 16:23:41 user nova-compute[75245]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 29 16:23:41 user nova-compute[75245]:         </nova:port>
Nov 29 16:23:41 user nova-compute[75245]:       </nova:ports>
Nov 29 16:23:41 user nova-compute[75245]:     </nova:instance>
Nov 29 16:23:41 user nova-compute[75245]:   </metadata>
Nov 29 16:23:41 user nova-compute[75245]:   <sysinfo type="smbios">
Nov 29 16:23:41 user nova-compute[75245]:     <system>
Nov 29 16:23:41 user nova-compute[75245]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 16:23:41 user nova-compute[75245]:       <entry name="product">OpenStack Nova</entry>
Nov 29 16:23:41 user nova-compute[75245]:       <entry name="version">0.0.0</entry>
Nov 29 16:23:41 user nova-compute[75245]:       <entry name="serial">d42fa9b3-91c3-4216-91f1-655ce140425f</entry>
Nov 29 16:23:41 user nova-compute[75245]:       <entry name="uuid">d42fa9b3-91c3-4216-91f1-655ce140425f</entry>
Nov 29 16:23:41 user nova-compute[75245]:       <entry name="family">Virtual Machine</entry>
Nov 29 16:23:41 user nova-compute[75245]:     </system>
Nov 29 16:23:41 user nova-compute[75245]:   </sysinfo>
Nov 29 16:23:41 user nova-compute[75245]:   <os>
Nov 29 16:23:41 user nova-compute[75245]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 16:23:41 user nova-compute[75245]:     <boot dev="hd"/>
Nov 29 16:23:41 user nova-compute[75245]:     <smbios mode="sysinfo"/>
Nov 29 16:23:41 user nova-compute[75245]:   </os>
Nov 29 16:23:41 user nova-compute[75245]:   <features>
Nov 29 16:23:41 user nova-compute[75245]:     <acpi/>
Nov 29 16:23:41 user nova-compute[75245]:     <apic/>
Nov 29 16:23:41 user nova-compute[75245]:     <vmcoreinfo/>
Nov 29 16:23:41 user nova-compute[75245]:   </features>
Nov 29 16:23:41 user nova-compute[75245]:   <clock offset="utc">
Nov 29 16:23:41 user nova-compute[75245]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 16:23:41 user nova-compute[75245]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 16:23:41 user nova-compute[75245]:     <timer name="hpet" present="no"/>
Nov 29 16:23:41 user nova-compute[75245]:   </clock>
Nov 29 16:23:41 user nova-compute[75245]:   <cpu mode="custom" match="exact">
Nov 29 16:23:41 user nova-compute[75245]:     <model>Nehalem</model>
Nov 29 16:23:41 user nova-compute[75245]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 16:23:41 user nova-compute[75245]:   </cpu>
Nov 29 16:23:41 user nova-compute[75245]:   <devices>
Nov 29 16:23:41 user nova-compute[75245]:     <disk type="block" device="disk">
Nov 29 16:23:41 user nova-compute[75245]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:23:41 user nova-compute[75245]:       <source dev="/dev/sdb"/>
Nov 29 16:23:41 user nova-compute[75245]:       <target dev="vda" bus="virtio"/>
Nov 29 16:23:41 user nova-compute[75245]:       <serial>e8b52560-8036-45ee-a78b-c74351f1495f</serial>
Nov 29 16:23:41 user nova-compute[75245]:     </disk>
Nov 29 16:23:41 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 16:23:41 user nova-compute[75245]:       <mac address="fa:16:3e:09:ba:94"/>
Nov 29 16:23:41 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:23:41 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 16:23:41 user nova-compute[75245]:       <target dev="tap497aee0b-48"/>
Nov 29 16:23:41 user nova-compute[75245]:     </interface>
Nov 29 16:23:41 user nova-compute[75245]:     <serial type="pty">
Nov 29 16:23:41 user nova-compute[75245]:       <log file="/opt/stack/data/nova/instances/d42fa9b3-91c3-4216-91f1-655ce140425f/console.log" append="off"/>
Nov 29 16:23:41 user nova-compute[75245]:     </serial>
Nov 29 16:23:41 user nova-compute[75245]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 16:23:41 user nova-compute[75245]:     <video>
Nov 29 16:23:41 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:23:41 user nova-compute[75245]:     </video>
Nov 29 16:23:41 user nova-compute[75245]:     <rng model="virtio">
Nov 29 16:23:41 user nova-compute[75245]:       <backend model="random">/dev/urandom</backend>
Nov 29 16:23:41 user nova-compute[75245]:     </rng>
Nov 29 16:23:41 user nova-compute[75245]:     <controller type="usb" index="0" model="none"/>
Nov 29 16:23:41 user nova-compute[75245]:     <memballoon model="virtio">
Nov 29 16:23:41 user nova-compute[75245]:       <stats period="10"/>
Nov 29 16:23:41 user nova-compute[75245]:     </memballoon>
Nov 29 16:23:41 user nova-compute[75245]:   </devices>
Nov 29 16:23:41 user nova-compute[75245]: </domain>
Nov 29 16:23:41 user nova-compute[75245]:  {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 16:23:41 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:21:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-398720439',display_name='tempest-ServerActionsTestOtherA-server-398720439',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-398720439',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBlv185nmJa9KBQWtd25ahGt24w8RxLoAajuGL7vBUTHaz3jTQraFsqx3MIOXaCnGwG9vPuUxlhI7TdDBUzC5IxITSYROv0nohB5+qOZUd0Imt2qi6DOpY2ZQc/HDcV0+g==',key_name='tempest-keypair-7729748',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:21:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c6b87e18ef1f48d19a6907b28cb54f04',ramdisk_id='',reservation_id='r-bs0pty7s',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1840344781',owner_user_name='tempest-ServerActionsTestOtherA-1840344781-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:23:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be595c3f7084413180f2ab86e9c56a64',uuid=d42fa9b3-91c3-4216-91f1-655ce140425f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "497aee0b-487f-4138-9394-a68c8bd55e61", "address": "fa:16:3e:09:ba:94", "network": {"id": "f1fac2f4-e789-443e-b6a5-1a3f829bc302", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1199431077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1199431077-network", "vif_mac": "fa:16:3e:09:ba:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6b87e18ef1f48d19a6907b28cb54f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap497aee0b-48", "ovs_interfaceid": "497aee0b-487f-4138-9394-a68c8bd55e61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 16:23:41 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Converting VIF {"id": "497aee0b-487f-4138-9394-a68c8bd55e61", "address": "fa:16:3e:09:ba:94", "network": {"id": "f1fac2f4-e789-443e-b6a5-1a3f829bc302", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1199431077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1199431077-network", "vif_mac": "fa:16:3e:09:ba:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6b87e18ef1f48d19a6907b28cb54f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap497aee0b-48", "ovs_interfaceid": "497aee0b-487f-4138-9394-a68c8bd55e61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:23:41 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:ba:94,bridge_name='br-int',has_traffic_filtering=True,id=497aee0b-487f-4138-9394-a68c8bd55e61,network=Network(f1fac2f4-e789-443e-b6a5-1a3f829bc302),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap497aee0b-48') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:23:41 user nova-compute[75245]: DEBUG os_vif [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:ba:94,bridge_name='br-int',has_traffic_filtering=True,id=497aee0b-487f-4138-9394-a68c8bd55e61,network=Network(f1fac2f4-e789-443e-b6a5-1a3f829bc302),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap497aee0b-48') {{(pid=75245) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 16:23:41 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:41 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:23:41 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 16:23:41 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:41 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c0ff478c-4d0c-5336-93ef-1f6de03a59aa', '_type': 'linux-noop'}}, row=False) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:23:41 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:41 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:23:41 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:41 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:41 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap497aee0b-48, may_exist=True, interface_attrs={}) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:23:41 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap497aee0b-48, col_values=(('qos', UUID('cca7898d-c835-43a5-82af-ca94f5d75777')),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:23:41 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap497aee0b-48, col_values=(('external_ids', {'iface-id': '497aee0b-487f-4138-9394-a68c8bd55e61', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:ba:94', 'vm-uuid': 'd42fa9b3-91c3-4216-91f1-655ce140425f'}),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:23:41 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:41 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:23:41 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:41 user nova-compute[75245]: INFO os_vif [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:ba:94,bridge_name='br-int',has_traffic_filtering=True,id=497aee0b-487f-4138-9394-a68c8bd55e61,network=Network(f1fac2f4-e789-443e-b6a5-1a3f829bc302),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap497aee0b-48')
Nov 29 16:23:41 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fe4e30e7d34178cb5f15ed957023dfad042ea33.part --force-share --output=json" returned: 0 in 0.186s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:23:41 user nova-compute[75245]: DEBUG nova.virt.images [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] 7c0391a4-70e5-45e2-82c5-2643c36ad03d was qcow2, converting to raw {{(pid=75245) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 16:23:41 user nova-compute[75245]: DEBUG nova.privsep.utils [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75245) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 16:23:41 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1fe4e30e7d34178cb5f15ed957023dfad042ea33.part /opt/stack/data/nova/instances/_base/1fe4e30e7d34178cb5f15ed957023dfad042ea33.converted {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:23:41 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:23:41 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] No VIF found with MAC fa:16:3e:09:ba:94, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1fe4e30e7d34178cb5f15ed957023dfad042ea33.part /opt/stack/data/nova/instances/_base/1fe4e30e7d34178cb5f15ed957023dfad042ea33.converted" returned: 0 in 0.558s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fe4e30e7d34178cb5f15ed957023dfad042ea33.converted --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fe4e30e7d34178cb5f15ed957023dfad042ea33.converted --force-share --output=json" returned: 0 in 0.176s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "1fe4e30e7d34178cb5f15ed957023dfad042ea33" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.306s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Acquiring lock "1fe4e30e7d34178cb5f15ed957023dfad042ea33" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "1fe4e30e7d34178cb5f15ed957023dfad042ea33" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fe4e30e7d34178cb5f15ed957023dfad042ea33 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fe4e30e7d34178cb5f15ed957023dfad042ea33 --force-share --output=json" returned: 0 in 0.171s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1fe4e30e7d34178cb5f15ed957023dfad042ea33,backing_fmt=raw /opt/stack/data/nova/instances/5de7e10c-f216-46b3-8f74-57bac6ab7e56/disk.rescue {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1fe4e30e7d34178cb5f15ed957023dfad042ea33,backing_fmt=raw /opt/stack/data/nova/instances/5de7e10c-f216-46b3-8f74-57bac6ab7e56/disk.rescue" returned: 0 in 0.046s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "1fe4e30e7d34178cb5f15ed957023dfad042ea33" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG nova.objects.instance [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lazy-loading 'migration_context' on Instance uuid 5de7e10c-f216-46b3-8f74-57bac6ab7e56 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG nova.objects.base [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Object Instance<5de7e10c-f216-46b3-8f74-57bac6ab7e56> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75245) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Created local disks {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Start _get_guest_xml network_info=[{"id": "116d08d0-5549-4438-b689-0bbda3a5934f", "address": "fa:16:3e:97:fb:c7", "network": {"id": "6a7f7426-b595-4aa3-bf80-cc92ba7ce15e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-917300903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-917300903-network", "vif_mac": "fa:16:3e:97:fb:c7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d52776451e947f5a9ef3fa44ac8acbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap116d08d0-55", "ovs_interfaceid": "116d08d0-5549-4438-b689-0bbda3a5934f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '7c0391a4-70e5-45e2-82c5-2643c36ad03d', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '44cf4c75-fc30-4192-9d06-8bfd65b51e0f', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TlHrZFpQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '5de7e10c-f216-46b3-8f74-57bac6ab7e56', 'attached_at': '', 'detached_at': '', 'volume_id': '02359d7f-e8f6-408e-961c-64d566ea0eed', 'serial': '02359d7f-e8f6-408e-961c-64d566ea0eed'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'guest_format': None, 'volume_type': None} {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG nova.objects.instance [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lazy-loading 'resources' on Instance uuid 5de7e10c-f216-46b3-8f74-57bac6ab7e56 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG nova.objects.base [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Object Instance<5de7e10c-f216-46b3-8f74-57bac6ab7e56> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75245) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG nova.objects.instance [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lazy-loading 'numa_topology' on Instance uuid 5de7e10c-f216-46b3-8f74-57bac6ab7e56 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG nova.objects.base [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Object Instance<5de7e10c-f216-46b3-8f74-57bac6ab7e56> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75245) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 16:23:42 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:23:42 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:23:42 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] CPU controller missing on host. {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] CPU controller found on host. {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75245) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T16:06:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Flavor limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Image limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Flavor pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Image pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Got 1 possible topologies {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG nova.objects.instance [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5de7e10c-f216-46b3-8f74-57bac6ab7e56 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG nova.objects.base [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Object Instance<5de7e10c-f216-46b3-8f74-57bac6ab7e56> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75245) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Calling os-brick to attach iSCSI Volume {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TlHrZFpQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:23:42 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:23:42 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:23:42 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:23:42 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:23:42 user nova-compute[75245]: INFO os_brick.initiator.connectors.iscsi [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 16:23:42 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed -p 172.16.0.220:3260 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[91989b05-c902-474c-bc38-150c708e8c78]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = TlHrZFpQ\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 29 16:23:42 user nova-compute[75245]: node.name = iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed
Nov 29 16:23:42 user nova-compute[75245]: node.tpgt = -1
Nov 29 16:23:42 user nova-compute[75245]: node.startup = automatic
Nov 29 16:23:42 user nova-compute[75245]: node.leading_login = No
Nov 29 16:23:42 user nova-compute[75245]: iface.iscsi_ifacename = default
Nov 29 16:23:42 user nova-compute[75245]: iface.net_ifacename = <empty>
Nov 29 16:23:42 user nova-compute[75245]: iface.ipaddress = <empty>
Nov 29 16:23:42 user nova-compute[75245]: iface.prefix_len = 0
Nov 29 16:23:42 user nova-compute[75245]: iface.hwaddress = <empty>
Nov 29 16:23:42 user nova-compute[75245]: iface.transport_name = tcp
Nov 29 16:23:42 user nova-compute[75245]: iface.initiatorname = <empty>
Nov 29 16:23:42 user nova-compute[75245]: iface.state = <empty>
Nov 29 16:23:42 user nova-compute[75245]: iface.vlan_id = 0
Nov 29 16:23:42 user nova-compute[75245]: iface.vlan_priority = 0
Nov 29 16:23:42 user nova-compute[75245]: iface.vlan_state = <empty>
Nov 29 16:23:42 user nova-compute[75245]: iface.iface_num = 0
Nov 29 16:23:42 user nova-compute[75245]: iface.mtu = 0
Nov 29 16:23:42 user nova-compute[75245]: iface.port = 0
Nov 29 16:23:42 user nova-compute[75245]: iface.bootproto = <empty>
Nov 29 16:23:42 user nova-compute[75245]: iface.subnet_mask = <empty>
Nov 29 16:23:42 user nova-compute[75245]: iface.gateway = <empty>
Nov 29 16:23:42 user nova-compute[75245]: iface.dhcp_alt_client_id_state = <empty>
Nov 29 16:23:42 user nova-compute[75245]: iface.dhcp_alt_client_id = <empty>
Nov 29 16:23:42 user nova-compute[75245]: iface.dhcp_dns = <empty>
Nov 29 16:23:42 user nova-compute[75245]: iface.dhcp_learn_iqn = <empty>
Nov 29 16:23:42 user nova-compute[75245]: iface.dhcp_req_vendor_id_state = <empty>
Nov 29 16:23:42 user nova-compute[75245]: iface.dhcp_vendor_id_state = <empty>
Nov 29 16:23:42 user nova-compute[75245]: iface.dhcp_vendor_id = <empty>
Nov 29 16:23:42 user nova-compute[75245]: iface.dhcp_slp_da = <empty>
Nov 29 16:23:42 user nova-compute[75245]: iface.fragmentation = <empty>
Nov 29 16:23:42 user nova-compute[75245]: iface.gratuitous_arp = <empty>
Nov 29 16:23:42 user nova-compute[75245]: iface.incoming_forwarding = <empty>
Nov 29 16:23:42 user nova-compute[75245]: iface.tos_state = <empty>
Nov 29 16:23:42 user nova-compute[75245]: iface.tos = 0
Nov 29 16:23:42 user nova-compute[75245]: iface.ttl = 0
Nov 29 16:23:42 user nova-compute[75245]: iface.delayed_ack = <empty>
Nov 29 16:23:42 user nova-compute[75245]: iface.tcp_nagle = <empty>
Nov 29 16:23:42 user nova-compute[75245]: iface.tcp_wsf_state = <empty>
Nov 29 16:23:42 user nova-compute[75245]: iface.tcp_wsf = 0
Nov 29 16:23:42 user nova-compute[75245]: iface.tcp_timer_scale = 0
Nov 29 16:23:42 user nova-compute[75245]: iface.tcp_timestamp = <empty>
Nov 29 16:23:42 user nova-compute[75245]: iface.redirect = <empty>
Nov 29 16:23:42 user nova-compute[75245]: iface.def_task_mgmt_timeout = 0
Nov 29 16:23:42 user nova-compute[75245]: iface.header_digest = <empty>
Nov 29 16:23:42 user nova-compute[75245]: iface.data_digest = <empty>
Nov 29 16:23:42 user nova-compute[75245]: iface.immediate_data = <empty>
Nov 29 16:23:42 user nova-compute[75245]: iface.initial_r2t = <empty>
Nov 29 16:23:42 user nova-compute[75245]: iface.data_seq_inorder = <empty>
Nov 29 16:23:42 user nova-compute[75245]: iface.data_pdu_inorder = <empty>
Nov 29 16:23:42 user nova-compute[75245]: iface.erl = 0
Nov 29 16:23:42 user nova-compute[75245]: iface.max_receive_data_len = 0
Nov 29 16:23:42 user nova-compute[75245]: iface.first_burst_len = 0
Nov 29 16:23:42 user nova-compute[75245]: iface.max_outstanding_r2t = 0
Nov 29 16:23:42 user nova-compute[75245]: iface.max_burst_len = 0
Nov 29 16:23:42 user nova-compute[75245]: iface.chap_auth = <empty>
Nov 29 16:23:42 user nova-compute[75245]: iface.bidi_chap = <empty>
Nov 29 16:23:42 user nova-compute[75245]: iface.strict_login_compliance = <empty>
Nov 29 16:23:42 user nova-compute[75245]: iface.discovery_auth = <empty>
Nov 29 16:23:42 user nova-compute[75245]: iface.discovery_logout = <empty>
Nov 29 16:23:42 user nova-compute[75245]: node.discovery_address = <empty>
Nov 29 16:23:42 user nova-compute[75245]: node.discovery_port = 0
Nov 29 16:23:42 user nova-compute[75245]: node.discovery_type = static
Nov 29 16:23:42 user nova-compute[75245]: node.session.initial_cmdsn = 0
Nov 29 16:23:42 user nova-compute[75245]: node.session.initial_login_retry_max = 8
Nov 29 16:23:42 user nova-compute[75245]: node.session.xmit_thread_priority = -20
Nov 29 16:23:42 user nova-compute[75245]: node.session.cmds_max = 128
Nov 29 16:23:42 user nova-compute[75245]: node.session.queue_depth = 32
Nov 29 16:23:42 user nova-compute[75245]: node.session.nr_sessions = 1
Nov 29 16:23:42 user nova-compute[75245]: node.session.auth.authmethod = CHAP
Nov 29 16:23:42 user nova-compute[75245]: node.session.auth.username = TlHrZFpQ
Nov 29 16:23:42 user nova-compute[75245]: node.session.auth.password = ***
Nov 29 16:23:42 user nova-compute[75245]: node.session.auth.username_in = <empty>
Nov 29 16:23:42 user nova-compute[75245]: node.session.auth.password_in = <empty>
Nov 29 16:23:42 user nova-compute[75245]: node.session.auth.chap_algs = MD5
Nov 29 16:23:42 user nova-compute[75245]: node.session.timeo.replacement_timeout = 120
Nov 29 16:23:42 user nova-compute[75245]: node.session.err_timeo.abort_timeout = 15
Nov 29 16:23:42 user nova-compute[75245]: node.session.err_timeo.lu_reset_timeout = 30
Nov 29 16:23:42 user nova-compute[75245]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 29 16:23:42 user nova-compute[75245]: node.session.err_timeo.host_reset_timeout = 60
Nov 29 16:23:42 user nova-compute[75245]: node.session.iscsi.FastAbort = Yes
Nov 29 16:23:42 user nova-compute[75245]: node.session.iscsi.InitialR2T = No
Nov 29 16:23:42 user nova-compute[75245]: node.session.iscsi.ImmediateData = Yes
Nov 29 16:23:42 user nova-compute[75245]: node.session.iscsi.FirstBurstLength = 262144
Nov 29 16:23:42 user nova-compute[75245]: node.session.iscsi.MaxBurstLength = 16776192
Nov 29 16:23:42 user nova-compute[75245]: node.session.iscsi.DefaultTime2Retain = 0
Nov 29 16:23:42 user nova-compute[75245]: node.session.iscsi.DefaultTime2Wait = 2
Nov 29 16:23:42 user nova-compute[75245]: node.session.iscsi.MaxConnections = 1
Nov 29 16:23:42 user nova-compute[75245]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 29 16:23:42 user nova-compute[75245]: node.session.iscsi.ERL = 0
Nov 29 16:23:42 user nova-compute[75245]: node.session.scan = manual
Nov 29 16:23:42 user nova-compute[75245]: node.session.reopen_max = 0
Nov 29 16:23:42 user nova-compute[75245]: node.conn[0].address = 172.16.0.220
Nov 29 16:23:42 user nova-compute[75245]: node.conn[0].port = 3260
Nov 29 16:23:42 user nova-compute[75245]: node.conn[0].startup = manual
Nov 29 16:23:42 user nova-compute[75245]: node.conn[0].tcp.window_size = 524288
Nov 29 16:23:42 user nova-compute[75245]: node.conn[0].tcp.type_of_service = 0
Nov 29 16:23:42 user nova-compute[75245]: node.conn[0].timeo.logout_timeout = 15
Nov 29 16:23:42 user nova-compute[75245]: node.conn[0].timeo.login_timeout = 15
Nov 29 16:23:42 user nova-compute[75245]: node.conn[0].timeo.auth_timeout = 45
Nov 29 16:23:42 user nova-compute[75245]: node.conn[0].timeo.noop_out_interval = 5
Nov 29 16:23:42 user nova-compute[75245]: node.conn[0].timeo.noop_out_timeout = 5
Nov 29 16:23:42 user nova-compute[75245]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 29 16:23:42 user nova-compute[75245]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 29 16:23:42 user nova-compute[75245]: node.conn[0].iscsi.HeaderDigest = None
Nov 29 16:23:42 user nova-compute[75245]: node.conn[0].iscsi.DataDigest = None
Nov 29 16:23:42 user nova-compute[75245]: node.conn[0].iscsi.IFMarker = No
Nov 29 16:23:42 user nova-compute[75245]: node.conn[0].iscsi.OFMarker = No
Nov 29 16:23:42 user nova-compute[75245]: # END RECORD
Nov 29 16:23:42 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc58062e-90b3-4500-a2ea-4eea69e1c02c]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[a891cb03-08f9-4c05-b35a-d591e713e498]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TlHrZFpQ {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TlHrZFpQ" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8fac069-f28d-417c-ae18-c52b5627c0ee]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TlHrZFpQ'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59ffa05-a6d7-48ec-adc9-1f0b8f513133]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e63091-3893-4591-b5ea-6737076800cd]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)
Nov 29 16:23:42 user nova-compute[75245]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f (non-flash)
Nov 29 16:23:42 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)
Nov 29 16:23:42 user nova-compute[75245]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f (non-flash)
Nov 29 16:23:42 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.139s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Connected to 172.16.0.220:3260 {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] HCTL ('36', '0', '0', 0) found on session 30 with lun 0 {{(pid=75245) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=75245) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.013s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[21296fbd-498e-4f12-b4c5-cbdcdd1a08fd]: (4, ('0 0 0', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Searching for a device in session 30 and hctl ('36', '0', '0', 0) yield: sde {{(pid=75245) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TlHrZFpQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.161s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] <== connect_volume: return (162ms) {'type': 'block', 'scsi_wwn': '23231386461326565', 'path': '/dev/sde'} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23231386461326565', 'path': '/dev/sde'} {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:21:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1389384608',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1389384608',id=24,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:22:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1d52776451e947f5a9ef3fa44ac8acbb',ramdisk_id='',reservation_id='r-l3dmntgm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1780163218',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:22:08Z,user_data=None,user_id='4f20e7c9ae22462ea6bc623c93697fce',uuid=5de7e10c-f216-46b3-8f74-57bac6ab7e56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "116d08d0-5549-4438-b689-0bbda3a5934f", "address": "fa:16:3e:97:fb:c7", "network": {"id": "6a7f7426-b595-4aa3-bf80-cc92ba7ce15e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-917300903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-917300903-network", "vif_mac": "fa:16:3e:97:fb:c7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d52776451e947f5a9ef3fa44ac8acbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap116d08d0-55", "ovs_interfaceid": "116d08d0-5549-4438-b689-0bbda3a5934f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Converting VIF {"id": "116d08d0-5549-4438-b689-0bbda3a5934f", "address": "fa:16:3e:97:fb:c7", "network": {"id": "6a7f7426-b595-4aa3-bf80-cc92ba7ce15e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-917300903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-917300903-network", "vif_mac": "fa:16:3e:97:fb:c7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d52776451e947f5a9ef3fa44ac8acbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap116d08d0-55", "ovs_interfaceid": "116d08d0-5549-4438-b689-0bbda3a5934f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:97:fb:c7,bridge_name='br-int',has_traffic_filtering=True,id=116d08d0-5549-4438-b689-0bbda3a5934f,network=Network(6a7f7426-b595-4aa3-bf80-cc92ba7ce15e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap116d08d0-55') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG nova.objects.instance [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lazy-loading 'pci_devices' on Instance uuid 5de7e10c-f216-46b3-8f74-57bac6ab7e56 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG nova.objects.base [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Object Instance<5de7e10c-f216-46b3-8f74-57bac6ab7e56> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75245) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] End _get_guest_xml xml=<domain type="kvm">
Nov 29 16:23:42 user nova-compute[75245]:   <uuid>5de7e10c-f216-46b3-8f74-57bac6ab7e56</uuid>
Nov 29 16:23:42 user nova-compute[75245]:   <name>instance-00000018</name>
Nov 29 16:23:42 user nova-compute[75245]:   <memory>524288</memory>
Nov 29 16:23:42 user nova-compute[75245]:   <vcpu>1</vcpu>
Nov 29 16:23:42 user nova-compute[75245]:   <metadata>
Nov 29 16:23:42 user nova-compute[75245]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 16:23:42 user nova-compute[75245]:       <nova:package version="0.0.0"/>
Nov 29 16:23:42 user nova-compute[75245]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1389384608</nova:name>
Nov 29 16:23:42 user nova-compute[75245]:       <nova:creationTime>2023-11-29 16:23:42</nova:creationTime>
Nov 29 16:23:42 user nova-compute[75245]:       <nova:flavor name="m1.tiny">
Nov 29 16:23:42 user nova-compute[75245]:         <nova:memory>512</nova:memory>
Nov 29 16:23:42 user nova-compute[75245]:         <nova:disk>1</nova:disk>
Nov 29 16:23:42 user nova-compute[75245]:         <nova:swap>0</nova:swap>
Nov 29 16:23:42 user nova-compute[75245]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 16:23:42 user nova-compute[75245]:         <nova:vcpus>1</nova:vcpus>
Nov 29 16:23:42 user nova-compute[75245]:       </nova:flavor>
Nov 29 16:23:42 user nova-compute[75245]:       <nova:owner>
Nov 29 16:23:42 user nova-compute[75245]:         <nova:user uuid="4f20e7c9ae22462ea6bc623c93697fce">tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member</nova:user>
Nov 29 16:23:42 user nova-compute[75245]:         <nova:project uuid="1d52776451e947f5a9ef3fa44ac8acbb">tempest-ServerBootFromVolumeStableRescueTest-1780163218</nova:project>
Nov 29 16:23:42 user nova-compute[75245]:       </nova:owner>
Nov 29 16:23:42 user nova-compute[75245]:       <nova:root type="image" uuid="a291d9c3-be02-4c6c-9649-4b45c5b7f487"/>
Nov 29 16:23:42 user nova-compute[75245]:       <nova:ports>
Nov 29 16:23:42 user nova-compute[75245]:         <nova:port uuid="116d08d0-5549-4438-b689-0bbda3a5934f">
Nov 29 16:23:42 user nova-compute[75245]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 29 16:23:42 user nova-compute[75245]:         </nova:port>
Nov 29 16:23:42 user nova-compute[75245]:       </nova:ports>
Nov 29 16:23:42 user nova-compute[75245]:     </nova:instance>
Nov 29 16:23:42 user nova-compute[75245]:   </metadata>
Nov 29 16:23:42 user nova-compute[75245]:   <sysinfo type="smbios">
Nov 29 16:23:42 user nova-compute[75245]:     <system>
Nov 29 16:23:42 user nova-compute[75245]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 16:23:42 user nova-compute[75245]:       <entry name="product">OpenStack Nova</entry>
Nov 29 16:23:42 user nova-compute[75245]:       <entry name="version">0.0.0</entry>
Nov 29 16:23:42 user nova-compute[75245]:       <entry name="serial">5de7e10c-f216-46b3-8f74-57bac6ab7e56</entry>
Nov 29 16:23:42 user nova-compute[75245]:       <entry name="uuid">5de7e10c-f216-46b3-8f74-57bac6ab7e56</entry>
Nov 29 16:23:42 user nova-compute[75245]:       <entry name="family">Virtual Machine</entry>
Nov 29 16:23:42 user nova-compute[75245]:     </system>
Nov 29 16:23:42 user nova-compute[75245]:   </sysinfo>
Nov 29 16:23:42 user nova-compute[75245]:   <os>
Nov 29 16:23:42 user nova-compute[75245]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 16:23:42 user nova-compute[75245]:     <smbios mode="sysinfo"/>
Nov 29 16:23:42 user nova-compute[75245]:   </os>
Nov 29 16:23:42 user nova-compute[75245]:   <features>
Nov 29 16:23:42 user nova-compute[75245]:     <acpi/>
Nov 29 16:23:42 user nova-compute[75245]:     <apic/>
Nov 29 16:23:42 user nova-compute[75245]:     <vmcoreinfo/>
Nov 29 16:23:42 user nova-compute[75245]:   </features>
Nov 29 16:23:42 user nova-compute[75245]:   <clock offset="utc">
Nov 29 16:23:42 user nova-compute[75245]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 16:23:42 user nova-compute[75245]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 16:23:42 user nova-compute[75245]:     <timer name="hpet" present="no"/>
Nov 29 16:23:42 user nova-compute[75245]:   </clock>
Nov 29 16:23:42 user nova-compute[75245]:   <cpu mode="custom" match="exact">
Nov 29 16:23:42 user nova-compute[75245]:     <model>Nehalem</model>
Nov 29 16:23:42 user nova-compute[75245]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 16:23:42 user nova-compute[75245]:   </cpu>
Nov 29 16:23:42 user nova-compute[75245]:   <devices>
Nov 29 16:23:42 user nova-compute[75245]:     <disk type="block" device="disk">
Nov 29 16:23:42 user nova-compute[75245]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:23:42 user nova-compute[75245]:       <source dev="/dev/sde"/>
Nov 29 16:23:42 user nova-compute[75245]:       <target dev="vda" bus="virtio"/>
Nov 29 16:23:42 user nova-compute[75245]:       <serial>02359d7f-e8f6-408e-961c-64d566ea0eed</serial>
Nov 29 16:23:42 user nova-compute[75245]:     </disk>
Nov 29 16:23:42 user nova-compute[75245]:     <disk type="file" device="disk">
Nov 29 16:23:42 user nova-compute[75245]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 16:23:42 user nova-compute[75245]:       <source file="/opt/stack/data/nova/instances/5de7e10c-f216-46b3-8f74-57bac6ab7e56/disk.rescue"/>
Nov 29 16:23:42 user nova-compute[75245]:       <target dev="vdb" bus="virtio"/>
Nov 29 16:23:42 user nova-compute[75245]:       <boot order="1"/>
Nov 29 16:23:42 user nova-compute[75245]:     </disk>
Nov 29 16:23:42 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 16:23:42 user nova-compute[75245]:       <mac address="fa:16:3e:97:fb:c7"/>
Nov 29 16:23:42 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:23:42 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 16:23:42 user nova-compute[75245]:       <target dev="tap116d08d0-55"/>
Nov 29 16:23:42 user nova-compute[75245]:     </interface>
Nov 29 16:23:42 user nova-compute[75245]:     <serial type="pty">
Nov 29 16:23:42 user nova-compute[75245]:       <log file="/opt/stack/data/nova/instances/5de7e10c-f216-46b3-8f74-57bac6ab7e56/console.log" append="off"/>
Nov 29 16:23:42 user nova-compute[75245]:     </serial>
Nov 29 16:23:42 user nova-compute[75245]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 16:23:42 user nova-compute[75245]:     <video>
Nov 29 16:23:42 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:23:42 user nova-compute[75245]:     </video>
Nov 29 16:23:42 user nova-compute[75245]:     <rng model="virtio">
Nov 29 16:23:42 user nova-compute[75245]:       <backend model="random">/dev/urandom</backend>
Nov 29 16:23:42 user nova-compute[75245]:     </rng>
Nov 29 16:23:42 user nova-compute[75245]:     <controller type="usb" index="0" model="none"/>
Nov 29 16:23:42 user nova-compute[75245]:     <memballoon model="virtio">
Nov 29 16:23:42 user nova-compute[75245]:       <stats period="10"/>
Nov 29 16:23:42 user nova-compute[75245]:     </memballoon>
Nov 29 16:23:42 user nova-compute[75245]:   </devices>
Nov 29 16:23:42 user nova-compute[75245]: </domain>
Nov 29 16:23:42 user nova-compute[75245]:  {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:42 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Instance destroyed successfully.
Nov 29 16:23:42 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:23:42 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] No VIF found with MAC fa:16:3e:97:fb:c7, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:23:43 user nova-compute[75245]: DEBUG nova.compute.manager [req-091ece66-75c5-464a-9ba1-0cf4d9f1ac2d req-82307c73-d4df-4cd7-97a8-d40ed62de222 service nova] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Received event network-vif-plugged-497aee0b-487f-4138-9394-a68c8bd55e61 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:23:43 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-091ece66-75c5-464a-9ba1-0cf4d9f1ac2d req-82307c73-d4df-4cd7-97a8-d40ed62de222 service nova] Acquiring lock "d42fa9b3-91c3-4216-91f1-655ce140425f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:23:43 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-091ece66-75c5-464a-9ba1-0cf4d9f1ac2d req-82307c73-d4df-4cd7-97a8-d40ed62de222 service nova] Lock "d42fa9b3-91c3-4216-91f1-655ce140425f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:23:43 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-091ece66-75c5-464a-9ba1-0cf4d9f1ac2d req-82307c73-d4df-4cd7-97a8-d40ed62de222 service nova] Lock "d42fa9b3-91c3-4216-91f1-655ce140425f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:23:43 user nova-compute[75245]: DEBUG nova.compute.manager [req-091ece66-75c5-464a-9ba1-0cf4d9f1ac2d req-82307c73-d4df-4cd7-97a8-d40ed62de222 service nova] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] No waiting events found dispatching network-vif-plugged-497aee0b-487f-4138-9394-a68c8bd55e61 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:23:43 user nova-compute[75245]: WARNING nova.compute.manager [req-091ece66-75c5-464a-9ba1-0cf4d9f1ac2d req-82307c73-d4df-4cd7-97a8-d40ed62de222 service nova] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Received unexpected event network-vif-plugged-497aee0b-487f-4138-9394-a68c8bd55e61 for instance with vm_state active and task_state resize_finish.
Nov 29 16:23:43 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:43 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:44 user nova-compute[75245]: DEBUG nova.compute.manager [req-cc731a18-231f-45ab-9f23-a98c13c8e505 req-68f91e7e-d9a1-4164-8b06-33bf6465f461 service nova] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Received event network-vif-plugged-116d08d0-5549-4438-b689-0bbda3a5934f {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:23:44 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-cc731a18-231f-45ab-9f23-a98c13c8e505 req-68f91e7e-d9a1-4164-8b06-33bf6465f461 service nova] Acquiring lock "5de7e10c-f216-46b3-8f74-57bac6ab7e56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:23:44 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-cc731a18-231f-45ab-9f23-a98c13c8e505 req-68f91e7e-d9a1-4164-8b06-33bf6465f461 service nova] Lock "5de7e10c-f216-46b3-8f74-57bac6ab7e56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:23:44 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-cc731a18-231f-45ab-9f23-a98c13c8e505 req-68f91e7e-d9a1-4164-8b06-33bf6465f461 service nova] Lock "5de7e10c-f216-46b3-8f74-57bac6ab7e56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:23:44 user nova-compute[75245]: DEBUG nova.compute.manager [req-cc731a18-231f-45ab-9f23-a98c13c8e505 req-68f91e7e-d9a1-4164-8b06-33bf6465f461 service nova] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] No waiting events found dispatching network-vif-plugged-116d08d0-5549-4438-b689-0bbda3a5934f {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:23:44 user nova-compute[75245]: WARNING nova.compute.manager [req-cc731a18-231f-45ab-9f23-a98c13c8e505 req-68f91e7e-d9a1-4164-8b06-33bf6465f461 service nova] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Received unexpected event network-vif-plugged-116d08d0-5549-4438-b689-0bbda3a5934f for instance with vm_state active and task_state rescuing.
Nov 29 16:23:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:45 user nova-compute[75245]: DEBUG nova.compute.manager [req-30b0be6b-c635-4108-ab10-f469a5c6c0fe req-9897aaad-ff25-4fbb-817b-7e68b7d2beb3 service nova] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Received event network-vif-plugged-497aee0b-487f-4138-9394-a68c8bd55e61 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:23:45 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-30b0be6b-c635-4108-ab10-f469a5c6c0fe req-9897aaad-ff25-4fbb-817b-7e68b7d2beb3 service nova] Acquiring lock "d42fa9b3-91c3-4216-91f1-655ce140425f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:23:45 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-30b0be6b-c635-4108-ab10-f469a5c6c0fe req-9897aaad-ff25-4fbb-817b-7e68b7d2beb3 service nova] Lock "d42fa9b3-91c3-4216-91f1-655ce140425f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:23:45 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-30b0be6b-c635-4108-ab10-f469a5c6c0fe req-9897aaad-ff25-4fbb-817b-7e68b7d2beb3 service nova] Lock "d42fa9b3-91c3-4216-91f1-655ce140425f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:23:45 user nova-compute[75245]: DEBUG nova.compute.manager [req-30b0be6b-c635-4108-ab10-f469a5c6c0fe req-9897aaad-ff25-4fbb-817b-7e68b7d2beb3 service nova] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] No waiting events found dispatching network-vif-plugged-497aee0b-487f-4138-9394-a68c8bd55e61 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:23:45 user nova-compute[75245]: WARNING nova.compute.manager [req-30b0be6b-c635-4108-ab10-f469a5c6c0fe req-9897aaad-ff25-4fbb-817b-7e68b7d2beb3 service nova] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Received unexpected event network-vif-plugged-497aee0b-487f-4138-9394-a68c8bd55e61 for instance with vm_state active and task_state resize_finish.
Nov 29 16:23:46 user nova-compute[75245]: DEBUG nova.compute.manager [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Instance event wait completed in 0 seconds for  {{(pid=75245) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 16:23:46 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Instance running successfully.
Nov 29 16:23:46 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Failed to set time: agent not configured {{(pid=75245) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 29 16:23:46 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-15d59389-8603-45ab-842c-b167c0bc3e21 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] finish_migration finished successfully. {{(pid=75245) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11766}}
Nov 29 16:23:46 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:46 user nova-compute[75245]: DEBUG nova.compute.manager [None req-b9d9018a-b5a2-413f-88c0-bdc600f74e98 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:23:46 user nova-compute[75245]: DEBUG nova.compute.manager [req-d268634e-397b-45c0-928a-164034d159d4 req-39062d12-1a42-4dba-8b0c-0bd3095ef588 service nova] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Received event network-vif-plugged-116d08d0-5549-4438-b689-0bbda3a5934f {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:23:46 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d268634e-397b-45c0-928a-164034d159d4 req-39062d12-1a42-4dba-8b0c-0bd3095ef588 service nova] Acquiring lock "5de7e10c-f216-46b3-8f74-57bac6ab7e56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:23:46 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d268634e-397b-45c0-928a-164034d159d4 req-39062d12-1a42-4dba-8b0c-0bd3095ef588 service nova] Lock "5de7e10c-f216-46b3-8f74-57bac6ab7e56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:23:46 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d268634e-397b-45c0-928a-164034d159d4 req-39062d12-1a42-4dba-8b0c-0bd3095ef588 service nova] Lock "5de7e10c-f216-46b3-8f74-57bac6ab7e56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:23:46 user nova-compute[75245]: DEBUG nova.compute.manager [req-d268634e-397b-45c0-928a-164034d159d4 req-39062d12-1a42-4dba-8b0c-0bd3095ef588 service nova] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] No waiting events found dispatching network-vif-plugged-116d08d0-5549-4438-b689-0bbda3a5934f {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:23:46 user nova-compute[75245]: WARNING nova.compute.manager [req-d268634e-397b-45c0-928a-164034d159d4 req-39062d12-1a42-4dba-8b0c-0bd3095ef588 service nova] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Received unexpected event network-vif-plugged-116d08d0-5549-4438-b689-0bbda3a5934f for instance with vm_state active and task_state rescuing.
Nov 29 16:23:46 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Starting finish_revert_migration {{(pid=75245) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11816}}
Nov 29 16:23:46 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Start _get_guest_xml network_info=[{"id": "27fc0374-0770-4171-a730-6696b09362eb", "address": "fa:16:3e:d1:e4:30", "network": {"id": "e38d9eed-b29b-4a4c-b084-876554dc5263", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1284740336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c018212e0654c4db442ca65a386f397", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27fc0374-07", "ovs_interfaceid": "27fc0374-0770-4171-a730-6696b09362eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'a291d9c3-be02-4c6c-9649-4b45c5b7f487'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'attachment_id': 'bb5fabb9-2714-4983-afd3-6715a7e2bc6c', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UPxkSWMT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '84bae51e-2a85-442d-bbd2-fc89f30f40b7', 'attached_at': '2023-11-29T16:23:47.000000', 'detached_at': '', 'volume_id': '0534d649-6af0-440a-86de-eadff936597e', 'serial': '0534d649-6af0-440a-86de-eadff936597e'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'guest_format': None, 'volume_type': None} {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 16:23:46 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:23:46 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:23:46 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 16:23:46 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] CPU controller missing on host. {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 16:23:46 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 16:23:46 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] CPU controller found on host. {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 16:23:46 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75245) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 16:23:46 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T16:06:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 16:23:47 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Flavor limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 16:23:47 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Image limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 16:23:47 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Flavor pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 16:23:47 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Image pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 16:23:47 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 16:23:47 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 16:23:47 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 16:23:47 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Got 1 possible topologies {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 16:23:47 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 16:23:47 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 16:23:47 user nova-compute[75245]: DEBUG nova.objects.instance [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Lazy-loading 'vcpu_model' on Instance uuid 84bae51e-2a85-442d-bbd2-fc89f30f40b7 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:23:47 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Calling os-brick to attach iSCSI Volume {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 16:23:47 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UPxkSWMT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:23:47 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:23:47 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:23:47 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:23:47 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:23:47 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:23:47 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:23:47 user nova-compute[75245]: INFO os_brick.initiator.connectors.iscsi [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 16:23:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e -p 172.16.0.220:3260 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:23:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:23:47 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[36bea1f8-a085-43a5-a0d4-3283416bcec9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:23:47 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 16:23:47 user nova-compute[75245]:  {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:23:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e -p 172.16.0.220:3260 --interface default --op new {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:23:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:23:47 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[c98db5aa-e5b0-471c-92d1-ee7f37fc1ec7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e] added\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:23:47 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e] added
Nov 29 16:23:47 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:23:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:23:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:23:47 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[89827d1c-a561-4162-8d15-dfc3be75ecb4]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:23:47 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:23:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:23:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:23:47 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[6338effb-0434-4b48-ac9f-a2cf68cb766d]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:23:47 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:23:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UPxkSWMT {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:23:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UPxkSWMT" returned: 0 in 0.022s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:23:47 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd357d3-5e76-4c30-8234-cca2a0dfaca5]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:23:47 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UPxkSWMT'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:23:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:23:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:23:47 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[15dd5bd0-f5d6-4fbf-a819-b958e8ca1a38]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:23:47 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:23:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:23:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:23:47 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[9536966b-bc4d-447e-9bc9-4638c813b3f3]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:23:47 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)
Nov 29 16:23:47 user nova-compute[75245]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f (non-flash)
Nov 29 16:23:47 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:23:47 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)
Nov 29 16:23:47 user nova-compute[75245]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f (non-flash)
Nov 29 16:23:47 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:23:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e -p 172.16.0.220:3260 --login {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:23:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:23:47 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0498f0c-0bd0-4117-9d27-fb3611264aa0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:23:47 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e, portal: 172.16.0.220,3260]
Nov 29 16:23:47 user nova-compute[75245]: Login to [iface: default, target: iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e, portal: 172.16.0.220,3260] successful.
Nov 29 16:23:47 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:23:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:23:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:23:47 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[b375ac44-5f70-4927-bb25-2f9ec3fd6a01]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:23:47 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:23:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:23:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:23:47 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[66128ce9-e525-48d2-b99d-f906897ad96a]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:23:47 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)
Nov 29 16:23:47 user nova-compute[75245]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f (non-flash)
Nov 29 16:23:47 user nova-compute[75245]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e (non-flash)
Nov 29 16:23:47 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:23:47 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)
Nov 29 16:23:47 user nova-compute[75245]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f (non-flash)
Nov 29 16:23:47 user nova-compute[75245]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e (non-flash)
Nov 29 16:23:47 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:23:47 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:23:47 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Connected to 172.16.0.220:3260 {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 16:23:47 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] HCTL ('34', '-', '-', 0) found on session 32 with lun 0 {{(pid=75245) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 16:23:47 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75245) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 16:23:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:23:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:23:47 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6ffa78-8daf-45a9-ad7b-e8a4677dc124]: (4, ('- - 0', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:23:47 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Searching for a device in session 32 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75245) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 16:23:47 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UPxkSWMT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 16:23:48 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:23:48 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '23933616436303938', 'path': '/dev/sdc'} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:23:48 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23933616436303938', 'path': '/dev/sdc'} {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 16:23:48 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:17:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-185985516',display_name='tempest-ServerActionsTestOtherB-server-185985516',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-185985516',id=20,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMGVVYk91CF4EJNlPGJ16B9aebX0g0461zoNkayBpAbBcPtumcB5nsUcunIZSLwTkPZC3DIGJ81mZLNGLk1xqtQ18lArBUMtmLGCUS7pb+CbAh4z22M0J6OlcUXZFjAglA==',key_name='tempest-keypair-1103342865',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:22:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3c018212e0654c4db442ca65a386f397',ramdisk_id='',reservation_id='r-rarysz12',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1446057763',owner_user_name='tempest-ServerActionsTestOtherB-1446057763-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:23:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecd08c449e8643c2b0eb4b2dc8cd7780',uuid=84bae51e-2a85-442d-bbd2-fc89f30f40b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "27fc0374-0770-4171-a730-6696b09362eb", "address": "fa:16:3e:d1:e4:30", "network": {"id": "e38d9eed-b29b-4a4c-b084-876554dc5263", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1284740336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c018212e0654c4db442ca65a386f397", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27fc0374-07", "ovs_interfaceid": "27fc0374-0770-4171-a730-6696b09362eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:23:48 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Converting VIF {"id": "27fc0374-0770-4171-a730-6696b09362eb", "address": "fa:16:3e:d1:e4:30", "network": {"id": "e38d9eed-b29b-4a4c-b084-876554dc5263", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1284740336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c018212e0654c4db442ca65a386f397", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27fc0374-07", "ovs_interfaceid": "27fc0374-0770-4171-a730-6696b09362eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:23:48 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:e4:30,bridge_name='br-int',has_traffic_filtering=True,id=27fc0374-0770-4171-a730-6696b09362eb,network=Network(e38d9eed-b29b-4a4c-b084-876554dc5263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27fc0374-07') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:23:48 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] End _get_guest_xml xml=<domain type="kvm">
Nov 29 16:23:48 user nova-compute[75245]:   <uuid>84bae51e-2a85-442d-bbd2-fc89f30f40b7</uuid>
Nov 29 16:23:48 user nova-compute[75245]:   <name>instance-00000014</name>
Nov 29 16:23:48 user nova-compute[75245]:   <memory>524288</memory>
Nov 29 16:23:48 user nova-compute[75245]:   <vcpu>1</vcpu>
Nov 29 16:23:48 user nova-compute[75245]:   <metadata>
Nov 29 16:23:48 user nova-compute[75245]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 16:23:48 user nova-compute[75245]:       <nova:package version="0.0.0"/>
Nov 29 16:23:48 user nova-compute[75245]:       <nova:name>tempest-ServerActionsTestOtherB-server-185985516</nova:name>
Nov 29 16:23:48 user nova-compute[75245]:       <nova:creationTime>2023-11-29 16:23:46</nova:creationTime>
Nov 29 16:23:48 user nova-compute[75245]:       <nova:flavor name="m1.tiny">
Nov 29 16:23:48 user nova-compute[75245]:         <nova:memory>512</nova:memory>
Nov 29 16:23:48 user nova-compute[75245]:         <nova:disk>1</nova:disk>
Nov 29 16:23:48 user nova-compute[75245]:         <nova:swap>0</nova:swap>
Nov 29 16:23:48 user nova-compute[75245]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 16:23:48 user nova-compute[75245]:         <nova:vcpus>1</nova:vcpus>
Nov 29 16:23:48 user nova-compute[75245]:       </nova:flavor>
Nov 29 16:23:48 user nova-compute[75245]:       <nova:owner>
Nov 29 16:23:48 user nova-compute[75245]:         <nova:user uuid="ecd08c449e8643c2b0eb4b2dc8cd7780">tempest-ServerActionsTestOtherB-1446057763-project-member</nova:user>
Nov 29 16:23:48 user nova-compute[75245]:         <nova:project uuid="3c018212e0654c4db442ca65a386f397">tempest-ServerActionsTestOtherB-1446057763</nova:project>
Nov 29 16:23:48 user nova-compute[75245]:       </nova:owner>
Nov 29 16:23:48 user nova-compute[75245]:       <nova:root type="image" uuid="a291d9c3-be02-4c6c-9649-4b45c5b7f487"/>
Nov 29 16:23:48 user nova-compute[75245]:       <nova:ports>
Nov 29 16:23:48 user nova-compute[75245]:         <nova:port uuid="27fc0374-0770-4171-a730-6696b09362eb">
Nov 29 16:23:48 user nova-compute[75245]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 16:23:48 user nova-compute[75245]:         </nova:port>
Nov 29 16:23:48 user nova-compute[75245]:       </nova:ports>
Nov 29 16:23:48 user nova-compute[75245]:     </nova:instance>
Nov 29 16:23:48 user nova-compute[75245]:   </metadata>
Nov 29 16:23:48 user nova-compute[75245]:   <sysinfo type="smbios">
Nov 29 16:23:48 user nova-compute[75245]:     <system>
Nov 29 16:23:48 user nova-compute[75245]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 16:23:48 user nova-compute[75245]:       <entry name="product">OpenStack Nova</entry>
Nov 29 16:23:48 user nova-compute[75245]:       <entry name="version">0.0.0</entry>
Nov 29 16:23:48 user nova-compute[75245]:       <entry name="serial">84bae51e-2a85-442d-bbd2-fc89f30f40b7</entry>
Nov 29 16:23:48 user nova-compute[75245]:       <entry name="uuid">84bae51e-2a85-442d-bbd2-fc89f30f40b7</entry>
Nov 29 16:23:48 user nova-compute[75245]:       <entry name="family">Virtual Machine</entry>
Nov 29 16:23:48 user nova-compute[75245]:     </system>
Nov 29 16:23:48 user nova-compute[75245]:   </sysinfo>
Nov 29 16:23:48 user nova-compute[75245]:   <os>
Nov 29 16:23:48 user nova-compute[75245]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 16:23:48 user nova-compute[75245]:     <boot dev="hd"/>
Nov 29 16:23:48 user nova-compute[75245]:     <smbios mode="sysinfo"/>
Nov 29 16:23:48 user nova-compute[75245]:   </os>
Nov 29 16:23:48 user nova-compute[75245]:   <features>
Nov 29 16:23:48 user nova-compute[75245]:     <acpi/>
Nov 29 16:23:48 user nova-compute[75245]:     <apic/>
Nov 29 16:23:48 user nova-compute[75245]:     <vmcoreinfo/>
Nov 29 16:23:48 user nova-compute[75245]:   </features>
Nov 29 16:23:48 user nova-compute[75245]:   <clock offset="utc">
Nov 29 16:23:48 user nova-compute[75245]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 16:23:48 user nova-compute[75245]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 16:23:48 user nova-compute[75245]:     <timer name="hpet" present="no"/>
Nov 29 16:23:48 user nova-compute[75245]:   </clock>
Nov 29 16:23:48 user nova-compute[75245]:   <cpu mode="custom" match="exact">
Nov 29 16:23:48 user nova-compute[75245]:     <model>Nehalem</model>
Nov 29 16:23:48 user nova-compute[75245]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 16:23:48 user nova-compute[75245]:   </cpu>
Nov 29 16:23:48 user nova-compute[75245]:   <devices>
Nov 29 16:23:48 user nova-compute[75245]:     <disk type="file" device="disk">
Nov 29 16:23:48 user nova-compute[75245]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 16:23:48 user nova-compute[75245]:       <source file="/opt/stack/data/nova/instances/84bae51e-2a85-442d-bbd2-fc89f30f40b7/disk"/>
Nov 29 16:23:48 user nova-compute[75245]:       <target dev="vda" bus="virtio"/>
Nov 29 16:23:48 user nova-compute[75245]:     </disk>
Nov 29 16:23:48 user nova-compute[75245]:     <disk type="block" device="disk">
Nov 29 16:23:48 user nova-compute[75245]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:23:48 user nova-compute[75245]:       <source dev="/dev/sdc"/>
Nov 29 16:23:48 user nova-compute[75245]:       <target dev="vdb" bus="virtio"/>
Nov 29 16:23:48 user nova-compute[75245]:       <serial>0534d649-6af0-440a-86de-eadff936597e</serial>
Nov 29 16:23:48 user nova-compute[75245]:     </disk>
Nov 29 16:23:48 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 16:23:48 user nova-compute[75245]:       <mac address="fa:16:3e:d1:e4:30"/>
Nov 29 16:23:48 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:23:48 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 16:23:48 user nova-compute[75245]:       <target dev="tap27fc0374-07"/>
Nov 29 16:23:48 user nova-compute[75245]:     </interface>
Nov 29 16:23:48 user nova-compute[75245]:     <serial type="pty">
Nov 29 16:23:48 user nova-compute[75245]:       <log file="/opt/stack/data/nova/instances/84bae51e-2a85-442d-bbd2-fc89f30f40b7/console.log" append="off"/>
Nov 29 16:23:48 user nova-compute[75245]:     </serial>
Nov 29 16:23:48 user nova-compute[75245]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 16:23:48 user nova-compute[75245]:     <video>
Nov 29 16:23:48 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:23:48 user nova-compute[75245]:     </video>
Nov 29 16:23:48 user nova-compute[75245]:     <rng model="virtio">
Nov 29 16:23:48 user nova-compute[75245]:       <backend model="random">/dev/urandom</backend>
Nov 29 16:23:48 user nova-compute[75245]:     </rng>
Nov 29 16:23:48 user nova-compute[75245]:     <controller type="usb" index="0" model="none"/>
Nov 29 16:23:48 user nova-compute[75245]:     <memballoon model="virtio">
Nov 29 16:23:48 user nova-compute[75245]:       <stats period="10"/>
Nov 29 16:23:48 user nova-compute[75245]:     </memballoon>
Nov 29 16:23:48 user nova-compute[75245]:   </devices>
Nov 29 16:23:48 user nova-compute[75245]: </domain>
Nov 29 16:23:48 user nova-compute[75245]:  {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 16:23:48 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:17:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-185985516',display_name='tempest-ServerActionsTestOtherB-server-185985516',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-185985516',id=20,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMGVVYk91CF4EJNlPGJ16B9aebX0g0461zoNkayBpAbBcPtumcB5nsUcunIZSLwTkPZC3DIGJ81mZLNGLk1xqtQ18lArBUMtmLGCUS7pb+CbAh4z22M0J6OlcUXZFjAglA==',key_name='tempest-keypair-1103342865',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:22:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3c018212e0654c4db442ca65a386f397',ramdisk_id='',reservation_id='r-rarysz12',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1446057763',owner_user_name='tempest-ServerActionsTestOtherB-1446057763-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:23:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecd08c449e8643c2b0eb4b2dc8cd7780',uuid=84bae51e-2a85-442d-bbd2-fc89f30f40b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "27fc0374-0770-4171-a730-6696b09362eb", "address": "fa:16:3e:d1:e4:30", "network": {"id": "e38d9eed-b29b-4a4c-b084-876554dc5263", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1284740336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c018212e0654c4db442ca65a386f397", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27fc0374-07", "ovs_interfaceid": "27fc0374-0770-4171-a730-6696b09362eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 16:23:48 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Converting VIF {"id": "27fc0374-0770-4171-a730-6696b09362eb", "address": "fa:16:3e:d1:e4:30", "network": {"id": "e38d9eed-b29b-4a4c-b084-876554dc5263", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1284740336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c018212e0654c4db442ca65a386f397", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27fc0374-07", "ovs_interfaceid": "27fc0374-0770-4171-a730-6696b09362eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:23:48 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:e4:30,bridge_name='br-int',has_traffic_filtering=True,id=27fc0374-0770-4171-a730-6696b09362eb,network=Network(e38d9eed-b29b-4a4c-b084-876554dc5263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27fc0374-07') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:23:48 user nova-compute[75245]: DEBUG os_vif [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:e4:30,bridge_name='br-int',has_traffic_filtering=True,id=27fc0374-0770-4171-a730-6696b09362eb,network=Network(e38d9eed-b29b-4a4c-b084-876554dc5263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27fc0374-07') {{(pid=75245) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 16:23:48 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:48 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:23:48 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 16:23:48 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:48 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fb342857-b7c7-5f40-b45a-63f3fe5e782f', '_type': 'linux-noop'}}, row=False) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:23:48 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:48 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:23:48 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:48 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap27fc0374-07, may_exist=True, interface_attrs={}) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:23:48 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap27fc0374-07, col_values=(('qos', UUID('b3cd1759-9823-480a-88d7-6bd2f0dd5ae6')),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:23:48 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap27fc0374-07, col_values=(('external_ids', {'iface-id': '27fc0374-0770-4171-a730-6696b09362eb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:e4:30', 'vm-uuid': '84bae51e-2a85-442d-bbd2-fc89f30f40b7'}),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:23:48 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:48 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:23:48 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:48 user nova-compute[75245]: INFO os_vif [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:e4:30,bridge_name='br-int',has_traffic_filtering=True,id=27fc0374-0770-4171-a730-6696b09362eb,network=Network(e38d9eed-b29b-4a4c-b084-876554dc5263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27fc0374-07')
Nov 29 16:23:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:50 user nova-compute[75245]: DEBUG nova.compute.manager [req-53e9ad71-6369-4e6d-b0ce-c19d35d57758 req-38ffc829-057d-49b7-9a56-519a16e626ff service nova] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Received event network-vif-plugged-27fc0374-0770-4171-a730-6696b09362eb {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:23:50 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-53e9ad71-6369-4e6d-b0ce-c19d35d57758 req-38ffc829-057d-49b7-9a56-519a16e626ff service nova] Acquiring lock "84bae51e-2a85-442d-bbd2-fc89f30f40b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:23:50 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-53e9ad71-6369-4e6d-b0ce-c19d35d57758 req-38ffc829-057d-49b7-9a56-519a16e626ff service nova] Lock "84bae51e-2a85-442d-bbd2-fc89f30f40b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:23:50 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-53e9ad71-6369-4e6d-b0ce-c19d35d57758 req-38ffc829-057d-49b7-9a56-519a16e626ff service nova] Lock "84bae51e-2a85-442d-bbd2-fc89f30f40b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:23:50 user nova-compute[75245]: DEBUG nova.compute.manager [req-53e9ad71-6369-4e6d-b0ce-c19d35d57758 req-38ffc829-057d-49b7-9a56-519a16e626ff service nova] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] No waiting events found dispatching network-vif-plugged-27fc0374-0770-4171-a730-6696b09362eb {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:23:50 user nova-compute[75245]: WARNING nova.compute.manager [req-53e9ad71-6369-4e6d-b0ce-c19d35d57758 req-38ffc829-057d-49b7-9a56-519a16e626ff service nova] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Received unexpected event network-vif-plugged-27fc0374-0770-4171-a730-6696b09362eb for instance with vm_state resized and task_state resize_reverting.
Nov 29 16:23:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:52 user nova-compute[75245]: DEBUG nova.compute.manager [req-285c5ba4-8732-4d46-a6f5-aac23180b420 req-1fb66aca-489c-4e8a-9520-4a4be66d5a4b service nova] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Received event network-vif-plugged-27fc0374-0770-4171-a730-6696b09362eb {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:23:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-285c5ba4-8732-4d46-a6f5-aac23180b420 req-1fb66aca-489c-4e8a-9520-4a4be66d5a4b service nova] Acquiring lock "84bae51e-2a85-442d-bbd2-fc89f30f40b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:23:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-285c5ba4-8732-4d46-a6f5-aac23180b420 req-1fb66aca-489c-4e8a-9520-4a4be66d5a4b service nova] Lock "84bae51e-2a85-442d-bbd2-fc89f30f40b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:23:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-285c5ba4-8732-4d46-a6f5-aac23180b420 req-1fb66aca-489c-4e8a-9520-4a4be66d5a4b service nova] Lock "84bae51e-2a85-442d-bbd2-fc89f30f40b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:23:52 user nova-compute[75245]: DEBUG nova.compute.manager [req-285c5ba4-8732-4d46-a6f5-aac23180b420 req-1fb66aca-489c-4e8a-9520-4a4be66d5a4b service nova] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] No waiting events found dispatching network-vif-plugged-27fc0374-0770-4171-a730-6696b09362eb {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:23:52 user nova-compute[75245]: WARNING nova.compute.manager [req-285c5ba4-8732-4d46-a6f5-aac23180b420 req-1fb66aca-489c-4e8a-9520-4a4be66d5a4b service nova] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Received unexpected event network-vif-plugged-27fc0374-0770-4171-a730-6696b09362eb for instance with vm_state resized and task_state resize_reverting.
Nov 29 16:23:52 user nova-compute[75245]: DEBUG nova.compute.manager [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Instance event wait completed in 0 seconds for  {{(pid=75245) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 16:23:52 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Instance running successfully.
Nov 29 16:23:52 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] finish_revert_migration finished successfully. {{(pid=75245) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11860}}
Nov 29 16:23:52 user nova-compute[75245]: INFO nova.compute.manager [None req-b85d47b7-5bce-4acf-b1b7-33720831a225 tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Updating instance to original state: 'active'
Nov 29 16:23:53 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:53 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:54 user nova-compute[75245]: INFO nova.compute.manager [None req-3616e150-751c-4eb2-a545-c82ed1a0a007 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Rescuing
Nov 29 16:23:54 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3616e150-751c-4eb2-a545-c82ed1a0a007 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Acquiring lock "refresh_cache-ed9d1ad5-f5d0-4a68-a073-e7a83be772ea" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:23:54 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3616e150-751c-4eb2-a545-c82ed1a0a007 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Acquired lock "refresh_cache-ed9d1ad5-f5d0-4a68-a073-e7a83be772ea" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:23:54 user nova-compute[75245]: DEBUG nova.network.neutron [None req-3616e150-751c-4eb2-a545-c82ed1a0a007 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 16:23:54 user nova-compute[75245]: DEBUG nova.network.neutron [None req-3616e150-751c-4eb2-a545-c82ed1a0a007 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Updating instance_info_cache with network_info: [{"id": "592b836b-e112-414f-b9a9-60e5f65b8f98", "address": "fa:16:3e:90:86:e1", "network": {"id": "02098e86-68f8-464e-84ee-bf2fb09b881b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085418471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e12002e1a11f4caf8953371e66e6652e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592b836b-e1", "ovs_interfaceid": "592b836b-e112-414f-b9a9-60e5f65b8f98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:23:54 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3616e150-751c-4eb2-a545-c82ed1a0a007 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Releasing lock "refresh_cache-ed9d1ad5-f5d0-4a68-a073-e7a83be772ea" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:23:55 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:55 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:55 user nova-compute[75245]: DEBUG nova.compute.manager [req-29622cd8-5c1f-4996-94a3-1549d2563763 req-1dba8a4b-52ea-4b38-8782-84be5aa1cc80 service nova] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Received event network-vif-unplugged-592b836b-e112-414f-b9a9-60e5f65b8f98 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:23:55 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-29622cd8-5c1f-4996-94a3-1549d2563763 req-1dba8a4b-52ea-4b38-8782-84be5aa1cc80 service nova] Acquiring lock "ed9d1ad5-f5d0-4a68-a073-e7a83be772ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:23:55 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-29622cd8-5c1f-4996-94a3-1549d2563763 req-1dba8a4b-52ea-4b38-8782-84be5aa1cc80 service nova] Lock "ed9d1ad5-f5d0-4a68-a073-e7a83be772ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:23:55 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-29622cd8-5c1f-4996-94a3-1549d2563763 req-1dba8a4b-52ea-4b38-8782-84be5aa1cc80 service nova] Lock "ed9d1ad5-f5d0-4a68-a073-e7a83be772ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:23:55 user nova-compute[75245]: DEBUG nova.compute.manager [req-29622cd8-5c1f-4996-94a3-1549d2563763 req-1dba8a4b-52ea-4b38-8782-84be5aa1cc80 service nova] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] No waiting events found dispatching network-vif-unplugged-592b836b-e112-414f-b9a9-60e5f65b8f98 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:23:55 user nova-compute[75245]: WARNING nova.compute.manager [req-29622cd8-5c1f-4996-94a3-1549d2563763 req-1dba8a4b-52ea-4b38-8782-84be5aa1cc80 service nova] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Received unexpected event network-vif-unplugged-592b836b-e112-414f-b9a9-60e5f65b8f98 for instance with vm_state active and task_state rescuing.
Nov 29 16:23:55 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:55 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:55 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Instance destroyed successfully.
Nov 29 16:23:55 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-3616e150-751c-4eb2-a545-c82ed1a0a007 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Attempting rescue
Nov 29 16:23:55 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-3616e150-751c-4eb2-a545-c82ed1a0a007 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75245) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 29 16:23:55 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-3616e150-751c-4eb2-a545-c82ed1a0a007 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Instance directory exists: not creating {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 16:23:55 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-3616e150-751c-4eb2-a545-c82ed1a0a007 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Creating image(s)
Nov 29 16:23:55 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3616e150-751c-4eb2-a545-c82ed1a0a007 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Acquiring lock "/opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:23:55 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3616e150-751c-4eb2-a545-c82ed1a0a007 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lock "/opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:23:55 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3616e150-751c-4eb2-a545-c82ed1a0a007 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lock "/opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:23:55 user nova-compute[75245]: DEBUG nova.objects.instance [None req-3616e150-751c-4eb2-a545-c82ed1a0a007 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lazy-loading 'trusted_certs' on Instance uuid ed9d1ad5-f5d0-4a68-a073-e7a83be772ea {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:23:56 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3616e150-751c-4eb2-a545-c82ed1a0a007 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Acquiring lock "d654f7206043e05d3525550b0fc885556eb999f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:23:56 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3616e150-751c-4eb2-a545-c82ed1a0a007 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:23:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-3616e150-751c-4eb2-a545-c82ed1a0a007 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:23:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-3616e150-751c-4eb2-a545-c82ed1a0a007 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.182s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:23:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-3616e150-751c-4eb2-a545-c82ed1a0a007 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk.rescue {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:23:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-3616e150-751c-4eb2-a545-c82ed1a0a007 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk.rescue" returned: 0 in 0.051s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:23:56 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3616e150-751c-4eb2-a545-c82ed1a0a007 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:23:56 user nova-compute[75245]: DEBUG nova.objects.instance [None req-3616e150-751c-4eb2-a545-c82ed1a0a007 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lazy-loading 'migration_context' on Instance uuid ed9d1ad5-f5d0-4a68-a073-e7a83be772ea {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:23:56 user nova-compute[75245]: DEBUG nova.objects.base [None req-3616e150-751c-4eb2-a545-c82ed1a0a007 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Object Instance<ed9d1ad5-f5d0-4a68-a073-e7a83be772ea> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75245) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 16:23:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-3616e150-751c-4eb2-a545-c82ed1a0a007 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Created local disks {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 16:23:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-3616e150-751c-4eb2-a545-c82ed1a0a007 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Start _get_guest_xml network_info=[{"id": "592b836b-e112-414f-b9a9-60e5f65b8f98", "address": "fa:16:3e:90:86:e1", "network": {"id": "02098e86-68f8-464e-84ee-bf2fb09b881b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085418471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2085418471-network", "vif_mac": "fa:16:3e:90:86:e1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e12002e1a11f4caf8953371e66e6652e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592b836b-e1", "ovs_interfaceid": "592b836b-e112-414f-b9a9-60e5f65b8f98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'a291d9c3-be02-4c6c-9649-4b45c5b7f487', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 16:23:56 user nova-compute[75245]: DEBUG nova.objects.instance [None req-3616e150-751c-4eb2-a545-c82ed1a0a007 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lazy-loading 'resources' on Instance uuid ed9d1ad5-f5d0-4a68-a073-e7a83be772ea {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:23:56 user nova-compute[75245]: DEBUG nova.objects.base [None req-3616e150-751c-4eb2-a545-c82ed1a0a007 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Object Instance<ed9d1ad5-f5d0-4a68-a073-e7a83be772ea> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75245) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 16:23:56 user nova-compute[75245]: DEBUG nova.objects.instance [None req-3616e150-751c-4eb2-a545-c82ed1a0a007 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lazy-loading 'numa_topology' on Instance uuid ed9d1ad5-f5d0-4a68-a073-e7a83be772ea {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:23:56 user nova-compute[75245]: DEBUG nova.objects.base [None req-3616e150-751c-4eb2-a545-c82ed1a0a007 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Object Instance<ed9d1ad5-f5d0-4a68-a073-e7a83be772ea> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75245) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 16:23:56 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-3616e150-751c-4eb2-a545-c82ed1a0a007 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:23:56 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-3616e150-751c-4eb2-a545-c82ed1a0a007 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:23:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-3616e150-751c-4eb2-a545-c82ed1a0a007 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 16:23:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-3616e150-751c-4eb2-a545-c82ed1a0a007 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] CPU controller missing on host. {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 16:23:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-3616e150-751c-4eb2-a545-c82ed1a0a007 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 16:23:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-3616e150-751c-4eb2-a545-c82ed1a0a007 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] CPU controller found on host. {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 16:23:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-3616e150-751c-4eb2-a545-c82ed1a0a007 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75245) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 16:23:56 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-3616e150-751c-4eb2-a545-c82ed1a0a007 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T16:06:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 16:23:56 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-3616e150-751c-4eb2-a545-c82ed1a0a007 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Flavor limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 16:23:56 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-3616e150-751c-4eb2-a545-c82ed1a0a007 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Image limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 16:23:56 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-3616e150-751c-4eb2-a545-c82ed1a0a007 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Flavor pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 16:23:56 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-3616e150-751c-4eb2-a545-c82ed1a0a007 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Image pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 16:23:56 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-3616e150-751c-4eb2-a545-c82ed1a0a007 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 16:23:56 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-3616e150-751c-4eb2-a545-c82ed1a0a007 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 16:23:56 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-3616e150-751c-4eb2-a545-c82ed1a0a007 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 16:23:56 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-3616e150-751c-4eb2-a545-c82ed1a0a007 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Got 1 possible topologies {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 16:23:56 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-3616e150-751c-4eb2-a545-c82ed1a0a007 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 16:23:56 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-3616e150-751c-4eb2-a545-c82ed1a0a007 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 16:23:56 user nova-compute[75245]: DEBUG nova.objects.instance [None req-3616e150-751c-4eb2-a545-c82ed1a0a007 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lazy-loading 'vcpu_model' on Instance uuid ed9d1ad5-f5d0-4a68-a073-e7a83be772ea {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:23:56 user nova-compute[75245]: DEBUG nova.objects.base [None req-3616e150-751c-4eb2-a545-c82ed1a0a007 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Object Instance<ed9d1ad5-f5d0-4a68-a073-e7a83be772ea> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75245) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 16:23:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-3616e150-751c-4eb2-a545-c82ed1a0a007 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:22:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1973964224',display_name='tempest-ServerRescueNegativeTestJSON-server-1973964224',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1973964224',id=26,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:22:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e12002e1a11f4caf8953371e66e6652e',ramdisk_id='',reservation_id='r-z1a05ozn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1013090395',owner_user_name='tempest-ServerRescueNegativeTestJSON-1013090395-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:22:13Z,user_data=None,user_id='d876b1e244b14a29ad5b4b422135336b',uuid=ed9d1ad5-f5d0-4a68-a073-e7a83be772ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "592b836b-e112-414f-b9a9-60e5f65b8f98", "address": "fa:16:3e:90:86:e1", "network": {"id": "02098e86-68f8-464e-84ee-bf2fb09b881b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085418471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2085418471-network", "vif_mac": "fa:16:3e:90:86:e1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e12002e1a11f4caf8953371e66e6652e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592b836b-e1", "ovs_interfaceid": "592b836b-e112-414f-b9a9-60e5f65b8f98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:23:56 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-3616e150-751c-4eb2-a545-c82ed1a0a007 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Converting VIF {"id": "592b836b-e112-414f-b9a9-60e5f65b8f98", "address": "fa:16:3e:90:86:e1", "network": {"id": "02098e86-68f8-464e-84ee-bf2fb09b881b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085418471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2085418471-network", "vif_mac": "fa:16:3e:90:86:e1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e12002e1a11f4caf8953371e66e6652e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592b836b-e1", "ovs_interfaceid": "592b836b-e112-414f-b9a9-60e5f65b8f98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:23:56 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-3616e150-751c-4eb2-a545-c82ed1a0a007 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:90:86:e1,bridge_name='br-int',has_traffic_filtering=True,id=592b836b-e112-414f-b9a9-60e5f65b8f98,network=Network(02098e86-68f8-464e-84ee-bf2fb09b881b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap592b836b-e1') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:23:56 user nova-compute[75245]: DEBUG nova.objects.instance [None req-3616e150-751c-4eb2-a545-c82ed1a0a007 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lazy-loading 'pci_devices' on Instance uuid ed9d1ad5-f5d0-4a68-a073-e7a83be772ea {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:23:56 user nova-compute[75245]: DEBUG nova.objects.base [None req-3616e150-751c-4eb2-a545-c82ed1a0a007 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Object Instance<ed9d1ad5-f5d0-4a68-a073-e7a83be772ea> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75245) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 16:23:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-3616e150-751c-4eb2-a545-c82ed1a0a007 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] End _get_guest_xml xml=<domain type="kvm">
Nov 29 16:23:56 user nova-compute[75245]:   <uuid>ed9d1ad5-f5d0-4a68-a073-e7a83be772ea</uuid>
Nov 29 16:23:56 user nova-compute[75245]:   <name>instance-0000001a</name>
Nov 29 16:23:56 user nova-compute[75245]:   <memory>524288</memory>
Nov 29 16:23:56 user nova-compute[75245]:   <vcpu>1</vcpu>
Nov 29 16:23:56 user nova-compute[75245]:   <metadata>
Nov 29 16:23:56 user nova-compute[75245]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 16:23:56 user nova-compute[75245]:       <nova:package version="0.0.0"/>
Nov 29 16:23:56 user nova-compute[75245]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1973964224</nova:name>
Nov 29 16:23:56 user nova-compute[75245]:       <nova:creationTime>2023-11-29 16:23:56</nova:creationTime>
Nov 29 16:23:56 user nova-compute[75245]:       <nova:flavor name="m1.tiny">
Nov 29 16:23:56 user nova-compute[75245]:         <nova:memory>512</nova:memory>
Nov 29 16:23:56 user nova-compute[75245]:         <nova:disk>1</nova:disk>
Nov 29 16:23:56 user nova-compute[75245]:         <nova:swap>0</nova:swap>
Nov 29 16:23:56 user nova-compute[75245]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 16:23:56 user nova-compute[75245]:         <nova:vcpus>1</nova:vcpus>
Nov 29 16:23:56 user nova-compute[75245]:       </nova:flavor>
Nov 29 16:23:56 user nova-compute[75245]:       <nova:owner>
Nov 29 16:23:56 user nova-compute[75245]:         <nova:user uuid="d876b1e244b14a29ad5b4b422135336b">tempest-ServerRescueNegativeTestJSON-1013090395-project-member</nova:user>
Nov 29 16:23:56 user nova-compute[75245]:         <nova:project uuid="e12002e1a11f4caf8953371e66e6652e">tempest-ServerRescueNegativeTestJSON-1013090395</nova:project>
Nov 29 16:23:56 user nova-compute[75245]:       </nova:owner>
Nov 29 16:23:56 user nova-compute[75245]:       <nova:root type="image" uuid="a291d9c3-be02-4c6c-9649-4b45c5b7f487"/>
Nov 29 16:23:56 user nova-compute[75245]:       <nova:ports>
Nov 29 16:23:56 user nova-compute[75245]:         <nova:port uuid="592b836b-e112-414f-b9a9-60e5f65b8f98">
Nov 29 16:23:56 user nova-compute[75245]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 29 16:23:56 user nova-compute[75245]:         </nova:port>
Nov 29 16:23:56 user nova-compute[75245]:       </nova:ports>
Nov 29 16:23:56 user nova-compute[75245]:     </nova:instance>
Nov 29 16:23:56 user nova-compute[75245]:   </metadata>
Nov 29 16:23:56 user nova-compute[75245]:   <sysinfo type="smbios">
Nov 29 16:23:56 user nova-compute[75245]:     <system>
Nov 29 16:23:56 user nova-compute[75245]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 16:23:56 user nova-compute[75245]:       <entry name="product">OpenStack Nova</entry>
Nov 29 16:23:56 user nova-compute[75245]:       <entry name="version">0.0.0</entry>
Nov 29 16:23:56 user nova-compute[75245]:       <entry name="serial">ed9d1ad5-f5d0-4a68-a073-e7a83be772ea</entry>
Nov 29 16:23:56 user nova-compute[75245]:       <entry name="uuid">ed9d1ad5-f5d0-4a68-a073-e7a83be772ea</entry>
Nov 29 16:23:56 user nova-compute[75245]:       <entry name="family">Virtual Machine</entry>
Nov 29 16:23:56 user nova-compute[75245]:     </system>
Nov 29 16:23:56 user nova-compute[75245]:   </sysinfo>
Nov 29 16:23:56 user nova-compute[75245]:   <os>
Nov 29 16:23:56 user nova-compute[75245]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 16:23:56 user nova-compute[75245]:     <smbios mode="sysinfo"/>
Nov 29 16:23:56 user nova-compute[75245]:   </os>
Nov 29 16:23:56 user nova-compute[75245]:   <features>
Nov 29 16:23:56 user nova-compute[75245]:     <acpi/>
Nov 29 16:23:56 user nova-compute[75245]:     <apic/>
Nov 29 16:23:56 user nova-compute[75245]:     <vmcoreinfo/>
Nov 29 16:23:56 user nova-compute[75245]:   </features>
Nov 29 16:23:56 user nova-compute[75245]:   <clock offset="utc">
Nov 29 16:23:56 user nova-compute[75245]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 16:23:56 user nova-compute[75245]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 16:23:56 user nova-compute[75245]:     <timer name="hpet" present="no"/>
Nov 29 16:23:56 user nova-compute[75245]:   </clock>
Nov 29 16:23:56 user nova-compute[75245]:   <cpu mode="custom" match="exact">
Nov 29 16:23:56 user nova-compute[75245]:     <model>Nehalem</model>
Nov 29 16:23:56 user nova-compute[75245]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 16:23:56 user nova-compute[75245]:   </cpu>
Nov 29 16:23:56 user nova-compute[75245]:   <devices>
Nov 29 16:23:56 user nova-compute[75245]:     <disk type="file" device="disk">
Nov 29 16:23:56 user nova-compute[75245]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 16:23:56 user nova-compute[75245]:       <source file="/opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk.rescue"/>
Nov 29 16:23:56 user nova-compute[75245]:       <target dev="vda" bus="virtio"/>
Nov 29 16:23:56 user nova-compute[75245]:     </disk>
Nov 29 16:23:56 user nova-compute[75245]:     <disk type="file" device="disk">
Nov 29 16:23:56 user nova-compute[75245]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 16:23:56 user nova-compute[75245]:       <source file="/opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk"/>
Nov 29 16:23:56 user nova-compute[75245]:       <target dev="vdb" bus="virtio"/>
Nov 29 16:23:56 user nova-compute[75245]:     </disk>
Nov 29 16:23:56 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 16:23:56 user nova-compute[75245]:       <mac address="fa:16:3e:90:86:e1"/>
Nov 29 16:23:56 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:23:56 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 16:23:56 user nova-compute[75245]:       <target dev="tap592b836b-e1"/>
Nov 29 16:23:56 user nova-compute[75245]:     </interface>
Nov 29 16:23:56 user nova-compute[75245]:     <serial type="pty">
Nov 29 16:23:56 user nova-compute[75245]:       <log file="/opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/console.log" append="off"/>
Nov 29 16:23:56 user nova-compute[75245]:     </serial>
Nov 29 16:23:56 user nova-compute[75245]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 16:23:56 user nova-compute[75245]:     <video>
Nov 29 16:23:56 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:23:56 user nova-compute[75245]:     </video>
Nov 29 16:23:56 user nova-compute[75245]:     <rng model="virtio">
Nov 29 16:23:56 user nova-compute[75245]:       <backend model="random">/dev/urandom</backend>
Nov 29 16:23:56 user nova-compute[75245]:     </rng>
Nov 29 16:23:56 user nova-compute[75245]:     <controller type="usb" index="0" model="none"/>
Nov 29 16:23:56 user nova-compute[75245]:     <memballoon model="virtio">
Nov 29 16:23:56 user nova-compute[75245]:       <stats period="10"/>
Nov 29 16:23:56 user nova-compute[75245]:     </memballoon>
Nov 29 16:23:56 user nova-compute[75245]:   </devices>
Nov 29 16:23:56 user nova-compute[75245]: </domain>
Nov 29 16:23:56 user nova-compute[75245]:  {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 16:23:56 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Instance destroyed successfully.
Nov 29 16:23:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-3616e150-751c-4eb2-a545-c82ed1a0a007 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:23:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-3616e150-751c-4eb2-a545-c82ed1a0a007 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:23:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-3616e150-751c-4eb2-a545-c82ed1a0a007 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] No VIF found with MAC fa:16:3e:90:86:e1, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:23:57 user nova-compute[75245]: DEBUG nova.compute.manager [req-7ac83ac8-f125-48ef-afbb-a1f3f34e7719 req-d3418a46-904f-4c82-9de7-4d1b25b3db88 service nova] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Received event network-vif-plugged-592b836b-e112-414f-b9a9-60e5f65b8f98 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:23:57 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-7ac83ac8-f125-48ef-afbb-a1f3f34e7719 req-d3418a46-904f-4c82-9de7-4d1b25b3db88 service nova] Acquiring lock "ed9d1ad5-f5d0-4a68-a073-e7a83be772ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:23:57 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-7ac83ac8-f125-48ef-afbb-a1f3f34e7719 req-d3418a46-904f-4c82-9de7-4d1b25b3db88 service nova] Lock "ed9d1ad5-f5d0-4a68-a073-e7a83be772ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:23:57 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-7ac83ac8-f125-48ef-afbb-a1f3f34e7719 req-d3418a46-904f-4c82-9de7-4d1b25b3db88 service nova] Lock "ed9d1ad5-f5d0-4a68-a073-e7a83be772ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:23:57 user nova-compute[75245]: DEBUG nova.compute.manager [req-7ac83ac8-f125-48ef-afbb-a1f3f34e7719 req-d3418a46-904f-4c82-9de7-4d1b25b3db88 service nova] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] No waiting events found dispatching network-vif-plugged-592b836b-e112-414f-b9a9-60e5f65b8f98 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:23:57 user nova-compute[75245]: WARNING nova.compute.manager [req-7ac83ac8-f125-48ef-afbb-a1f3f34e7719 req-d3418a46-904f-4c82-9de7-4d1b25b3db88 service nova] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Received unexpected event network-vif-plugged-592b836b-e112-414f-b9a9-60e5f65b8f98 for instance with vm_state active and task_state rescuing.
Nov 29 16:23:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:23:59 user nova-compute[75245]: DEBUG nova.compute.manager [req-493a79fc-881c-4af2-8b26-8769ad5995b7 req-8e37732b-7bde-47a6-b479-a798d053b60a service nova] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Received event network-vif-plugged-592b836b-e112-414f-b9a9-60e5f65b8f98 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:23:59 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-493a79fc-881c-4af2-8b26-8769ad5995b7 req-8e37732b-7bde-47a6-b479-a798d053b60a service nova] Acquiring lock "ed9d1ad5-f5d0-4a68-a073-e7a83be772ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:23:59 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-493a79fc-881c-4af2-8b26-8769ad5995b7 req-8e37732b-7bde-47a6-b479-a798d053b60a service nova] Lock "ed9d1ad5-f5d0-4a68-a073-e7a83be772ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:23:59 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-493a79fc-881c-4af2-8b26-8769ad5995b7 req-8e37732b-7bde-47a6-b479-a798d053b60a service nova] Lock "ed9d1ad5-f5d0-4a68-a073-e7a83be772ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:23:59 user nova-compute[75245]: DEBUG nova.compute.manager [req-493a79fc-881c-4af2-8b26-8769ad5995b7 req-8e37732b-7bde-47a6-b479-a798d053b60a service nova] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] No waiting events found dispatching network-vif-plugged-592b836b-e112-414f-b9a9-60e5f65b8f98 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:23:59 user nova-compute[75245]: WARNING nova.compute.manager [req-493a79fc-881c-4af2-8b26-8769ad5995b7 req-8e37732b-7bde-47a6-b479-a798d053b60a service nova] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Received unexpected event network-vif-plugged-592b836b-e112-414f-b9a9-60e5f65b8f98 for instance with vm_state active and task_state rescuing.
Nov 29 16:23:59 user nova-compute[75245]: DEBUG nova.compute.manager [req-493a79fc-881c-4af2-8b26-8769ad5995b7 req-8e37732b-7bde-47a6-b479-a798d053b60a service nova] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Received event network-vif-plugged-592b836b-e112-414f-b9a9-60e5f65b8f98 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:23:59 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-493a79fc-881c-4af2-8b26-8769ad5995b7 req-8e37732b-7bde-47a6-b479-a798d053b60a service nova] Acquiring lock "ed9d1ad5-f5d0-4a68-a073-e7a83be772ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:23:59 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-493a79fc-881c-4af2-8b26-8769ad5995b7 req-8e37732b-7bde-47a6-b479-a798d053b60a service nova] Lock "ed9d1ad5-f5d0-4a68-a073-e7a83be772ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:23:59 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-493a79fc-881c-4af2-8b26-8769ad5995b7 req-8e37732b-7bde-47a6-b479-a798d053b60a service nova] Lock "ed9d1ad5-f5d0-4a68-a073-e7a83be772ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:23:59 user nova-compute[75245]: DEBUG nova.compute.manager [req-493a79fc-881c-4af2-8b26-8769ad5995b7 req-8e37732b-7bde-47a6-b479-a798d053b60a service nova] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] No waiting events found dispatching network-vif-plugged-592b836b-e112-414f-b9a9-60e5f65b8f98 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:23:59 user nova-compute[75245]: WARNING nova.compute.manager [req-493a79fc-881c-4af2-8b26-8769ad5995b7 req-8e37732b-7bde-47a6-b479-a798d053b60a service nova] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Received unexpected event network-vif-plugged-592b836b-e112-414f-b9a9-60e5f65b8f98 for instance with vm_state active and task_state rescuing.
Nov 29 16:23:59 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:23:59 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Starting heal instance info cache {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 16:23:59 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Rebuilding the list of instances to heal {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 16:23:59 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "refresh_cache-ed9a6a4e-2e7d-443c-82ef-f14f11d32c81" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:23:59 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquired lock "refresh_cache-ed9a6a4e-2e7d-443c-82ef-f14f11d32c81" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:23:59 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] Forcefully refreshing network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 16:23:59 user nova-compute[75245]: DEBUG nova.objects.instance [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lazy-loading 'info_cache' on Instance uuid ed9a6a4e-2e7d-443c-82ef-f14f11d32c81 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:24:00 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] Updating instance_info_cache with network_info: [{"id": "c72edead-bad2-45c4-9ac8-90dd2a4f8ed5", "address": "fa:16:3e:bb:74:67", "network": {"id": "f1fac2f4-e789-443e-b6a5-1a3f829bc302", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1199431077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6b87e18ef1f48d19a6907b28cb54f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc72edead-ba", "ovs_interfaceid": "c72edead-bad2-45c4-9ac8-90dd2a4f8ed5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:24:00 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Releasing lock "refresh_cache-ed9a6a4e-2e7d-443c-82ef-f14f11d32c81" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:24:00 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] Updated the network info_cache for instance {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 16:24:00 user nova-compute[75245]: DEBUG nova.compute.manager [None req-3616e150-751c-4eb2-a545-c82ed1a0a007 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:24:01 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:24:02 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:24:02 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:24:02 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:24:02 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:24:02 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:24:02 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75245) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 16:24:02 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bae51e-2a85-442d-bbd2-fc89f30f40b7/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:24:02 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bae51e-2a85-442d-bbd2-fc89f30f40b7/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:24:02 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bae51e-2a85-442d-bbd2-fc89f30f40b7/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:24:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bae51e-2a85-442d-bbd2-fc89f30f40b7/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:24:03 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:24:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:24:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:24:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:24:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:24:03 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:24:03 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:24:03 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:24:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5de7e10c-f216-46b3-8f74-57bac6ab7e56/disk.rescue --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:24:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5de7e10c-f216-46b3-8f74-57bac6ab7e56/disk.rescue --force-share --output=json" returned: 0 in 0.212s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:24:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5de7e10c-f216-46b3-8f74-57bac6ab7e56/disk.rescue --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:24:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5de7e10c-f216-46b3-8f74-57bac6ab7e56/disk.rescue --force-share --output=json" returned: 0 in 0.231s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:24:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:24:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:24:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:24:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:24:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk.rescue --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:24:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:24:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk.rescue --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:24:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:24:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:24:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:24:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:24:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:24:05 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:24:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:24:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:24:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:24:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:24:06 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:24:06 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:24:06 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Hypervisor/Node resource view: name=user free_ram=8143MB free_disk=25.252220153808594GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75245) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 16:24:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:24:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:24:06 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Applying migration context for instance d42fa9b3-91c3-4216-91f1-655ce140425f as it has an incoming, in-progress migration 5086ee39-8d43-4f62-b55b-269f7ca7eb37. Migration status is finished {{(pid=75245) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 29 16:24:06 user nova-compute[75245]: INFO nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Updating resource usage from migration 5086ee39-8d43-4f62-b55b-269f7ca7eb37
Nov 29 16:24:06 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance ed9a6a4e-2e7d-443c-82ef-f14f11d32c81 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:24:06 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 8785a3c2-5b7a-4382-b50d-cecd8743329c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:24:06 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 84bae51e-2a85-442d-bbd2-fc89f30f40b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:24:06 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 5de7e10c-f216-46b3-8f74-57bac6ab7e56 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:24:06 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:24:06 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance ed9d1ad5-f5d0-4a68-a073-e7a83be772ea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:24:06 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Migration 5086ee39-8d43-4f62-b55b-269f7ca7eb37 is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 29 16:24:06 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance d42fa9b3-91c3-4216-91f1-655ce140425f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:24:06 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 16:24:06 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 16:24:06 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:24:06 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:24:06 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Compute_service record updated for user:user {{(pid=75245) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 16:24:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.487s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:24:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:24:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:24:08 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:24:08 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:24:08 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:24:08 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:24:08 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:24:08 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75245) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 16:24:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:24:12 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:24:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:24:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:24:16 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:24:17 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:24:18 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:24:18 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:24:20 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Acquiring lock "0b629ca7-b69e-471c-a7b0-9eb43301c36f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:24:20 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lock "0b629ca7-b69e-471c-a7b0-9eb43301c36f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:24:20 user nova-compute[75245]: DEBUG nova.compute.manager [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Starting instance... {{(pid=75245) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 16:24:20 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:24:20 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:24:20 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75245) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 16:24:20 user nova-compute[75245]: INFO nova.compute.claims [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Claim successful on node user
Nov 29 16:24:21 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:24:21 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:24:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.378s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:24:21 user nova-compute[75245]: DEBUG nova.compute.manager [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Start building networks asynchronously for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 16:24:21 user nova-compute[75245]: DEBUG nova.compute.manager [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Allocating IP information in the background. {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 16:24:21 user nova-compute[75245]: DEBUG nova.network.neutron [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] allocate_for_instance() {{(pid=75245) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 16:24:21 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 16:24:21 user nova-compute[75245]: DEBUG nova.compute.manager [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Start building block device mappings for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 16:24:21 user nova-compute[75245]: DEBUG nova.policy [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6d5d3377c73648b8ba9044cfddbfc759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba4d99c1c6c4472be06502d8b0e75a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75245) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 16:24:21 user nova-compute[75245]: DEBUG nova.compute.manager [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Start spawning the instance on the hypervisor. {{(pid=75245) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 16:24:21 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Creating instance directory {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 16:24:21 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Creating image(s)
Nov 29 16:24:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Acquiring lock "/opt/stack/data/nova/instances/0b629ca7-b69e-471c-a7b0-9eb43301c36f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:24:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lock "/opt/stack/data/nova/instances/0b629ca7-b69e-471c-a7b0-9eb43301c36f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:24:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lock "/opt/stack/data/nova/instances/0b629ca7-b69e-471c-a7b0-9eb43301c36f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:24:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:24:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.199s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:24:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Acquiring lock "d654f7206043e05d3525550b0fc885556eb999f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:24:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:24:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:24:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.192s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:24:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/0b629ca7-b69e-471c-a7b0-9eb43301c36f/disk 1073741824 {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:24:21 user nova-compute[75245]: DEBUG nova.network.neutron [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Successfully created port: 6d28be36-e00b-4f84-9a2b-60515f2e65a1 {{(pid=75245) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 16:24:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/0b629ca7-b69e-471c-a7b0-9eb43301c36f/disk 1073741824" returned: 0 in 0.066s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:24:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:24:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:24:22 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.175s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:24:22 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0b629ca7-b69e-471c-a7b0-9eb43301c36f/disk. size=1073741824 {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 16:24:22 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b629ca7-b69e-471c-a7b0-9eb43301c36f/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:24:22 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b629ca7-b69e-471c-a7b0-9eb43301c36f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:24:22 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Cannot resize image /opt/stack/data/nova/instances/0b629ca7-b69e-471c-a7b0-9eb43301c36f/disk to a smaller size. {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 16:24:22 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Created local disks {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 16:24:22 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Ensure instance console log exists: /opt/stack/data/nova/instances/0b629ca7-b69e-471c-a7b0-9eb43301c36f/console.log {{(pid=75245) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 16:24:22 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:24:22 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:24:22 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:24:22 user nova-compute[75245]: DEBUG nova.network.neutron [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Successfully updated port: 6d28be36-e00b-4f84-9a2b-60515f2e65a1 {{(pid=75245) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 16:24:22 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Acquiring lock "refresh_cache-0b629ca7-b69e-471c-a7b0-9eb43301c36f" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:24:22 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Acquired lock "refresh_cache-0b629ca7-b69e-471c-a7b0-9eb43301c36f" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:24:22 user nova-compute[75245]: DEBUG nova.network.neutron [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 16:24:22 user nova-compute[75245]: DEBUG nova.compute.manager [req-f051e4ac-417f-4b0b-8999-0998371f0599 req-eb86a285-e06e-4a35-b264-c9c167ede01b service nova] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Received event network-changed-6d28be36-e00b-4f84-9a2b-60515f2e65a1 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:24:22 user nova-compute[75245]: DEBUG nova.compute.manager [req-f051e4ac-417f-4b0b-8999-0998371f0599 req-eb86a285-e06e-4a35-b264-c9c167ede01b service nova] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Refreshing instance network info cache due to event network-changed-6d28be36-e00b-4f84-9a2b-60515f2e65a1. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:24:22 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-f051e4ac-417f-4b0b-8999-0998371f0599 req-eb86a285-e06e-4a35-b264-c9c167ede01b service nova] Acquiring lock "refresh_cache-0b629ca7-b69e-471c-a7b0-9eb43301c36f" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:24:22 user nova-compute[75245]: DEBUG nova.network.neutron [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Instance cache missing network info. {{(pid=75245) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 16:24:22 user nova-compute[75245]: DEBUG nova.network.neutron [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Updating instance_info_cache with network_info: [{"id": "6d28be36-e00b-4f84-9a2b-60515f2e65a1", "address": "fa:16:3e:90:6c:6b", "network": {"id": "2110162d-c25f-4c3d-9a67-18e52f6caf43", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1854809203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba4d99c1c6c4472be06502d8b0e75a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d28be36-e0", "ovs_interfaceid": "6d28be36-e00b-4f84-9a2b-60515f2e65a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:24:22 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Releasing lock "refresh_cache-0b629ca7-b69e-471c-a7b0-9eb43301c36f" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:24:22 user nova-compute[75245]: DEBUG nova.compute.manager [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Instance network_info: |[{"id": "6d28be36-e00b-4f84-9a2b-60515f2e65a1", "address": "fa:16:3e:90:6c:6b", "network": {"id": "2110162d-c25f-4c3d-9a67-18e52f6caf43", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1854809203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba4d99c1c6c4472be06502d8b0e75a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d28be36-e0", "ovs_interfaceid": "6d28be36-e00b-4f84-9a2b-60515f2e65a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 16:24:22 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-f051e4ac-417f-4b0b-8999-0998371f0599 req-eb86a285-e06e-4a35-b264-c9c167ede01b service nova] Acquired lock "refresh_cache-0b629ca7-b69e-471c-a7b0-9eb43301c36f" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:24:22 user nova-compute[75245]: DEBUG nova.network.neutron [req-f051e4ac-417f-4b0b-8999-0998371f0599 req-eb86a285-e06e-4a35-b264-c9c167ede01b service nova] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Refreshing network info cache for port 6d28be36-e00b-4f84-9a2b-60515f2e65a1 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:24:22 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Start _get_guest_xml network_info=[{"id": "6d28be36-e00b-4f84-9a2b-60515f2e65a1", "address": "fa:16:3e:90:6c:6b", "network": {"id": "2110162d-c25f-4c3d-9a67-18e52f6caf43", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1854809203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba4d99c1c6c4472be06502d8b0e75a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d28be36-e0", "ovs_interfaceid": "6d28be36-e00b-4f84-9a2b-60515f2e65a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'a291d9c3-be02-4c6c-9649-4b45c5b7f487'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 16:24:22 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:24:22 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:24:22 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 16:24:22 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] CPU controller missing on host. {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 16:24:22 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 16:24:22 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] CPU controller found on host. {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 16:24:22 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75245) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 16:24:22 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T16:06:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 16:24:22 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Flavor limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 16:24:22 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Image limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 16:24:22 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Flavor pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 16:24:22 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Image pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 16:24:22 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 16:24:22 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 16:24:22 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 16:24:22 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Got 1 possible topologies {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 16:24:22 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 16:24:22 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 16:24:22 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:24:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-871835871',display_name='tempest-AttachVolumeTestJSON-server-871835871',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-871835871',id=27,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTIsqUKP4igeT4gYnfCqdp6pLBcrk+0/CaYGDmMNaIt3Zkf1GMFiqF0F/vVjvbmae59TIWFlaDJkZXQ3lbtxQKuqPvpidiCFuJrrX+TZL7X+RQDx6md7i0ExrSBiMAnKw==',key_name='tempest-keypair-721153735',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ba4d99c1c6c4472be06502d8b0e75a4',ramdisk_id='',reservation_id='r-1rsjawj5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-280497743',owner_user_name='tempest-AttachVolumeTestJSON-280497743-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:24:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d5d3377c73648b8ba9044cfddbfc759',uuid=0b629ca7-b69e-471c-a7b0-9eb43301c36f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d28be36-e00b-4f84-9a2b-60515f2e65a1", "address": "fa:16:3e:90:6c:6b", "network": {"id": "2110162d-c25f-4c3d-9a67-18e52f6caf43", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1854809203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba4d99c1c6c4472be06502d8b0e75a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d28be36-e0", "ovs_interfaceid": "6d28be36-e00b-4f84-9a2b-60515f2e65a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:24:22 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Converting VIF {"id": "6d28be36-e00b-4f84-9a2b-60515f2e65a1", "address": "fa:16:3e:90:6c:6b", "network": {"id": "2110162d-c25f-4c3d-9a67-18e52f6caf43", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1854809203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba4d99c1c6c4472be06502d8b0e75a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d28be36-e0", "ovs_interfaceid": "6d28be36-e00b-4f84-9a2b-60515f2e65a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:24:22 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:6c:6b,bridge_name='br-int',has_traffic_filtering=True,id=6d28be36-e00b-4f84-9a2b-60515f2e65a1,network=Network(2110162d-c25f-4c3d-9a67-18e52f6caf43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d28be36-e0') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:24:22 user nova-compute[75245]: DEBUG nova.objects.instance [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lazy-loading 'pci_devices' on Instance uuid 0b629ca7-b69e-471c-a7b0-9eb43301c36f {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:24:22 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] End _get_guest_xml xml=<domain type="kvm">
Nov 29 16:24:22 user nova-compute[75245]:   <uuid>0b629ca7-b69e-471c-a7b0-9eb43301c36f</uuid>
Nov 29 16:24:22 user nova-compute[75245]:   <name>instance-0000001b</name>
Nov 29 16:24:22 user nova-compute[75245]:   <memory>524288</memory>
Nov 29 16:24:22 user nova-compute[75245]:   <vcpu>1</vcpu>
Nov 29 16:24:22 user nova-compute[75245]:   <metadata>
Nov 29 16:24:22 user nova-compute[75245]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 16:24:22 user nova-compute[75245]:       <nova:package version="0.0.0"/>
Nov 29 16:24:22 user nova-compute[75245]:       <nova:name>tempest-AttachVolumeTestJSON-server-871835871</nova:name>
Nov 29 16:24:22 user nova-compute[75245]:       <nova:creationTime>2023-11-29 16:24:22</nova:creationTime>
Nov 29 16:24:22 user nova-compute[75245]:       <nova:flavor name="m1.tiny">
Nov 29 16:24:22 user nova-compute[75245]:         <nova:memory>512</nova:memory>
Nov 29 16:24:22 user nova-compute[75245]:         <nova:disk>1</nova:disk>
Nov 29 16:24:22 user nova-compute[75245]:         <nova:swap>0</nova:swap>
Nov 29 16:24:22 user nova-compute[75245]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 16:24:22 user nova-compute[75245]:         <nova:vcpus>1</nova:vcpus>
Nov 29 16:24:22 user nova-compute[75245]:       </nova:flavor>
Nov 29 16:24:22 user nova-compute[75245]:       <nova:owner>
Nov 29 16:24:22 user nova-compute[75245]:         <nova:user uuid="6d5d3377c73648b8ba9044cfddbfc759">tempest-AttachVolumeTestJSON-280497743-project-member</nova:user>
Nov 29 16:24:22 user nova-compute[75245]:         <nova:project uuid="0ba4d99c1c6c4472be06502d8b0e75a4">tempest-AttachVolumeTestJSON-280497743</nova:project>
Nov 29 16:24:22 user nova-compute[75245]:       </nova:owner>
Nov 29 16:24:22 user nova-compute[75245]:       <nova:root type="image" uuid="a291d9c3-be02-4c6c-9649-4b45c5b7f487"/>
Nov 29 16:24:22 user nova-compute[75245]:       <nova:ports>
Nov 29 16:24:22 user nova-compute[75245]:         <nova:port uuid="6d28be36-e00b-4f84-9a2b-60515f2e65a1">
Nov 29 16:24:22 user nova-compute[75245]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 16:24:22 user nova-compute[75245]:         </nova:port>
Nov 29 16:24:22 user nova-compute[75245]:       </nova:ports>
Nov 29 16:24:22 user nova-compute[75245]:     </nova:instance>
Nov 29 16:24:22 user nova-compute[75245]:   </metadata>
Nov 29 16:24:22 user nova-compute[75245]:   <sysinfo type="smbios">
Nov 29 16:24:22 user nova-compute[75245]:     <system>
Nov 29 16:24:22 user nova-compute[75245]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 16:24:22 user nova-compute[75245]:       <entry name="product">OpenStack Nova</entry>
Nov 29 16:24:22 user nova-compute[75245]:       <entry name="version">0.0.0</entry>
Nov 29 16:24:22 user nova-compute[75245]:       <entry name="serial">0b629ca7-b69e-471c-a7b0-9eb43301c36f</entry>
Nov 29 16:24:22 user nova-compute[75245]:       <entry name="uuid">0b629ca7-b69e-471c-a7b0-9eb43301c36f</entry>
Nov 29 16:24:22 user nova-compute[75245]:       <entry name="family">Virtual Machine</entry>
Nov 29 16:24:22 user nova-compute[75245]:     </system>
Nov 29 16:24:22 user nova-compute[75245]:   </sysinfo>
Nov 29 16:24:22 user nova-compute[75245]:   <os>
Nov 29 16:24:22 user nova-compute[75245]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 16:24:22 user nova-compute[75245]:     <boot dev="hd"/>
Nov 29 16:24:22 user nova-compute[75245]:     <smbios mode="sysinfo"/>
Nov 29 16:24:22 user nova-compute[75245]:   </os>
Nov 29 16:24:22 user nova-compute[75245]:   <features>
Nov 29 16:24:22 user nova-compute[75245]:     <acpi/>
Nov 29 16:24:22 user nova-compute[75245]:     <apic/>
Nov 29 16:24:22 user nova-compute[75245]:     <vmcoreinfo/>
Nov 29 16:24:22 user nova-compute[75245]:   </features>
Nov 29 16:24:22 user nova-compute[75245]:   <clock offset="utc">
Nov 29 16:24:22 user nova-compute[75245]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 16:24:22 user nova-compute[75245]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 16:24:22 user nova-compute[75245]:     <timer name="hpet" present="no"/>
Nov 29 16:24:22 user nova-compute[75245]:   </clock>
Nov 29 16:24:22 user nova-compute[75245]:   <cpu mode="custom" match="exact">
Nov 29 16:24:22 user nova-compute[75245]:     <model>Nehalem</model>
Nov 29 16:24:22 user nova-compute[75245]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 16:24:22 user nova-compute[75245]:   </cpu>
Nov 29 16:24:22 user nova-compute[75245]:   <devices>
Nov 29 16:24:22 user nova-compute[75245]:     <disk type="file" device="disk">
Nov 29 16:24:22 user nova-compute[75245]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 16:24:22 user nova-compute[75245]:       <source file="/opt/stack/data/nova/instances/0b629ca7-b69e-471c-a7b0-9eb43301c36f/disk"/>
Nov 29 16:24:22 user nova-compute[75245]:       <target dev="vda" bus="virtio"/>
Nov 29 16:24:22 user nova-compute[75245]:     </disk>
Nov 29 16:24:22 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 16:24:22 user nova-compute[75245]:       <mac address="fa:16:3e:90:6c:6b"/>
Nov 29 16:24:22 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:24:22 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 16:24:22 user nova-compute[75245]:       <target dev="tap6d28be36-e0"/>
Nov 29 16:24:22 user nova-compute[75245]:     </interface>
Nov 29 16:24:22 user nova-compute[75245]:     <serial type="pty">
Nov 29 16:24:22 user nova-compute[75245]:       <log file="/opt/stack/data/nova/instances/0b629ca7-b69e-471c-a7b0-9eb43301c36f/console.log" append="off"/>
Nov 29 16:24:22 user nova-compute[75245]:     </serial>
Nov 29 16:24:22 user nova-compute[75245]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 16:24:22 user nova-compute[75245]:     <video>
Nov 29 16:24:22 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:24:22 user nova-compute[75245]:     </video>
Nov 29 16:24:22 user nova-compute[75245]:     <rng model="virtio">
Nov 29 16:24:22 user nova-compute[75245]:       <backend model="random">/dev/urandom</backend>
Nov 29 16:24:22 user nova-compute[75245]:     </rng>
Nov 29 16:24:22 user nova-compute[75245]:     <controller type="usb" index="0" model="none"/>
Nov 29 16:24:22 user nova-compute[75245]:     <memballoon model="virtio">
Nov 29 16:24:22 user nova-compute[75245]:       <stats period="10"/>
Nov 29 16:24:22 user nova-compute[75245]:     </memballoon>
Nov 29 16:24:22 user nova-compute[75245]:   </devices>
Nov 29 16:24:22 user nova-compute[75245]: </domain>
Nov 29 16:24:22 user nova-compute[75245]:  {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 16:24:22 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:24:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-871835871',display_name='tempest-AttachVolumeTestJSON-server-871835871',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-871835871',id=27,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTIsqUKP4igeT4gYnfCqdp6pLBcrk+0/CaYGDmMNaIt3Zkf1GMFiqF0F/vVjvbmae59TIWFlaDJkZXQ3lbtxQKuqPvpidiCFuJrrX+TZL7X+RQDx6md7i0ExrSBiMAnKw==',key_name='tempest-keypair-721153735',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ba4d99c1c6c4472be06502d8b0e75a4',ramdisk_id='',reservation_id='r-1rsjawj5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-280497743',owner_user_name='tempest-AttachVolumeTestJSON-280497743-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:24:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d5d3377c73648b8ba9044cfddbfc759',uuid=0b629ca7-b69e-471c-a7b0-9eb43301c36f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d28be36-e00b-4f84-9a2b-60515f2e65a1", "address": "fa:16:3e:90:6c:6b", "network": {"id": "2110162d-c25f-4c3d-9a67-18e52f6caf43", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1854809203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba4d99c1c6c4472be06502d8b0e75a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d28be36-e0", "ovs_interfaceid": "6d28be36-e00b-4f84-9a2b-60515f2e65a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 16:24:22 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Converting VIF {"id": "6d28be36-e00b-4f84-9a2b-60515f2e65a1", "address": "fa:16:3e:90:6c:6b", "network": {"id": "2110162d-c25f-4c3d-9a67-18e52f6caf43", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1854809203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba4d99c1c6c4472be06502d8b0e75a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d28be36-e0", "ovs_interfaceid": "6d28be36-e00b-4f84-9a2b-60515f2e65a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:24:22 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:6c:6b,bridge_name='br-int',has_traffic_filtering=True,id=6d28be36-e00b-4f84-9a2b-60515f2e65a1,network=Network(2110162d-c25f-4c3d-9a67-18e52f6caf43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d28be36-e0') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:24:22 user nova-compute[75245]: DEBUG os_vif [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:6c:6b,bridge_name='br-int',has_traffic_filtering=True,id=6d28be36-e00b-4f84-9a2b-60515f2e65a1,network=Network(2110162d-c25f-4c3d-9a67-18e52f6caf43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d28be36-e0') {{(pid=75245) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 16:24:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:24:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:24:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 16:24:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:24:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd295f6e0-8b9c-5dc8-ba46-5fbf089bf478', '_type': 'linux-noop'}}, row=False) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:24:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:24:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:24:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6d28be36-e0, may_exist=True, interface_attrs={}) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:24:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6d28be36-e0, col_values=(('qos', UUID('457cb758-e9cd-428d-8733-981dd0fffad2')),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:24:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6d28be36-e0, col_values=(('external_ids', {'iface-id': '6d28be36-e00b-4f84-9a2b-60515f2e65a1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:90:6c:6b', 'vm-uuid': '0b629ca7-b69e-471c-a7b0-9eb43301c36f'}),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:24:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:24:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:24:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:24:23 user nova-compute[75245]: INFO os_vif [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:6c:6b,bridge_name='br-int',has_traffic_filtering=True,id=6d28be36-e00b-4f84-9a2b-60515f2e65a1,network=Network(2110162d-c25f-4c3d-9a67-18e52f6caf43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d28be36-e0')
Nov 29 16:24:23 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:24:23 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] No VIF found with MAC fa:16:3e:90:6c:6b, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:24:23 user nova-compute[75245]: DEBUG nova.network.neutron [req-f051e4ac-417f-4b0b-8999-0998371f0599 req-eb86a285-e06e-4a35-b264-c9c167ede01b service nova] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Updated VIF entry in instance network info cache for port 6d28be36-e00b-4f84-9a2b-60515f2e65a1. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:24:23 user nova-compute[75245]: DEBUG nova.network.neutron [req-f051e4ac-417f-4b0b-8999-0998371f0599 req-eb86a285-e06e-4a35-b264-c9c167ede01b service nova] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Updating instance_info_cache with network_info: [{"id": "6d28be36-e00b-4f84-9a2b-60515f2e65a1", "address": "fa:16:3e:90:6c:6b", "network": {"id": "2110162d-c25f-4c3d-9a67-18e52f6caf43", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1854809203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba4d99c1c6c4472be06502d8b0e75a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d28be36-e0", "ovs_interfaceid": "6d28be36-e00b-4f84-9a2b-60515f2e65a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:24:23 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-f051e4ac-417f-4b0b-8999-0998371f0599 req-eb86a285-e06e-4a35-b264-c9c167ede01b service nova] Releasing lock "refresh_cache-0b629ca7-b69e-471c-a7b0-9eb43301c36f" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:24:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:24:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:24:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:24:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:24:24 user nova-compute[75245]: DEBUG nova.compute.manager [req-c4d2c1a3-d039-4b02-9df6-2fd50daf577d req-298ae8e5-0396-4bff-8cc4-3123368427fb service nova] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Received event network-vif-plugged-6d28be36-e00b-4f84-9a2b-60515f2e65a1 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:24:24 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-c4d2c1a3-d039-4b02-9df6-2fd50daf577d req-298ae8e5-0396-4bff-8cc4-3123368427fb service nova] Acquiring lock "0b629ca7-b69e-471c-a7b0-9eb43301c36f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:24:24 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-c4d2c1a3-d039-4b02-9df6-2fd50daf577d req-298ae8e5-0396-4bff-8cc4-3123368427fb service nova] Lock "0b629ca7-b69e-471c-a7b0-9eb43301c36f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:24:24 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-c4d2c1a3-d039-4b02-9df6-2fd50daf577d req-298ae8e5-0396-4bff-8cc4-3123368427fb service nova] Lock "0b629ca7-b69e-471c-a7b0-9eb43301c36f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:24:24 user nova-compute[75245]: DEBUG nova.compute.manager [req-c4d2c1a3-d039-4b02-9df6-2fd50daf577d req-298ae8e5-0396-4bff-8cc4-3123368427fb service nova] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] No waiting events found dispatching network-vif-plugged-6d28be36-e00b-4f84-9a2b-60515f2e65a1 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:24:24 user nova-compute[75245]: WARNING nova.compute.manager [req-c4d2c1a3-d039-4b02-9df6-2fd50daf577d req-298ae8e5-0396-4bff-8cc4-3123368427fb service nova] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Received unexpected event network-vif-plugged-6d28be36-e00b-4f84-9a2b-60515f2e65a1 for instance with vm_state building and task_state spawning.
Nov 29 16:24:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:24:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:24:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:24:26 user nova-compute[75245]: DEBUG nova.compute.manager [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Instance event wait completed in 0 seconds for  {{(pid=75245) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 16:24:26 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Guest created on hypervisor {{(pid=75245) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 16:24:26 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Instance spawned successfully.
Nov 29 16:24:26 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 16:24:26 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Found default for hw_cdrom_bus of ide {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:24:26 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Found default for hw_disk_bus of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:24:26 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Found default for hw_input_bus of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:24:26 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Found default for hw_pointer_model of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:24:26 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Found default for hw_video_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:24:26 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Found default for hw_vif_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:24:26 user nova-compute[75245]: INFO nova.compute.manager [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Took 5.14 seconds to spawn the instance on the hypervisor.
Nov 29 16:24:26 user nova-compute[75245]: DEBUG nova.compute.manager [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:24:26 user nova-compute[75245]: DEBUG nova.compute.manager [req-0f3bfab9-b797-4e51-9e24-abf68eee1903 req-7eb21acb-33e1-4c42-af6d-59d5b774f3fb service nova] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Received event network-vif-plugged-6d28be36-e00b-4f84-9a2b-60515f2e65a1 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:24:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-0f3bfab9-b797-4e51-9e24-abf68eee1903 req-7eb21acb-33e1-4c42-af6d-59d5b774f3fb service nova] Acquiring lock "0b629ca7-b69e-471c-a7b0-9eb43301c36f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:24:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-0f3bfab9-b797-4e51-9e24-abf68eee1903 req-7eb21acb-33e1-4c42-af6d-59d5b774f3fb service nova] Lock "0b629ca7-b69e-471c-a7b0-9eb43301c36f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:24:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-0f3bfab9-b797-4e51-9e24-abf68eee1903 req-7eb21acb-33e1-4c42-af6d-59d5b774f3fb service nova] Lock "0b629ca7-b69e-471c-a7b0-9eb43301c36f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:24:26 user nova-compute[75245]: DEBUG nova.compute.manager [req-0f3bfab9-b797-4e51-9e24-abf68eee1903 req-7eb21acb-33e1-4c42-af6d-59d5b774f3fb service nova] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] No waiting events found dispatching network-vif-plugged-6d28be36-e00b-4f84-9a2b-60515f2e65a1 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:24:26 user nova-compute[75245]: WARNING nova.compute.manager [req-0f3bfab9-b797-4e51-9e24-abf68eee1903 req-7eb21acb-33e1-4c42-af6d-59d5b774f3fb service nova] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Received unexpected event network-vif-plugged-6d28be36-e00b-4f84-9a2b-60515f2e65a1 for instance with vm_state building and task_state spawning.
Nov 29 16:24:26 user nova-compute[75245]: INFO nova.compute.manager [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Took 5.97 seconds to build instance.
Nov 29 16:24:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-bad5b8d7-8093-4913-94fe-7ac47b312721 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lock "0b629ca7-b69e-471c-a7b0-9eb43301c36f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.067s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:24:27 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:24:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:24:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:24:33 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:24:37 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:24:42 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:24:43 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:24:47 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:24:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Acquiring lock "4f7fb562-a698-4fc9-91b0-c786627f6d75" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:24:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Lock "4f7fb562-a698-4fc9-91b0-c786627f6d75" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:24:48 user nova-compute[75245]: INFO nova.compute.manager [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Unshelving
Nov 29 16:24:48 user nova-compute[75245]: INFO nova.virt.block_device [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Booting with volume a87461eb-363d-43eb-94cb-4f69edc13024 at /dev/vda
Nov 29 16:24:48 user nova-compute[75245]: DEBUG os_brick.utils [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:24:48 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:24:48 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:24:48 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de7a15e-283a-4504-bff1-2269028a3433]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:69ed8ed87091\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:24:48 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:24:48 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:24:48 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b9bb40c-3658-4471-9780-9ac0b5544c67]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:24:48 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:24:48 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:24:48 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[0646b610-6454-483c-88b9-e80c9d9982ec]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:24:48 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f0a0301-26b8-48ad-9b46-ace8e41e3b8c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:24:48 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Running cmd (subprocess): nvme version {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:24:48 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] 'nvme version' failed. Not Retrying. {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:24:48 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] nvme not present on system {{(pid=75245) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 16:24:48 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:24:48 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:24:48 user nova-compute[75245]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 16:24:48 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d8e3c2b-10c4-4bd0-94b7-f326b13b4393]: (4, '') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:24:48 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75245) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 16:24:48 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 16:24:48 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] LIGHTOS: no hostnqn found. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 16:24:48 user nova-compute[75245]: DEBUG os_brick.utils [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:69ed8ed87091', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:24:48 user nova-compute[75245]: DEBUG nova.virt.block_device [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Updating existing volume attachment record: 1fd9d379-40ac-4107-9493-fafb830463bf {{(pid=75245) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 16:24:48 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:24:52 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:24:53 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:24:55 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:24:55 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:24:55 user nova-compute[75245]: DEBUG nova.objects.instance [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Lazy-loading 'pci_requests' on Instance uuid 4f7fb562-a698-4fc9-91b0-c786627f6d75 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:24:55 user nova-compute[75245]: DEBUG nova.objects.instance [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Lazy-loading 'numa_topology' on Instance uuid 4f7fb562-a698-4fc9-91b0-c786627f6d75 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:24:55 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75245) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 16:24:55 user nova-compute[75245]: INFO nova.compute.claims [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Claim successful on node user
Nov 29 16:24:56 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:24:56 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:24:56 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.432s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:24:56 user nova-compute[75245]: INFO nova.network.neutron [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Updating port 467a0f1e-1ad6-4474-bbcb-dadad3ea69ab with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 29 16:24:56 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Acquiring lock "refresh_cache-4f7fb562-a698-4fc9-91b0-c786627f6d75" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:24:56 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Acquired lock "refresh_cache-4f7fb562-a698-4fc9-91b0-c786627f6d75" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:24:56 user nova-compute[75245]: DEBUG nova.network.neutron [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 16:24:56 user nova-compute[75245]: DEBUG nova.compute.manager [req-a78ca3d3-7c15-490f-80c8-72bdb37da458 req-238e1d95-f005-4d8e-9a9f-a1d496d7e416 service nova] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Received event network-changed-467a0f1e-1ad6-4474-bbcb-dadad3ea69ab {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:24:56 user nova-compute[75245]: DEBUG nova.compute.manager [req-a78ca3d3-7c15-490f-80c8-72bdb37da458 req-238e1d95-f005-4d8e-9a9f-a1d496d7e416 service nova] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Refreshing instance network info cache due to event network-changed-467a0f1e-1ad6-4474-bbcb-dadad3ea69ab. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:24:56 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a78ca3d3-7c15-490f-80c8-72bdb37da458 req-238e1d95-f005-4d8e-9a9f-a1d496d7e416 service nova] Acquiring lock "refresh_cache-4f7fb562-a698-4fc9-91b0-c786627f6d75" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG nova.network.neutron [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Updating instance_info_cache with network_info: [{"id": "467a0f1e-1ad6-4474-bbcb-dadad3ea69ab", "address": "fa:16:3e:ab:27:73", "network": {"id": "1869d0f1-8115-44c6-b5d4-42e362716749", "bridge": "br-int", "label": "tempest-TestShelveInstance-1207362046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bd57c6933c04f5a9ec5e27eb8bce661", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap467a0f1e-1a", "ovs_interfaceid": "467a0f1e-1ad6-4474-bbcb-dadad3ea69ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Releasing lock "refresh_cache-4f7fb562-a698-4fc9-91b0-c786627f6d75" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Creating instance directory {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 16:24:57 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Creating image(s)
Nov 29 16:24:57 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Did not create local disks {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Ensure instance console log exists: /opt/stack/data/nova/instances/4f7fb562-a698-4fc9-91b0-c786627f6d75/console.log {{(pid=75245) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Start _get_guest_xml network_info=[{"id": "467a0f1e-1ad6-4474-bbcb-dadad3ea69ab", "address": "fa:16:3e:ab:27:73", "network": {"id": "1869d0f1-8115-44c6-b5d4-42e362716749", "bridge": "br-int", "label": "tempest-TestShelveInstance-1207362046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bd57c6933c04f5a9ec5e27eb8bce661", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap467a0f1e-1a", "ovs_interfaceid": "467a0f1e-1ad6-4474-bbcb-dadad3ea69ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '1fd9d379-40ac-4107-9493-fafb830463bf', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hfwlIuBG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4f7fb562-a698-4fc9-91b0-c786627f6d75', 'attached_at': '', 'detached_at': '', 'volume_id': 'a87461eb-363d-43eb-94cb-4f69edc13024', 'serial': 'a87461eb-363d-43eb-94cb-4f69edc13024'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'guest_format': None, 'volume_type': None} {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a78ca3d3-7c15-490f-80c8-72bdb37da458 req-238e1d95-f005-4d8e-9a9f-a1d496d7e416 service nova] Acquired lock "refresh_cache-4f7fb562-a698-4fc9-91b0-c786627f6d75" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG nova.network.neutron [req-a78ca3d3-7c15-490f-80c8-72bdb37da458 req-238e1d95-f005-4d8e-9a9f-a1d496d7e416 service nova] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Refreshing network info cache for port 467a0f1e-1ad6-4474-bbcb-dadad3ea69ab {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:24:57 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:24:57 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:24:57 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] CPU controller missing on host. {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] CPU controller found on host. {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75245) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T16:06:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Flavor limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Image limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Flavor pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Image pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Got 1 possible topologies {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG nova.objects.instance [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4f7fb562-a698-4fc9-91b0-c786627f6d75 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG nova.objects.base [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Object Instance<4f7fb562-a698-4fc9-91b0-c786627f6d75> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=75245) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Calling os-brick to attach iSCSI Volume {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hfwlIuBG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:24:57 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:24:57 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:24:57 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:24:57 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:24:57 user nova-compute[75245]: INFO os_brick.initiator.connectors.iscsi [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 16:24:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 -p 172.16.0.220:3260 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[d51098e6-6437-47a5-9b19-6e0680af5875]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 16:24:57 user nova-compute[75245]:  {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 -p 172.16.0.220:3260 --interface default --op new {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a2497a0-9930-4ef1-aaa5-06a1c9333ec3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024] added\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024] added
Nov 29 16:24:57 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e8044e-1504-41c8-a18c-782ff4231db5]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc08ee8-793e-447b-ad22-df4d303c321d]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hfwlIuBG {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hfwlIuBG" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c70cbc-2317-4f55-b9f4-24a1ae8c5492]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hfwlIuBG'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe149335-d022-4e59-bc50-528ae4edcea0]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af43fa5-5127-40bb-bb77-fb219c94f23a]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)
Nov 29 16:24:57 user nova-compute[75245]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f (non-flash)
Nov 29 16:24:57 user nova-compute[75245]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e (non-flash)
Nov 29 16:24:57 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)
Nov 29 16:24:57 user nova-compute[75245]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f (non-flash)
Nov 29 16:24:57 user nova-compute[75245]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e (non-flash)
Nov 29 16:24:57 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 -p 172.16.0.220:3260 --login {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a172b2-83bb-47ba-8ae5-9eb9d3d4e3ba]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024, portal: 172.16.0.220,3260]
Nov 29 16:24:57 user nova-compute[75245]: Login to [iface: default, target: iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024, portal: 172.16.0.220,3260] successful.
Nov 29 16:24:57 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[a547fd50-2bf6-43fc-8075-714742ec5248]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd970fc-299f-4901-a50f-6c8e286fe957]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)
Nov 29 16:24:57 user nova-compute[75245]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f (non-flash)
Nov 29 16:24:57 user nova-compute[75245]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e (non-flash)
Nov 29 16:24:57 user nova-compute[75245]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 (non-flash)
Nov 29 16:24:57 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)
Nov 29 16:24:57 user nova-compute[75245]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f (non-flash)
Nov 29 16:24:57 user nova-compute[75245]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e (non-flash)
Nov 29 16:24:57 user nova-compute[75245]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 (non-flash)
Nov 29 16:24:57 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Connected to 172.16.0.220:3260 {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] HCTL ('35', '-', '-', 0) found on session 33 with lun 0 {{(pid=75245) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75245) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG nova.network.neutron [req-a78ca3d3-7c15-490f-80c8-72bdb37da458 req-238e1d95-f005-4d8e-9a9f-a1d496d7e416 service nova] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Updated VIF entry in instance network info cache for port 467a0f1e-1ad6-4474-bbcb-dadad3ea69ab. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG nova.network.neutron [req-a78ca3d3-7c15-490f-80c8-72bdb37da458 req-238e1d95-f005-4d8e-9a9f-a1d496d7e416 service nova] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Updating instance_info_cache with network_info: [{"id": "467a0f1e-1ad6-4474-bbcb-dadad3ea69ab", "address": "fa:16:3e:ab:27:73", "network": {"id": "1869d0f1-8115-44c6-b5d4-42e362716749", "bridge": "br-int", "label": "tempest-TestShelveInstance-1207362046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bd57c6933c04f5a9ec5e27eb8bce661", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap467a0f1e-1a", "ovs_interfaceid": "467a0f1e-1ad6-4474-bbcb-dadad3ea69ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[490f7c45-8a90-4b19-83aa-ddc8a28200b3]: (4, ('- - 0', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Searching for a device in session 33 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75245) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hfwlIuBG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a78ca3d3-7c15-490f-80c8-72bdb37da458 req-238e1d95-f005-4d8e-9a9f-a1d496d7e416 service nova] Releasing lock "refresh_cache-4f7fb562-a698-4fc9-91b0-c786627f6d75" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:24:57 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:24:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:24:58 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:24:58 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '26361356134653339', 'path': '/dev/sdd'} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:24:58 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26361356134653339', 'path': '/dev/sdd'} {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 16:24:58 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T16:21:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1369972773',display_name='tempest-TestShelveInstance-server-1369972773',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1369972773',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1582200683',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:21:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5bd57c6933c04f5a9ec5e27eb8bce661',ramdisk_id='',reservation_id='r-058m537p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1248422115',owner_user_name='tempest-TestShelveInstance-1248422115-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:24:48Z,user_data=None,user_id='a271b4251cd64c5c8d5bf8e73e365624',uuid=4f7fb562-a698-4fc9-91b0-c786627f6d75,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "467a0f1e-1ad6-4474-bbcb-dadad3ea69ab", "address": "fa:16:3e:ab:27:73", "network": {"id": "1869d0f1-8115-44c6-b5d4-42e362716749", "bridge": "br-int", "label": "tempest-TestShelveInstance-1207362046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bd57c6933c04f5a9ec5e27eb8bce661", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap467a0f1e-1a", "ovs_interfaceid": "467a0f1e-1ad6-4474-bbcb-dadad3ea69ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:24:58 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Converting VIF {"id": "467a0f1e-1ad6-4474-bbcb-dadad3ea69ab", "address": "fa:16:3e:ab:27:73", "network": {"id": "1869d0f1-8115-44c6-b5d4-42e362716749", "bridge": "br-int", "label": "tempest-TestShelveInstance-1207362046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bd57c6933c04f5a9ec5e27eb8bce661", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap467a0f1e-1a", "ovs_interfaceid": "467a0f1e-1ad6-4474-bbcb-dadad3ea69ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:24:58 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:27:73,bridge_name='br-int',has_traffic_filtering=True,id=467a0f1e-1ad6-4474-bbcb-dadad3ea69ab,network=Network(1869d0f1-8115-44c6-b5d4-42e362716749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap467a0f1e-1a') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:24:58 user nova-compute[75245]: DEBUG nova.objects.instance [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Lazy-loading 'pci_devices' on Instance uuid 4f7fb562-a698-4fc9-91b0-c786627f6d75 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:24:58 user nova-compute[75245]: DEBUG nova.objects.base [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Object Instance<4f7fb562-a698-4fc9-91b0-c786627f6d75> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=75245) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 16:24:58 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] End _get_guest_xml xml=<domain type="kvm">
Nov 29 16:24:58 user nova-compute[75245]:   <uuid>4f7fb562-a698-4fc9-91b0-c786627f6d75</uuid>
Nov 29 16:24:58 user nova-compute[75245]:   <name>instance-00000016</name>
Nov 29 16:24:58 user nova-compute[75245]:   <memory>524288</memory>
Nov 29 16:24:58 user nova-compute[75245]:   <vcpu>1</vcpu>
Nov 29 16:24:58 user nova-compute[75245]:   <metadata>
Nov 29 16:24:58 user nova-compute[75245]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 16:24:58 user nova-compute[75245]:       <nova:package version="0.0.0"/>
Nov 29 16:24:58 user nova-compute[75245]:       <nova:name>tempest-TestShelveInstance-server-1369972773</nova:name>
Nov 29 16:24:58 user nova-compute[75245]:       <nova:creationTime>2023-11-29 16:24:57</nova:creationTime>
Nov 29 16:24:58 user nova-compute[75245]:       <nova:flavor name="m1.tiny">
Nov 29 16:24:58 user nova-compute[75245]:         <nova:memory>512</nova:memory>
Nov 29 16:24:58 user nova-compute[75245]:         <nova:disk>1</nova:disk>
Nov 29 16:24:58 user nova-compute[75245]:         <nova:swap>0</nova:swap>
Nov 29 16:24:58 user nova-compute[75245]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 16:24:58 user nova-compute[75245]:         <nova:vcpus>1</nova:vcpus>
Nov 29 16:24:58 user nova-compute[75245]:       </nova:flavor>
Nov 29 16:24:58 user nova-compute[75245]:       <nova:owner>
Nov 29 16:24:58 user nova-compute[75245]:         <nova:user uuid="a271b4251cd64c5c8d5bf8e73e365624">tempest-TestShelveInstance-1248422115-project-member</nova:user>
Nov 29 16:24:58 user nova-compute[75245]:         <nova:project uuid="5bd57c6933c04f5a9ec5e27eb8bce661">tempest-TestShelveInstance-1248422115</nova:project>
Nov 29 16:24:58 user nova-compute[75245]:       </nova:owner>
Nov 29 16:24:58 user nova-compute[75245]:       <nova:ports>
Nov 29 16:24:58 user nova-compute[75245]:         <nova:port uuid="467a0f1e-1ad6-4474-bbcb-dadad3ea69ab">
Nov 29 16:24:58 user nova-compute[75245]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 29 16:24:58 user nova-compute[75245]:         </nova:port>
Nov 29 16:24:58 user nova-compute[75245]:       </nova:ports>
Nov 29 16:24:58 user nova-compute[75245]:     </nova:instance>
Nov 29 16:24:58 user nova-compute[75245]:   </metadata>
Nov 29 16:24:58 user nova-compute[75245]:   <sysinfo type="smbios">
Nov 29 16:24:58 user nova-compute[75245]:     <system>
Nov 29 16:24:58 user nova-compute[75245]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 16:24:58 user nova-compute[75245]:       <entry name="product">OpenStack Nova</entry>
Nov 29 16:24:58 user nova-compute[75245]:       <entry name="version">0.0.0</entry>
Nov 29 16:24:58 user nova-compute[75245]:       <entry name="serial">4f7fb562-a698-4fc9-91b0-c786627f6d75</entry>
Nov 29 16:24:58 user nova-compute[75245]:       <entry name="uuid">4f7fb562-a698-4fc9-91b0-c786627f6d75</entry>
Nov 29 16:24:58 user nova-compute[75245]:       <entry name="family">Virtual Machine</entry>
Nov 29 16:24:58 user nova-compute[75245]:     </system>
Nov 29 16:24:58 user nova-compute[75245]:   </sysinfo>
Nov 29 16:24:58 user nova-compute[75245]:   <os>
Nov 29 16:24:58 user nova-compute[75245]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 16:24:58 user nova-compute[75245]:     <boot dev="hd"/>
Nov 29 16:24:58 user nova-compute[75245]:     <smbios mode="sysinfo"/>
Nov 29 16:24:58 user nova-compute[75245]:   </os>
Nov 29 16:24:58 user nova-compute[75245]:   <features>
Nov 29 16:24:58 user nova-compute[75245]:     <acpi/>
Nov 29 16:24:58 user nova-compute[75245]:     <apic/>
Nov 29 16:24:58 user nova-compute[75245]:     <vmcoreinfo/>
Nov 29 16:24:58 user nova-compute[75245]:   </features>
Nov 29 16:24:58 user nova-compute[75245]:   <clock offset="utc">
Nov 29 16:24:58 user nova-compute[75245]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 16:24:58 user nova-compute[75245]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 16:24:58 user nova-compute[75245]:     <timer name="hpet" present="no"/>
Nov 29 16:24:58 user nova-compute[75245]:   </clock>
Nov 29 16:24:58 user nova-compute[75245]:   <cpu mode="custom" match="exact">
Nov 29 16:24:58 user nova-compute[75245]:     <model>Nehalem</model>
Nov 29 16:24:58 user nova-compute[75245]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 16:24:58 user nova-compute[75245]:   </cpu>
Nov 29 16:24:58 user nova-compute[75245]:   <devices>
Nov 29 16:24:58 user nova-compute[75245]:     <disk type="block" device="disk">
Nov 29 16:24:58 user nova-compute[75245]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:24:58 user nova-compute[75245]:       <source dev="/dev/sdd"/>
Nov 29 16:24:58 user nova-compute[75245]:       <target dev="vda" bus="virtio"/>
Nov 29 16:24:58 user nova-compute[75245]:       <serial>a87461eb-363d-43eb-94cb-4f69edc13024</serial>
Nov 29 16:24:58 user nova-compute[75245]:     </disk>
Nov 29 16:24:58 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 16:24:58 user nova-compute[75245]:       <mac address="fa:16:3e:ab:27:73"/>
Nov 29 16:24:58 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:24:58 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 16:24:58 user nova-compute[75245]:       <target dev="tap467a0f1e-1a"/>
Nov 29 16:24:58 user nova-compute[75245]:     </interface>
Nov 29 16:24:58 user nova-compute[75245]:     <serial type="pty">
Nov 29 16:24:58 user nova-compute[75245]:       <log file="/opt/stack/data/nova/instances/4f7fb562-a698-4fc9-91b0-c786627f6d75/console.log" append="off"/>
Nov 29 16:24:58 user nova-compute[75245]:     </serial>
Nov 29 16:24:58 user nova-compute[75245]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 16:24:58 user nova-compute[75245]:     <video>
Nov 29 16:24:58 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:24:58 user nova-compute[75245]:     </video>
Nov 29 16:24:58 user nova-compute[75245]:     <rng model="virtio">
Nov 29 16:24:58 user nova-compute[75245]:       <backend model="random">/dev/urandom</backend>
Nov 29 16:24:58 user nova-compute[75245]:     </rng>
Nov 29 16:24:58 user nova-compute[75245]:     <controller type="usb" index="0" model="none"/>
Nov 29 16:24:58 user nova-compute[75245]:     <memballoon model="virtio">
Nov 29 16:24:58 user nova-compute[75245]:       <stats period="10"/>
Nov 29 16:24:58 user nova-compute[75245]:     </memballoon>
Nov 29 16:24:58 user nova-compute[75245]:   </devices>
Nov 29 16:24:58 user nova-compute[75245]: </domain>
Nov 29 16:24:58 user nova-compute[75245]:  {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 16:24:58 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T16:21:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1369972773',display_name='tempest-TestShelveInstance-server-1369972773',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1369972773',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1582200683',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:21:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5bd57c6933c04f5a9ec5e27eb8bce661',ramdisk_id='',reservation_id='r-058m537p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1248422115',owner_user_name='tempest-TestShelveInstance-1248422115-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:24:48Z,user_data=None,user_id='a271b4251cd64c5c8d5bf8e73e365624',uuid=4f7fb562-a698-4fc9-91b0-c786627f6d75,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "467a0f1e-1ad6-4474-bbcb-dadad3ea69ab", "address": "fa:16:3e:ab:27:73", "network": {"id": "1869d0f1-8115-44c6-b5d4-42e362716749", "bridge": "br-int", "label": "tempest-TestShelveInstance-1207362046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bd57c6933c04f5a9ec5e27eb8bce661", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap467a0f1e-1a", "ovs_interfaceid": "467a0f1e-1ad6-4474-bbcb-dadad3ea69ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 16:24:58 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Converting VIF {"id": "467a0f1e-1ad6-4474-bbcb-dadad3ea69ab", "address": "fa:16:3e:ab:27:73", "network": {"id": "1869d0f1-8115-44c6-b5d4-42e362716749", "bridge": "br-int", "label": "tempest-TestShelveInstance-1207362046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bd57c6933c04f5a9ec5e27eb8bce661", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap467a0f1e-1a", "ovs_interfaceid": "467a0f1e-1ad6-4474-bbcb-dadad3ea69ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:24:58 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:27:73,bridge_name='br-int',has_traffic_filtering=True,id=467a0f1e-1ad6-4474-bbcb-dadad3ea69ab,network=Network(1869d0f1-8115-44c6-b5d4-42e362716749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap467a0f1e-1a') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:24:58 user nova-compute[75245]: DEBUG os_vif [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:27:73,bridge_name='br-int',has_traffic_filtering=True,id=467a0f1e-1ad6-4474-bbcb-dadad3ea69ab,network=Network(1869d0f1-8115-44c6-b5d4-42e362716749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap467a0f1e-1a') {{(pid=75245) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 16:24:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:24:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:24:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 16:24:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:24:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '50d25e14-a04d-5892-a859-10b88a1b405c', '_type': 'linux-noop'}}, row=False) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:24:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:24:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:24:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:24:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap467a0f1e-1a, may_exist=True, interface_attrs={}) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:24:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap467a0f1e-1a, col_values=(('qos', UUID('af069662-d236-40af-b057-07198a02936e')),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:24:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap467a0f1e-1a, col_values=(('external_ids', {'iface-id': '467a0f1e-1ad6-4474-bbcb-dadad3ea69ab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ab:27:73', 'vm-uuid': '4f7fb562-a698-4fc9-91b0-c786627f6d75'}),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:24:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:24:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:24:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:24:58 user nova-compute[75245]: INFO os_vif [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:27:73,bridge_name='br-int',has_traffic_filtering=True,id=467a0f1e-1ad6-4474-bbcb-dadad3ea69ab,network=Network(1869d0f1-8115-44c6-b5d4-42e362716749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap467a0f1e-1a')
Nov 29 16:24:58 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:24:58 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] No VIF found with MAC fa:16:3e:ab:27:73, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:25:00 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:25:00 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:25:00 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:25:00 user nova-compute[75245]: DEBUG nova.compute.manager [req-184a933e-c0e8-47d0-9823-95a67a57c2e1 req-c7ee2e5b-d370-414b-be7e-a0ef82923f9a service nova] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Received event network-vif-plugged-467a0f1e-1ad6-4474-bbcb-dadad3ea69ab {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:25:00 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-184a933e-c0e8-47d0-9823-95a67a57c2e1 req-c7ee2e5b-d370-414b-be7e-a0ef82923f9a service nova] Acquiring lock "4f7fb562-a698-4fc9-91b0-c786627f6d75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:25:00 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-184a933e-c0e8-47d0-9823-95a67a57c2e1 req-c7ee2e5b-d370-414b-be7e-a0ef82923f9a service nova] Lock "4f7fb562-a698-4fc9-91b0-c786627f6d75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:25:00 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-184a933e-c0e8-47d0-9823-95a67a57c2e1 req-c7ee2e5b-d370-414b-be7e-a0ef82923f9a service nova] Lock "4f7fb562-a698-4fc9-91b0-c786627f6d75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:25:00 user nova-compute[75245]: DEBUG nova.compute.manager [req-184a933e-c0e8-47d0-9823-95a67a57c2e1 req-c7ee2e5b-d370-414b-be7e-a0ef82923f9a service nova] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] No waiting events found dispatching network-vif-plugged-467a0f1e-1ad6-4474-bbcb-dadad3ea69ab {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:25:00 user nova-compute[75245]: WARNING nova.compute.manager [req-184a933e-c0e8-47d0-9823-95a67a57c2e1 req-c7ee2e5b-d370-414b-be7e-a0ef82923f9a service nova] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Received unexpected event network-vif-plugged-467a0f1e-1ad6-4474-bbcb-dadad3ea69ab for instance with vm_state shelved_offloaded and task_state spawning.
Nov 29 16:25:00 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:25:00 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Starting heal instance info cache {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 16:25:00 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:25:00 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "refresh_cache-84bae51e-2a85-442d-bbd2-fc89f30f40b7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:25:00 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquired lock "refresh_cache-84bae51e-2a85-442d-bbd2-fc89f30f40b7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:25:00 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Forcefully refreshing network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 16:25:00 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:25:00 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:25:01 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Updating instance_info_cache with network_info: [{"id": "27fc0374-0770-4171-a730-6696b09362eb", "address": "fa:16:3e:d1:e4:30", "network": {"id": "e38d9eed-b29b-4a4c-b084-876554dc5263", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1284740336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c018212e0654c4db442ca65a386f397", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27fc0374-07", "ovs_interfaceid": "27fc0374-0770-4171-a730-6696b09362eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:25:01 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Releasing lock "refresh_cache-84bae51e-2a85-442d-bbd2-fc89f30f40b7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:25:01 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Updated the network info_cache for instance {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 16:25:02 user nova-compute[75245]: DEBUG nova.compute.manager [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Instance event wait completed in 0 seconds for  {{(pid=75245) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 16:25:02 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Guest created on hypervisor {{(pid=75245) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 16:25:02 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Instance spawned successfully.
Nov 29 16:25:02 user nova-compute[75245]: DEBUG nova.compute.manager [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:25:02 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-c5789734-b97e-4987-91bc-0ca1e92432b1 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Lock "4f7fb562-a698-4fc9-91b0-c786627f6d75" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 14.272s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:25:02 user nova-compute[75245]: DEBUG nova.compute.manager [req-e5ecc240-48f8-4ed2-b8d2-b4e22cd4f5cb req-e80757d5-dc1f-44d0-9cef-2a6b621e299b service nova] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Received event network-vif-plugged-467a0f1e-1ad6-4474-bbcb-dadad3ea69ab {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:25:02 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-e5ecc240-48f8-4ed2-b8d2-b4e22cd4f5cb req-e80757d5-dc1f-44d0-9cef-2a6b621e299b service nova] Acquiring lock "4f7fb562-a698-4fc9-91b0-c786627f6d75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:25:02 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-e5ecc240-48f8-4ed2-b8d2-b4e22cd4f5cb req-e80757d5-dc1f-44d0-9cef-2a6b621e299b service nova] Lock "4f7fb562-a698-4fc9-91b0-c786627f6d75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:25:02 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-e5ecc240-48f8-4ed2-b8d2-b4e22cd4f5cb req-e80757d5-dc1f-44d0-9cef-2a6b621e299b service nova] Lock "4f7fb562-a698-4fc9-91b0-c786627f6d75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:25:02 user nova-compute[75245]: DEBUG nova.compute.manager [req-e5ecc240-48f8-4ed2-b8d2-b4e22cd4f5cb req-e80757d5-dc1f-44d0-9cef-2a6b621e299b service nova] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] No waiting events found dispatching network-vif-plugged-467a0f1e-1ad6-4474-bbcb-dadad3ea69ab {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:25:02 user nova-compute[75245]: WARNING nova.compute.manager [req-e5ecc240-48f8-4ed2-b8d2-b4e22cd4f5cb req-e80757d5-dc1f-44d0-9cef-2a6b621e299b service nova] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Received unexpected event network-vif-plugged-467a0f1e-1ad6-4474-bbcb-dadad3ea69ab for instance with vm_state active and task_state None.
Nov 29 16:25:02 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:25:02 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:25:02 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:25:02 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:25:02 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:25:02 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75245) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 16:25:02 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b629ca7-b69e-471c-a7b0-9eb43301c36f/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:25:02 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b629ca7-b69e-471c-a7b0-9eb43301c36f/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:25:02 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b629ca7-b69e-471c-a7b0-9eb43301c36f/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:25:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b629ca7-b69e-471c-a7b0-9eb43301c36f/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:25:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bae51e-2a85-442d-bbd2-fc89f30f40b7/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:25:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bae51e-2a85-442d-bbd2-fc89f30f40b7/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:25:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bae51e-2a85-442d-bbd2-fc89f30f40b7/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:25:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bae51e-2a85-442d-bbd2-fc89f30f40b7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:25:03 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:25:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:25:03 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:25:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:25:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:25:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:25:03 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:25:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5de7e10c-f216-46b3-8f74-57bac6ab7e56/disk.rescue --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:25:03 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:25:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5de7e10c-f216-46b3-8f74-57bac6ab7e56/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:25:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5de7e10c-f216-46b3-8f74-57bac6ab7e56/disk.rescue --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:25:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5de7e10c-f216-46b3-8f74-57bac6ab7e56/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:25:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:25:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:25:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:25:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:25:04 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:25:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk.rescue --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:25:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:25:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk.rescue --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:25:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:25:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:25:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:25:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:25:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:25:05 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:25:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:25:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:25:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:25:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:25:06 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:25:06 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:25:06 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Hypervisor/Node resource view: name=user free_ram=7778MB free_disk=25.211959838867188GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75245) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 16:25:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:25:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:25:06 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Applying migration context for instance d42fa9b3-91c3-4216-91f1-655ce140425f as it has an incoming, in-progress migration 5086ee39-8d43-4f62-b55b-269f7ca7eb37. Migration status is finished {{(pid=75245) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 29 16:25:06 user nova-compute[75245]: INFO nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Updating resource usage from migration 5086ee39-8d43-4f62-b55b-269f7ca7eb37
Nov 29 16:25:06 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance ed9a6a4e-2e7d-443c-82ef-f14f11d32c81 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:25:06 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 8785a3c2-5b7a-4382-b50d-cecd8743329c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:25:06 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 84bae51e-2a85-442d-bbd2-fc89f30f40b7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:25:06 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 5de7e10c-f216-46b3-8f74-57bac6ab7e56 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:25:06 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:25:06 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance ed9d1ad5-f5d0-4a68-a073-e7a83be772ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:25:06 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Migration 5086ee39-8d43-4f62-b55b-269f7ca7eb37 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 29 16:25:06 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance d42fa9b3-91c3-4216-91f1-655ce140425f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:25:06 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 0b629ca7-b69e-471c-a7b0-9eb43301c36f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:25:06 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 4f7fb562-a698-4fc9-91b0-c786627f6d75 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:25:06 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 16:25:06 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 16:25:06 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:25:06 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:25:06 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Compute_service record updated for user:user {{(pid=75245) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 16:25:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.458s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:25:07 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:25:07 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:25:07 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:25:08 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:25:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:25:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:25:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75245) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 16:25:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:25:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:25:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:25:09 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:25:10 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:25:10 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75245) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 16:25:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:25:17 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-e84fa9d3-4572-4b79-b3c7-6213ebbc6a07 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Acquiring lock "d42fa9b3-91c3-4216-91f1-655ce140425f" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:25:17 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-e84fa9d3-4572-4b79-b3c7-6213ebbc6a07 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "d42fa9b3-91c3-4216-91f1-655ce140425f" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:25:17 user nova-compute[75245]: DEBUG nova.compute.manager [None req-e84fa9d3-4572-4b79-b3c7-6213ebbc6a07 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Going to confirm migration 2 {{(pid=75245) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 29 16:25:18 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-e84fa9d3-4572-4b79-b3c7-6213ebbc6a07 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Acquiring lock "refresh_cache-d42fa9b3-91c3-4216-91f1-655ce140425f" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:25:18 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-e84fa9d3-4572-4b79-b3c7-6213ebbc6a07 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Acquired lock "refresh_cache-d42fa9b3-91c3-4216-91f1-655ce140425f" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:25:18 user nova-compute[75245]: DEBUG nova.network.neutron [None req-e84fa9d3-4572-4b79-b3c7-6213ebbc6a07 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 16:25:18 user nova-compute[75245]: DEBUG nova.objects.instance [None req-e84fa9d3-4572-4b79-b3c7-6213ebbc6a07 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lazy-loading 'info_cache' on Instance uuid d42fa9b3-91c3-4216-91f1-655ce140425f {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:25:18 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:25:18 user nova-compute[75245]: DEBUG nova.network.neutron [None req-e84fa9d3-4572-4b79-b3c7-6213ebbc6a07 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Updating instance_info_cache with network_info: [{"id": "497aee0b-487f-4138-9394-a68c8bd55e61", "address": "fa:16:3e:09:ba:94", "network": {"id": "f1fac2f4-e789-443e-b6a5-1a3f829bc302", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1199431077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6b87e18ef1f48d19a6907b28cb54f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap497aee0b-48", "ovs_interfaceid": "497aee0b-487f-4138-9394-a68c8bd55e61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:25:18 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-e84fa9d3-4572-4b79-b3c7-6213ebbc6a07 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Releasing lock "refresh_cache-d42fa9b3-91c3-4216-91f1-655ce140425f" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:25:18 user nova-compute[75245]: DEBUG nova.objects.instance [None req-e84fa9d3-4572-4b79-b3c7-6213ebbc6a07 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lazy-loading 'migration_context' on Instance uuid d42fa9b3-91c3-4216-91f1-655ce140425f {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:25:18 user nova-compute[75245]: DEBUG nova.objects.base [None req-e84fa9d3-4572-4b79-b3c7-6213ebbc6a07 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Object Instance<d42fa9b3-91c3-4216-91f1-655ce140425f> lazy-loaded attributes: info_cache,migration_context {{(pid=75245) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 16:25:18 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-e84fa9d3-4572-4b79-b3c7-6213ebbc6a07 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:25:18 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-e84fa9d3-4572-4b79-b3c7-6213ebbc6a07 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:25:18 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-e84fa9d3-4572-4b79-b3c7-6213ebbc6a07 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:25:18 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-e84fa9d3-4572-4b79-b3c7-6213ebbc6a07 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:25:18 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:25:18 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-e84fa9d3-4572-4b79-b3c7-6213ebbc6a07 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.330s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:25:19 user nova-compute[75245]: INFO nova.scheduler.client.report [None req-e84fa9d3-4572-4b79-b3c7-6213ebbc6a07 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Deleted allocation for migration 5086ee39-8d43-4f62-b55b-269f7ca7eb37
Nov 29 16:25:19 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-e84fa9d3-4572-4b79-b3c7-6213ebbc6a07 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "d42fa9b3-91c3-4216-91f1-655ce140425f" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.316s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:25:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:25:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:25:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:25:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:25:29 user nova-compute[75245]: INFO nova.compute.manager [None req-b4f39ecf-c821-428c-92ce-c32de24087c8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Unrescuing
Nov 29 16:25:29 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-b4f39ecf-c821-428c-92ce-c32de24087c8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Acquiring lock "refresh_cache-5de7e10c-f216-46b3-8f74-57bac6ab7e56" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:25:29 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-b4f39ecf-c821-428c-92ce-c32de24087c8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Acquired lock "refresh_cache-5de7e10c-f216-46b3-8f74-57bac6ab7e56" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:25:29 user nova-compute[75245]: DEBUG nova.network.neutron [None req-b4f39ecf-c821-428c-92ce-c32de24087c8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 16:25:29 user nova-compute[75245]: DEBUG nova.network.neutron [None req-b4f39ecf-c821-428c-92ce-c32de24087c8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Updating instance_info_cache with network_info: [{"id": "116d08d0-5549-4438-b689-0bbda3a5934f", "address": "fa:16:3e:97:fb:c7", "network": {"id": "6a7f7426-b595-4aa3-bf80-cc92ba7ce15e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-917300903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d52776451e947f5a9ef3fa44ac8acbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap116d08d0-55", "ovs_interfaceid": "116d08d0-5549-4438-b689-0bbda3a5934f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:25:29 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-b4f39ecf-c821-428c-92ce-c32de24087c8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Releasing lock "refresh_cache-5de7e10c-f216-46b3-8f74-57bac6ab7e56" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:25:29 user nova-compute[75245]: DEBUG nova.objects.instance [None req-b4f39ecf-c821-428c-92ce-c32de24087c8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lazy-loading 'flavor' on Instance uuid 5de7e10c-f216-46b3-8f74-57bac6ab7e56 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:25:29 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:25:29 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:25:29 user nova-compute[75245]: DEBUG nova.compute.manager [req-f64064b2-397f-4315-a47e-ec12460226b4 req-b8bfa841-9904-4e81-b96a-f80e415bbda3 service nova] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Received event network-vif-unplugged-116d08d0-5549-4438-b689-0bbda3a5934f {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:25:29 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-f64064b2-397f-4315-a47e-ec12460226b4 req-b8bfa841-9904-4e81-b96a-f80e415bbda3 service nova] Acquiring lock "5de7e10c-f216-46b3-8f74-57bac6ab7e56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:25:29 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-f64064b2-397f-4315-a47e-ec12460226b4 req-b8bfa841-9904-4e81-b96a-f80e415bbda3 service nova] Lock "5de7e10c-f216-46b3-8f74-57bac6ab7e56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:25:29 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-f64064b2-397f-4315-a47e-ec12460226b4 req-b8bfa841-9904-4e81-b96a-f80e415bbda3 service nova] Lock "5de7e10c-f216-46b3-8f74-57bac6ab7e56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:25:29 user nova-compute[75245]: DEBUG nova.compute.manager [req-f64064b2-397f-4315-a47e-ec12460226b4 req-b8bfa841-9904-4e81-b96a-f80e415bbda3 service nova] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] No waiting events found dispatching network-vif-unplugged-116d08d0-5549-4438-b689-0bbda3a5934f {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:25:29 user nova-compute[75245]: WARNING nova.compute.manager [req-f64064b2-397f-4315-a47e-ec12460226b4 req-b8bfa841-9904-4e81-b96a-f80e415bbda3 service nova] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Received unexpected event network-vif-unplugged-116d08d0-5549-4438-b689-0bbda3a5934f for instance with vm_state rescued and task_state unrescuing.
Nov 29 16:25:29 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:25:29 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:25:30 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Instance destroyed successfully.
Nov 29 16:25:31 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:25:31 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:25:31 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:25:31 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:25:31 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:25:31 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:25:31 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:25:31 user nova-compute[75245]: DEBUG nova.compute.manager [req-077815ca-4f65-4f64-bfec-2f5d2e20a2e0 req-07c19d2a-e094-4ceb-bcd4-f22061af6ffc service nova] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Received event network-vif-plugged-116d08d0-5549-4438-b689-0bbda3a5934f {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:25:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-077815ca-4f65-4f64-bfec-2f5d2e20a2e0 req-07c19d2a-e094-4ceb-bcd4-f22061af6ffc service nova] Acquiring lock "5de7e10c-f216-46b3-8f74-57bac6ab7e56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:25:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-077815ca-4f65-4f64-bfec-2f5d2e20a2e0 req-07c19d2a-e094-4ceb-bcd4-f22061af6ffc service nova] Lock "5de7e10c-f216-46b3-8f74-57bac6ab7e56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:25:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-077815ca-4f65-4f64-bfec-2f5d2e20a2e0 req-07c19d2a-e094-4ceb-bcd4-f22061af6ffc service nova] Lock "5de7e10c-f216-46b3-8f74-57bac6ab7e56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:25:31 user nova-compute[75245]: DEBUG nova.compute.manager [req-077815ca-4f65-4f64-bfec-2f5d2e20a2e0 req-07c19d2a-e094-4ceb-bcd4-f22061af6ffc service nova] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] No waiting events found dispatching network-vif-plugged-116d08d0-5549-4438-b689-0bbda3a5934f {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:25:31 user nova-compute[75245]: WARNING nova.compute.manager [req-077815ca-4f65-4f64-bfec-2f5d2e20a2e0 req-07c19d2a-e094-4ceb-bcd4-f22061af6ffc service nova] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Received unexpected event network-vif-plugged-116d08d0-5549-4438-b689-0bbda3a5934f for instance with vm_state rescued and task_state unrescuing.
Nov 29 16:25:31 user nova-compute[75245]: DEBUG nova.compute.manager [req-077815ca-4f65-4f64-bfec-2f5d2e20a2e0 req-07c19d2a-e094-4ceb-bcd4-f22061af6ffc service nova] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Received event network-vif-plugged-116d08d0-5549-4438-b689-0bbda3a5934f {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:25:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-077815ca-4f65-4f64-bfec-2f5d2e20a2e0 req-07c19d2a-e094-4ceb-bcd4-f22061af6ffc service nova] Acquiring lock "5de7e10c-f216-46b3-8f74-57bac6ab7e56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:25:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-077815ca-4f65-4f64-bfec-2f5d2e20a2e0 req-07c19d2a-e094-4ceb-bcd4-f22061af6ffc service nova] Lock "5de7e10c-f216-46b3-8f74-57bac6ab7e56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:25:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-077815ca-4f65-4f64-bfec-2f5d2e20a2e0 req-07c19d2a-e094-4ceb-bcd4-f22061af6ffc service nova] Lock "5de7e10c-f216-46b3-8f74-57bac6ab7e56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:25:31 user nova-compute[75245]: DEBUG nova.compute.manager [req-077815ca-4f65-4f64-bfec-2f5d2e20a2e0 req-07c19d2a-e094-4ceb-bcd4-f22061af6ffc service nova] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] No waiting events found dispatching network-vif-plugged-116d08d0-5549-4438-b689-0bbda3a5934f {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:25:31 user nova-compute[75245]: WARNING nova.compute.manager [req-077815ca-4f65-4f64-bfec-2f5d2e20a2e0 req-07c19d2a-e094-4ceb-bcd4-f22061af6ffc service nova] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Received unexpected event network-vif-plugged-116d08d0-5549-4438-b689-0bbda3a5934f for instance with vm_state rescued and task_state unrescuing.
Nov 29 16:25:33 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:25:33 user nova-compute[75245]: DEBUG nova.compute.manager [None req-b4f39ecf-c821-428c-92ce-c32de24087c8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:25:33 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:25:33 user nova-compute[75245]: DEBUG nova.compute.manager [req-96e9bbee-2a6c-4860-9371-7430b2172f19 req-2f541f0f-bb0c-4bf7-9e23-94aa0b45e747 service nova] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Received event network-vif-plugged-116d08d0-5549-4438-b689-0bbda3a5934f {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:25:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-96e9bbee-2a6c-4860-9371-7430b2172f19 req-2f541f0f-bb0c-4bf7-9e23-94aa0b45e747 service nova] Acquiring lock "5de7e10c-f216-46b3-8f74-57bac6ab7e56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:25:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-96e9bbee-2a6c-4860-9371-7430b2172f19 req-2f541f0f-bb0c-4bf7-9e23-94aa0b45e747 service nova] Lock "5de7e10c-f216-46b3-8f74-57bac6ab7e56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:25:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-96e9bbee-2a6c-4860-9371-7430b2172f19 req-2f541f0f-bb0c-4bf7-9e23-94aa0b45e747 service nova] Lock "5de7e10c-f216-46b3-8f74-57bac6ab7e56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:25:33 user nova-compute[75245]: DEBUG nova.compute.manager [req-96e9bbee-2a6c-4860-9371-7430b2172f19 req-2f541f0f-bb0c-4bf7-9e23-94aa0b45e747 service nova] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] No waiting events found dispatching network-vif-plugged-116d08d0-5549-4438-b689-0bbda3a5934f {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:25:33 user nova-compute[75245]: WARNING nova.compute.manager [req-96e9bbee-2a6c-4860-9371-7430b2172f19 req-2f541f0f-bb0c-4bf7-9e23-94aa0b45e747 service nova] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Received unexpected event network-vif-plugged-116d08d0-5549-4438-b689-0bbda3a5934f for instance with vm_state active and task_state None.
Nov 29 16:25:38 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:25:43 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:25:43 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:25:43 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75245) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 16:25:43 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:25:43 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:25:43 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:25:48 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:25:48 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:25:48 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75245) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 16:25:48 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:25:48 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:25:48 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:25:53 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:25:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:25:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:25:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75245) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 16:25:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:25:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:25:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:26:02 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:26:02 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Starting heal instance info cache {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 16:26:02 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "refresh_cache-8785a3c2-5b7a-4382-b50d-cecd8743329c" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:26:02 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquired lock "refresh_cache-8785a3c2-5b7a-4382-b50d-cecd8743329c" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:26:02 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Forcefully refreshing network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 16:26:02 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Updating instance_info_cache with network_info: [{"id": "8c7418c2-2459-4bc3-acfb-16df97c78f67", "address": "fa:16:3e:82:d0:d8", "network": {"id": "6a7f7426-b595-4aa3-bf80-cc92ba7ce15e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-917300903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d52776451e947f5a9ef3fa44ac8acbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7418c2-24", "ovs_interfaceid": "8c7418c2-2459-4bc3-acfb-16df97c78f67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:26:02 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Releasing lock "refresh_cache-8785a3c2-5b7a-4382-b50d-cecd8743329c" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:26:02 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Updated the network info_cache for instance {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 16:26:02 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:26:02 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:26:02 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Cleaning up deleted instances {{(pid=75245) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 16:26:03 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] There are 0 instances to clean {{(pid=75245) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 16:26:03 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:26:03 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:26:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:26:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:26:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:26:03 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75245) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 16:26:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b629ca7-b69e-471c-a7b0-9eb43301c36f/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:26:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b629ca7-b69e-471c-a7b0-9eb43301c36f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:26:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b629ca7-b69e-471c-a7b0-9eb43301c36f/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:26:03 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:26:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b629ca7-b69e-471c-a7b0-9eb43301c36f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:26:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bae51e-2a85-442d-bbd2-fc89f30f40b7/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:26:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bae51e-2a85-442d-bbd2-fc89f30f40b7/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:26:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bae51e-2a85-442d-bbd2-fc89f30f40b7/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:26:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bae51e-2a85-442d-bbd2-fc89f30f40b7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:26:04 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:26:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:26:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:26:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:26:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:26:04 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:26:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:26:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:26:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:26:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:26:05 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:26:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk.rescue --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:26:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:26:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk.rescue --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:26:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:26:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:26:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:26:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:26:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:26:05 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:26:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:26:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:26:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:26:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:26:06 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:26:06 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:26:06 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Hypervisor/Node resource view: name=user free_ram=7966MB free_disk=25.211994171142578GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75245) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 16:26:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:26:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:26:06 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance ed9a6a4e-2e7d-443c-82ef-f14f11d32c81 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:26:06 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 8785a3c2-5b7a-4382-b50d-cecd8743329c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:26:06 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 84bae51e-2a85-442d-bbd2-fc89f30f40b7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:26:06 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 5de7e10c-f216-46b3-8f74-57bac6ab7e56 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:26:06 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:26:06 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance ed9d1ad5-f5d0-4a68-a073-e7a83be772ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:26:06 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance d42fa9b3-91c3-4216-91f1-655ce140425f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:26:06 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 0b629ca7-b69e-471c-a7b0-9eb43301c36f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:26:06 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 4f7fb562-a698-4fc9-91b0-c786627f6d75 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:26:06 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 16:26:06 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 16:26:07 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Refreshing inventories for resource provider dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 16:26:07 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Updating ProviderTree inventory for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 16:26:07 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Updating inventory in ProviderTree for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 16:26:07 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Refreshing aggregate associations for resource provider dcc0ed27-167e-4f3a-a0de-183bb144a50c, aggregates: None {{(pid=75245) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 16:26:07 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Refreshing trait associations for resource provider dcc0ed27-167e-4f3a-a0de-183bb144a50c, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG {{(pid=75245) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 16:26:07 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:26:07 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:26:07 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Compute_service record updated for user:user {{(pid=75245) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 16:26:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.697s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:26:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:26:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:26:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75245) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 16:26:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:26:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:26:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:26:09 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:26:09 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:26:09 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:26:09 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:26:10 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:26:11 user nova-compute[75245]: DEBUG nova.compute.manager [req-168459f3-c4a6-4504-b2ae-b3f921cffca2 req-ebe2d779-fc6a-44f8-8450-4535aea8dc75 service nova] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Received event network-changed-6d28be36-e00b-4f84-9a2b-60515f2e65a1 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:26:11 user nova-compute[75245]: DEBUG nova.compute.manager [req-168459f3-c4a6-4504-b2ae-b3f921cffca2 req-ebe2d779-fc6a-44f8-8450-4535aea8dc75 service nova] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Refreshing instance network info cache due to event network-changed-6d28be36-e00b-4f84-9a2b-60515f2e65a1. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:26:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-168459f3-c4a6-4504-b2ae-b3f921cffca2 req-ebe2d779-fc6a-44f8-8450-4535aea8dc75 service nova] Acquiring lock "refresh_cache-0b629ca7-b69e-471c-a7b0-9eb43301c36f" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:26:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-168459f3-c4a6-4504-b2ae-b3f921cffca2 req-ebe2d779-fc6a-44f8-8450-4535aea8dc75 service nova] Acquired lock "refresh_cache-0b629ca7-b69e-471c-a7b0-9eb43301c36f" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:26:11 user nova-compute[75245]: DEBUG nova.network.neutron [req-168459f3-c4a6-4504-b2ae-b3f921cffca2 req-ebe2d779-fc6a-44f8-8450-4535aea8dc75 service nova] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Refreshing network info cache for port 6d28be36-e00b-4f84-9a2b-60515f2e65a1 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:26:12 user nova-compute[75245]: DEBUG nova.network.neutron [req-168459f3-c4a6-4504-b2ae-b3f921cffca2 req-ebe2d779-fc6a-44f8-8450-4535aea8dc75 service nova] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Updated VIF entry in instance network info cache for port 6d28be36-e00b-4f84-9a2b-60515f2e65a1. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:26:12 user nova-compute[75245]: DEBUG nova.network.neutron [req-168459f3-c4a6-4504-b2ae-b3f921cffca2 req-ebe2d779-fc6a-44f8-8450-4535aea8dc75 service nova] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Updating instance_info_cache with network_info: [{"id": "6d28be36-e00b-4f84-9a2b-60515f2e65a1", "address": "fa:16:3e:90:6c:6b", "network": {"id": "2110162d-c25f-4c3d-9a67-18e52f6caf43", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1854809203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba4d99c1c6c4472be06502d8b0e75a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d28be36-e0", "ovs_interfaceid": "6d28be36-e00b-4f84-9a2b-60515f2e65a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:26:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-168459f3-c4a6-4504-b2ae-b3f921cffca2 req-ebe2d779-fc6a-44f8-8450-4535aea8dc75 service nova] Releasing lock "refresh_cache-0b629ca7-b69e-471c-a7b0-9eb43301c36f" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:26:12 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:26:12 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75245) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 16:26:12 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:26:12 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75245) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 16:26:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:26:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:26:14 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-c7da57dc-8cdd-479f-b030-d92a0c51b4d0 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Acquiring lock "0b629ca7-b69e-471c-a7b0-9eb43301c36f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:26:14 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-c7da57dc-8cdd-479f-b030-d92a0c51b4d0 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lock "0b629ca7-b69e-471c-a7b0-9eb43301c36f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:26:14 user nova-compute[75245]: DEBUG nova.objects.instance [None req-c7da57dc-8cdd-479f-b030-d92a0c51b4d0 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lazy-loading 'flavor' on Instance uuid 0b629ca7-b69e-471c-a7b0-9eb43301c36f {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:26:14 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-c7da57dc-8cdd-479f-b030-d92a0c51b4d0 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lock "0b629ca7-b69e-471c-a7b0-9eb43301c36f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:26:14 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-c7da57dc-8cdd-479f-b030-d92a0c51b4d0 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Acquiring lock "0b629ca7-b69e-471c-a7b0-9eb43301c36f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:26:14 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-c7da57dc-8cdd-479f-b030-d92a0c51b4d0 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lock "0b629ca7-b69e-471c-a7b0-9eb43301c36f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:26:14 user nova-compute[75245]: INFO nova.compute.manager [None req-c7da57dc-8cdd-479f-b030-d92a0c51b4d0 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Attaching volume 38349e5b-ff4e-436e-8072-9fb91dc48c75 to /dev/vdb
Nov 29 16:26:14 user nova-compute[75245]: DEBUG os_brick.utils [None req-c7da57dc-8cdd-479f-b030-d92a0c51b4d0 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:26:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:26:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:26:14 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[26acfb28-a6a5-4ba9-9e08-d20418699970]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:69ed8ed87091\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:26:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:26:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:26:14 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[49135199-1fa3-4165-b046-e8598fa58f1c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:26:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:26:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:26:14 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[28db905d-1a52-4e27-b5f9-c4021b53e791]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:26:14 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5212774-dd5c-4295-9aac-04adc9920d2e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:26:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-c7da57dc-8cdd-479f-b030-d92a0c51b4d0 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Running cmd (subprocess): nvme version {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:26:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-c7da57dc-8cdd-479f-b030-d92a0c51b4d0 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] 'nvme version' failed. Not Retrying. {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:26:14 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c7da57dc-8cdd-479f-b030-d92a0c51b4d0 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] nvme not present on system {{(pid=75245) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 16:26:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:26:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:26:14 user nova-compute[75245]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 16:26:14 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9b5892-11d8-42df-a4f0-f7463cb96146]: (4, '') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:26:14 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-c7da57dc-8cdd-479f-b030-d92a0c51b4d0 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75245) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 16:26:14 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-c7da57dc-8cdd-479f-b030-d92a0c51b4d0 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 16:26:14 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-c7da57dc-8cdd-479f-b030-d92a0c51b4d0 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] LIGHTOS: no hostnqn found. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 16:26:15 user nova-compute[75245]: DEBUG os_brick.utils [None req-c7da57dc-8cdd-479f-b030-d92a0c51b4d0 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:69ed8ed87091', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:26:15 user nova-compute[75245]: DEBUG nova.virt.block_device [None req-c7da57dc-8cdd-479f-b030-d92a0c51b4d0 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Updating existing volume attachment record: 62481e7a-666e-4e95-862b-31e97d4d4870 {{(pid=75245) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 16:26:15 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:26:18 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:26:18 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:26:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:26:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:26:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75245) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 16:26:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:26:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:26:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:26:24 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7da57dc-8cdd-479f-b030-d92a0c51b4d0 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Calling os-brick to attach iSCSI Volume {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 16:26:24 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7da57dc-8cdd-479f-b030-d92a0c51b4d0 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rEjNxBRa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:26:24 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-c7da57dc-8cdd-479f-b030-d92a0c51b4d0 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:26:24 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-c7da57dc-8cdd-479f-b030-d92a0c51b4d0 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:26:24 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-c7da57dc-8cdd-479f-b030-d92a0c51b4d0 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:26:24 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-c7da57dc-8cdd-479f-b030-d92a0c51b4d0 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:26:24 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-c7da57dc-8cdd-479f-b030-d92a0c51b4d0 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:26:24 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-c7da57dc-8cdd-479f-b030-d92a0c51b4d0 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:26:24 user nova-compute[75245]: INFO os_brick.initiator.connectors.iscsi [None req-c7da57dc-8cdd-479f-b030-d92a0c51b4d0 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 16:26:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75 -p 172.16.0.220:3260 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:26:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:26:25 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[977ca946-2c38-41de-9671-0e6ef4c8ab11]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:26:25 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7da57dc-8cdd-479f-b030-d92a0c51b4d0 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 16:26:25 user nova-compute[75245]:  {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:26:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75 -p 172.16.0.220:3260 --interface default --op new {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:26:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:26:25 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ccbe74-c47b-4624-853e-6e00c7b5c2ce]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75] added\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:26:25 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7da57dc-8cdd-479f-b030-d92a0c51b4d0 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75] added
Nov 29 16:26:25 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:26:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:26:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:26:25 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7fcdc9a-1125-450a-b13e-817d2557b212]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:26:25 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7da57dc-8cdd-479f-b030-d92a0c51b4d0 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:26:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:26:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:26:25 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2a5bbd-8961-412b-a34e-1f295657fb15]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:26:25 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7da57dc-8cdd-479f-b030-d92a0c51b4d0 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:26:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rEjNxBRa {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:26:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rEjNxBRa" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:26:25 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[df47f703-5e7b-4d93-a303-cb7275d0f9a2]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:26:25 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7da57dc-8cdd-479f-b030-d92a0c51b4d0 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rEjNxBRa'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:26:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:26:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:26:25 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[e89c9205-587f-4310-bb86-4b4321565765]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:26:25 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7da57dc-8cdd-479f-b030-d92a0c51b4d0 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:26:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:26:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:26:25 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a79f4ed-9f03-465e-af2e-35ee20f1950b]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:26:25 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7da57dc-8cdd-479f-b030-d92a0c51b4d0 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)
Nov 29 16:26:25 user nova-compute[75245]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f (non-flash)
Nov 29 16:26:25 user nova-compute[75245]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e (non-flash)
Nov 29 16:26:25 user nova-compute[75245]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 (non-flash)
Nov 29 16:26:25 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:26:25 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7da57dc-8cdd-479f-b030-d92a0c51b4d0 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)
Nov 29 16:26:25 user nova-compute[75245]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f (non-flash)
Nov 29 16:26:25 user nova-compute[75245]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e (non-flash)
Nov 29 16:26:25 user nova-compute[75245]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 (non-flash)
Nov 29 16:26:25 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:26:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75 -p 172.16.0.220:3260 --login {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:26:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:26:25 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3fd96eb-92ce-424c-bef4-63bda3e8c121]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:26:25 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7da57dc-8cdd-479f-b030-d92a0c51b4d0 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75, portal: 172.16.0.220,3260]
Nov 29 16:26:25 user nova-compute[75245]: Login to [iface: default, target: iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75, portal: 172.16.0.220,3260] successful.
Nov 29 16:26:25 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:26:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:26:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:26:25 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[3233db29-b9d0-4601-a362-a3f4a4bef42d]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:26:25 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7da57dc-8cdd-479f-b030-d92a0c51b4d0 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:26:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:26:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:26:25 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e2bbfa-022a-4b65-bbf6-d28a35b6c9ca]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:26:25 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7da57dc-8cdd-479f-b030-d92a0c51b4d0 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)
Nov 29 16:26:25 user nova-compute[75245]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f (non-flash)
Nov 29 16:26:25 user nova-compute[75245]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e (non-flash)
Nov 29 16:26:25 user nova-compute[75245]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 (non-flash)
Nov 29 16:26:25 user nova-compute[75245]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75 (non-flash)
Nov 29 16:26:25 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:26:25 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7da57dc-8cdd-479f-b030-d92a0c51b4d0 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)
Nov 29 16:26:25 user nova-compute[75245]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f (non-flash)
Nov 29 16:26:25 user nova-compute[75245]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e (non-flash)
Nov 29 16:26:25 user nova-compute[75245]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 (non-flash)
Nov 29 16:26:25 user nova-compute[75245]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75 (non-flash)
Nov 29 16:26:25 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:26:25 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-c7da57dc-8cdd-479f-b030-d92a0c51b4d0 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:26:25 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7da57dc-8cdd-479f-b030-d92a0c51b4d0 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Connected to 172.16.0.220:3260 {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 16:26:25 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-c7da57dc-8cdd-479f-b030-d92a0c51b4d0 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] HCTL ('37', '-', '-', 0) found on session 34 with lun 0 {{(pid=75245) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 16:26:25 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-c7da57dc-8cdd-479f-b030-d92a0c51b4d0 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75245) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 16:26:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:26:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:26:25 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5743542-b547-465b-81ae-20a248bd4fa7]: (4, ('- - 0', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:26:25 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-c7da57dc-8cdd-479f-b030-d92a0c51b4d0 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Searching for a device in session 34 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75245) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 16:26:25 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7da57dc-8cdd-479f-b030-d92a0c51b4d0 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rEjNxBRa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 16:26:25 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-da0bef27-21e6-46ba-bee9-b59649a49f1d tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Acquiring lock "84bae51e-2a85-442d-bbd2-fc89f30f40b7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:26:25 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-da0bef27-21e6-46ba-bee9-b59649a49f1d tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Lock "84bae51e-2a85-442d-bbd2-fc89f30f40b7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:26:25 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-da0bef27-21e6-46ba-bee9-b59649a49f1d tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Acquiring lock "84bae51e-2a85-442d-bbd2-fc89f30f40b7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:26:25 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-da0bef27-21e6-46ba-bee9-b59649a49f1d tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Lock "84bae51e-2a85-442d-bbd2-fc89f30f40b7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:26:25 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-da0bef27-21e6-46ba-bee9-b59649a49f1d tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Lock "84bae51e-2a85-442d-bbd2-fc89f30f40b7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:26:25 user nova-compute[75245]: INFO nova.compute.manager [None req-da0bef27-21e6-46ba-bee9-b59649a49f1d tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Terminating instance
Nov 29 16:26:25 user nova-compute[75245]: DEBUG nova.compute.manager [None req-da0bef27-21e6-46ba-bee9-b59649a49f1d tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Start destroying the instance on the hypervisor. {{(pid=75245) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 16:26:25 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:26:25 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:26:25 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:26:25 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:26:26 user nova-compute[75245]: DEBUG nova.compute.manager [req-388278ac-c305-4329-a274-6276be51a618 req-ba2dc9ea-9e84-42fc-8a92-6c57ed44f4c4 service nova] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Received event network-vif-unplugged-27fc0374-0770-4171-a730-6696b09362eb {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:26:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-388278ac-c305-4329-a274-6276be51a618 req-ba2dc9ea-9e84-42fc-8a92-6c57ed44f4c4 service nova] Acquiring lock "84bae51e-2a85-442d-bbd2-fc89f30f40b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:26:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-388278ac-c305-4329-a274-6276be51a618 req-ba2dc9ea-9e84-42fc-8a92-6c57ed44f4c4 service nova] Lock "84bae51e-2a85-442d-bbd2-fc89f30f40b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:26:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-388278ac-c305-4329-a274-6276be51a618 req-ba2dc9ea-9e84-42fc-8a92-6c57ed44f4c4 service nova] Lock "84bae51e-2a85-442d-bbd2-fc89f30f40b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:26:26 user nova-compute[75245]: DEBUG nova.compute.manager [req-388278ac-c305-4329-a274-6276be51a618 req-ba2dc9ea-9e84-42fc-8a92-6c57ed44f4c4 service nova] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] No waiting events found dispatching network-vif-unplugged-27fc0374-0770-4171-a730-6696b09362eb {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:26:26 user nova-compute[75245]: DEBUG nova.compute.manager [req-388278ac-c305-4329-a274-6276be51a618 req-ba2dc9ea-9e84-42fc-8a92-6c57ed44f4c4 service nova] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Received event network-vif-unplugged-27fc0374-0770-4171-a730-6696b09362eb for instance with task_state deleting. {{(pid=75245) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 16:26:26 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-c7da57dc-8cdd-479f-b030-d92a0c51b4d0 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:26:26 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7da57dc-8cdd-479f-b030-d92a0c51b4d0 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '26435666565353738', 'path': '/dev/sdf'} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:26:26 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7da57dc-8cdd-479f-b030-d92a0c51b4d0 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26435666565353738', 'path': '/dev/sdf'} {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 16:26:26 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:26:26 user nova-compute[75245]: DEBUG nova.objects.instance [None req-c7da57dc-8cdd-479f-b030-d92a0c51b4d0 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lazy-loading 'flavor' on Instance uuid 0b629ca7-b69e-471c-a7b0-9eb43301c36f {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:26:26 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-c7da57dc-8cdd-479f-b030-d92a0c51b4d0 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 16:26:26 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:26:26 user nova-compute[75245]:   <source dev="/dev/sdf"/>
Nov 29 16:26:26 user nova-compute[75245]:   <target dev="vdb" bus="virtio"/>
Nov 29 16:26:26 user nova-compute[75245]:   <serial>38349e5b-ff4e-436e-8072-9fb91dc48c75</serial>
Nov 29 16:26:26 user nova-compute[75245]: </disk>
Nov 29 16:26:26 user nova-compute[75245]:  {{(pid=75245) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 16:26:26 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:26:26 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:26:26 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Instance destroyed successfully.
Nov 29 16:26:26 user nova-compute[75245]: DEBUG nova.objects.instance [None req-da0bef27-21e6-46ba-bee9-b59649a49f1d tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Lazy-loading 'resources' on Instance uuid 84bae51e-2a85-442d-bbd2-fc89f30f40b7 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:26:26 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-da0bef27-21e6-46ba-bee9-b59649a49f1d tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:17:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-185985516',display_name='tempest-ServerActionsTestOtherB-server-185985516',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-185985516',id=20,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMGVVYk91CF4EJNlPGJ16B9aebX0g0461zoNkayBpAbBcPtumcB5nsUcunIZSLwTkPZC3DIGJ81mZLNGLk1xqtQ18lArBUMtmLGCUS7pb+CbAh4z22M0J6OlcUXZFjAglA==',key_name='tempest-keypair-1103342865',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:23:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3c018212e0654c4db442ca65a386f397',ramdisk_id='',reservation_id='r-rarysz12',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1446057763',owner_user_name='tempest-ServerActionsTestOtherB-1446057763-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:23:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecd08c449e8643c2b0eb4b2dc8cd7780',uuid=84bae51e-2a85-442d-bbd2-fc89f30f40b7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "27fc0374-0770-4171-a730-6696b09362eb", "address": "fa:16:3e:d1:e4:30", "network": {"id": "e38d9eed-b29b-4a4c-b084-876554dc5263", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1284740336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c018212e0654c4db442ca65a386f397", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27fc0374-07", "ovs_interfaceid": "27fc0374-0770-4171-a730-6696b09362eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 16:26:26 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-da0bef27-21e6-46ba-bee9-b59649a49f1d tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Converting VIF {"id": "27fc0374-0770-4171-a730-6696b09362eb", "address": "fa:16:3e:d1:e4:30", "network": {"id": "e38d9eed-b29b-4a4c-b084-876554dc5263", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1284740336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c018212e0654c4db442ca65a386f397", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27fc0374-07", "ovs_interfaceid": "27fc0374-0770-4171-a730-6696b09362eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:26:26 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-da0bef27-21e6-46ba-bee9-b59649a49f1d tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d1:e4:30,bridge_name='br-int',has_traffic_filtering=True,id=27fc0374-0770-4171-a730-6696b09362eb,network=Network(e38d9eed-b29b-4a4c-b084-876554dc5263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27fc0374-07') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:26:26 user nova-compute[75245]: DEBUG os_vif [None req-da0bef27-21e6-46ba-bee9-b59649a49f1d tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:e4:30,bridge_name='br-int',has_traffic_filtering=True,id=27fc0374-0770-4171-a730-6696b09362eb,network=Network(e38d9eed-b29b-4a4c-b084-876554dc5263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27fc0374-07') {{(pid=75245) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 16:26:26 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:26:26 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap27fc0374-07, bridge=br-int, if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:26:26 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:26:26 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:26:26 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:26:26 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b3cd1759-9823-480a-88d7-6bd2f0dd5ae6) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:26:26 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:26:26 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:26:26 user nova-compute[75245]: INFO os_vif [None req-da0bef27-21e6-46ba-bee9-b59649a49f1d tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:e4:30,bridge_name='br-int',has_traffic_filtering=True,id=27fc0374-0770-4171-a730-6696b09362eb,network=Network(e38d9eed-b29b-4a4c-b084-876554dc5263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27fc0374-07')
Nov 29 16:26:26 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da0bef27-21e6-46ba-bee9-b59649a49f1d tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] calling os-brick to detach iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 16:26:26 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-da0bef27-21e6-46ba-bee9-b59649a49f1d tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, {'target_iqn': 'iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UPxkSWMT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:26:26 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-da0bef27-21e6-46ba-bee9-b59649a49f1d tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:26:26 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-da0bef27-21e6-46ba-bee9-b59649a49f1d tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:26:26 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-da0bef27-21e6-46ba-bee9-b59649a49f1d tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:26:26 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:26:26 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-c7da57dc-8cdd-479f-b030-d92a0c51b4d0 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:26:26 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-c7da57dc-8cdd-479f-b030-d92a0c51b4d0 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:26:26 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-c7da57dc-8cdd-479f-b030-d92a0c51b4d0 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] No VIF found with MAC fa:16:3e:90:6c:6b, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:26:26 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.086s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:26:26 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f4a65c8-a646-48d8-b3a0-d7f6bc4a35f2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:26:26 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-da0bef27-21e6-46ba-bee9-b59649a49f1d tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 16:26:26 user nova-compute[75245]: No targets found.
Nov 29 16:26:26 user nova-compute[75245]: iSNS:
Nov 29 16:26:26 user nova-compute[75245]: No targets found.
Nov 29 16:26:26 user nova-compute[75245]: STATIC:
Nov 29 16:26:26 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e
Nov 29 16:26:26 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:26:26 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:26:26 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024
Nov 29 16:26:26 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:26:26 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:26:26 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed
Nov 29 16:26:26 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:26:26 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:26:26 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75
Nov 29 16:26:26 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:26:26 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:26:26 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f
Nov 29 16:26:26 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:26:26 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:26:26 user nova-compute[75245]: FIRMWARE:
Nov 29 16:26:26 user nova-compute[75245]: No targets found.
Nov 29 16:26:26 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:26:26 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-da0bef27-21e6-46ba-bee9-b59649a49f1d tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 16:26:26 user nova-compute[75245]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 16:26:26 user nova-compute[75245]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75245) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 16:26:26 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-da0bef27-21e6-46ba-bee9-b59649a49f1d tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e', 0)] {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 16:26:27 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:26:27 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:26:27 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a7a6203-63b2-4a4d-b482-f2d1c730c6a6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:26:27 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:26:27 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:26:27 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb03425-f87c-40ef-ae5b-615ee838a36e]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:26:27 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-da0bef27-21e6-46ba-bee9-b59649a49f1d tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)
Nov 29 16:26:27 user nova-compute[75245]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f (non-flash)
Nov 29 16:26:27 user nova-compute[75245]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e (non-flash)
Nov 29 16:26:27 user nova-compute[75245]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 (non-flash)
Nov 29 16:26:27 user nova-compute[75245]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75 (non-flash)
Nov 29 16:26:27 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:26:27 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-da0bef27-21e6-46ba-bee9-b59649a49f1d tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)
Nov 29 16:26:27 user nova-compute[75245]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f (non-flash)
Nov 29 16:26:27 user nova-compute[75245]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e (non-flash)
Nov 29 16:26:27 user nova-compute[75245]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 (non-flash)
Nov 29 16:26:27 user nova-compute[75245]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75 (non-flash)
Nov 29 16:26:27 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:26:27 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-da0bef27-21e6-46ba-bee9-b59649a49f1d tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0d4c1dbeb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e'): ({'sdc'}, set())}) {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 16:26:27 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-da0bef27-21e6-46ba-bee9-b59649a49f1d tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Removing single pathed devices sdc {{(pid=75245) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 16:26:27 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:26:27 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:26:27 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2b38b7-c135-4003-835a-f41e75bf4f95]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:26:27 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:26:27 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:26:27 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a27c6f-9006-4ecd-ad9f-d2fc18ac768e]: (4, ('ok\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:26:27 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-da0bef27-21e6-46ba-bee9-b59649a49f1d tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Flushing IO for device /dev/sdc {{(pid=75245) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 16:26:27 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:26:27 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:26:27 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[e529ac52-6f16-4656-bf69-362274be0ceb]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:26:27 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-da0bef27-21e6-46ba-bee9-b59649a49f1d tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75245) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 16:26:27 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:26:27 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-c7da57dc-8cdd-479f-b030-d92a0c51b4d0 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lock "0b629ca7-b69e-471c-a7b0-9eb43301c36f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.309s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:26:27 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:26:27 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[963fd1f4-faeb-4646-b58e-e7a14a76d92a]: (4, ('1', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:26:27 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-da0bef27-21e6-46ba-bee9-b59649a49f1d tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 16:26:27 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-da0bef27-21e6-46ba-bee9-b59649a49f1d tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] SCSI volumes sdc have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 16:26:27 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-da0bef27-21e6-46ba-bee9-b59649a49f1d tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e')] {{(pid=75245) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 16:26:27 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:26:27 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:26:27 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ca1e0c-503a-4beb-a34d-712d4d6e4903]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:26:27 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-da0bef27-21e6-46ba-bee9-b59649a49f1d tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:26:27 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e -p 172.16.0.220:3260 --logout {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:26:27 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:26:27 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f89ab3-8778-461d-bf37-2ed8e40116ec]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:26:27 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-da0bef27-21e6-46ba-bee9-b59649a49f1d tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e, portal: 172.16.0.220,3260]
Nov 29 16:26:27 user nova-compute[75245]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e, portal: 172.16.0.220,3260] successful.
Nov 29 16:26:27 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:26:27 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e -p 172.16.0.220:3260 --op delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:26:27 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0534d649-6af0-440a-86de-eadff936597e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:26:27 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a45723-c8c1-4850-ac43-7e693347517c]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:26:27 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-da0bef27-21e6-46ba-bee9-b59649a49f1d tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:26:27 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-da0bef27-21e6-46ba-bee9-b59649a49f1d tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.389s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:26:27 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-da0bef27-21e6-46ba-bee9-b59649a49f1d tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] <== disconnect_volume: return (390ms) None {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:26:27 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da0bef27-21e6-46ba-bee9-b59649a49f1d tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Disconnected iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 16:26:27 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-da0bef27-21e6-46ba-bee9-b59649a49f1d tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Deleting instance files /opt/stack/data/nova/instances/84bae51e-2a85-442d-bbd2-fc89f30f40b7_del
Nov 29 16:26:27 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-da0bef27-21e6-46ba-bee9-b59649a49f1d tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Deletion of /opt/stack/data/nova/instances/84bae51e-2a85-442d-bbd2-fc89f30f40b7_del complete
Nov 29 16:26:27 user nova-compute[75245]: INFO nova.compute.manager [None req-da0bef27-21e6-46ba-bee9-b59649a49f1d tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Took 1.60 seconds to destroy the instance on the hypervisor.
Nov 29 16:26:27 user nova-compute[75245]: DEBUG oslo.service.loopingcall [None req-da0bef27-21e6-46ba-bee9-b59649a49f1d tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75245) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 16:26:27 user nova-compute[75245]: DEBUG nova.compute.manager [-] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Deallocating network for instance {{(pid=75245) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 16:26:27 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] deallocate_for_instance() {{(pid=75245) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 16:26:27 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-310b8711-c012-46a2-bdf4-bd97de3f81ec tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Acquiring lock "0b629ca7-b69e-471c-a7b0-9eb43301c36f" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:26:27 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-310b8711-c012-46a2-bdf4-bd97de3f81ec tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lock "0b629ca7-b69e-471c-a7b0-9eb43301c36f" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:26:27 user nova-compute[75245]: DEBUG nova.compute.manager [None req-310b8711-c012-46a2-bdf4-bd97de3f81ec tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:26:27 user nova-compute[75245]: DEBUG nova.compute.manager [None req-310b8711-c012-46a2-bdf4-bd97de3f81ec tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75245) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 29 16:26:27 user nova-compute[75245]: DEBUG nova.objects.instance [None req-310b8711-c012-46a2-bdf4-bd97de3f81ec tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lazy-loading 'flavor' on Instance uuid 0b629ca7-b69e-471c-a7b0-9eb43301c36f {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:26:27 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:26:27 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:26:27 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:26:27 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:26:28 user nova-compute[75245]: DEBUG nova.compute.manager [req-c25e0bcd-cbeb-424a-b1a6-ae5f08fb33e6 req-c6377091-5e38-4638-bac7-cababb950d2e service nova] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Received event network-vif-plugged-27fc0374-0770-4171-a730-6696b09362eb {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:26:28 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-c25e0bcd-cbeb-424a-b1a6-ae5f08fb33e6 req-c6377091-5e38-4638-bac7-cababb950d2e service nova] Acquiring lock "84bae51e-2a85-442d-bbd2-fc89f30f40b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:26:28 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-c25e0bcd-cbeb-424a-b1a6-ae5f08fb33e6 req-c6377091-5e38-4638-bac7-cababb950d2e service nova] Lock "84bae51e-2a85-442d-bbd2-fc89f30f40b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:26:28 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-c25e0bcd-cbeb-424a-b1a6-ae5f08fb33e6 req-c6377091-5e38-4638-bac7-cababb950d2e service nova] Lock "84bae51e-2a85-442d-bbd2-fc89f30f40b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:26:28 user nova-compute[75245]: DEBUG nova.compute.manager [req-c25e0bcd-cbeb-424a-b1a6-ae5f08fb33e6 req-c6377091-5e38-4638-bac7-cababb950d2e service nova] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] No waiting events found dispatching network-vif-plugged-27fc0374-0770-4171-a730-6696b09362eb {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:26:28 user nova-compute[75245]: WARNING nova.compute.manager [req-c25e0bcd-cbeb-424a-b1a6-ae5f08fb33e6 req-c6377091-5e38-4638-bac7-cababb950d2e service nova] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Received unexpected event network-vif-plugged-27fc0374-0770-4171-a730-6696b09362eb for instance with vm_state active and task_state deleting.
Nov 29 16:26:28 user nova-compute[75245]: DEBUG nova.compute.manager [req-c25e0bcd-cbeb-424a-b1a6-ae5f08fb33e6 req-c6377091-5e38-4638-bac7-cababb950d2e service nova] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Received event network-vif-unplugged-6d28be36-e00b-4f84-9a2b-60515f2e65a1 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:26:28 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-c25e0bcd-cbeb-424a-b1a6-ae5f08fb33e6 req-c6377091-5e38-4638-bac7-cababb950d2e service nova] Acquiring lock "0b629ca7-b69e-471c-a7b0-9eb43301c36f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:26:28 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-c25e0bcd-cbeb-424a-b1a6-ae5f08fb33e6 req-c6377091-5e38-4638-bac7-cababb950d2e service nova] Lock "0b629ca7-b69e-471c-a7b0-9eb43301c36f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:26:28 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-c25e0bcd-cbeb-424a-b1a6-ae5f08fb33e6 req-c6377091-5e38-4638-bac7-cababb950d2e service nova] Lock "0b629ca7-b69e-471c-a7b0-9eb43301c36f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:26:28 user nova-compute[75245]: DEBUG nova.compute.manager [req-c25e0bcd-cbeb-424a-b1a6-ae5f08fb33e6 req-c6377091-5e38-4638-bac7-cababb950d2e service nova] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] No waiting events found dispatching network-vif-unplugged-6d28be36-e00b-4f84-9a2b-60515f2e65a1 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:26:28 user nova-compute[75245]: WARNING nova.compute.manager [req-c25e0bcd-cbeb-424a-b1a6-ae5f08fb33e6 req-c6377091-5e38-4638-bac7-cababb950d2e service nova] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Received unexpected event network-vif-unplugged-6d28be36-e00b-4f84-9a2b-60515f2e65a1 for instance with vm_state active and task_state powering-off.
Nov 29 16:26:28 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:26:28 user nova-compute[75245]: INFO nova.compute.manager [-] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Took 0.86 seconds to deallocate network for instance.
Nov 29 16:26:28 user nova-compute[75245]: DEBUG nova.compute.manager [req-20e1c057-3775-41f5-9f1b-6c500165805f req-83deba29-1b50-41fb-897a-eebc61770abd service nova] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Received event network-vif-deleted-27fc0374-0770-4171-a730-6696b09362eb {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:26:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:26:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:26:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:26:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:26:28 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Instance destroyed successfully.
Nov 29 16:26:28 user nova-compute[75245]: DEBUG nova.compute.manager [None req-310b8711-c012-46a2-bdf4-bd97de3f81ec tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:26:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:26:28 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-310b8711-c012-46a2-bdf4-bd97de3f81ec tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lock "0b629ca7-b69e-471c-a7b0-9eb43301c36f" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.844s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:26:29 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:26:29 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:26:29 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:26:29 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:26:29 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:26:29 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:26:29 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:26:29 user nova-compute[75245]: INFO nova.compute.manager [None req-da0bef27-21e6-46ba-bee9-b59649a49f1d tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] [instance: 84bae51e-2a85-442d-bbd2-fc89f30f40b7] Took 1.11 seconds to detach 1 volumes for instance.
Nov 29 16:26:29 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-da0bef27-21e6-46ba-bee9-b59649a49f1d tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:26:29 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-da0bef27-21e6-46ba-bee9-b59649a49f1d tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:26:29 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-da0bef27-21e6-46ba-bee9-b59649a49f1d tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:26:29 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-da0bef27-21e6-46ba-bee9-b59649a49f1d tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:26:29 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-da0bef27-21e6-46ba-bee9-b59649a49f1d tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.281s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:26:29 user nova-compute[75245]: INFO nova.scheduler.client.report [None req-da0bef27-21e6-46ba-bee9-b59649a49f1d tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Deleted allocations for instance 84bae51e-2a85-442d-bbd2-fc89f30f40b7
Nov 29 16:26:29 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-da0bef27-21e6-46ba-bee9-b59649a49f1d tempest-ServerActionsTestOtherB-1446057763 tempest-ServerActionsTestOtherB-1446057763-project-member] Lock "84bae51e-2a85-442d-bbd2-fc89f30f40b7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.077s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:26:30 user nova-compute[75245]: DEBUG nova.compute.manager [req-1becdd64-5e7b-459d-8fb0-b9e621ed644e req-846b983f-f4be-4705-8bab-44b08f8870e3 service nova] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Received event network-vif-plugged-6d28be36-e00b-4f84-9a2b-60515f2e65a1 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:26:30 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-1becdd64-5e7b-459d-8fb0-b9e621ed644e req-846b983f-f4be-4705-8bab-44b08f8870e3 service nova] Acquiring lock "0b629ca7-b69e-471c-a7b0-9eb43301c36f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:26:30 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-1becdd64-5e7b-459d-8fb0-b9e621ed644e req-846b983f-f4be-4705-8bab-44b08f8870e3 service nova] Lock "0b629ca7-b69e-471c-a7b0-9eb43301c36f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:26:30 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-1becdd64-5e7b-459d-8fb0-b9e621ed644e req-846b983f-f4be-4705-8bab-44b08f8870e3 service nova] Lock "0b629ca7-b69e-471c-a7b0-9eb43301c36f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:26:30 user nova-compute[75245]: DEBUG nova.compute.manager [req-1becdd64-5e7b-459d-8fb0-b9e621ed644e req-846b983f-f4be-4705-8bab-44b08f8870e3 service nova] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] No waiting events found dispatching network-vif-plugged-6d28be36-e00b-4f84-9a2b-60515f2e65a1 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:26:30 user nova-compute[75245]: WARNING nova.compute.manager [req-1becdd64-5e7b-459d-8fb0-b9e621ed644e req-846b983f-f4be-4705-8bab-44b08f8870e3 service nova] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Received unexpected event network-vif-plugged-6d28be36-e00b-4f84-9a2b-60515f2e65a1 for instance with vm_state stopped and task_state None.
Nov 29 16:26:31 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:26:36 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:26:38 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:26:39 user nova-compute[75245]: DEBUG nova.compute.manager [req-2c53cec5-4336-45fd-b9f9-9cbb9b64f7ed req-85cbda30-8992-440b-9206-88900578a0be service nova] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Received event network-changed-467a0f1e-1ad6-4474-bbcb-dadad3ea69ab {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:26:39 user nova-compute[75245]: DEBUG nova.compute.manager [req-2c53cec5-4336-45fd-b9f9-9cbb9b64f7ed req-85cbda30-8992-440b-9206-88900578a0be service nova] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Refreshing instance network info cache due to event network-changed-467a0f1e-1ad6-4474-bbcb-dadad3ea69ab. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:26:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-2c53cec5-4336-45fd-b9f9-9cbb9b64f7ed req-85cbda30-8992-440b-9206-88900578a0be service nova] Acquiring lock "refresh_cache-4f7fb562-a698-4fc9-91b0-c786627f6d75" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:26:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-2c53cec5-4336-45fd-b9f9-9cbb9b64f7ed req-85cbda30-8992-440b-9206-88900578a0be service nova] Acquired lock "refresh_cache-4f7fb562-a698-4fc9-91b0-c786627f6d75" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:26:39 user nova-compute[75245]: DEBUG nova.network.neutron [req-2c53cec5-4336-45fd-b9f9-9cbb9b64f7ed req-85cbda30-8992-440b-9206-88900578a0be service nova] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Refreshing network info cache for port 467a0f1e-1ad6-4474-bbcb-dadad3ea69ab {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:26:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d14e4f8a-b07e-4d4d-9583-2c7b31f617f9 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Acquiring lock "4f7fb562-a698-4fc9-91b0-c786627f6d75" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:26:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d14e4f8a-b07e-4d4d-9583-2c7b31f617f9 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Lock "4f7fb562-a698-4fc9-91b0-c786627f6d75" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:26:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d14e4f8a-b07e-4d4d-9583-2c7b31f617f9 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Acquiring lock "4f7fb562-a698-4fc9-91b0-c786627f6d75-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:26:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d14e4f8a-b07e-4d4d-9583-2c7b31f617f9 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Lock "4f7fb562-a698-4fc9-91b0-c786627f6d75-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:26:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d14e4f8a-b07e-4d4d-9583-2c7b31f617f9 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Lock "4f7fb562-a698-4fc9-91b0-c786627f6d75-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:26:39 user nova-compute[75245]: INFO nova.compute.manager [None req-d14e4f8a-b07e-4d4d-9583-2c7b31f617f9 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Terminating instance
Nov 29 16:26:39 user nova-compute[75245]: DEBUG nova.compute.manager [None req-d14e4f8a-b07e-4d4d-9583-2c7b31f617f9 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Start destroying the instance on the hypervisor. {{(pid=75245) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 16:26:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:26:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:26:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:26:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:26:39 user nova-compute[75245]: DEBUG nova.network.neutron [req-2c53cec5-4336-45fd-b9f9-9cbb9b64f7ed req-85cbda30-8992-440b-9206-88900578a0be service nova] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Updated VIF entry in instance network info cache for port 467a0f1e-1ad6-4474-bbcb-dadad3ea69ab. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:26:39 user nova-compute[75245]: DEBUG nova.network.neutron [req-2c53cec5-4336-45fd-b9f9-9cbb9b64f7ed req-85cbda30-8992-440b-9206-88900578a0be service nova] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Updating instance_info_cache with network_info: [{"id": "467a0f1e-1ad6-4474-bbcb-dadad3ea69ab", "address": "fa:16:3e:ab:27:73", "network": {"id": "1869d0f1-8115-44c6-b5d4-42e362716749", "bridge": "br-int", "label": "tempest-TestShelveInstance-1207362046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bd57c6933c04f5a9ec5e27eb8bce661", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap467a0f1e-1a", "ovs_interfaceid": "467a0f1e-1ad6-4474-bbcb-dadad3ea69ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:26:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-2c53cec5-4336-45fd-b9f9-9cbb9b64f7ed req-85cbda30-8992-440b-9206-88900578a0be service nova] Releasing lock "refresh_cache-4f7fb562-a698-4fc9-91b0-c786627f6d75" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:26:39 user nova-compute[75245]: DEBUG nova.compute.manager [req-78a88c03-b9bf-44f2-937a-85429d9ac91e req-57bc23ab-183e-4469-8fce-be76bfd8e665 service nova] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Received event network-vif-unplugged-467a0f1e-1ad6-4474-bbcb-dadad3ea69ab {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:26:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-78a88c03-b9bf-44f2-937a-85429d9ac91e req-57bc23ab-183e-4469-8fce-be76bfd8e665 service nova] Acquiring lock "4f7fb562-a698-4fc9-91b0-c786627f6d75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:26:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-78a88c03-b9bf-44f2-937a-85429d9ac91e req-57bc23ab-183e-4469-8fce-be76bfd8e665 service nova] Lock "4f7fb562-a698-4fc9-91b0-c786627f6d75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:26:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-78a88c03-b9bf-44f2-937a-85429d9ac91e req-57bc23ab-183e-4469-8fce-be76bfd8e665 service nova] Lock "4f7fb562-a698-4fc9-91b0-c786627f6d75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:26:39 user nova-compute[75245]: DEBUG nova.compute.manager [req-78a88c03-b9bf-44f2-937a-85429d9ac91e req-57bc23ab-183e-4469-8fce-be76bfd8e665 service nova] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] No waiting events found dispatching network-vif-unplugged-467a0f1e-1ad6-4474-bbcb-dadad3ea69ab {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:26:39 user nova-compute[75245]: DEBUG nova.compute.manager [req-78a88c03-b9bf-44f2-937a-85429d9ac91e req-57bc23ab-183e-4469-8fce-be76bfd8e665 service nova] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Received event network-vif-unplugged-467a0f1e-1ad6-4474-bbcb-dadad3ea69ab for instance with task_state deleting. {{(pid=75245) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 16:26:40 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:26:40 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:26:40 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Instance destroyed successfully.
Nov 29 16:26:40 user nova-compute[75245]: DEBUG nova.objects.instance [None req-d14e4f8a-b07e-4d4d-9583-2c7b31f617f9 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Lazy-loading 'resources' on Instance uuid 4f7fb562-a698-4fc9-91b0-c786627f6d75 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:26:40 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-d14e4f8a-b07e-4d4d-9583-2c7b31f617f9 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T16:21:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1369972773',display_name='tempest-TestShelveInstance-server-1369972773',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1369972773',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLE7nr47G8CHHLOTmQq/XixPARJFpOT+HvuTUIzQWMmpzlpPoy+l6Oj2zJ7pst+CAggF8656bQlmnmYfbIcrkf9PnEB/N+Dql4y/VnBwqBg2qMznC5qDYlg7sEsaYBgGjA==',key_name='tempest-TestShelveInstance-1582200683',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:25:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5bd57c6933c04f5a9ec5e27eb8bce661',ramdisk_id='',reservation_id='r-058m537p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1248422115',owner_user_name='tempest-TestShelveInstance-1248422115-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:25:02Z,user_data=None,user_id='a271b4251cd64c5c8d5bf8e73e365624',uuid=4f7fb562-a698-4fc9-91b0-c786627f6d75,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "467a0f1e-1ad6-4474-bbcb-dadad3ea69ab", "address": "fa:16:3e:ab:27:73", "network": {"id": "1869d0f1-8115-44c6-b5d4-42e362716749", "bridge": "br-int", "label": "tempest-TestShelveInstance-1207362046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bd57c6933c04f5a9ec5e27eb8bce661", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap467a0f1e-1a", "ovs_interfaceid": "467a0f1e-1ad6-4474-bbcb-dadad3ea69ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 16:26:40 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-d14e4f8a-b07e-4d4d-9583-2c7b31f617f9 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Converting VIF {"id": "467a0f1e-1ad6-4474-bbcb-dadad3ea69ab", "address": "fa:16:3e:ab:27:73", "network": {"id": "1869d0f1-8115-44c6-b5d4-42e362716749", "bridge": "br-int", "label": "tempest-TestShelveInstance-1207362046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bd57c6933c04f5a9ec5e27eb8bce661", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap467a0f1e-1a", "ovs_interfaceid": "467a0f1e-1ad6-4474-bbcb-dadad3ea69ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:26:40 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-d14e4f8a-b07e-4d4d-9583-2c7b31f617f9 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:27:73,bridge_name='br-int',has_traffic_filtering=True,id=467a0f1e-1ad6-4474-bbcb-dadad3ea69ab,network=Network(1869d0f1-8115-44c6-b5d4-42e362716749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap467a0f1e-1a') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:26:40 user nova-compute[75245]: DEBUG os_vif [None req-d14e4f8a-b07e-4d4d-9583-2c7b31f617f9 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:27:73,bridge_name='br-int',has_traffic_filtering=True,id=467a0f1e-1ad6-4474-bbcb-dadad3ea69ab,network=Network(1869d0f1-8115-44c6-b5d4-42e362716749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap467a0f1e-1a') {{(pid=75245) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 16:26:40 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:26:40 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap467a0f1e-1a, bridge=br-int, if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:26:40 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:26:40 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:26:40 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:26:40 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=af069662-d236-40af-b057-07198a02936e) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:26:40 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:26:40 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:26:40 user nova-compute[75245]: INFO os_vif [None req-d14e4f8a-b07e-4d4d-9583-2c7b31f617f9 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:27:73,bridge_name='br-int',has_traffic_filtering=True,id=467a0f1e-1ad6-4474-bbcb-dadad3ea69ab,network=Network(1869d0f1-8115-44c6-b5d4-42e362716749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap467a0f1e-1a')
Nov 29 16:26:40 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d14e4f8a-b07e-4d4d-9583-2c7b31f617f9 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] calling os-brick to detach iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 16:26:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-d14e4f8a-b07e-4d4d-9583-2c7b31f617f9 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, {'target_iqn': 'iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hfwlIuBG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:26:40 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-d14e4f8a-b07e-4d4d-9583-2c7b31f617f9 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:26:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-d14e4f8a-b07e-4d4d-9583-2c7b31f617f9 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:26:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-d14e4f8a-b07e-4d4d-9583-2c7b31f617f9 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:26:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:26:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:26:40 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[03220e65-64cd-4bfc-9031-bc6279a3d956]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:26:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-d14e4f8a-b07e-4d4d-9583-2c7b31f617f9 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 16:26:40 user nova-compute[75245]: No targets found.
Nov 29 16:26:40 user nova-compute[75245]: iSNS:
Nov 29 16:26:40 user nova-compute[75245]: No targets found.
Nov 29 16:26:40 user nova-compute[75245]: STATIC:
Nov 29 16:26:40 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024
Nov 29 16:26:40 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:26:40 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:26:40 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed
Nov 29 16:26:40 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:26:40 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:26:40 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75
Nov 29 16:26:40 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:26:40 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:26:40 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f
Nov 29 16:26:40 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:26:40 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:26:40 user nova-compute[75245]: FIRMWARE:
Nov 29 16:26:40 user nova-compute[75245]: No targets found.
Nov 29 16:26:40 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:26:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-d14e4f8a-b07e-4d4d-9583-2c7b31f617f9 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 16:26:40 user nova-compute[75245]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 16:26:40 user nova-compute[75245]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75245) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 16:26:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-d14e4f8a-b07e-4d4d-9583-2c7b31f617f9 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024', 0)] {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 16:26:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:26:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:26:40 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[899ba63c-acc4-4d26-963a-606d2c32884c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:26:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:26:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:26:40 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f180c2-0d85-4c5f-a27b-bc0720693489]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:26:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-d14e4f8a-b07e-4d4d-9583-2c7b31f617f9 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)
Nov 29 16:26:40 user nova-compute[75245]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f (non-flash)
Nov 29 16:26:40 user nova-compute[75245]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 (non-flash)
Nov 29 16:26:40 user nova-compute[75245]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75 (non-flash)
Nov 29 16:26:40 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:26:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-d14e4f8a-b07e-4d4d-9583-2c7b31f617f9 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)
Nov 29 16:26:40 user nova-compute[75245]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f (non-flash)
Nov 29 16:26:40 user nova-compute[75245]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 (non-flash)
Nov 29 16:26:40 user nova-compute[75245]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75 (non-flash)
Nov 29 16:26:40 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:26:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-d14e4f8a-b07e-4d4d-9583-2c7b31f617f9 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0d20781090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024'): ({'sdd'}, set())}) {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 16:26:40 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-d14e4f8a-b07e-4d4d-9583-2c7b31f617f9 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Removing single pathed devices sdd {{(pid=75245) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 16:26:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:26:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:26:40 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[249c83c2-2e72-4d8d-a987-779fc995751f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:26:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:26:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:26:40 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[b80c2e24-732c-4693-9b99-a343c485c259]: (4, ('ok\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:26:40 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-d14e4f8a-b07e-4d4d-9583-2c7b31f617f9 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Flushing IO for device /dev/sdd {{(pid=75245) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 16:26:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:26:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:26:40 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aad3aff-89b1-4a75-bb4a-6b26471190e4]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:26:40 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-d14e4f8a-b07e-4d4d-9583-2c7b31f617f9 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75245) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 16:26:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:26:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:26:40 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[0216e4f8-c4f5-4387-8b75-aa1e68b2dcc2]: (4, ('1', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:26:40 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-d14e4f8a-b07e-4d4d-9583-2c7b31f617f9 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 16:26:40 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-d14e4f8a-b07e-4d4d-9583-2c7b31f617f9 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] SCSI volumes sdd have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 16:26:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-d14e4f8a-b07e-4d4d-9583-2c7b31f617f9 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024')] {{(pid=75245) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 16:26:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:26:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:26:40 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ade2e4-76e0-438b-8d87-4fb55dec7da3]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:26:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-d14e4f8a-b07e-4d4d-9583-2c7b31f617f9 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:26:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 -p 172.16.0.220:3260 --logout {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:26:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:26:40 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef0ae66-8787-4b0b-a68b-64c0fdcf1aaa]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:26:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-d14e4f8a-b07e-4d4d-9583-2c7b31f617f9 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024, portal: 172.16.0.220,3260]
Nov 29 16:26:40 user nova-compute[75245]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024, portal: 172.16.0.220,3260] successful.
Nov 29 16:26:40 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:26:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 -p 172.16.0.220:3260 --op delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:26:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a87461eb-363d-43eb-94cb-4f69edc13024 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:26:40 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b751f6f-83fa-40c2-8361-41f94db7d6e2]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:26:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-d14e4f8a-b07e-4d4d-9583-2c7b31f617f9 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:26:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-d14e4f8a-b07e-4d4d-9583-2c7b31f617f9 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:26:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-d14e4f8a-b07e-4d4d-9583-2c7b31f617f9 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] <== disconnect_volume: return (311ms) None {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:26:40 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d14e4f8a-b07e-4d4d-9583-2c7b31f617f9 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Disconnected iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 16:26:40 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-d14e4f8a-b07e-4d4d-9583-2c7b31f617f9 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Deleting instance files /opt/stack/data/nova/instances/4f7fb562-a698-4fc9-91b0-c786627f6d75_del
Nov 29 16:26:40 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-d14e4f8a-b07e-4d4d-9583-2c7b31f617f9 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Deletion of /opt/stack/data/nova/instances/4f7fb562-a698-4fc9-91b0-c786627f6d75_del complete
Nov 29 16:26:40 user nova-compute[75245]: INFO nova.compute.manager [None req-d14e4f8a-b07e-4d4d-9583-2c7b31f617f9 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 29 16:26:40 user nova-compute[75245]: DEBUG oslo.service.loopingcall [None req-d14e4f8a-b07e-4d4d-9583-2c7b31f617f9 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75245) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 16:26:40 user nova-compute[75245]: DEBUG nova.compute.manager [-] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Deallocating network for instance {{(pid=75245) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 16:26:40 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] deallocate_for_instance() {{(pid=75245) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 16:26:40 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:26:40 user nova-compute[75245]: INFO nova.compute.manager [-] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Took 0.44 seconds to deallocate network for instance.
Nov 29 16:26:40 user nova-compute[75245]: DEBUG nova.compute.manager [req-98e611ba-83a7-4083-ac76-8aca250ddea0 req-ba81ef59-4ca1-49d7-8577-be44d755b4c5 service nova] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Received event network-vif-deleted-467a0f1e-1ad6-4474-bbcb-dadad3ea69ab {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:26:40 user nova-compute[75245]: INFO nova.compute.manager [req-98e611ba-83a7-4083-ac76-8aca250ddea0 req-ba81ef59-4ca1-49d7-8577-be44d755b4c5 service nova] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Neutron deleted interface 467a0f1e-1ad6-4474-bbcb-dadad3ea69ab; detaching it from the instance and deleting it from the info cache
Nov 29 16:26:40 user nova-compute[75245]: DEBUG nova.network.neutron [req-98e611ba-83a7-4083-ac76-8aca250ddea0 req-ba81ef59-4ca1-49d7-8577-be44d755b4c5 service nova] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:26:40 user nova-compute[75245]: DEBUG nova.compute.manager [req-98e611ba-83a7-4083-ac76-8aca250ddea0 req-ba81ef59-4ca1-49d7-8577-be44d755b4c5 service nova] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Detach interface failed, port_id=467a0f1e-1ad6-4474-bbcb-dadad3ea69ab, reason: Instance 4f7fb562-a698-4fc9-91b0-c786627f6d75 could not be found. {{(pid=75245) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 16:26:41 user nova-compute[75245]: INFO nova.compute.manager [None req-d14e4f8a-b07e-4d4d-9583-2c7b31f617f9 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Took 0.76 seconds to detach 1 volumes for instance.
Nov 29 16:26:41 user nova-compute[75245]: DEBUG nova.compute.manager [None req-d14e4f8a-b07e-4d4d-9583-2c7b31f617f9 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Deleting volume: a87461eb-363d-43eb-94cb-4f69edc13024 {{(pid=75245) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 29 16:26:41 user nova-compute[75245]: DEBUG nova.compute.manager [req-b4dad164-4b82-4744-a250-abe1715dabaf req-4a5f7a30-a55d-44a9-958e-e8fdd8df2cb0 service nova] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Received event network-vif-plugged-467a0f1e-1ad6-4474-bbcb-dadad3ea69ab {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:26:41 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b4dad164-4b82-4744-a250-abe1715dabaf req-4a5f7a30-a55d-44a9-958e-e8fdd8df2cb0 service nova] Acquiring lock "4f7fb562-a698-4fc9-91b0-c786627f6d75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:26:41 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b4dad164-4b82-4744-a250-abe1715dabaf req-4a5f7a30-a55d-44a9-958e-e8fdd8df2cb0 service nova] Lock "4f7fb562-a698-4fc9-91b0-c786627f6d75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:26:41 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b4dad164-4b82-4744-a250-abe1715dabaf req-4a5f7a30-a55d-44a9-958e-e8fdd8df2cb0 service nova] Lock "4f7fb562-a698-4fc9-91b0-c786627f6d75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:26:41 user nova-compute[75245]: DEBUG nova.compute.manager [req-b4dad164-4b82-4744-a250-abe1715dabaf req-4a5f7a30-a55d-44a9-958e-e8fdd8df2cb0 service nova] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] No waiting events found dispatching network-vif-plugged-467a0f1e-1ad6-4474-bbcb-dadad3ea69ab {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:26:41 user nova-compute[75245]: WARNING nova.compute.manager [req-b4dad164-4b82-4744-a250-abe1715dabaf req-4a5f7a30-a55d-44a9-958e-e8fdd8df2cb0 service nova] [instance: 4f7fb562-a698-4fc9-91b0-c786627f6d75] Received unexpected event network-vif-plugged-467a0f1e-1ad6-4474-bbcb-dadad3ea69ab for instance with vm_state active and task_state deleting.
Nov 29 16:26:41 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d14e4f8a-b07e-4d4d-9583-2c7b31f617f9 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:26:41 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d14e4f8a-b07e-4d4d-9583-2c7b31f617f9 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:26:42 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-d14e4f8a-b07e-4d4d-9583-2c7b31f617f9 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:26:42 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-d14e4f8a-b07e-4d4d-9583-2c7b31f617f9 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:26:42 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d14e4f8a-b07e-4d4d-9583-2c7b31f617f9 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.272s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:26:42 user nova-compute[75245]: INFO nova.scheduler.client.report [None req-d14e4f8a-b07e-4d4d-9583-2c7b31f617f9 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Deleted allocations for instance 4f7fb562-a698-4fc9-91b0-c786627f6d75
Nov 29 16:26:42 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d14e4f8a-b07e-4d4d-9583-2c7b31f617f9 tempest-TestShelveInstance-1248422115 tempest-TestShelveInstance-1248422115-project-member] Lock "4f7fb562-a698-4fc9-91b0-c786627f6d75" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.925s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:26:43 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:26:45 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:26:48 user nova-compute[75245]: INFO nova.compute.manager [None req-e169c8a3-c059-42a9-8eb0-360e3a5bbe25 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Rescuing
Nov 29 16:26:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-e169c8a3-c059-42a9-8eb0-360e3a5bbe25 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Acquiring lock "refresh_cache-35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:26:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-e169c8a3-c059-42a9-8eb0-360e3a5bbe25 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Acquired lock "refresh_cache-35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:26:48 user nova-compute[75245]: DEBUG nova.network.neutron [None req-e169c8a3-c059-42a9-8eb0-360e3a5bbe25 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 16:26:48 user nova-compute[75245]: DEBUG nova.network.neutron [None req-e169c8a3-c059-42a9-8eb0-360e3a5bbe25 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Updating instance_info_cache with network_info: [{"id": "545bae30-b03e-41ac-8dd9-f86e85b590d1", "address": "fa:16:3e:26:46:35", "network": {"id": "02098e86-68f8-464e-84ee-bf2fb09b881b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085418471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e12002e1a11f4caf8953371e66e6652e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap545bae30-b0", "ovs_interfaceid": "545bae30-b03e-41ac-8dd9-f86e85b590d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:26:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-e169c8a3-c059-42a9-8eb0-360e3a5bbe25 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Releasing lock "refresh_cache-35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:26:48 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:26:48 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:26:48 user nova-compute[75245]: DEBUG nova.compute.manager [req-714fb175-1648-4f41-80e2-0a0b8ebf5b44 req-0874597e-7a56-4453-a9e0-40b2a883441f service nova] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Received event network-vif-unplugged-545bae30-b03e-41ac-8dd9-f86e85b590d1 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:26:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-714fb175-1648-4f41-80e2-0a0b8ebf5b44 req-0874597e-7a56-4453-a9e0-40b2a883441f service nova] Acquiring lock "35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:26:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-714fb175-1648-4f41-80e2-0a0b8ebf5b44 req-0874597e-7a56-4453-a9e0-40b2a883441f service nova] Lock "35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:26:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-714fb175-1648-4f41-80e2-0a0b8ebf5b44 req-0874597e-7a56-4453-a9e0-40b2a883441f service nova] Lock "35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:26:48 user nova-compute[75245]: DEBUG nova.compute.manager [req-714fb175-1648-4f41-80e2-0a0b8ebf5b44 req-0874597e-7a56-4453-a9e0-40b2a883441f service nova] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] No waiting events found dispatching network-vif-unplugged-545bae30-b03e-41ac-8dd9-f86e85b590d1 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:26:48 user nova-compute[75245]: WARNING nova.compute.manager [req-714fb175-1648-4f41-80e2-0a0b8ebf5b44 req-0874597e-7a56-4453-a9e0-40b2a883441f service nova] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Received unexpected event network-vif-unplugged-545bae30-b03e-41ac-8dd9-f86e85b590d1 for instance with vm_state active and task_state rescuing.
Nov 29 16:26:48 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:26:48 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:26:49 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Instance destroyed successfully.
Nov 29 16:26:49 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-e169c8a3-c059-42a9-8eb0-360e3a5bbe25 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Attempting rescue
Nov 29 16:26:49 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-e169c8a3-c059-42a9-8eb0-360e3a5bbe25 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75245) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 29 16:26:49 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-e169c8a3-c059-42a9-8eb0-360e3a5bbe25 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Instance directory exists: not creating {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 16:26:49 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-e169c8a3-c059-42a9-8eb0-360e3a5bbe25 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Creating image(s)
Nov 29 16:26:49 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-e169c8a3-c059-42a9-8eb0-360e3a5bbe25 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Acquiring lock "/opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:26:49 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-e169c8a3-c059-42a9-8eb0-360e3a5bbe25 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lock "/opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:26:49 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-e169c8a3-c059-42a9-8eb0-360e3a5bbe25 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lock "/opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:26:49 user nova-compute[75245]: DEBUG nova.objects.instance [None req-e169c8a3-c059-42a9-8eb0-360e3a5bbe25 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lazy-loading 'trusted_certs' on Instance uuid 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:26:49 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-e169c8a3-c059-42a9-8eb0-360e3a5bbe25 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Acquiring lock "d654f7206043e05d3525550b0fc885556eb999f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:26:49 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-e169c8a3-c059-42a9-8eb0-360e3a5bbe25 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:26:49 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-e169c8a3-c059-42a9-8eb0-360e3a5bbe25 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:26:49 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-e169c8a3-c059-42a9-8eb0-360e3a5bbe25 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.185s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:26:49 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-e169c8a3-c059-42a9-8eb0-360e3a5bbe25 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk.rescue {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:26:49 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-e169c8a3-c059-42a9-8eb0-360e3a5bbe25 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk.rescue" returned: 0 in 0.048s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:26:49 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-e169c8a3-c059-42a9-8eb0-360e3a5bbe25 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:26:49 user nova-compute[75245]: DEBUG nova.objects.instance [None req-e169c8a3-c059-42a9-8eb0-360e3a5bbe25 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lazy-loading 'migration_context' on Instance uuid 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:26:49 user nova-compute[75245]: DEBUG nova.objects.base [None req-e169c8a3-c059-42a9-8eb0-360e3a5bbe25 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Object Instance<35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75245) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 16:26:49 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-e169c8a3-c059-42a9-8eb0-360e3a5bbe25 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Created local disks {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 16:26:49 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-e169c8a3-c059-42a9-8eb0-360e3a5bbe25 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Start _get_guest_xml network_info=[{"id": "545bae30-b03e-41ac-8dd9-f86e85b590d1", "address": "fa:16:3e:26:46:35", "network": {"id": "02098e86-68f8-464e-84ee-bf2fb09b881b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085418471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2085418471-network", "vif_mac": "fa:16:3e:26:46:35"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e12002e1a11f4caf8953371e66e6652e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap545bae30-b0", "ovs_interfaceid": "545bae30-b03e-41ac-8dd9-f86e85b590d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'a291d9c3-be02-4c6c-9649-4b45c5b7f487', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 16:26:49 user nova-compute[75245]: DEBUG nova.objects.instance [None req-e169c8a3-c059-42a9-8eb0-360e3a5bbe25 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lazy-loading 'resources' on Instance uuid 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:26:49 user nova-compute[75245]: DEBUG nova.objects.base [None req-e169c8a3-c059-42a9-8eb0-360e3a5bbe25 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Object Instance<35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75245) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 16:26:49 user nova-compute[75245]: DEBUG nova.objects.instance [None req-e169c8a3-c059-42a9-8eb0-360e3a5bbe25 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lazy-loading 'numa_topology' on Instance uuid 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:26:49 user nova-compute[75245]: DEBUG nova.objects.base [None req-e169c8a3-c059-42a9-8eb0-360e3a5bbe25 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Object Instance<35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75245) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 16:26:49 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-e169c8a3-c059-42a9-8eb0-360e3a5bbe25 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:26:49 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-e169c8a3-c059-42a9-8eb0-360e3a5bbe25 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:26:49 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-e169c8a3-c059-42a9-8eb0-360e3a5bbe25 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 16:26:49 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-e169c8a3-c059-42a9-8eb0-360e3a5bbe25 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] CPU controller missing on host. {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 16:26:49 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-e169c8a3-c059-42a9-8eb0-360e3a5bbe25 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 16:26:49 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-e169c8a3-c059-42a9-8eb0-360e3a5bbe25 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] CPU controller found on host. {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 16:26:49 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-e169c8a3-c059-42a9-8eb0-360e3a5bbe25 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75245) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 16:26:49 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-e169c8a3-c059-42a9-8eb0-360e3a5bbe25 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T16:06:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 16:26:49 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-e169c8a3-c059-42a9-8eb0-360e3a5bbe25 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Flavor limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 16:26:49 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-e169c8a3-c059-42a9-8eb0-360e3a5bbe25 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Image limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 16:26:49 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-e169c8a3-c059-42a9-8eb0-360e3a5bbe25 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Flavor pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 16:26:49 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-e169c8a3-c059-42a9-8eb0-360e3a5bbe25 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Image pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 16:26:49 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-e169c8a3-c059-42a9-8eb0-360e3a5bbe25 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 16:26:49 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-e169c8a3-c059-42a9-8eb0-360e3a5bbe25 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 16:26:49 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-e169c8a3-c059-42a9-8eb0-360e3a5bbe25 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 16:26:49 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-e169c8a3-c059-42a9-8eb0-360e3a5bbe25 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Got 1 possible topologies {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 16:26:49 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-e169c8a3-c059-42a9-8eb0-360e3a5bbe25 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 16:26:49 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-e169c8a3-c059-42a9-8eb0-360e3a5bbe25 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 16:26:49 user nova-compute[75245]: DEBUG nova.objects.instance [None req-e169c8a3-c059-42a9-8eb0-360e3a5bbe25 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lazy-loading 'vcpu_model' on Instance uuid 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:26:49 user nova-compute[75245]: DEBUG nova.objects.base [None req-e169c8a3-c059-42a9-8eb0-360e3a5bbe25 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Object Instance<35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75245) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 16:26:49 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-e169c8a3-c059-42a9-8eb0-360e3a5bbe25 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:22:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1012702765',display_name='tempest-ServerRescueNegativeTestJSON-server-1012702765',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1012702765',id=25,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:22:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e12002e1a11f4caf8953371e66e6652e',ramdisk_id='',reservation_id='r-vzx9ywrd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1013090395',owner_user_name='tempest-ServerRescueNegativeTestJSON-1013090395-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:22:13Z,user_data=None,user_id='d876b1e244b14a29ad5b4b422135336b',uuid=35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "545bae30-b03e-41ac-8dd9-f86e85b590d1", "address": "fa:16:3e:26:46:35", "network": {"id": "02098e86-68f8-464e-84ee-bf2fb09b881b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085418471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2085418471-network", "vif_mac": "fa:16:3e:26:46:35"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e12002e1a11f4caf8953371e66e6652e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap545bae30-b0", "ovs_interfaceid": "545bae30-b03e-41ac-8dd9-f86e85b590d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:26:49 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-e169c8a3-c059-42a9-8eb0-360e3a5bbe25 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Converting VIF {"id": "545bae30-b03e-41ac-8dd9-f86e85b590d1", "address": "fa:16:3e:26:46:35", "network": {"id": "02098e86-68f8-464e-84ee-bf2fb09b881b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085418471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2085418471-network", "vif_mac": "fa:16:3e:26:46:35"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e12002e1a11f4caf8953371e66e6652e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap545bae30-b0", "ovs_interfaceid": "545bae30-b03e-41ac-8dd9-f86e85b590d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:26:49 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-e169c8a3-c059-42a9-8eb0-360e3a5bbe25 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:46:35,bridge_name='br-int',has_traffic_filtering=True,id=545bae30-b03e-41ac-8dd9-f86e85b590d1,network=Network(02098e86-68f8-464e-84ee-bf2fb09b881b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap545bae30-b0') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:26:49 user nova-compute[75245]: DEBUG nova.objects.instance [None req-e169c8a3-c059-42a9-8eb0-360e3a5bbe25 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lazy-loading 'pci_devices' on Instance uuid 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:26:49 user nova-compute[75245]: DEBUG nova.objects.base [None req-e169c8a3-c059-42a9-8eb0-360e3a5bbe25 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Object Instance<35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75245) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 16:26:49 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-e169c8a3-c059-42a9-8eb0-360e3a5bbe25 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] End _get_guest_xml xml=<domain type="kvm">
Nov 29 16:26:49 user nova-compute[75245]:   <uuid>35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8</uuid>
Nov 29 16:26:49 user nova-compute[75245]:   <name>instance-00000019</name>
Nov 29 16:26:49 user nova-compute[75245]:   <memory>524288</memory>
Nov 29 16:26:49 user nova-compute[75245]:   <vcpu>1</vcpu>
Nov 29 16:26:49 user nova-compute[75245]:   <metadata>
Nov 29 16:26:49 user nova-compute[75245]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 16:26:49 user nova-compute[75245]:       <nova:package version="0.0.0"/>
Nov 29 16:26:49 user nova-compute[75245]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1012702765</nova:name>
Nov 29 16:26:49 user nova-compute[75245]:       <nova:creationTime>2023-11-29 16:26:49</nova:creationTime>
Nov 29 16:26:49 user nova-compute[75245]:       <nova:flavor name="m1.tiny">
Nov 29 16:26:49 user nova-compute[75245]:         <nova:memory>512</nova:memory>
Nov 29 16:26:49 user nova-compute[75245]:         <nova:disk>1</nova:disk>
Nov 29 16:26:49 user nova-compute[75245]:         <nova:swap>0</nova:swap>
Nov 29 16:26:49 user nova-compute[75245]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 16:26:49 user nova-compute[75245]:         <nova:vcpus>1</nova:vcpus>
Nov 29 16:26:49 user nova-compute[75245]:       </nova:flavor>
Nov 29 16:26:49 user nova-compute[75245]:       <nova:owner>
Nov 29 16:26:49 user nova-compute[75245]:         <nova:user uuid="d876b1e244b14a29ad5b4b422135336b">tempest-ServerRescueNegativeTestJSON-1013090395-project-member</nova:user>
Nov 29 16:26:49 user nova-compute[75245]:         <nova:project uuid="e12002e1a11f4caf8953371e66e6652e">tempest-ServerRescueNegativeTestJSON-1013090395</nova:project>
Nov 29 16:26:49 user nova-compute[75245]:       </nova:owner>
Nov 29 16:26:49 user nova-compute[75245]:       <nova:root type="image" uuid="a291d9c3-be02-4c6c-9649-4b45c5b7f487"/>
Nov 29 16:26:49 user nova-compute[75245]:       <nova:ports>
Nov 29 16:26:49 user nova-compute[75245]:         <nova:port uuid="545bae30-b03e-41ac-8dd9-f86e85b590d1">
Nov 29 16:26:49 user nova-compute[75245]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 29 16:26:49 user nova-compute[75245]:         </nova:port>
Nov 29 16:26:49 user nova-compute[75245]:       </nova:ports>
Nov 29 16:26:49 user nova-compute[75245]:     </nova:instance>
Nov 29 16:26:49 user nova-compute[75245]:   </metadata>
Nov 29 16:26:49 user nova-compute[75245]:   <sysinfo type="smbios">
Nov 29 16:26:49 user nova-compute[75245]:     <system>
Nov 29 16:26:49 user nova-compute[75245]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 16:26:49 user nova-compute[75245]:       <entry name="product">OpenStack Nova</entry>
Nov 29 16:26:49 user nova-compute[75245]:       <entry name="version">0.0.0</entry>
Nov 29 16:26:49 user nova-compute[75245]:       <entry name="serial">35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8</entry>
Nov 29 16:26:49 user nova-compute[75245]:       <entry name="uuid">35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8</entry>
Nov 29 16:26:49 user nova-compute[75245]:       <entry name="family">Virtual Machine</entry>
Nov 29 16:26:49 user nova-compute[75245]:     </system>
Nov 29 16:26:49 user nova-compute[75245]:   </sysinfo>
Nov 29 16:26:49 user nova-compute[75245]:   <os>
Nov 29 16:26:49 user nova-compute[75245]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 16:26:49 user nova-compute[75245]:     <smbios mode="sysinfo"/>
Nov 29 16:26:49 user nova-compute[75245]:   </os>
Nov 29 16:26:49 user nova-compute[75245]:   <features>
Nov 29 16:26:49 user nova-compute[75245]:     <acpi/>
Nov 29 16:26:49 user nova-compute[75245]:     <apic/>
Nov 29 16:26:49 user nova-compute[75245]:     <vmcoreinfo/>
Nov 29 16:26:49 user nova-compute[75245]:   </features>
Nov 29 16:26:49 user nova-compute[75245]:   <clock offset="utc">
Nov 29 16:26:49 user nova-compute[75245]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 16:26:49 user nova-compute[75245]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 16:26:49 user nova-compute[75245]:     <timer name="hpet" present="no"/>
Nov 29 16:26:49 user nova-compute[75245]:   </clock>
Nov 29 16:26:49 user nova-compute[75245]:   <cpu mode="custom" match="exact">
Nov 29 16:26:49 user nova-compute[75245]:     <model>Nehalem</model>
Nov 29 16:26:49 user nova-compute[75245]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 16:26:49 user nova-compute[75245]:   </cpu>
Nov 29 16:26:49 user nova-compute[75245]:   <devices>
Nov 29 16:26:49 user nova-compute[75245]:     <disk type="file" device="disk">
Nov 29 16:26:49 user nova-compute[75245]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 16:26:49 user nova-compute[75245]:       <source file="/opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk.rescue"/>
Nov 29 16:26:49 user nova-compute[75245]:       <target dev="vda" bus="virtio"/>
Nov 29 16:26:49 user nova-compute[75245]:     </disk>
Nov 29 16:26:49 user nova-compute[75245]:     <disk type="file" device="disk">
Nov 29 16:26:49 user nova-compute[75245]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 16:26:49 user nova-compute[75245]:       <source file="/opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk"/>
Nov 29 16:26:49 user nova-compute[75245]:       <target dev="vdb" bus="virtio"/>
Nov 29 16:26:49 user nova-compute[75245]:     </disk>
Nov 29 16:26:49 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 16:26:49 user nova-compute[75245]:       <mac address="fa:16:3e:26:46:35"/>
Nov 29 16:26:49 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:26:49 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 16:26:49 user nova-compute[75245]:       <target dev="tap545bae30-b0"/>
Nov 29 16:26:49 user nova-compute[75245]:     </interface>
Nov 29 16:26:49 user nova-compute[75245]:     <serial type="pty">
Nov 29 16:26:49 user nova-compute[75245]:       <log file="/opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/console.log" append="off"/>
Nov 29 16:26:49 user nova-compute[75245]:     </serial>
Nov 29 16:26:49 user nova-compute[75245]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 16:26:49 user nova-compute[75245]:     <video>
Nov 29 16:26:49 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:26:49 user nova-compute[75245]:     </video>
Nov 29 16:26:49 user nova-compute[75245]:     <rng model="virtio">
Nov 29 16:26:49 user nova-compute[75245]:       <backend model="random">/dev/urandom</backend>
Nov 29 16:26:49 user nova-compute[75245]:     </rng>
Nov 29 16:26:49 user nova-compute[75245]:     <controller type="usb" index="0" model="none"/>
Nov 29 16:26:49 user nova-compute[75245]:     <memballoon model="virtio">
Nov 29 16:26:49 user nova-compute[75245]:       <stats period="10"/>
Nov 29 16:26:49 user nova-compute[75245]:     </memballoon>
Nov 29 16:26:49 user nova-compute[75245]:   </devices>
Nov 29 16:26:49 user nova-compute[75245]: </domain>
Nov 29 16:26:49 user nova-compute[75245]:  {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 16:26:49 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Instance destroyed successfully.
Nov 29 16:26:49 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-e169c8a3-c059-42a9-8eb0-360e3a5bbe25 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:26:49 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-e169c8a3-c059-42a9-8eb0-360e3a5bbe25 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:26:49 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-e169c8a3-c059-42a9-8eb0-360e3a5bbe25 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] No VIF found with MAC fa:16:3e:26:46:35, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:26:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:26:50 user nova-compute[75245]: DEBUG nova.compute.manager [req-31327f36-d3bd-4a42-b978-e50dc2d2c506 req-244161a8-9928-463d-9142-7ab1003a057e service nova] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Received event network-vif-plugged-545bae30-b03e-41ac-8dd9-f86e85b590d1 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:26:50 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-31327f36-d3bd-4a42-b978-e50dc2d2c506 req-244161a8-9928-463d-9142-7ab1003a057e service nova] Acquiring lock "35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:26:50 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-31327f36-d3bd-4a42-b978-e50dc2d2c506 req-244161a8-9928-463d-9142-7ab1003a057e service nova] Lock "35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:26:50 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-31327f36-d3bd-4a42-b978-e50dc2d2c506 req-244161a8-9928-463d-9142-7ab1003a057e service nova] Lock "35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:26:50 user nova-compute[75245]: DEBUG nova.compute.manager [req-31327f36-d3bd-4a42-b978-e50dc2d2c506 req-244161a8-9928-463d-9142-7ab1003a057e service nova] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] No waiting events found dispatching network-vif-plugged-545bae30-b03e-41ac-8dd9-f86e85b590d1 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:26:50 user nova-compute[75245]: WARNING nova.compute.manager [req-31327f36-d3bd-4a42-b978-e50dc2d2c506 req-244161a8-9928-463d-9142-7ab1003a057e service nova] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Received unexpected event network-vif-plugged-545bae30-b03e-41ac-8dd9-f86e85b590d1 for instance with vm_state active and task_state rescuing.
Nov 29 16:26:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:26:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:26:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:26:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:26:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:26:52 user nova-compute[75245]: DEBUG nova.compute.manager [req-bedd5c47-d696-45df-9001-72a01f55a906 req-7128f2df-4bd9-4237-bf10-08dfe6147f6b service nova] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Received event network-vif-plugged-545bae30-b03e-41ac-8dd9-f86e85b590d1 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:26:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-bedd5c47-d696-45df-9001-72a01f55a906 req-7128f2df-4bd9-4237-bf10-08dfe6147f6b service nova] Acquiring lock "35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:26:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-bedd5c47-d696-45df-9001-72a01f55a906 req-7128f2df-4bd9-4237-bf10-08dfe6147f6b service nova] Lock "35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:26:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-bedd5c47-d696-45df-9001-72a01f55a906 req-7128f2df-4bd9-4237-bf10-08dfe6147f6b service nova] Lock "35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:26:52 user nova-compute[75245]: DEBUG nova.compute.manager [req-bedd5c47-d696-45df-9001-72a01f55a906 req-7128f2df-4bd9-4237-bf10-08dfe6147f6b service nova] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] No waiting events found dispatching network-vif-plugged-545bae30-b03e-41ac-8dd9-f86e85b590d1 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:26:52 user nova-compute[75245]: WARNING nova.compute.manager [req-bedd5c47-d696-45df-9001-72a01f55a906 req-7128f2df-4bd9-4237-bf10-08dfe6147f6b service nova] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Received unexpected event network-vif-plugged-545bae30-b03e-41ac-8dd9-f86e85b590d1 for instance with vm_state active and task_state rescuing.
Nov 29 16:26:52 user nova-compute[75245]: DEBUG nova.compute.manager [req-bedd5c47-d696-45df-9001-72a01f55a906 req-7128f2df-4bd9-4237-bf10-08dfe6147f6b service nova] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Received event network-vif-plugged-545bae30-b03e-41ac-8dd9-f86e85b590d1 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:26:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-bedd5c47-d696-45df-9001-72a01f55a906 req-7128f2df-4bd9-4237-bf10-08dfe6147f6b service nova] Acquiring lock "35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:26:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-bedd5c47-d696-45df-9001-72a01f55a906 req-7128f2df-4bd9-4237-bf10-08dfe6147f6b service nova] Lock "35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:26:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-bedd5c47-d696-45df-9001-72a01f55a906 req-7128f2df-4bd9-4237-bf10-08dfe6147f6b service nova] Lock "35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:26:52 user nova-compute[75245]: DEBUG nova.compute.manager [req-bedd5c47-d696-45df-9001-72a01f55a906 req-7128f2df-4bd9-4237-bf10-08dfe6147f6b service nova] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] No waiting events found dispatching network-vif-plugged-545bae30-b03e-41ac-8dd9-f86e85b590d1 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:26:52 user nova-compute[75245]: WARNING nova.compute.manager [req-bedd5c47-d696-45df-9001-72a01f55a906 req-7128f2df-4bd9-4237-bf10-08dfe6147f6b service nova] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Received unexpected event network-vif-plugged-545bae30-b03e-41ac-8dd9-f86e85b590d1 for instance with vm_state active and task_state rescuing.
Nov 29 16:26:53 user nova-compute[75245]: DEBUG nova.compute.manager [None req-e169c8a3-c059-42a9-8eb0-360e3a5bbe25 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:26:53 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:26:55 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:27:00 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:27:02 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:27:02 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Starting heal instance info cache {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 16:27:02 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "refresh_cache-d42fa9b3-91c3-4216-91f1-655ce140425f" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:27:02 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquired lock "refresh_cache-d42fa9b3-91c3-4216-91f1-655ce140425f" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:27:02 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Forcefully refreshing network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 16:27:03 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Updating instance_info_cache with network_info: [{"id": "497aee0b-487f-4138-9394-a68c8bd55e61", "address": "fa:16:3e:09:ba:94", "network": {"id": "f1fac2f4-e789-443e-b6a5-1a3f829bc302", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1199431077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6b87e18ef1f48d19a6907b28cb54f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap497aee0b-48", "ovs_interfaceid": "497aee0b-487f-4138-9394-a68c8bd55e61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:27:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Releasing lock "refresh_cache-d42fa9b3-91c3-4216-91f1-655ce140425f" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:27:03 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Updated the network info_cache for instance {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 16:27:03 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:27:03 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:27:03 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:27:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:27:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:27:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:27:03 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75245) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 16:27:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b629ca7-b69e-471c-a7b0-9eb43301c36f/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:27:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b629ca7-b69e-471c-a7b0-9eb43301c36f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:27:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b629ca7-b69e-471c-a7b0-9eb43301c36f/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:27:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b629ca7-b69e-471c-a7b0-9eb43301c36f/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:27:04 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:27:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:27:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:27:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:27:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:27:04 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:27:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk.rescue --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:27:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:27:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk.rescue --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:27:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:27:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:27:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:27:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:27:05 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:27:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:27:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk.rescue --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:27:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:27:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk.rescue --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:27:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:27:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:27:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:27:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:27:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:27:05 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:27:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:27:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:27:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:27:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:27:06 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:27:06 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:27:06 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Hypervisor/Node resource view: name=user free_ram=8285MB free_disk=25.23741912841797GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75245) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 16:27:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:27:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:27:06 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance ed9a6a4e-2e7d-443c-82ef-f14f11d32c81 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:27:06 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 8785a3c2-5b7a-4382-b50d-cecd8743329c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:27:06 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 5de7e10c-f216-46b3-8f74-57bac6ab7e56 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:27:06 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:27:06 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance ed9d1ad5-f5d0-4a68-a073-e7a83be772ea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:27:06 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance d42fa9b3-91c3-4216-91f1-655ce140425f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:27:06 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 0b629ca7-b69e-471c-a7b0-9eb43301c36f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:27:06 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 16:27:06 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 16:27:06 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:27:06 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:27:06 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Compute_service record updated for user:user {{(pid=75245) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 16:27:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.361s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:27:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:27:08 user nova-compute[75245]: INFO nova.compute.manager [None req-f5601fa6-ce3b-4240-b068-bfdc70a22d8a tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Get console output
Nov 29 16:27:08 user nova-compute[75245]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 29 16:27:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:27:10 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:27:10 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:27:10 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:27:10 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:27:10 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:27:11 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Triggering sync for uuid ed9a6a4e-2e7d-443c-82ef-f14f11d32c81 {{(pid=75245) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 16:27:11 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Triggering sync for uuid 8785a3c2-5b7a-4382-b50d-cecd8743329c {{(pid=75245) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 16:27:11 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Triggering sync for uuid d42fa9b3-91c3-4216-91f1-655ce140425f {{(pid=75245) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 16:27:11 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Triggering sync for uuid 5de7e10c-f216-46b3-8f74-57bac6ab7e56 {{(pid=75245) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 16:27:11 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Triggering sync for uuid 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8 {{(pid=75245) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 16:27:11 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Triggering sync for uuid ed9d1ad5-f5d0-4a68-a073-e7a83be772ea {{(pid=75245) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 16:27:11 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Triggering sync for uuid 0b629ca7-b69e-471c-a7b0-9eb43301c36f {{(pid=75245) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 16:27:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "ed9a6a4e-2e7d-443c-82ef-f14f11d32c81" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:27:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "ed9a6a4e-2e7d-443c-82ef-f14f11d32c81" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:27:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "8785a3c2-5b7a-4382-b50d-cecd8743329c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:27:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "8785a3c2-5b7a-4382-b50d-cecd8743329c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:27:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "d42fa9b3-91c3-4216-91f1-655ce140425f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:27:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "d42fa9b3-91c3-4216-91f1-655ce140425f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:27:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "5de7e10c-f216-46b3-8f74-57bac6ab7e56" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:27:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "5de7e10c-f216-46b3-8f74-57bac6ab7e56" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:27:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:27:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:27:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "ed9d1ad5-f5d0-4a68-a073-e7a83be772ea" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:27:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "ed9d1ad5-f5d0-4a68-a073-e7a83be772ea" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:27:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "0b629ca7-b69e-471c-a7b0-9eb43301c36f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:27:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "0b629ca7-b69e-471c-a7b0-9eb43301c36f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:27:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "ed9a6a4e-2e7d-443c-82ef-f14f11d32c81" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.036s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:27:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "8785a3c2-5b7a-4382-b50d-cecd8743329c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:27:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "d42fa9b3-91c3-4216-91f1-655ce140425f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:27:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "5de7e10c-f216-46b3-8f74-57bac6ab7e56" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.044s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:27:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:27:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "0b629ca7-b69e-471c-a7b0-9eb43301c36f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.050s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:27:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "ed9d1ad5-f5d0-4a68-a073-e7a83be772ea" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.059s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:27:13 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:27:13 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75245) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 16:27:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:27:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:27:18 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:27:20 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:27:20 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Acquiring lock "78784fb7-a25f-4c6c-9a44-649c994004c7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:27:20 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "78784fb7-a25f-4c6c-9a44-649c994004c7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:27:20 user nova-compute[75245]: DEBUG nova.compute.manager [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 78784fb7-a25f-4c6c-9a44-649c994004c7] Starting instance... {{(pid=75245) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 16:27:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:27:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:27:21 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75245) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 16:27:21 user nova-compute[75245]: INFO nova.compute.claims [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 78784fb7-a25f-4c6c-9a44-649c994004c7] Claim successful on node user
Nov 29 16:27:21 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:27:21 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:27:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.449s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:27:21 user nova-compute[75245]: DEBUG nova.compute.manager [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 78784fb7-a25f-4c6c-9a44-649c994004c7] Start building networks asynchronously for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 16:27:21 user nova-compute[75245]: DEBUG nova.compute.manager [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 78784fb7-a25f-4c6c-9a44-649c994004c7] Allocating IP information in the background. {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 16:27:21 user nova-compute[75245]: DEBUG nova.network.neutron [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 78784fb7-a25f-4c6c-9a44-649c994004c7] allocate_for_instance() {{(pid=75245) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 16:27:21 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 78784fb7-a25f-4c6c-9a44-649c994004c7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 16:27:21 user nova-compute[75245]: DEBUG nova.compute.manager [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 78784fb7-a25f-4c6c-9a44-649c994004c7] Start building block device mappings for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 16:27:21 user nova-compute[75245]: DEBUG nova.policy [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4f20e7c9ae22462ea6bc623c93697fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d52776451e947f5a9ef3fa44ac8acbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75245) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 16:27:21 user nova-compute[75245]: DEBUG nova.compute.manager [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 78784fb7-a25f-4c6c-9a44-649c994004c7] Start spawning the instance on the hypervisor. {{(pid=75245) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 16:27:21 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 78784fb7-a25f-4c6c-9a44-649c994004c7] Creating instance directory {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 16:27:21 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 78784fb7-a25f-4c6c-9a44-649c994004c7] Creating image(s)
Nov 29 16:27:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Acquiring lock "/opt/stack/data/nova/instances/78784fb7-a25f-4c6c-9a44-649c994004c7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:27:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "/opt/stack/data/nova/instances/78784fb7-a25f-4c6c-9a44-649c994004c7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:27:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "/opt/stack/data/nova/instances/78784fb7-a25f-4c6c-9a44-649c994004c7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:27:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:27:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.186s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:27:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Acquiring lock "d654f7206043e05d3525550b0fc885556eb999f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:27:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:27:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:27:22 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.185s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:27:22 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/78784fb7-a25f-4c6c-9a44-649c994004c7/disk 1073741824 {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:27:22 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/78784fb7-a25f-4c6c-9a44-649c994004c7/disk 1073741824" returned: 0 in 0.055s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:27:22 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:27:22 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:27:22 user nova-compute[75245]: DEBUG nova.network.neutron [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 78784fb7-a25f-4c6c-9a44-649c994004c7] Successfully created port: be7f7c96-525a-4895-933d-a680c6bbf4f2 {{(pid=75245) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 16:27:22 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.193s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:27:22 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Checking if we can resize image /opt/stack/data/nova/instances/78784fb7-a25f-4c6c-9a44-649c994004c7/disk. size=1073741824 {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 16:27:22 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78784fb7-a25f-4c6c-9a44-649c994004c7/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:27:22 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78784fb7-a25f-4c6c-9a44-649c994004c7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:27:22 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Cannot resize image /opt/stack/data/nova/instances/78784fb7-a25f-4c6c-9a44-649c994004c7/disk to a smaller size. {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 16:27:22 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 78784fb7-a25f-4c6c-9a44-649c994004c7] Created local disks {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 16:27:22 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 78784fb7-a25f-4c6c-9a44-649c994004c7] Ensure instance console log exists: /opt/stack/data/nova/instances/78784fb7-a25f-4c6c-9a44-649c994004c7/console.log {{(pid=75245) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 16:27:22 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:27:22 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:27:22 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:27:22 user nova-compute[75245]: DEBUG nova.network.neutron [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 78784fb7-a25f-4c6c-9a44-649c994004c7] Successfully updated port: be7f7c96-525a-4895-933d-a680c6bbf4f2 {{(pid=75245) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 16:27:22 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Acquiring lock "refresh_cache-78784fb7-a25f-4c6c-9a44-649c994004c7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:27:22 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Acquired lock "refresh_cache-78784fb7-a25f-4c6c-9a44-649c994004c7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:27:22 user nova-compute[75245]: DEBUG nova.network.neutron [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 78784fb7-a25f-4c6c-9a44-649c994004c7] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 16:27:22 user nova-compute[75245]: DEBUG nova.compute.manager [req-2b4121e8-7305-4444-a09d-0794036f7954 req-b3aca526-4e22-4c0e-bf08-a7566159ba7c service nova] [instance: 78784fb7-a25f-4c6c-9a44-649c994004c7] Received event network-changed-be7f7c96-525a-4895-933d-a680c6bbf4f2 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:27:22 user nova-compute[75245]: DEBUG nova.compute.manager [req-2b4121e8-7305-4444-a09d-0794036f7954 req-b3aca526-4e22-4c0e-bf08-a7566159ba7c service nova] [instance: 78784fb7-a25f-4c6c-9a44-649c994004c7] Refreshing instance network info cache due to event network-changed-be7f7c96-525a-4895-933d-a680c6bbf4f2. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:27:22 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-2b4121e8-7305-4444-a09d-0794036f7954 req-b3aca526-4e22-4c0e-bf08-a7566159ba7c service nova] Acquiring lock "refresh_cache-78784fb7-a25f-4c6c-9a44-649c994004c7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:27:22 user nova-compute[75245]: DEBUG nova.network.neutron [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 78784fb7-a25f-4c6c-9a44-649c994004c7] Instance cache missing network info. {{(pid=75245) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 16:27:23 user nova-compute[75245]: DEBUG nova.network.neutron [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 78784fb7-a25f-4c6c-9a44-649c994004c7] Updating instance_info_cache with network_info: [{"id": "be7f7c96-525a-4895-933d-a680c6bbf4f2", "address": "fa:16:3e:f3:a2:bb", "network": {"id": "6a7f7426-b595-4aa3-bf80-cc92ba7ce15e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-917300903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d52776451e947f5a9ef3fa44ac8acbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe7f7c96-52", "ovs_interfaceid": "be7f7c96-525a-4895-933d-a680c6bbf4f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:27:23 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Releasing lock "refresh_cache-78784fb7-a25f-4c6c-9a44-649c994004c7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:27:23 user nova-compute[75245]: DEBUG nova.compute.manager [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 78784fb7-a25f-4c6c-9a44-649c994004c7] Instance network_info: |[{"id": "be7f7c96-525a-4895-933d-a680c6bbf4f2", "address": "fa:16:3e:f3:a2:bb", "network": {"id": "6a7f7426-b595-4aa3-bf80-cc92ba7ce15e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-917300903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d52776451e947f5a9ef3fa44ac8acbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe7f7c96-52", "ovs_interfaceid": "be7f7c96-525a-4895-933d-a680c6bbf4f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 16:27:23 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-2b4121e8-7305-4444-a09d-0794036f7954 req-b3aca526-4e22-4c0e-bf08-a7566159ba7c service nova] Acquired lock "refresh_cache-78784fb7-a25f-4c6c-9a44-649c994004c7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:27:23 user nova-compute[75245]: DEBUG nova.network.neutron [req-2b4121e8-7305-4444-a09d-0794036f7954 req-b3aca526-4e22-4c0e-bf08-a7566159ba7c service nova] [instance: 78784fb7-a25f-4c6c-9a44-649c994004c7] Refreshing network info cache for port be7f7c96-525a-4895-933d-a680c6bbf4f2 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:27:23 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 78784fb7-a25f-4c6c-9a44-649c994004c7] Start _get_guest_xml network_info=[{"id": "be7f7c96-525a-4895-933d-a680c6bbf4f2", "address": "fa:16:3e:f3:a2:bb", "network": {"id": "6a7f7426-b595-4aa3-bf80-cc92ba7ce15e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-917300903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d52776451e947f5a9ef3fa44ac8acbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe7f7c96-52", "ovs_interfaceid": "be7f7c96-525a-4895-933d-a680c6bbf4f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'a291d9c3-be02-4c6c-9649-4b45c5b7f487'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 16:27:23 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:27:23 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:27:23 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 16:27:23 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] CPU controller missing on host. {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 16:27:23 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 16:27:23 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] CPU controller found on host. {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 16:27:23 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75245) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 16:27:23 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T16:06:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 16:27:23 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Flavor limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 16:27:23 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Image limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 16:27:23 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Flavor pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 16:27:23 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Image pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 16:27:23 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 16:27:23 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 16:27:23 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 16:27:23 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Got 1 possible topologies {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 16:27:23 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 16:27:23 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 16:27:23 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:27:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1566046722',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1566046722',id=28,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d52776451e947f5a9ef3fa44ac8acbb',ramdisk_id='',reservation_id='r-ztv0bcou',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1780163218',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:27:22Z,user_data=None,user_id='4f20e7c9ae22462ea6bc623c93697fce',uuid=78784fb7-a25f-4c6c-9a44-649c994004c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be7f7c96-525a-4895-933d-a680c6bbf4f2", "address": "fa:16:3e:f3:a2:bb", "network": {"id": "6a7f7426-b595-4aa3-bf80-cc92ba7ce15e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-917300903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d52776451e947f5a9ef3fa44ac8acbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe7f7c96-52", "ovs_interfaceid": "be7f7c96-525a-4895-933d-a680c6bbf4f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:27:23 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Converting VIF {"id": "be7f7c96-525a-4895-933d-a680c6bbf4f2", "address": "fa:16:3e:f3:a2:bb", "network": {"id": "6a7f7426-b595-4aa3-bf80-cc92ba7ce15e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-917300903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d52776451e947f5a9ef3fa44ac8acbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe7f7c96-52", "ovs_interfaceid": "be7f7c96-525a-4895-933d-a680c6bbf4f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:27:23 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:a2:bb,bridge_name='br-int',has_traffic_filtering=True,id=be7f7c96-525a-4895-933d-a680c6bbf4f2,network=Network(6a7f7426-b595-4aa3-bf80-cc92ba7ce15e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe7f7c96-52') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:27:23 user nova-compute[75245]: DEBUG nova.objects.instance [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lazy-loading 'pci_devices' on Instance uuid 78784fb7-a25f-4c6c-9a44-649c994004c7 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:27:23 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 78784fb7-a25f-4c6c-9a44-649c994004c7] End _get_guest_xml xml=<domain type="kvm">
Nov 29 16:27:23 user nova-compute[75245]:   <uuid>78784fb7-a25f-4c6c-9a44-649c994004c7</uuid>
Nov 29 16:27:23 user nova-compute[75245]:   <name>instance-0000001c</name>
Nov 29 16:27:23 user nova-compute[75245]:   <memory>524288</memory>
Nov 29 16:27:23 user nova-compute[75245]:   <vcpu>1</vcpu>
Nov 29 16:27:23 user nova-compute[75245]:   <metadata>
Nov 29 16:27:23 user nova-compute[75245]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 16:27:23 user nova-compute[75245]:       <nova:package version="0.0.0"/>
Nov 29 16:27:23 user nova-compute[75245]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1566046722</nova:name>
Nov 29 16:27:23 user nova-compute[75245]:       <nova:creationTime>2023-11-29 16:27:23</nova:creationTime>
Nov 29 16:27:23 user nova-compute[75245]:       <nova:flavor name="m1.tiny">
Nov 29 16:27:23 user nova-compute[75245]:         <nova:memory>512</nova:memory>
Nov 29 16:27:23 user nova-compute[75245]:         <nova:disk>1</nova:disk>
Nov 29 16:27:23 user nova-compute[75245]:         <nova:swap>0</nova:swap>
Nov 29 16:27:23 user nova-compute[75245]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 16:27:23 user nova-compute[75245]:         <nova:vcpus>1</nova:vcpus>
Nov 29 16:27:23 user nova-compute[75245]:       </nova:flavor>
Nov 29 16:27:23 user nova-compute[75245]:       <nova:owner>
Nov 29 16:27:23 user nova-compute[75245]:         <nova:user uuid="4f20e7c9ae22462ea6bc623c93697fce">tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member</nova:user>
Nov 29 16:27:23 user nova-compute[75245]:         <nova:project uuid="1d52776451e947f5a9ef3fa44ac8acbb">tempest-ServerBootFromVolumeStableRescueTest-1780163218</nova:project>
Nov 29 16:27:23 user nova-compute[75245]:       </nova:owner>
Nov 29 16:27:23 user nova-compute[75245]:       <nova:root type="image" uuid="a291d9c3-be02-4c6c-9649-4b45c5b7f487"/>
Nov 29 16:27:23 user nova-compute[75245]:       <nova:ports>
Nov 29 16:27:23 user nova-compute[75245]:         <nova:port uuid="be7f7c96-525a-4895-933d-a680c6bbf4f2">
Nov 29 16:27:23 user nova-compute[75245]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 29 16:27:23 user nova-compute[75245]:         </nova:port>
Nov 29 16:27:23 user nova-compute[75245]:       </nova:ports>
Nov 29 16:27:23 user nova-compute[75245]:     </nova:instance>
Nov 29 16:27:23 user nova-compute[75245]:   </metadata>
Nov 29 16:27:23 user nova-compute[75245]:   <sysinfo type="smbios">
Nov 29 16:27:23 user nova-compute[75245]:     <system>
Nov 29 16:27:23 user nova-compute[75245]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 16:27:23 user nova-compute[75245]:       <entry name="product">OpenStack Nova</entry>
Nov 29 16:27:23 user nova-compute[75245]:       <entry name="version">0.0.0</entry>
Nov 29 16:27:23 user nova-compute[75245]:       <entry name="serial">78784fb7-a25f-4c6c-9a44-649c994004c7</entry>
Nov 29 16:27:23 user nova-compute[75245]:       <entry name="uuid">78784fb7-a25f-4c6c-9a44-649c994004c7</entry>
Nov 29 16:27:23 user nova-compute[75245]:       <entry name="family">Virtual Machine</entry>
Nov 29 16:27:23 user nova-compute[75245]:     </system>
Nov 29 16:27:23 user nova-compute[75245]:   </sysinfo>
Nov 29 16:27:23 user nova-compute[75245]:   <os>
Nov 29 16:27:23 user nova-compute[75245]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 16:27:23 user nova-compute[75245]:     <boot dev="hd"/>
Nov 29 16:27:23 user nova-compute[75245]:     <smbios mode="sysinfo"/>
Nov 29 16:27:23 user nova-compute[75245]:   </os>
Nov 29 16:27:23 user nova-compute[75245]:   <features>
Nov 29 16:27:23 user nova-compute[75245]:     <acpi/>
Nov 29 16:27:23 user nova-compute[75245]:     <apic/>
Nov 29 16:27:23 user nova-compute[75245]:     <vmcoreinfo/>
Nov 29 16:27:23 user nova-compute[75245]:   </features>
Nov 29 16:27:23 user nova-compute[75245]:   <clock offset="utc">
Nov 29 16:27:23 user nova-compute[75245]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 16:27:23 user nova-compute[75245]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 16:27:23 user nova-compute[75245]:     <timer name="hpet" present="no"/>
Nov 29 16:27:23 user nova-compute[75245]:   </clock>
Nov 29 16:27:23 user nova-compute[75245]:   <cpu mode="custom" match="exact">
Nov 29 16:27:23 user nova-compute[75245]:     <model>Nehalem</model>
Nov 29 16:27:23 user nova-compute[75245]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 16:27:23 user nova-compute[75245]:   </cpu>
Nov 29 16:27:23 user nova-compute[75245]:   <devices>
Nov 29 16:27:23 user nova-compute[75245]:     <disk type="file" device="disk">
Nov 29 16:27:23 user nova-compute[75245]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 16:27:23 user nova-compute[75245]:       <source file="/opt/stack/data/nova/instances/78784fb7-a25f-4c6c-9a44-649c994004c7/disk"/>
Nov 29 16:27:23 user nova-compute[75245]:       <target dev="vda" bus="virtio"/>
Nov 29 16:27:23 user nova-compute[75245]:     </disk>
Nov 29 16:27:23 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 16:27:23 user nova-compute[75245]:       <mac address="fa:16:3e:f3:a2:bb"/>
Nov 29 16:27:23 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:27:23 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 16:27:23 user nova-compute[75245]:       <target dev="tapbe7f7c96-52"/>
Nov 29 16:27:23 user nova-compute[75245]:     </interface>
Nov 29 16:27:23 user nova-compute[75245]:     <serial type="pty">
Nov 29 16:27:23 user nova-compute[75245]:       <log file="/opt/stack/data/nova/instances/78784fb7-a25f-4c6c-9a44-649c994004c7/console.log" append="off"/>
Nov 29 16:27:23 user nova-compute[75245]:     </serial>
Nov 29 16:27:23 user nova-compute[75245]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 16:27:23 user nova-compute[75245]:     <video>
Nov 29 16:27:23 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:27:23 user nova-compute[75245]:     </video>
Nov 29 16:27:23 user nova-compute[75245]:     <rng model="virtio">
Nov 29 16:27:23 user nova-compute[75245]:       <backend model="random">/dev/urandom</backend>
Nov 29 16:27:23 user nova-compute[75245]:     </rng>
Nov 29 16:27:23 user nova-compute[75245]:     <controller type="usb" index="0" model="none"/>
Nov 29 16:27:23 user nova-compute[75245]:     <memballoon model="virtio">
Nov 29 16:27:23 user nova-compute[75245]:       <stats period="10"/>
Nov 29 16:27:23 user nova-compute[75245]:     </memballoon>
Nov 29 16:27:23 user nova-compute[75245]:   </devices>
Nov 29 16:27:23 user nova-compute[75245]: </domain>
Nov 29 16:27:23 user nova-compute[75245]:  {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 16:27:23 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:27:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1566046722',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1566046722',id=28,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d52776451e947f5a9ef3fa44ac8acbb',ramdisk_id='',reservation_id='r-ztv0bcou',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1780163218',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:27:22Z,user_data=None,user_id='4f20e7c9ae22462ea6bc623c93697fce',uuid=78784fb7-a25f-4c6c-9a44-649c994004c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be7f7c96-525a-4895-933d-a680c6bbf4f2", "address": "fa:16:3e:f3:a2:bb", "network": {"id": "6a7f7426-b595-4aa3-bf80-cc92ba7ce15e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-917300903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d52776451e947f5a9ef3fa44ac8acbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe7f7c96-52", "ovs_interfaceid": "be7f7c96-525a-4895-933d-a680c6bbf4f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 16:27:23 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Converting VIF {"id": "be7f7c96-525a-4895-933d-a680c6bbf4f2", "address": "fa:16:3e:f3:a2:bb", "network": {"id": "6a7f7426-b595-4aa3-bf80-cc92ba7ce15e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-917300903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d52776451e947f5a9ef3fa44ac8acbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe7f7c96-52", "ovs_interfaceid": "be7f7c96-525a-4895-933d-a680c6bbf4f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:27:23 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:a2:bb,bridge_name='br-int',has_traffic_filtering=True,id=be7f7c96-525a-4895-933d-a680c6bbf4f2,network=Network(6a7f7426-b595-4aa3-bf80-cc92ba7ce15e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe7f7c96-52') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:27:23 user nova-compute[75245]: DEBUG os_vif [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:a2:bb,bridge_name='br-int',has_traffic_filtering=True,id=be7f7c96-525a-4895-933d-a680c6bbf4f2,network=Network(6a7f7426-b595-4aa3-bf80-cc92ba7ce15e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe7f7c96-52') {{(pid=75245) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 16:27:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:27:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:27:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 16:27:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:27:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fa5832e4-9510-5fbc-a1f7-140913ce52f7', '_type': 'linux-noop'}}, row=False) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:27:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:27:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:27:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:27:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:27:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbe7f7c96-52, may_exist=True, interface_attrs={}) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:27:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbe7f7c96-52, col_values=(('qos', UUID('bb8e20a6-7c03-443f-9dd4-93047a96dbf4')),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:27:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbe7f7c96-52, col_values=(('external_ids', {'iface-id': 'be7f7c96-525a-4895-933d-a680c6bbf4f2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:a2:bb', 'vm-uuid': '78784fb7-a25f-4c6c-9a44-649c994004c7'}),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:27:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:27:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:27:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:27:23 user nova-compute[75245]: INFO os_vif [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:a2:bb,bridge_name='br-int',has_traffic_filtering=True,id=be7f7c96-525a-4895-933d-a680c6bbf4f2,network=Network(6a7f7426-b595-4aa3-bf80-cc92ba7ce15e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe7f7c96-52')
Nov 29 16:27:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:27:23 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:27:23 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] No VIF found with MAC fa:16:3e:f3:a2:bb, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:27:24 user nova-compute[75245]: DEBUG nova.network.neutron [req-2b4121e8-7305-4444-a09d-0794036f7954 req-b3aca526-4e22-4c0e-bf08-a7566159ba7c service nova] [instance: 78784fb7-a25f-4c6c-9a44-649c994004c7] Updated VIF entry in instance network info cache for port be7f7c96-525a-4895-933d-a680c6bbf4f2. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:27:24 user nova-compute[75245]: DEBUG nova.network.neutron [req-2b4121e8-7305-4444-a09d-0794036f7954 req-b3aca526-4e22-4c0e-bf08-a7566159ba7c service nova] [instance: 78784fb7-a25f-4c6c-9a44-649c994004c7] Updating instance_info_cache with network_info: [{"id": "be7f7c96-525a-4895-933d-a680c6bbf4f2", "address": "fa:16:3e:f3:a2:bb", "network": {"id": "6a7f7426-b595-4aa3-bf80-cc92ba7ce15e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-917300903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d52776451e947f5a9ef3fa44ac8acbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe7f7c96-52", "ovs_interfaceid": "be7f7c96-525a-4895-933d-a680c6bbf4f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:27:24 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-2b4121e8-7305-4444-a09d-0794036f7954 req-b3aca526-4e22-4c0e-bf08-a7566159ba7c service nova] Releasing lock "refresh_cache-78784fb7-a25f-4c6c-9a44-649c994004c7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:27:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:27:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:27:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:27:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:27:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:27:25 user nova-compute[75245]: DEBUG nova.compute.manager [req-af304d5d-9f00-4b1e-95b5-16a7c70515b7 req-8096a7db-5414-4ad9-8fac-b976ecf0cb3a service nova] [instance: 78784fb7-a25f-4c6c-9a44-649c994004c7] Received event network-vif-plugged-be7f7c96-525a-4895-933d-a680c6bbf4f2 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:27:25 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-af304d5d-9f00-4b1e-95b5-16a7c70515b7 req-8096a7db-5414-4ad9-8fac-b976ecf0cb3a service nova] Acquiring lock "78784fb7-a25f-4c6c-9a44-649c994004c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:27:25 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-af304d5d-9f00-4b1e-95b5-16a7c70515b7 req-8096a7db-5414-4ad9-8fac-b976ecf0cb3a service nova] Lock "78784fb7-a25f-4c6c-9a44-649c994004c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:27:25 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-af304d5d-9f00-4b1e-95b5-16a7c70515b7 req-8096a7db-5414-4ad9-8fac-b976ecf0cb3a service nova] Lock "78784fb7-a25f-4c6c-9a44-649c994004c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:27:25 user nova-compute[75245]: DEBUG nova.compute.manager [req-af304d5d-9f00-4b1e-95b5-16a7c70515b7 req-8096a7db-5414-4ad9-8fac-b976ecf0cb3a service nova] [instance: 78784fb7-a25f-4c6c-9a44-649c994004c7] No waiting events found dispatching network-vif-plugged-be7f7c96-525a-4895-933d-a680c6bbf4f2 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:27:25 user nova-compute[75245]: WARNING nova.compute.manager [req-af304d5d-9f00-4b1e-95b5-16a7c70515b7 req-8096a7db-5414-4ad9-8fac-b976ecf0cb3a service nova] [instance: 78784fb7-a25f-4c6c-9a44-649c994004c7] Received unexpected event network-vif-plugged-be7f7c96-525a-4895-933d-a680c6bbf4f2 for instance with vm_state building and task_state spawning.
Nov 29 16:27:25 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:27:25 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:27:27 user nova-compute[75245]: DEBUG nova.compute.manager [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 78784fb7-a25f-4c6c-9a44-649c994004c7] Instance event wait completed in 0 seconds for  {{(pid=75245) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 16:27:27 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 78784fb7-a25f-4c6c-9a44-649c994004c7] Guest created on hypervisor {{(pid=75245) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 16:27:27 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 78784fb7-a25f-4c6c-9a44-649c994004c7] Instance spawned successfully.
Nov 29 16:27:27 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 78784fb7-a25f-4c6c-9a44-649c994004c7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 16:27:27 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 78784fb7-a25f-4c6c-9a44-649c994004c7] Found default for hw_cdrom_bus of ide {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:27:27 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 78784fb7-a25f-4c6c-9a44-649c994004c7] Found default for hw_disk_bus of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:27:27 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 78784fb7-a25f-4c6c-9a44-649c994004c7] Found default for hw_input_bus of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:27:27 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 78784fb7-a25f-4c6c-9a44-649c994004c7] Found default for hw_pointer_model of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:27:27 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 78784fb7-a25f-4c6c-9a44-649c994004c7] Found default for hw_video_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:27:27 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 78784fb7-a25f-4c6c-9a44-649c994004c7] Found default for hw_vif_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:27:27 user nova-compute[75245]: DEBUG nova.compute.manager [req-cd5ac568-f70c-42f2-a0b5-538bf012dc4c req-6a74edfe-eaad-4cdd-8dc3-004e4dc0d4ed service nova] [instance: 78784fb7-a25f-4c6c-9a44-649c994004c7] Received event network-vif-plugged-be7f7c96-525a-4895-933d-a680c6bbf4f2 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:27:27 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-cd5ac568-f70c-42f2-a0b5-538bf012dc4c req-6a74edfe-eaad-4cdd-8dc3-004e4dc0d4ed service nova] Acquiring lock "78784fb7-a25f-4c6c-9a44-649c994004c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:27:27 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-cd5ac568-f70c-42f2-a0b5-538bf012dc4c req-6a74edfe-eaad-4cdd-8dc3-004e4dc0d4ed service nova] Lock "78784fb7-a25f-4c6c-9a44-649c994004c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:27:27 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-cd5ac568-f70c-42f2-a0b5-538bf012dc4c req-6a74edfe-eaad-4cdd-8dc3-004e4dc0d4ed service nova] Lock "78784fb7-a25f-4c6c-9a44-649c994004c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:27:27 user nova-compute[75245]: DEBUG nova.compute.manager [req-cd5ac568-f70c-42f2-a0b5-538bf012dc4c req-6a74edfe-eaad-4cdd-8dc3-004e4dc0d4ed service nova] [instance: 78784fb7-a25f-4c6c-9a44-649c994004c7] No waiting events found dispatching network-vif-plugged-be7f7c96-525a-4895-933d-a680c6bbf4f2 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:27:27 user nova-compute[75245]: WARNING nova.compute.manager [req-cd5ac568-f70c-42f2-a0b5-538bf012dc4c req-6a74edfe-eaad-4cdd-8dc3-004e4dc0d4ed service nova] [instance: 78784fb7-a25f-4c6c-9a44-649c994004c7] Received unexpected event network-vif-plugged-be7f7c96-525a-4895-933d-a680c6bbf4f2 for instance with vm_state building and task_state spawning.
Nov 29 16:27:27 user nova-compute[75245]: INFO nova.compute.manager [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 78784fb7-a25f-4c6c-9a44-649c994004c7] Took 5.47 seconds to spawn the instance on the hypervisor.
Nov 29 16:27:27 user nova-compute[75245]: DEBUG nova.compute.manager [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 78784fb7-a25f-4c6c-9a44-649c994004c7] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:27:27 user nova-compute[75245]: INFO nova.compute.manager [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 78784fb7-a25f-4c6c-9a44-649c994004c7] Took 6.29 seconds to build instance.
Nov 29 16:27:27 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-137a48b9-1afb-48d3-8428-e4bbfdc10e6c tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "78784fb7-a25f-4c6c-9a44-649c994004c7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.395s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:27:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:27:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:27:29 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:27:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:27:33 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:27:35 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:27:38 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:27:43 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:27:43 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:27:43 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75245) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 16:27:43 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:27:43 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:27:43 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:27:43 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:27:48 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:27:48 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:27:53 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:27:53 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:27:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:27:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:28:02 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:28:02 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Starting heal instance info cache {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 16:28:02 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "refresh_cache-5de7e10c-f216-46b3-8f74-57bac6ab7e56" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:28:02 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquired lock "refresh_cache-5de7e10c-f216-46b3-8f74-57bac6ab7e56" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:28:02 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Forcefully refreshing network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 16:28:02 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Updating instance_info_cache with network_info: [{"id": "116d08d0-5549-4438-b689-0bbda3a5934f", "address": "fa:16:3e:97:fb:c7", "network": {"id": "6a7f7426-b595-4aa3-bf80-cc92ba7ce15e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-917300903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d52776451e947f5a9ef3fa44ac8acbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap116d08d0-55", "ovs_interfaceid": "116d08d0-5549-4438-b689-0bbda3a5934f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:28:02 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Releasing lock "refresh_cache-5de7e10c-f216-46b3-8f74-57bac6ab7e56" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:28:02 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Updated the network info_cache for instance {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 16:28:03 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:28:03 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:28:04 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:28:04 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:28:04 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:28:04 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:28:04 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:28:04 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75245) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 16:28:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b629ca7-b69e-471c-a7b0-9eb43301c36f/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:28:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b629ca7-b69e-471c-a7b0-9eb43301c36f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:28:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b629ca7-b69e-471c-a7b0-9eb43301c36f/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:28:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b629ca7-b69e-471c-a7b0-9eb43301c36f/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:28:05 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:28:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:28:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:28:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:28:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:28:05 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:28:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk.rescue --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:28:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:28:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk.rescue --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:28:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:28:05 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:28:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:28:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:28:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:28:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk.rescue --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:28:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:28:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk.rescue --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:28:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk.rescue --force-share --output=json" returned: 0 in 0.209s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:28:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:28:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:28:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:28:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:28:07 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:28:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:28:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:28:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:28:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:28:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78784fb7-a25f-4c6c-9a44-649c994004c7/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:28:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78784fb7-a25f-4c6c-9a44-649c994004c7/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:28:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78784fb7-a25f-4c6c-9a44-649c994004c7/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:28:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78784fb7-a25f-4c6c-9a44-649c994004c7/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:28:08 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:28:08 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:28:08 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Hypervisor/Node resource view: name=user free_ram=8178MB free_disk=25.196617126464844GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75245) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 16:28:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:28:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:28:08 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance ed9a6a4e-2e7d-443c-82ef-f14f11d32c81 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:28:08 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 8785a3c2-5b7a-4382-b50d-cecd8743329c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:28:08 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 5de7e10c-f216-46b3-8f74-57bac6ab7e56 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:28:08 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:28:08 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance ed9d1ad5-f5d0-4a68-a073-e7a83be772ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:28:08 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance d42fa9b3-91c3-4216-91f1-655ce140425f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:28:08 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 0b629ca7-b69e-471c-a7b0-9eb43301c36f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:28:08 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 78784fb7-a25f-4c6c-9a44-649c994004c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:28:08 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 16:28:08 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 16:28:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:28:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:28:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75245) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 16:28:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:28:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:28:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:28:08 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:28:08 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:28:08 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Compute_service record updated for user:user {{(pid=75245) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 16:28:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.581s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:28:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3da3b8ed-e49b-4a73-8242-09ea448149f8 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Acquiring lock "d42fa9b3-91c3-4216-91f1-655ce140425f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:28:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3da3b8ed-e49b-4a73-8242-09ea448149f8 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "d42fa9b3-91c3-4216-91f1-655ce140425f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:28:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3da3b8ed-e49b-4a73-8242-09ea448149f8 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Acquiring lock "d42fa9b3-91c3-4216-91f1-655ce140425f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:28:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3da3b8ed-e49b-4a73-8242-09ea448149f8 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "d42fa9b3-91c3-4216-91f1-655ce140425f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:28:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3da3b8ed-e49b-4a73-8242-09ea448149f8 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "d42fa9b3-91c3-4216-91f1-655ce140425f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:28:09 user nova-compute[75245]: INFO nova.compute.manager [None req-3da3b8ed-e49b-4a73-8242-09ea448149f8 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Terminating instance
Nov 29 16:28:09 user nova-compute[75245]: DEBUG nova.compute.manager [None req-3da3b8ed-e49b-4a73-8242-09ea448149f8 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Start destroying the instance on the hypervisor. {{(pid=75245) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 16:28:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:28:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:28:09 user nova-compute[75245]: DEBUG nova.compute.manager [req-6baec2a5-7502-4940-b645-4deffbd7e60f req-ce494f20-f7bc-4725-bf9d-491443f0fe7b service nova] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Received event network-vif-unplugged-497aee0b-487f-4138-9394-a68c8bd55e61 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:28:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-6baec2a5-7502-4940-b645-4deffbd7e60f req-ce494f20-f7bc-4725-bf9d-491443f0fe7b service nova] Acquiring lock "d42fa9b3-91c3-4216-91f1-655ce140425f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:28:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-6baec2a5-7502-4940-b645-4deffbd7e60f req-ce494f20-f7bc-4725-bf9d-491443f0fe7b service nova] Lock "d42fa9b3-91c3-4216-91f1-655ce140425f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:28:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-6baec2a5-7502-4940-b645-4deffbd7e60f req-ce494f20-f7bc-4725-bf9d-491443f0fe7b service nova] Lock "d42fa9b3-91c3-4216-91f1-655ce140425f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:28:09 user nova-compute[75245]: DEBUG nova.compute.manager [req-6baec2a5-7502-4940-b645-4deffbd7e60f req-ce494f20-f7bc-4725-bf9d-491443f0fe7b service nova] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] No waiting events found dispatching network-vif-unplugged-497aee0b-487f-4138-9394-a68c8bd55e61 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:28:09 user nova-compute[75245]: DEBUG nova.compute.manager [req-6baec2a5-7502-4940-b645-4deffbd7e60f req-ce494f20-f7bc-4725-bf9d-491443f0fe7b service nova] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Received event network-vif-unplugged-497aee0b-487f-4138-9394-a68c8bd55e61 for instance with task_state deleting. {{(pid=75245) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 16:28:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:28:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:28:10 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Instance destroyed successfully.
Nov 29 16:28:10 user nova-compute[75245]: DEBUG nova.objects.instance [None req-3da3b8ed-e49b-4a73-8242-09ea448149f8 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lazy-loading 'resources' on Instance uuid d42fa9b3-91c3-4216-91f1-655ce140425f {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:28:10 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-3da3b8ed-e49b-4a73-8242-09ea448149f8 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:21:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-398720439',display_name='tempest-ServerActionsTestOtherA-server-398720439',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-398720439',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBlv185nmJa9KBQWtd25ahGt24w8RxLoAajuGL7vBUTHaz3jTQraFsqx3MIOXaCnGwG9vPuUxlhI7TdDBUzC5IxITSYROv0nohB5+qOZUd0Imt2qi6DOpY2ZQc/HDcV0+g==',key_name='tempest-keypair-7729748',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:23:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c6b87e18ef1f48d19a6907b28cb54f04',ramdisk_id='',reservation_id='r-bs0pty7s',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1840344781',owner_user_name='tempest-ServerActionsTestOtherA-1840344781-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:25:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be595c3f7084413180f2ab86e9c56a64',uuid=d42fa9b3-91c3-4216-91f1-655ce140425f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "497aee0b-487f-4138-9394-a68c8bd55e61", "address": "fa:16:3e:09:ba:94", "network": {"id": "f1fac2f4-e789-443e-b6a5-1a3f829bc302", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1199431077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6b87e18ef1f48d19a6907b28cb54f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap497aee0b-48", "ovs_interfaceid": "497aee0b-487f-4138-9394-a68c8bd55e61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 16:28:10 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-3da3b8ed-e49b-4a73-8242-09ea448149f8 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Converting VIF {"id": "497aee0b-487f-4138-9394-a68c8bd55e61", "address": "fa:16:3e:09:ba:94", "network": {"id": "f1fac2f4-e789-443e-b6a5-1a3f829bc302", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1199431077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6b87e18ef1f48d19a6907b28cb54f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap497aee0b-48", "ovs_interfaceid": "497aee0b-487f-4138-9394-a68c8bd55e61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:28:10 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-3da3b8ed-e49b-4a73-8242-09ea448149f8 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:09:ba:94,bridge_name='br-int',has_traffic_filtering=True,id=497aee0b-487f-4138-9394-a68c8bd55e61,network=Network(f1fac2f4-e789-443e-b6a5-1a3f829bc302),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap497aee0b-48') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:28:10 user nova-compute[75245]: DEBUG os_vif [None req-3da3b8ed-e49b-4a73-8242-09ea448149f8 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:ba:94,bridge_name='br-int',has_traffic_filtering=True,id=497aee0b-487f-4138-9394-a68c8bd55e61,network=Network(f1fac2f4-e789-443e-b6a5-1a3f829bc302),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap497aee0b-48') {{(pid=75245) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 16:28:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:28:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap497aee0b-48, bridge=br-int, if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:28:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:28:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:28:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:28:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cca7898d-c835-43a5-82af-ca94f5d75777) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:28:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:28:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:28:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:28:10 user nova-compute[75245]: INFO os_vif [None req-3da3b8ed-e49b-4a73-8242-09ea448149f8 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:ba:94,bridge_name='br-int',has_traffic_filtering=True,id=497aee0b-487f-4138-9394-a68c8bd55e61,network=Network(f1fac2f4-e789-443e-b6a5-1a3f829bc302),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap497aee0b-48')
Nov 29 16:28:10 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3da3b8ed-e49b-4a73-8242-09ea448149f8 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] calling os-brick to detach iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 16:28:10 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-3da3b8ed-e49b-4a73-8242-09ea448149f8 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, {'target_iqn': 'iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zpXHZUKQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:28:10 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-3da3b8ed-e49b-4a73-8242-09ea448149f8 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:28:10 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-3da3b8ed-e49b-4a73-8242-09ea448149f8 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:28:10 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-3da3b8ed-e49b-4a73-8242-09ea448149f8 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:28:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:28:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:28:10 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b1790a-9d63-406f-b38d-fea75c2345e1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:28:10 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-3da3b8ed-e49b-4a73-8242-09ea448149f8 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 16:28:10 user nova-compute[75245]: No targets found.
Nov 29 16:28:10 user nova-compute[75245]: iSNS:
Nov 29 16:28:10 user nova-compute[75245]: No targets found.
Nov 29 16:28:10 user nova-compute[75245]: STATIC:
Nov 29 16:28:10 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed
Nov 29 16:28:10 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:28:10 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:28:10 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75
Nov 29 16:28:10 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:28:10 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:28:10 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f
Nov 29 16:28:10 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:28:10 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:28:10 user nova-compute[75245]: FIRMWARE:
Nov 29 16:28:10 user nova-compute[75245]: No targets found.
Nov 29 16:28:10 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:28:10 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-3da3b8ed-e49b-4a73-8242-09ea448149f8 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 16:28:10 user nova-compute[75245]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 16:28:10 user nova-compute[75245]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75245) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 16:28:10 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-3da3b8ed-e49b-4a73-8242-09ea448149f8 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f', 0)] {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 16:28:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:28:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:28:10 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ddf841e-4c17-434e-965c-308303c9dcc0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:28:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:28:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:28:10 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3860e89-fd2f-4645-8443-f5f75f19bb0e]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:28:10 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-3da3b8ed-e49b-4a73-8242-09ea448149f8 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)
Nov 29 16:28:10 user nova-compute[75245]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f (non-flash)
Nov 29 16:28:10 user nova-compute[75245]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75 (non-flash)
Nov 29 16:28:10 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:28:10 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-3da3b8ed-e49b-4a73-8242-09ea448149f8 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)
Nov 29 16:28:10 user nova-compute[75245]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f (non-flash)
Nov 29 16:28:10 user nova-compute[75245]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75 (non-flash)
Nov 29 16:28:10 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:28:10 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-3da3b8ed-e49b-4a73-8242-09ea448149f8 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0d4c1c0f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f'): ({'sdb'}, set())}) {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 16:28:10 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-3da3b8ed-e49b-4a73-8242-09ea448149f8 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Removing single pathed devices sdb {{(pid=75245) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 16:28:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:28:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:28:10 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[50721928-82e4-4fa0-99d1-3383f8a62f94]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:28:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:28:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:28:10 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba66d6dd-7602-4e3f-9a49-c9191866511e]: (4, ('ok\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:28:10 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-3da3b8ed-e49b-4a73-8242-09ea448149f8 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Flushing IO for device /dev/sdb {{(pid=75245) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 16:28:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:28:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:28:10 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[3236755f-6184-4f39-b20b-ad6bd9ed9271]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:28:10 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-3da3b8ed-e49b-4a73-8242-09ea448149f8 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75245) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 16:28:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:28:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.110s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:28:10 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[55fdd9c7-2a76-49fb-9a76-59cd406598e5]: (4, ('1', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:28:10 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-3da3b8ed-e49b-4a73-8242-09ea448149f8 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 16:28:10 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-3da3b8ed-e49b-4a73-8242-09ea448149f8 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] SCSI volumes sdb have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 16:28:10 user nova-compute[75245]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_be8cd36b', '/dev/disk/by-id/scsi-23465333932326266', '/dev/disk/by-id/scsi-1SCST_BIObe8cd36b-4e3922bf6640c185') {{(pid=86166) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 29 16:28:10 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[668071ba-30c5-42b1-b901-fddbec11290f]: (4, None) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:28:10 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-3da3b8ed-e49b-4a73-8242-09ea448149f8 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f')] {{(pid=75245) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 16:28:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:28:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.038s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:28:10 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9130ada-391d-4fea-8c7c-cc804107bdef]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:28:10 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-3da3b8ed-e49b-4a73-8242-09ea448149f8 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:28:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f -p 172.16.0.220:3260 --logout {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:28:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:28:10 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9cc9de-e84b-4ed5-b991-be6ed7ae035a]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:28:10 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-3da3b8ed-e49b-4a73-8242-09ea448149f8 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f, portal: 172.16.0.220,3260]
Nov 29 16:28:10 user nova-compute[75245]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f, portal: 172.16.0.220,3260] successful.
Nov 29 16:28:10 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:28:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f -p 172.16.0.220:3260 --op delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:28:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8b52560-8036-45ee-a78b-c74351f1495f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.160s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:28:10 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[afbc0bb0-be83-4781-a8ca-41690c127c00]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:28:10 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-3da3b8ed-e49b-4a73-8242-09ea448149f8 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:28:10 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-3da3b8ed-e49b-4a73-8242-09ea448149f8 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.522s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:28:10 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-3da3b8ed-e49b-4a73-8242-09ea448149f8 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] <== disconnect_volume: return (524ms) None {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:28:10 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3da3b8ed-e49b-4a73-8242-09ea448149f8 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Disconnected iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 16:28:10 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-3da3b8ed-e49b-4a73-8242-09ea448149f8 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Deleting instance files /opt/stack/data/nova/instances/d42fa9b3-91c3-4216-91f1-655ce140425f_del
Nov 29 16:28:10 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-3da3b8ed-e49b-4a73-8242-09ea448149f8 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Deletion of /opt/stack/data/nova/instances/d42fa9b3-91c3-4216-91f1-655ce140425f_del complete
Nov 29 16:28:10 user nova-compute[75245]: INFO nova.compute.manager [None req-3da3b8ed-e49b-4a73-8242-09ea448149f8 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Took 1.39 seconds to destroy the instance on the hypervisor.
Nov 29 16:28:10 user nova-compute[75245]: DEBUG oslo.service.loopingcall [None req-3da3b8ed-e49b-4a73-8242-09ea448149f8 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75245) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 16:28:10 user nova-compute[75245]: DEBUG nova.compute.manager [-] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Deallocating network for instance {{(pid=75245) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 16:28:10 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] deallocate_for_instance() {{(pid=75245) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 16:28:11 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:28:11 user nova-compute[75245]: INFO nova.compute.manager [-] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Took 0.80 seconds to deallocate network for instance.
Nov 29 16:28:11 user nova-compute[75245]: DEBUG nova.compute.manager [req-3594c02e-341e-4ae1-956e-1ea6618be867 req-2a90938d-f7e3-4e3d-8aef-a4b7e2eef4aa service nova] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Received event network-vif-deleted-497aee0b-487f-4138-9394-a68c8bd55e61 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:28:11 user nova-compute[75245]: DEBUG nova.compute.manager [req-afcdd196-1e79-47d2-9555-98e1c52d0a90 req-77155191-c4fb-4a9a-bc91-04623e8cca71 service nova] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Received event network-vif-plugged-497aee0b-487f-4138-9394-a68c8bd55e61 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:28:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-afcdd196-1e79-47d2-9555-98e1c52d0a90 req-77155191-c4fb-4a9a-bc91-04623e8cca71 service nova] Acquiring lock "d42fa9b3-91c3-4216-91f1-655ce140425f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:28:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-afcdd196-1e79-47d2-9555-98e1c52d0a90 req-77155191-c4fb-4a9a-bc91-04623e8cca71 service nova] Lock "d42fa9b3-91c3-4216-91f1-655ce140425f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:28:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-afcdd196-1e79-47d2-9555-98e1c52d0a90 req-77155191-c4fb-4a9a-bc91-04623e8cca71 service nova] Lock "d42fa9b3-91c3-4216-91f1-655ce140425f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:28:11 user nova-compute[75245]: DEBUG nova.compute.manager [req-afcdd196-1e79-47d2-9555-98e1c52d0a90 req-77155191-c4fb-4a9a-bc91-04623e8cca71 service nova] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] No waiting events found dispatching network-vif-plugged-497aee0b-487f-4138-9394-a68c8bd55e61 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:28:11 user nova-compute[75245]: WARNING nova.compute.manager [req-afcdd196-1e79-47d2-9555-98e1c52d0a90 req-77155191-c4fb-4a9a-bc91-04623e8cca71 service nova] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Received unexpected event network-vif-plugged-497aee0b-487f-4138-9394-a68c8bd55e61 for instance with vm_state active and task_state deleting.
Nov 29 16:28:12 user nova-compute[75245]: INFO nova.compute.manager [None req-3da3b8ed-e49b-4a73-8242-09ea448149f8 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Took 0.76 seconds to detach 1 volumes for instance.
Nov 29 16:28:12 user nova-compute[75245]: DEBUG nova.compute.manager [None req-3da3b8ed-e49b-4a73-8242-09ea448149f8 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: d42fa9b3-91c3-4216-91f1-655ce140425f] Deleting volume: e8b52560-8036-45ee-a78b-c74351f1495f {{(pid=75245) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 29 16:28:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3da3b8ed-e49b-4a73-8242-09ea448149f8 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:28:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3da3b8ed-e49b-4a73-8242-09ea448149f8 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:28:12 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-3da3b8ed-e49b-4a73-8242-09ea448149f8 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:28:12 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-3da3b8ed-e49b-4a73-8242-09ea448149f8 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:28:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3da3b8ed-e49b-4a73-8242-09ea448149f8 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.283s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:28:12 user nova-compute[75245]: INFO nova.scheduler.client.report [None req-3da3b8ed-e49b-4a73-8242-09ea448149f8 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Deleted allocations for instance d42fa9b3-91c3-4216-91f1-655ce140425f
Nov 29 16:28:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3da3b8ed-e49b-4a73-8242-09ea448149f8 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "d42fa9b3-91c3-4216-91f1-655ce140425f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.485s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:28:13 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:28:13 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:28:13 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:28:13 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:28:14 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:28:14 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75245) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 16:28:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:28:18 user nova-compute[75245]: DEBUG nova.objects.instance [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lazy-loading 'flavor' on Instance uuid 0b629ca7-b69e-471c-a7b0-9eb43301c36f {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:28:18 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Acquiring lock "refresh_cache-0b629ca7-b69e-471c-a7b0-9eb43301c36f" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:28:18 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Acquired lock "refresh_cache-0b629ca7-b69e-471c-a7b0-9eb43301c36f" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:28:18 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 16:28:18 user nova-compute[75245]: DEBUG nova.objects.instance [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lazy-loading 'info_cache' on Instance uuid 0b629ca7-b69e-471c-a7b0-9eb43301c36f {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG nova.objects.base [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Object Instance<0b629ca7-b69e-471c-a7b0-9eb43301c36f> lazy-loaded attributes: flavor,info_cache {{(pid=75245) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Updating instance_info_cache with network_info: [{"id": "6d28be36-e00b-4f84-9a2b-60515f2e65a1", "address": "fa:16:3e:90:6c:6b", "network": {"id": "2110162d-c25f-4c3d-9a67-18e52f6caf43", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1854809203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba4d99c1c6c4472be06502d8b0e75a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d28be36-e0", "ovs_interfaceid": "6d28be36-e00b-4f84-9a2b-60515f2e65a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Releasing lock "refresh_cache-0b629ca7-b69e-471c-a7b0-9eb43301c36f" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:28:19 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Instance destroyed successfully.
Nov 29 16:28:19 user nova-compute[75245]: DEBUG nova.objects.instance [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lazy-loading 'resources' on Instance uuid 0b629ca7-b69e-471c-a7b0-9eb43301c36f {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG nova.objects.base [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Object Instance<0b629ca7-b69e-471c-a7b0-9eb43301c36f> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75245) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:24:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-871835871',display_name='tempest-AttachVolumeTestJSON-server-871835871',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-871835871',id=27,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTIsqUKP4igeT4gYnfCqdp6pLBcrk+0/CaYGDmMNaIt3Zkf1GMFiqF0F/vVjvbmae59TIWFlaDJkZXQ3lbtxQKuqPvpidiCFuJrrX+TZL7X+RQDx6md7i0ExrSBiMAnKw==',key_name='tempest-keypair-721153735',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:24:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='0ba4d99c1c6c4472be06502d8b0e75a4',ramdisk_id='',reservation_id='r-1rsjawj5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-280497743',owner_user_name='tempest-AttachVolumeTestJSON-280497743-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:26:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d5d3377c73648b8ba9044cfddbfc759',uuid=0b629ca7-b69e-471c-a7b0-9eb43301c36f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "6d28be36-e00b-4f84-9a2b-60515f2e65a1", "address": "fa:16:3e:90:6c:6b", "network": {"id": "2110162d-c25f-4c3d-9a67-18e52f6caf43", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1854809203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba4d99c1c6c4472be06502d8b0e75a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d28be36-e0", "ovs_interfaceid": "6d28be36-e00b-4f84-9a2b-60515f2e65a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Converting VIF {"id": "6d28be36-e00b-4f84-9a2b-60515f2e65a1", "address": "fa:16:3e:90:6c:6b", "network": {"id": "2110162d-c25f-4c3d-9a67-18e52f6caf43", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1854809203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba4d99c1c6c4472be06502d8b0e75a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d28be36-e0", "ovs_interfaceid": "6d28be36-e00b-4f84-9a2b-60515f2e65a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:6c:6b,bridge_name='br-int',has_traffic_filtering=True,id=6d28be36-e00b-4f84-9a2b-60515f2e65a1,network=Network(2110162d-c25f-4c3d-9a67-18e52f6caf43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d28be36-e0') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG os_vif [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:6c:6b,bridge_name='br-int',has_traffic_filtering=True,id=6d28be36-e00b-4f84-9a2b-60515f2e65a1,network=Network(2110162d-c25f-4c3d-9a67-18e52f6caf43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d28be36-e0') {{(pid=75245) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6d28be36-e0, bridge=br-int, if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=457cb758-e9cd-428d-8733-981dd0fffad2) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:28:19 user nova-compute[75245]: INFO os_vif [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:6c:6b,bridge_name='br-int',has_traffic_filtering=True,id=6d28be36-e00b-4f84-9a2b-60515f2e65a1,network=Network(2110162d-c25f-4c3d-9a67-18e52f6caf43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d28be36-e0')
Nov 29 16:28:19 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] calling os-brick to detach iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, {'target_iqn': 'iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rEjNxBRa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:28:19 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:28:19 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f41ff9-6396-4a68-9b4c-85d41208c7e5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 16:28:19 user nova-compute[75245]: No targets found.
Nov 29 16:28:19 user nova-compute[75245]: iSNS:
Nov 29 16:28:19 user nova-compute[75245]: No targets found.
Nov 29 16:28:19 user nova-compute[75245]: STATIC:
Nov 29 16:28:19 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed
Nov 29 16:28:19 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:28:19 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:28:19 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75
Nov 29 16:28:19 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:28:19 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:28:19 user nova-compute[75245]: FIRMWARE:
Nov 29 16:28:19 user nova-compute[75245]: No targets found.
Nov 29 16:28:19 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 16:28:19 user nova-compute[75245]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 16:28:19 user nova-compute[75245]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75245) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75', 0)] {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[4adc3eac-f413-48c7-974e-2825d9ae18c2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d819f23-3d9c-44fb-98f8-c744cf002923]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)
Nov 29 16:28:19 user nova-compute[75245]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75 (non-flash)
Nov 29 16:28:19 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)
Nov 29 16:28:19 user nova-compute[75245]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75 (non-flash)
Nov 29 16:28:19 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0d4c090670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75'): ({'sdf'}, set())}) {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Removing single pathed devices sdf {{(pid=75245) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a586af2-f15a-4d19-94e9-f5e612e1a22f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7358268-8d6f-4277-9fca-f6e979df59cd]: (4, ('ok\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Flushing IO for device /dev/sdf {{(pid=75245) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f0688b6-01b2-4479-8ac9-8b22fd474707]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75245) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.033s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc2cebc-3a10-4955-976c-0c2ea7cc1e98]: (4, ('1', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] SCSI volumes sdf have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75')] {{(pid=75245) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f054e4-6979-4bc8-b33e-d48c043b5732]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75 -p 172.16.0.220:3260 --logout {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[0962ae46-d5ec-4c8d-a4a8-220c48d76838]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75, portal: 172.16.0.220,3260]
Nov 29 16:28:19 user nova-compute[75245]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75, portal: 172.16.0.220,3260] successful.
Nov 29 16:28:19 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75 -p 172.16.0.220:3260 --op delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3f1b1d-ba35-447e-b6eb-532531f245ba]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] <== disconnect_volume: return (277ms) None {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Disconnected iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Start _get_guest_xml network_info=[{"id": "6d28be36-e00b-4f84-9a2b-60515f2e65a1", "address": "fa:16:3e:90:6c:6b", "network": {"id": "2110162d-c25f-4c3d-9a67-18e52f6caf43", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1854809203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba4d99c1c6c4472be06502d8b0e75a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d28be36-e0", "ovs_interfaceid": "6d28be36-e00b-4f84-9a2b-60515f2e65a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'a291d9c3-be02-4c6c-9649-4b45c5b7f487'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'attachment_id': '62481e7a-666e-4e95-862b-31e97d4d4870', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rEjNxBRa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '0b629ca7-b69e-471c-a7b0-9eb43301c36f', 'attached_at': '', 'detached_at': '', 'volume_id': '38349e5b-ff4e-436e-8072-9fb91dc48c75', 'serial': '38349e5b-ff4e-436e-8072-9fb91dc48c75'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'guest_format': None, 'volume_type': None} {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG nova.objects.instance [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lazy-loading 'numa_topology' on Instance uuid 0b629ca7-b69e-471c-a7b0-9eb43301c36f {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG nova.objects.base [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Object Instance<0b629ca7-b69e-471c-a7b0-9eb43301c36f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75245) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 16:28:19 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:28:19 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:28:19 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] CPU controller missing on host. {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] CPU controller found on host. {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75245) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T16:06:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Flavor limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Image limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Flavor pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Image pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Got 1 possible topologies {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG nova.objects.instance [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0b629ca7-b69e-471c-a7b0-9eb43301c36f {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG nova.objects.base [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Object Instance<0b629ca7-b69e-471c-a7b0-9eb43301c36f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75245) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Calling os-brick to attach iSCSI Volume {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 16:28:19 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rEjNxBRa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:28:19 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:28:19 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:28:20 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:28:20 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:28:20 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:28:20 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:28:20 user nova-compute[75245]: INFO os_brick.initiator.connectors.iscsi [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 16:28:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75 -p 172.16.0.220:3260 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:28:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:28:20 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de8a519-062f-4d72-a123-c113795fbb42]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:28:20 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 16:28:20 user nova-compute[75245]:  {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:28:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75 -p 172.16.0.220:3260 --interface default --op new {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:28:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:28:20 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc912f9-6db9-4a18-ac93-a70cd270b645]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75] added\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:28:20 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75] added
Nov 29 16:28:20 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:28:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:28:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:28:20 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15b596f-2eed-47be-a619-579ef336f8ca]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:28:20 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:28:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:28:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:28:20 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[32802b9a-6502-461b-9925-a942f4b3ef7a]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:28:20 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:28:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rEjNxBRa {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:28:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rEjNxBRa" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:28:20 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a11a26-84a6-4f4f-ba20-9228ee8f2b80]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:28:20 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rEjNxBRa'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:28:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:28:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:28:20 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ca7337-3c8f-43e8-8600-b48bcaf63bad]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:28:20 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:28:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:28:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:28:20 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[2398b357-4e73-468d-8dba-de656bcb67c7]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:28:20 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)
Nov 29 16:28:20 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:28:20 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)
Nov 29 16:28:20 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:28:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75 -p 172.16.0.220:3260 --login {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:28:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:28:20 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[b026dc41-a6fb-4f40-98e0-61f03a10cefa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:28:20 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75, portal: 172.16.0.220,3260]
Nov 29 16:28:20 user nova-compute[75245]: Login to [iface: default, target: iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75, portal: 172.16.0.220,3260] successful.
Nov 29 16:28:20 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:28:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:28:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:28:20 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4cf7bc-61a1-4807-80f8-b593d0e2cb33]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:28:20 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:28:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:28:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:28:20 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d4ea93-2e85-4af6-b2c2-5ca8500d1999]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:28:20 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)
Nov 29 16:28:20 user nova-compute[75245]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75 (non-flash)
Nov 29 16:28:20 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:28:20 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)
Nov 29 16:28:20 user nova-compute[75245]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75 (non-flash)
Nov 29 16:28:20 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:28:20 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:28:20 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Connected to 172.16.0.220:3260 {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 16:28:20 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] HCTL ('33', '-', '-', 0) found on session 35 with lun 0 {{(pid=75245) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 16:28:20 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75245) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 16:28:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:28:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:28:20 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e86aa6d-81a5-4571-b09c-2391deacafaf]: (4, ('- - 0', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:28:20 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Searching for a device in session 35 and hctl ['33', '*', '*', 0] yield: None {{(pid=75245) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 16:28:20 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:28:21 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Searching for a device in session 35 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75245) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 16:28:21 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rEjNxBRa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 16:28:21 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:28:21 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] <== connect_volume: return (1283ms) {'type': 'block', 'scsi_wwn': '26435666565353738', 'path': '/dev/sdb'} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:28:21 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26435666565353738', 'path': '/dev/sdb'} {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 16:28:21 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:24:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-871835871',display_name='tempest-AttachVolumeTestJSON-server-871835871',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-871835871',id=27,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTIsqUKP4igeT4gYnfCqdp6pLBcrk+0/CaYGDmMNaIt3Zkf1GMFiqF0F/vVjvbmae59TIWFlaDJkZXQ3lbtxQKuqPvpidiCFuJrrX+TZL7X+RQDx6md7i0ExrSBiMAnKw==',key_name='tempest-keypair-721153735',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:24:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='0ba4d99c1c6c4472be06502d8b0e75a4',ramdisk_id='',reservation_id='r-1rsjawj5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-280497743',owner_user_name='tempest-AttachVolumeTestJSON-280497743-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:26:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d5d3377c73648b8ba9044cfddbfc759',uuid=0b629ca7-b69e-471c-a7b0-9eb43301c36f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "6d28be36-e00b-4f84-9a2b-60515f2e65a1", "address": "fa:16:3e:90:6c:6b", "network": {"id": "2110162d-c25f-4c3d-9a67-18e52f6caf43", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1854809203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba4d99c1c6c4472be06502d8b0e75a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d28be36-e0", "ovs_interfaceid": "6d28be36-e00b-4f84-9a2b-60515f2e65a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:28:21 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Converting VIF {"id": "6d28be36-e00b-4f84-9a2b-60515f2e65a1", "address": "fa:16:3e:90:6c:6b", "network": {"id": "2110162d-c25f-4c3d-9a67-18e52f6caf43", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1854809203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba4d99c1c6c4472be06502d8b0e75a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d28be36-e0", "ovs_interfaceid": "6d28be36-e00b-4f84-9a2b-60515f2e65a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:28:21 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:6c:6b,bridge_name='br-int',has_traffic_filtering=True,id=6d28be36-e00b-4f84-9a2b-60515f2e65a1,network=Network(2110162d-c25f-4c3d-9a67-18e52f6caf43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d28be36-e0') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:28:21 user nova-compute[75245]: DEBUG nova.objects.instance [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lazy-loading 'pci_devices' on Instance uuid 0b629ca7-b69e-471c-a7b0-9eb43301c36f {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:28:21 user nova-compute[75245]: DEBUG nova.objects.base [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Object Instance<0b629ca7-b69e-471c-a7b0-9eb43301c36f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75245) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 16:28:21 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] End _get_guest_xml xml=<domain type="kvm">
Nov 29 16:28:21 user nova-compute[75245]:   <uuid>0b629ca7-b69e-471c-a7b0-9eb43301c36f</uuid>
Nov 29 16:28:21 user nova-compute[75245]:   <name>instance-0000001b</name>
Nov 29 16:28:21 user nova-compute[75245]:   <memory>524288</memory>
Nov 29 16:28:21 user nova-compute[75245]:   <vcpu>1</vcpu>
Nov 29 16:28:21 user nova-compute[75245]:   <metadata>
Nov 29 16:28:21 user nova-compute[75245]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 16:28:21 user nova-compute[75245]:       <nova:package version="0.0.0"/>
Nov 29 16:28:21 user nova-compute[75245]:       <nova:name>tempest-AttachVolumeTestJSON-server-871835871</nova:name>
Nov 29 16:28:21 user nova-compute[75245]:       <nova:creationTime>2023-11-29 16:28:19</nova:creationTime>
Nov 29 16:28:21 user nova-compute[75245]:       <nova:flavor name="m1.tiny">
Nov 29 16:28:21 user nova-compute[75245]:         <nova:memory>512</nova:memory>
Nov 29 16:28:21 user nova-compute[75245]:         <nova:disk>1</nova:disk>
Nov 29 16:28:21 user nova-compute[75245]:         <nova:swap>0</nova:swap>
Nov 29 16:28:21 user nova-compute[75245]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 16:28:21 user nova-compute[75245]:         <nova:vcpus>1</nova:vcpus>
Nov 29 16:28:21 user nova-compute[75245]:       </nova:flavor>
Nov 29 16:28:21 user nova-compute[75245]:       <nova:owner>
Nov 29 16:28:21 user nova-compute[75245]:         <nova:user uuid="6d5d3377c73648b8ba9044cfddbfc759">tempest-AttachVolumeTestJSON-280497743-project-member</nova:user>
Nov 29 16:28:21 user nova-compute[75245]:         <nova:project uuid="0ba4d99c1c6c4472be06502d8b0e75a4">tempest-AttachVolumeTestJSON-280497743</nova:project>
Nov 29 16:28:21 user nova-compute[75245]:       </nova:owner>
Nov 29 16:28:21 user nova-compute[75245]:       <nova:root type="image" uuid="a291d9c3-be02-4c6c-9649-4b45c5b7f487"/>
Nov 29 16:28:21 user nova-compute[75245]:       <nova:ports>
Nov 29 16:28:21 user nova-compute[75245]:         <nova:port uuid="6d28be36-e00b-4f84-9a2b-60515f2e65a1">
Nov 29 16:28:21 user nova-compute[75245]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 16:28:21 user nova-compute[75245]:         </nova:port>
Nov 29 16:28:21 user nova-compute[75245]:       </nova:ports>
Nov 29 16:28:21 user nova-compute[75245]:     </nova:instance>
Nov 29 16:28:21 user nova-compute[75245]:   </metadata>
Nov 29 16:28:21 user nova-compute[75245]:   <sysinfo type="smbios">
Nov 29 16:28:21 user nova-compute[75245]:     <system>
Nov 29 16:28:21 user nova-compute[75245]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 16:28:21 user nova-compute[75245]:       <entry name="product">OpenStack Nova</entry>
Nov 29 16:28:21 user nova-compute[75245]:       <entry name="version">0.0.0</entry>
Nov 29 16:28:21 user nova-compute[75245]:       <entry name="serial">0b629ca7-b69e-471c-a7b0-9eb43301c36f</entry>
Nov 29 16:28:21 user nova-compute[75245]:       <entry name="uuid">0b629ca7-b69e-471c-a7b0-9eb43301c36f</entry>
Nov 29 16:28:21 user nova-compute[75245]:       <entry name="family">Virtual Machine</entry>
Nov 29 16:28:21 user nova-compute[75245]:     </system>
Nov 29 16:28:21 user nova-compute[75245]:   </sysinfo>
Nov 29 16:28:21 user nova-compute[75245]:   <os>
Nov 29 16:28:21 user nova-compute[75245]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 16:28:21 user nova-compute[75245]:     <boot dev="hd"/>
Nov 29 16:28:21 user nova-compute[75245]:     <smbios mode="sysinfo"/>
Nov 29 16:28:21 user nova-compute[75245]:   </os>
Nov 29 16:28:21 user nova-compute[75245]:   <features>
Nov 29 16:28:21 user nova-compute[75245]:     <acpi/>
Nov 29 16:28:21 user nova-compute[75245]:     <apic/>
Nov 29 16:28:21 user nova-compute[75245]:     <vmcoreinfo/>
Nov 29 16:28:21 user nova-compute[75245]:   </features>
Nov 29 16:28:21 user nova-compute[75245]:   <clock offset="utc">
Nov 29 16:28:21 user nova-compute[75245]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 16:28:21 user nova-compute[75245]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 16:28:21 user nova-compute[75245]:     <timer name="hpet" present="no"/>
Nov 29 16:28:21 user nova-compute[75245]:   </clock>
Nov 29 16:28:21 user nova-compute[75245]:   <cpu mode="custom" match="exact">
Nov 29 16:28:21 user nova-compute[75245]:     <model>Nehalem</model>
Nov 29 16:28:21 user nova-compute[75245]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 16:28:21 user nova-compute[75245]:   </cpu>
Nov 29 16:28:21 user nova-compute[75245]:   <devices>
Nov 29 16:28:21 user nova-compute[75245]:     <disk type="file" device="disk">
Nov 29 16:28:21 user nova-compute[75245]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 16:28:21 user nova-compute[75245]:       <source file="/opt/stack/data/nova/instances/0b629ca7-b69e-471c-a7b0-9eb43301c36f/disk"/>
Nov 29 16:28:21 user nova-compute[75245]:       <target dev="vda" bus="virtio"/>
Nov 29 16:28:21 user nova-compute[75245]:     </disk>
Nov 29 16:28:21 user nova-compute[75245]:     <disk type="block" device="disk">
Nov 29 16:28:21 user nova-compute[75245]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:28:21 user nova-compute[75245]:       <source dev="/dev/sdb"/>
Nov 29 16:28:21 user nova-compute[75245]:       <target dev="vdb" bus="virtio"/>
Nov 29 16:28:21 user nova-compute[75245]:       <serial>38349e5b-ff4e-436e-8072-9fb91dc48c75</serial>
Nov 29 16:28:21 user nova-compute[75245]:     </disk>
Nov 29 16:28:21 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 16:28:21 user nova-compute[75245]:       <mac address="fa:16:3e:90:6c:6b"/>
Nov 29 16:28:21 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:28:21 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 16:28:21 user nova-compute[75245]:       <target dev="tap6d28be36-e0"/>
Nov 29 16:28:21 user nova-compute[75245]:     </interface>
Nov 29 16:28:21 user nova-compute[75245]:     <serial type="pty">
Nov 29 16:28:21 user nova-compute[75245]:       <log file="/opt/stack/data/nova/instances/0b629ca7-b69e-471c-a7b0-9eb43301c36f/console.log" append="off"/>
Nov 29 16:28:21 user nova-compute[75245]:     </serial>
Nov 29 16:28:21 user nova-compute[75245]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 16:28:21 user nova-compute[75245]:     <video>
Nov 29 16:28:21 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:28:21 user nova-compute[75245]:     </video>
Nov 29 16:28:21 user nova-compute[75245]:     <rng model="virtio">
Nov 29 16:28:21 user nova-compute[75245]:       <backend model="random">/dev/urandom</backend>
Nov 29 16:28:21 user nova-compute[75245]:     </rng>
Nov 29 16:28:21 user nova-compute[75245]:     <controller type="usb" index="0" model="none"/>
Nov 29 16:28:21 user nova-compute[75245]:     <memballoon model="virtio">
Nov 29 16:28:21 user nova-compute[75245]:       <stats period="10"/>
Nov 29 16:28:21 user nova-compute[75245]:     </memballoon>
Nov 29 16:28:21 user nova-compute[75245]:   </devices>
Nov 29 16:28:21 user nova-compute[75245]: </domain>
Nov 29 16:28:21 user nova-compute[75245]:  {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 16:28:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b629ca7-b69e-471c-a7b0-9eb43301c36f/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:28:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b629ca7-b69e-471c-a7b0-9eb43301c36f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:28:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b629ca7-b69e-471c-a7b0-9eb43301c36f/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:28:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b629ca7-b69e-471c-a7b0-9eb43301c36f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:28:21 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:28:21 user nova-compute[75245]: DEBUG nova.objects.instance [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0b629ca7-b69e-471c-a7b0-9eb43301c36f {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:28:21 user nova-compute[75245]: DEBUG nova.objects.base [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Object Instance<0b629ca7-b69e-471c-a7b0-9eb43301c36f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75245) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 16:28:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:28:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.192s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:28:21 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0b629ca7-b69e-471c-a7b0-9eb43301c36f/disk. size=1073741824 {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 16:28:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b629ca7-b69e-471c-a7b0-9eb43301c36f/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:28:22 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b629ca7-b69e-471c-a7b0-9eb43301c36f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:28:22 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Cannot resize image /opt/stack/data/nova/instances/0b629ca7-b69e-471c-a7b0-9eb43301c36f/disk to a smaller size. {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 16:28:22 user nova-compute[75245]: DEBUG nova.objects.instance [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lazy-loading 'migration_context' on Instance uuid 0b629ca7-b69e-471c-a7b0-9eb43301c36f {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:28:22 user nova-compute[75245]: DEBUG nova.objects.base [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Object Instance<0b629ca7-b69e-471c-a7b0-9eb43301c36f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75245) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 16:28:22 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:24:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-871835871',display_name='tempest-AttachVolumeTestJSON-server-871835871',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-871835871',id=27,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTIsqUKP4igeT4gYnfCqdp6pLBcrk+0/CaYGDmMNaIt3Zkf1GMFiqF0F/vVjvbmae59TIWFlaDJkZXQ3lbtxQKuqPvpidiCFuJrrX+TZL7X+RQDx6md7i0ExrSBiMAnKw==',key_name='tempest-keypair-721153735',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:24:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='0ba4d99c1c6c4472be06502d8b0e75a4',ramdisk_id='',reservation_id='r-1rsjawj5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-280497743',owner_user_name='tempest-AttachVolumeTestJSON-280497743-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:26:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d5d3377c73648b8ba9044cfddbfc759',uuid=0b629ca7-b69e-471c-a7b0-9eb43301c36f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "6d28be36-e00b-4f84-9a2b-60515f2e65a1", "address": "fa:16:3e:90:6c:6b", "network": {"id": "2110162d-c25f-4c3d-9a67-18e52f6caf43", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1854809203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba4d99c1c6c4472be06502d8b0e75a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d28be36-e0", "ovs_interfaceid": "6d28be36-e00b-4f84-9a2b-60515f2e65a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 16:28:22 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Converting VIF {"id": "6d28be36-e00b-4f84-9a2b-60515f2e65a1", "address": "fa:16:3e:90:6c:6b", "network": {"id": "2110162d-c25f-4c3d-9a67-18e52f6caf43", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1854809203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba4d99c1c6c4472be06502d8b0e75a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d28be36-e0", "ovs_interfaceid": "6d28be36-e00b-4f84-9a2b-60515f2e65a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:28:22 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:6c:6b,bridge_name='br-int',has_traffic_filtering=True,id=6d28be36-e00b-4f84-9a2b-60515f2e65a1,network=Network(2110162d-c25f-4c3d-9a67-18e52f6caf43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d28be36-e0') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:28:22 user nova-compute[75245]: DEBUG os_vif [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:6c:6b,bridge_name='br-int',has_traffic_filtering=True,id=6d28be36-e00b-4f84-9a2b-60515f2e65a1,network=Network(2110162d-c25f-4c3d-9a67-18e52f6caf43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d28be36-e0') {{(pid=75245) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 16:28:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:28:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:28:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 16:28:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:28:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd295f6e0-8b9c-5dc8-ba46-5fbf089bf478', '_type': 'linux-noop'}}, row=False) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:28:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:28:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:28:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:28:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6d28be36-e0, may_exist=True, interface_attrs={}) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:28:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6d28be36-e0, col_values=(('qos', UUID('d3922258-78ea-4250-ba08-ea0fdfc47e2b')),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:28:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6d28be36-e0, col_values=(('external_ids', {'iface-id': '6d28be36-e00b-4f84-9a2b-60515f2e65a1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:90:6c:6b', 'vm-uuid': '0b629ca7-b69e-471c-a7b0-9eb43301c36f'}),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:28:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:28:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:28:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:28:22 user nova-compute[75245]: INFO os_vif [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:6c:6b,bridge_name='br-int',has_traffic_filtering=True,id=6d28be36-e00b-4f84-9a2b-60515f2e65a1,network=Network(2110162d-c25f-4c3d-9a67-18e52f6caf43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d28be36-e0')
Nov 29 16:28:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:28:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:28:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:28:23 user nova-compute[75245]: DEBUG nova.compute.manager [req-8211bd2d-9c9a-478f-a2db-8f4b170a8aa0 req-cb05d939-b0d9-4d64-853d-0c1b219c6d4f service nova] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Received event network-vif-plugged-6d28be36-e00b-4f84-9a2b-60515f2e65a1 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:28:23 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-8211bd2d-9c9a-478f-a2db-8f4b170a8aa0 req-cb05d939-b0d9-4d64-853d-0c1b219c6d4f service nova] Acquiring lock "0b629ca7-b69e-471c-a7b0-9eb43301c36f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:28:23 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-8211bd2d-9c9a-478f-a2db-8f4b170a8aa0 req-cb05d939-b0d9-4d64-853d-0c1b219c6d4f service nova] Lock "0b629ca7-b69e-471c-a7b0-9eb43301c36f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:28:23 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-8211bd2d-9c9a-478f-a2db-8f4b170a8aa0 req-cb05d939-b0d9-4d64-853d-0c1b219c6d4f service nova] Lock "0b629ca7-b69e-471c-a7b0-9eb43301c36f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:28:23 user nova-compute[75245]: DEBUG nova.compute.manager [req-8211bd2d-9c9a-478f-a2db-8f4b170a8aa0 req-cb05d939-b0d9-4d64-853d-0c1b219c6d4f service nova] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] No waiting events found dispatching network-vif-plugged-6d28be36-e00b-4f84-9a2b-60515f2e65a1 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:28:23 user nova-compute[75245]: WARNING nova.compute.manager [req-8211bd2d-9c9a-478f-a2db-8f4b170a8aa0 req-cb05d939-b0d9-4d64-853d-0c1b219c6d4f service nova] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Received unexpected event network-vif-plugged-6d28be36-e00b-4f84-9a2b-60515f2e65a1 for instance with vm_state stopped and task_state powering-on.
Nov 29 16:28:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:28:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:28:25 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Instance event wait completed in 0 seconds for  {{(pid=75245) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 16:28:25 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Instance rebooted successfully.
Nov 29 16:28:25 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1aaadf2a-db3b-4d22-bdbb-01156c312590 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:28:25 user nova-compute[75245]: DEBUG nova.compute.manager [req-2effa91c-7d4d-4eca-aff5-b3af1ed708cb req-faf1537a-abe2-4df7-87c7-589e77a1b13c service nova] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Received event network-vif-plugged-6d28be36-e00b-4f84-9a2b-60515f2e65a1 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:28:25 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-2effa91c-7d4d-4eca-aff5-b3af1ed708cb req-faf1537a-abe2-4df7-87c7-589e77a1b13c service nova] Acquiring lock "0b629ca7-b69e-471c-a7b0-9eb43301c36f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:28:25 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-2effa91c-7d4d-4eca-aff5-b3af1ed708cb req-faf1537a-abe2-4df7-87c7-589e77a1b13c service nova] Lock "0b629ca7-b69e-471c-a7b0-9eb43301c36f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:28:25 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-2effa91c-7d4d-4eca-aff5-b3af1ed708cb req-faf1537a-abe2-4df7-87c7-589e77a1b13c service nova] Lock "0b629ca7-b69e-471c-a7b0-9eb43301c36f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:28:25 user nova-compute[75245]: DEBUG nova.compute.manager [req-2effa91c-7d4d-4eca-aff5-b3af1ed708cb req-faf1537a-abe2-4df7-87c7-589e77a1b13c service nova] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] No waiting events found dispatching network-vif-plugged-6d28be36-e00b-4f84-9a2b-60515f2e65a1 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:28:25 user nova-compute[75245]: WARNING nova.compute.manager [req-2effa91c-7d4d-4eca-aff5-b3af1ed708cb req-faf1537a-abe2-4df7-87c7-589e77a1b13c service nova] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Received unexpected event network-vif-plugged-6d28be36-e00b-4f84-9a2b-60515f2e65a1 for instance with vm_state active and task_state None.
Nov 29 16:28:27 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:28:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:28:30 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:28:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:28:37 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:28:39 user nova-compute[75245]: INFO nova.compute.manager [None req-df2bf355-4801-4e24-b425-0841b7896087 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Unrescuing
Nov 29 16:28:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-df2bf355-4801-4e24-b425-0841b7896087 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Acquiring lock "refresh_cache-35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:28:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-df2bf355-4801-4e24-b425-0841b7896087 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Acquired lock "refresh_cache-35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:28:39 user nova-compute[75245]: DEBUG nova.network.neutron [None req-df2bf355-4801-4e24-b425-0841b7896087 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 16:28:39 user nova-compute[75245]: DEBUG nova.network.neutron [None req-df2bf355-4801-4e24-b425-0841b7896087 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Updating instance_info_cache with network_info: [{"id": "545bae30-b03e-41ac-8dd9-f86e85b590d1", "address": "fa:16:3e:26:46:35", "network": {"id": "02098e86-68f8-464e-84ee-bf2fb09b881b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085418471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e12002e1a11f4caf8953371e66e6652e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap545bae30-b0", "ovs_interfaceid": "545bae30-b03e-41ac-8dd9-f86e85b590d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:28:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-df2bf355-4801-4e24-b425-0841b7896087 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Releasing lock "refresh_cache-35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:28:39 user nova-compute[75245]: DEBUG nova.objects.instance [None req-df2bf355-4801-4e24-b425-0841b7896087 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lazy-loading 'flavor' on Instance uuid 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:28:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:28:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:28:39 user nova-compute[75245]: DEBUG nova.compute.manager [req-6ca85730-382c-46e1-9acd-cf518c9f93b8 req-90b3a70c-7c99-420e-a4a6-f03e2b6acf20 service nova] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Received event network-vif-unplugged-545bae30-b03e-41ac-8dd9-f86e85b590d1 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:28:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-6ca85730-382c-46e1-9acd-cf518c9f93b8 req-90b3a70c-7c99-420e-a4a6-f03e2b6acf20 service nova] Acquiring lock "35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:28:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-6ca85730-382c-46e1-9acd-cf518c9f93b8 req-90b3a70c-7c99-420e-a4a6-f03e2b6acf20 service nova] Lock "35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:28:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-6ca85730-382c-46e1-9acd-cf518c9f93b8 req-90b3a70c-7c99-420e-a4a6-f03e2b6acf20 service nova] Lock "35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:28:39 user nova-compute[75245]: DEBUG nova.compute.manager [req-6ca85730-382c-46e1-9acd-cf518c9f93b8 req-90b3a70c-7c99-420e-a4a6-f03e2b6acf20 service nova] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] No waiting events found dispatching network-vif-unplugged-545bae30-b03e-41ac-8dd9-f86e85b590d1 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:28:39 user nova-compute[75245]: WARNING nova.compute.manager [req-6ca85730-382c-46e1-9acd-cf518c9f93b8 req-90b3a70c-7c99-420e-a4a6-f03e2b6acf20 service nova] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Received unexpected event network-vif-unplugged-545bae30-b03e-41ac-8dd9-f86e85b590d1 for instance with vm_state rescued and task_state unrescuing.
Nov 29 16:28:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:28:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:28:40 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Instance destroyed successfully.
Nov 29 16:28:41 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:28:41 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:28:41 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:28:41 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:28:41 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:28:41 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:28:41 user nova-compute[75245]: DEBUG nova.compute.manager [req-2db8afea-12fb-4d61-b806-0f21c61fc6bf req-7df1333e-7e3f-4f90-ac08-7f4b483f360a service nova] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Received event network-vif-plugged-545bae30-b03e-41ac-8dd9-f86e85b590d1 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:28:41 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-2db8afea-12fb-4d61-b806-0f21c61fc6bf req-7df1333e-7e3f-4f90-ac08-7f4b483f360a service nova] Acquiring lock "35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:28:41 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-2db8afea-12fb-4d61-b806-0f21c61fc6bf req-7df1333e-7e3f-4f90-ac08-7f4b483f360a service nova] Lock "35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:28:41 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-2db8afea-12fb-4d61-b806-0f21c61fc6bf req-7df1333e-7e3f-4f90-ac08-7f4b483f360a service nova] Lock "35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:28:41 user nova-compute[75245]: DEBUG nova.compute.manager [req-2db8afea-12fb-4d61-b806-0f21c61fc6bf req-7df1333e-7e3f-4f90-ac08-7f4b483f360a service nova] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] No waiting events found dispatching network-vif-plugged-545bae30-b03e-41ac-8dd9-f86e85b590d1 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:28:41 user nova-compute[75245]: WARNING nova.compute.manager [req-2db8afea-12fb-4d61-b806-0f21c61fc6bf req-7df1333e-7e3f-4f90-ac08-7f4b483f360a service nova] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Received unexpected event network-vif-plugged-545bae30-b03e-41ac-8dd9-f86e85b590d1 for instance with vm_state rescued and task_state unrescuing.
Nov 29 16:28:41 user nova-compute[75245]: DEBUG nova.compute.manager [req-2db8afea-12fb-4d61-b806-0f21c61fc6bf req-7df1333e-7e3f-4f90-ac08-7f4b483f360a service nova] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Received event network-vif-plugged-545bae30-b03e-41ac-8dd9-f86e85b590d1 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:28:41 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-2db8afea-12fb-4d61-b806-0f21c61fc6bf req-7df1333e-7e3f-4f90-ac08-7f4b483f360a service nova] Acquiring lock "35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:28:41 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-2db8afea-12fb-4d61-b806-0f21c61fc6bf req-7df1333e-7e3f-4f90-ac08-7f4b483f360a service nova] Lock "35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:28:41 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-2db8afea-12fb-4d61-b806-0f21c61fc6bf req-7df1333e-7e3f-4f90-ac08-7f4b483f360a service nova] Lock "35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:28:41 user nova-compute[75245]: DEBUG nova.compute.manager [req-2db8afea-12fb-4d61-b806-0f21c61fc6bf req-7df1333e-7e3f-4f90-ac08-7f4b483f360a service nova] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] No waiting events found dispatching network-vif-plugged-545bae30-b03e-41ac-8dd9-f86e85b590d1 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:28:41 user nova-compute[75245]: WARNING nova.compute.manager [req-2db8afea-12fb-4d61-b806-0f21c61fc6bf req-7df1333e-7e3f-4f90-ac08-7f4b483f360a service nova] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Received unexpected event network-vif-plugged-545bae30-b03e-41ac-8dd9-f86e85b590d1 for instance with vm_state rescued and task_state unrescuing.
Nov 29 16:28:41 user nova-compute[75245]: DEBUG nova.compute.manager [req-2db8afea-12fb-4d61-b806-0f21c61fc6bf req-7df1333e-7e3f-4f90-ac08-7f4b483f360a service nova] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Received event network-vif-plugged-545bae30-b03e-41ac-8dd9-f86e85b590d1 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:28:41 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-2db8afea-12fb-4d61-b806-0f21c61fc6bf req-7df1333e-7e3f-4f90-ac08-7f4b483f360a service nova] Acquiring lock "35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:28:41 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-2db8afea-12fb-4d61-b806-0f21c61fc6bf req-7df1333e-7e3f-4f90-ac08-7f4b483f360a service nova] Lock "35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:28:41 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-2db8afea-12fb-4d61-b806-0f21c61fc6bf req-7df1333e-7e3f-4f90-ac08-7f4b483f360a service nova] Lock "35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:28:41 user nova-compute[75245]: DEBUG nova.compute.manager [req-2db8afea-12fb-4d61-b806-0f21c61fc6bf req-7df1333e-7e3f-4f90-ac08-7f4b483f360a service nova] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] No waiting events found dispatching network-vif-plugged-545bae30-b03e-41ac-8dd9-f86e85b590d1 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:28:41 user nova-compute[75245]: WARNING nova.compute.manager [req-2db8afea-12fb-4d61-b806-0f21c61fc6bf req-7df1333e-7e3f-4f90-ac08-7f4b483f360a service nova] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Received unexpected event network-vif-plugged-545bae30-b03e-41ac-8dd9-f86e85b590d1 for instance with vm_state rescued and task_state unrescuing.
Nov 29 16:28:42 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:28:43 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:28:43 user nova-compute[75245]: DEBUG nova.compute.manager [None req-df2bf355-4801-4e24-b425-0841b7896087 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:28:47 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:28:48 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:28:52 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:28:53 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:28:57 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:28:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:29:02 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:29:02 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:29:02 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Starting heal instance info cache {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 16:29:02 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "refresh_cache-35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:29:02 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquired lock "refresh_cache-35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:29:02 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Forcefully refreshing network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 16:29:02 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Updating instance_info_cache with network_info: [{"id": "545bae30-b03e-41ac-8dd9-f86e85b590d1", "address": "fa:16:3e:26:46:35", "network": {"id": "02098e86-68f8-464e-84ee-bf2fb09b881b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085418471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e12002e1a11f4caf8953371e66e6652e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap545bae30-b0", "ovs_interfaceid": "545bae30-b03e-41ac-8dd9-f86e85b590d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:29:02 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Releasing lock "refresh_cache-35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:29:02 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Updated the network info_cache for instance {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 16:29:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4126bb1f-91fa-4f01-8d83-e21cdd0bb2d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Acquiring lock "ed9a6a4e-2e7d-443c-82ef-f14f11d32c81" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:29:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4126bb1f-91fa-4f01-8d83-e21cdd0bb2d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "ed9a6a4e-2e7d-443c-82ef-f14f11d32c81" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:29:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4126bb1f-91fa-4f01-8d83-e21cdd0bb2d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Acquiring lock "ed9a6a4e-2e7d-443c-82ef-f14f11d32c81-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:29:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4126bb1f-91fa-4f01-8d83-e21cdd0bb2d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "ed9a6a4e-2e7d-443c-82ef-f14f11d32c81-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:29:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4126bb1f-91fa-4f01-8d83-e21cdd0bb2d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "ed9a6a4e-2e7d-443c-82ef-f14f11d32c81-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:29:03 user nova-compute[75245]: INFO nova.compute.manager [None req-4126bb1f-91fa-4f01-8d83-e21cdd0bb2d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] Terminating instance
Nov 29 16:29:03 user nova-compute[75245]: DEBUG nova.compute.manager [None req-4126bb1f-91fa-4f01-8d83-e21cdd0bb2d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] Start destroying the instance on the hypervisor. {{(pid=75245) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 16:29:03 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:29:03 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:29:03 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:29:03 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:29:03 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:29:03 user nova-compute[75245]: DEBUG nova.compute.manager [req-cfc41c9e-047d-4e60-9d7a-6fb0c697e5f9 req-cf64daf3-85bf-43df-bb9e-7e0a5c0316e5 service nova] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] Received event network-vif-unplugged-c72edead-bad2-45c4-9ac8-90dd2a4f8ed5 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:29:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-cfc41c9e-047d-4e60-9d7a-6fb0c697e5f9 req-cf64daf3-85bf-43df-bb9e-7e0a5c0316e5 service nova] Acquiring lock "ed9a6a4e-2e7d-443c-82ef-f14f11d32c81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:29:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-cfc41c9e-047d-4e60-9d7a-6fb0c697e5f9 req-cf64daf3-85bf-43df-bb9e-7e0a5c0316e5 service nova] Lock "ed9a6a4e-2e7d-443c-82ef-f14f11d32c81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:29:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-cfc41c9e-047d-4e60-9d7a-6fb0c697e5f9 req-cf64daf3-85bf-43df-bb9e-7e0a5c0316e5 service nova] Lock "ed9a6a4e-2e7d-443c-82ef-f14f11d32c81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:29:03 user nova-compute[75245]: DEBUG nova.compute.manager [req-cfc41c9e-047d-4e60-9d7a-6fb0c697e5f9 req-cf64daf3-85bf-43df-bb9e-7e0a5c0316e5 service nova] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] No waiting events found dispatching network-vif-unplugged-c72edead-bad2-45c4-9ac8-90dd2a4f8ed5 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:29:03 user nova-compute[75245]: DEBUG nova.compute.manager [req-cfc41c9e-047d-4e60-9d7a-6fb0c697e5f9 req-cf64daf3-85bf-43df-bb9e-7e0a5c0316e5 service nova] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] Received event network-vif-unplugged-c72edead-bad2-45c4-9ac8-90dd2a4f8ed5 for instance with task_state deleting. {{(pid=75245) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 16:29:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:29:04 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] Instance destroyed successfully.
Nov 29 16:29:04 user nova-compute[75245]: DEBUG nova.objects.instance [None req-4126bb1f-91fa-4f01-8d83-e21cdd0bb2d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lazy-loading 'resources' on Instance uuid ed9a6a4e-2e7d-443c-82ef-f14f11d32c81 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:29:04 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-4126bb1f-91fa-4f01-8d83-e21cdd0bb2d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:10:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-770743428',display_name='tempest-ServerActionsTestOtherA-server-770743428',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-770743428',id=3,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBlv185nmJa9KBQWtd25ahGt24w8RxLoAajuGL7vBUTHaz3jTQraFsqx3MIOXaCnGwG9vPuUxlhI7TdDBUzC5IxITSYROv0nohB5+qOZUd0Imt2qi6DOpY2ZQc/HDcV0+g==',key_name='tempest-keypair-7729748',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:10:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c6b87e18ef1f48d19a6907b28cb54f04',ramdisk_id='',reservation_id='r-ltass5rn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1840344781',owner_user_name='tempest-ServerActionsTestOtherA-1840344781-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:10:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be595c3f7084413180f2ab86e9c56a64',uuid=ed9a6a4e-2e7d-443c-82ef-f14f11d32c81,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c72edead-bad2-45c4-9ac8-90dd2a4f8ed5", "address": "fa:16:3e:bb:74:67", "network": {"id": "f1fac2f4-e789-443e-b6a5-1a3f829bc302", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1199431077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6b87e18ef1f48d19a6907b28cb54f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc72edead-ba", "ovs_interfaceid": "c72edead-bad2-45c4-9ac8-90dd2a4f8ed5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 16:29:04 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-4126bb1f-91fa-4f01-8d83-e21cdd0bb2d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Converting VIF {"id": "c72edead-bad2-45c4-9ac8-90dd2a4f8ed5", "address": "fa:16:3e:bb:74:67", "network": {"id": "f1fac2f4-e789-443e-b6a5-1a3f829bc302", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1199431077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6b87e18ef1f48d19a6907b28cb54f04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc72edead-ba", "ovs_interfaceid": "c72edead-bad2-45c4-9ac8-90dd2a4f8ed5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:29:04 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-4126bb1f-91fa-4f01-8d83-e21cdd0bb2d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bb:74:67,bridge_name='br-int',has_traffic_filtering=True,id=c72edead-bad2-45c4-9ac8-90dd2a4f8ed5,network=Network(f1fac2f4-e789-443e-b6a5-1a3f829bc302),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc72edead-ba') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:29:04 user nova-compute[75245]: DEBUG os_vif [None req-4126bb1f-91fa-4f01-8d83-e21cdd0bb2d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:74:67,bridge_name='br-int',has_traffic_filtering=True,id=c72edead-bad2-45c4-9ac8-90dd2a4f8ed5,network=Network(f1fac2f4-e789-443e-b6a5-1a3f829bc302),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc72edead-ba') {{(pid=75245) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 16:29:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:29:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc72edead-ba, bridge=br-int, if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:29:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:29:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:29:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:29:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=496146bb-a85c-4d23-a6ee-bd8912c8a899) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:29:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:29:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:29:04 user nova-compute[75245]: INFO os_vif [None req-4126bb1f-91fa-4f01-8d83-e21cdd0bb2d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:74:67,bridge_name='br-int',has_traffic_filtering=True,id=c72edead-bad2-45c4-9ac8-90dd2a4f8ed5,network=Network(f1fac2f4-e789-443e-b6a5-1a3f829bc302),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc72edead-ba')
Nov 29 16:29:04 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-4126bb1f-91fa-4f01-8d83-e21cdd0bb2d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] Deleting instance files /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81_del
Nov 29 16:29:04 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-4126bb1f-91fa-4f01-8d83-e21cdd0bb2d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] Deletion of /opt/stack/data/nova/instances/ed9a6a4e-2e7d-443c-82ef-f14f11d32c81_del complete
Nov 29 16:29:04 user nova-compute[75245]: INFO nova.compute.manager [None req-4126bb1f-91fa-4f01-8d83-e21cdd0bb2d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 29 16:29:04 user nova-compute[75245]: DEBUG oslo.service.loopingcall [None req-4126bb1f-91fa-4f01-8d83-e21cdd0bb2d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75245) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 16:29:04 user nova-compute[75245]: DEBUG nova.compute.manager [-] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] Deallocating network for instance {{(pid=75245) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 16:29:04 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] deallocate_for_instance() {{(pid=75245) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 16:29:04 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:29:04 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:29:04 user nova-compute[75245]: INFO nova.compute.manager [-] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] Took 0.54 seconds to deallocate network for instance.
Nov 29 16:29:04 user nova-compute[75245]: DEBUG nova.compute.manager [req-001660ad-b2b5-405e-8d6a-f481ac4317d8 req-53507cd1-1ded-42cd-bdf2-af0364743ebc service nova] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] Received event network-vif-deleted-c72edead-bad2-45c4-9ac8-90dd2a4f8ed5 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:29:04 user nova-compute[75245]: INFO nova.compute.manager [req-001660ad-b2b5-405e-8d6a-f481ac4317d8 req-53507cd1-1ded-42cd-bdf2-af0364743ebc service nova] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] Neutron deleted interface c72edead-bad2-45c4-9ac8-90dd2a4f8ed5; detaching it from the instance and deleting it from the info cache
Nov 29 16:29:04 user nova-compute[75245]: DEBUG nova.network.neutron [req-001660ad-b2b5-405e-8d6a-f481ac4317d8 req-53507cd1-1ded-42cd-bdf2-af0364743ebc service nova] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:29:04 user nova-compute[75245]: DEBUG nova.compute.manager [req-001660ad-b2b5-405e-8d6a-f481ac4317d8 req-53507cd1-1ded-42cd-bdf2-af0364743ebc service nova] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] Detach interface failed, port_id=c72edead-bad2-45c4-9ac8-90dd2a4f8ed5, reason: Instance ed9a6a4e-2e7d-443c-82ef-f14f11d32c81 could not be found. {{(pid=75245) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 16:29:04 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4126bb1f-91fa-4f01-8d83-e21cdd0bb2d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:29:04 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4126bb1f-91fa-4f01-8d83-e21cdd0bb2d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:29:05 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-4126bb1f-91fa-4f01-8d83-e21cdd0bb2d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:29:05 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-4126bb1f-91fa-4f01-8d83-e21cdd0bb2d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:29:05 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4126bb1f-91fa-4f01-8d83-e21cdd0bb2d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.305s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:29:05 user nova-compute[75245]: INFO nova.scheduler.client.report [None req-4126bb1f-91fa-4f01-8d83-e21cdd0bb2d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Deleted allocations for instance ed9a6a4e-2e7d-443c-82ef-f14f11d32c81
Nov 29 16:29:05 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4126bb1f-91fa-4f01-8d83-e21cdd0bb2d2 tempest-ServerActionsTestOtherA-1840344781 tempest-ServerActionsTestOtherA-1840344781-project-member] Lock "ed9a6a4e-2e7d-443c-82ef-f14f11d32c81" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.902s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:29:05 user nova-compute[75245]: DEBUG nova.compute.manager [req-72f13dec-26cc-42f9-a570-e5f81870e8df req-d5a24cb8-f8ec-4af4-b166-1ad9934e58bd service nova] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] Received event network-vif-plugged-c72edead-bad2-45c4-9ac8-90dd2a4f8ed5 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:29:05 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-72f13dec-26cc-42f9-a570-e5f81870e8df req-d5a24cb8-f8ec-4af4-b166-1ad9934e58bd service nova] Acquiring lock "ed9a6a4e-2e7d-443c-82ef-f14f11d32c81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:29:05 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-72f13dec-26cc-42f9-a570-e5f81870e8df req-d5a24cb8-f8ec-4af4-b166-1ad9934e58bd service nova] Lock "ed9a6a4e-2e7d-443c-82ef-f14f11d32c81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:29:05 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-72f13dec-26cc-42f9-a570-e5f81870e8df req-d5a24cb8-f8ec-4af4-b166-1ad9934e58bd service nova] Lock "ed9a6a4e-2e7d-443c-82ef-f14f11d32c81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:29:05 user nova-compute[75245]: DEBUG nova.compute.manager [req-72f13dec-26cc-42f9-a570-e5f81870e8df req-d5a24cb8-f8ec-4af4-b166-1ad9934e58bd service nova] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] No waiting events found dispatching network-vif-plugged-c72edead-bad2-45c4-9ac8-90dd2a4f8ed5 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:29:05 user nova-compute[75245]: WARNING nova.compute.manager [req-72f13dec-26cc-42f9-a570-e5f81870e8df req-d5a24cb8-f8ec-4af4-b166-1ad9934e58bd service nova] [instance: ed9a6a4e-2e7d-443c-82ef-f14f11d32c81] Received unexpected event network-vif-plugged-c72edead-bad2-45c4-9ac8-90dd2a4f8ed5 for instance with vm_state deleted and task_state None.
Nov 29 16:29:06 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:29:06 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:29:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:29:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:29:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:29:06 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75245) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 16:29:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b629ca7-b69e-471c-a7b0-9eb43301c36f/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:29:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b629ca7-b69e-471c-a7b0-9eb43301c36f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:29:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b629ca7-b69e-471c-a7b0-9eb43301c36f/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:29:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b629ca7-b69e-471c-a7b0-9eb43301c36f/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:29:06 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:29:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:29:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:29:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:29:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:29:07 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:29:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:29:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:29:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:29:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:29:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk.rescue --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:29:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:29:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk.rescue --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:29:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:29:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:29:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:29:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:29:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:29:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78784fb7-a25f-4c6c-9a44-649c994004c7/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:29:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:29:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78784fb7-a25f-4c6c-9a44-649c994004c7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:29:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78784fb7-a25f-4c6c-9a44-649c994004c7/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:29:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78784fb7-a25f-4c6c-9a44-649c994004c7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:29:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:29:09 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:29:09 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:29:09 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Hypervisor/Node resource view: name=user free_ram=8371MB free_disk=25.221378326416016GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75245) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 16:29:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:29:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:29:09 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 8785a3c2-5b7a-4382-b50d-cecd8743329c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:29:09 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 5de7e10c-f216-46b3-8f74-57bac6ab7e56 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:29:09 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:29:09 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance ed9d1ad5-f5d0-4a68-a073-e7a83be772ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:29:09 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 0b629ca7-b69e-471c-a7b0-9eb43301c36f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:29:09 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 78784fb7-a25f-4c6c-9a44-649c994004c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:29:09 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 16:29:09 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 16:29:09 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:29:09 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:29:09 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Compute_service record updated for user:user {{(pid=75245) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 16:29:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.385s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:29:11 user nova-compute[75245]: DEBUG nova.compute.manager [None req-d8a53a85-d79e-4626-858e-81968490198e tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 78784fb7-a25f-4c6c-9a44-649c994004c7] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:29:11 user nova-compute[75245]: INFO nova.compute.manager [None req-d8a53a85-d79e-4626-858e-81968490198e tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 78784fb7-a25f-4c6c-9a44-649c994004c7] instance snapshotting
Nov 29 16:29:11 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-d8a53a85-d79e-4626-858e-81968490198e tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 78784fb7-a25f-4c6c-9a44-649c994004c7] Beginning live snapshot process
Nov 29 16:29:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-d8a53a85-d79e-4626-858e-81968490198e tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78784fb7-a25f-4c6c-9a44-649c994004c7/disk --force-share --output=json -f qcow2 {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:29:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-d8a53a85-d79e-4626-858e-81968490198e tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78784fb7-a25f-4c6c-9a44-649c994004c7/disk --force-share --output=json -f qcow2" returned: 0 in 0.175s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:29:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-d8a53a85-d79e-4626-858e-81968490198e tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78784fb7-a25f-4c6c-9a44-649c994004c7/disk --force-share --output=json -f qcow2 {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:29:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-d8a53a85-d79e-4626-858e-81968490198e tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78784fb7-a25f-4c6c-9a44-649c994004c7/disk --force-share --output=json -f qcow2" returned: 0 in 0.167s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:29:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-d8a53a85-d79e-4626-858e-81968490198e tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:29:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-d8a53a85-d79e-4626-858e-81968490198e tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.175s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:29:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-d8a53a85-d79e-4626-858e-81968490198e tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp9_t9fcpz/9fd0f2a3af274b66a5fcc798ee9f0403.delta 1073741824 {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:29:12 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:29:12 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:29:12 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:29:12 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:29:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-d8a53a85-d79e-4626-858e-81968490198e tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp9_t9fcpz/9fd0f2a3af274b66a5fcc798ee9f0403.delta 1073741824" returned: 0 in 0.048s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:29:12 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-d8a53a85-d79e-4626-858e-81968490198e tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 78784fb7-a25f-4c6c-9a44-649c994004c7] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 29 16:29:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-d8a53a85-d79e-4626-858e-81968490198e tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75245) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 16:29:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:29:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-d8a53a85-d79e-4626-858e-81968490198e tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75245) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 16:29:13 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-d8a53a85-d79e-4626-858e-81968490198e tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 78784fb7-a25f-4c6c-9a44-649c994004c7] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 29 16:29:13 user nova-compute[75245]: DEBUG nova.privsep.utils [None req-d8a53a85-d79e-4626-858e-81968490198e tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75245) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 16:29:13 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-d8a53a85-d79e-4626-858e-81968490198e tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp9_t9fcpz/9fd0f2a3af274b66a5fcc798ee9f0403.delta /opt/stack/data/nova/instances/snapshots/tmp9_t9fcpz/9fd0f2a3af274b66a5fcc798ee9f0403 {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:29:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:29:14 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:29:14 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75245) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 16:29:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-d8a53a85-d79e-4626-858e-81968490198e tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp9_t9fcpz/9fd0f2a3af274b66a5fcc798ee9f0403.delta /opt/stack/data/nova/instances/snapshots/tmp9_t9fcpz/9fd0f2a3af274b66a5fcc798ee9f0403" returned: 0 in 0.704s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:29:14 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-d8a53a85-d79e-4626-858e-81968490198e tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 78784fb7-a25f-4c6c-9a44-649c994004c7] Snapshot extracted, beginning image upload
Nov 29 16:29:17 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-d8a53a85-d79e-4626-858e-81968490198e tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 78784fb7-a25f-4c6c-9a44-649c994004c7] Snapshot image upload complete
Nov 29 16:29:17 user nova-compute[75245]: INFO nova.compute.manager [None req-d8a53a85-d79e-4626-858e-81968490198e tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 78784fb7-a25f-4c6c-9a44-649c994004c7] Took 5.13 seconds to snapshot the instance on the hypervisor.
Nov 29 16:29:18 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:29:19 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:29:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:29:29 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:29:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:29:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:29:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:29:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75245) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 16:29:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:29:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:29:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:29:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:29:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:29:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:29:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75245) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 16:29:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:29:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:29:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:29:53 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:29:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:29:56 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:29:59 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:30:01 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:30:02 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:30:02 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Starting heal instance info cache {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 16:30:02 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "refresh_cache-ed9d1ad5-f5d0-4a68-a073-e7a83be772ea" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:30:02 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquired lock "refresh_cache-ed9d1ad5-f5d0-4a68-a073-e7a83be772ea" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:30:02 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Forcefully refreshing network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 16:30:02 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Updating instance_info_cache with network_info: [{"id": "592b836b-e112-414f-b9a9-60e5f65b8f98", "address": "fa:16:3e:90:86:e1", "network": {"id": "02098e86-68f8-464e-84ee-bf2fb09b881b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085418471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e12002e1a11f4caf8953371e66e6652e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592b836b-e1", "ovs_interfaceid": "592b836b-e112-414f-b9a9-60e5f65b8f98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:30:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Releasing lock "refresh_cache-ed9d1ad5-f5d0-4a68-a073-e7a83be772ea" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:30:03 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Updated the network info_cache for instance {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 16:30:03 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:30:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:30:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:30:05 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:30:06 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:30:06 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:30:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:30:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:30:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:30:06 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75245) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 16:30:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b629ca7-b69e-471c-a7b0-9eb43301c36f/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:30:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b629ca7-b69e-471c-a7b0-9eb43301c36f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:30:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b629ca7-b69e-471c-a7b0-9eb43301c36f/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:30:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b629ca7-b69e-471c-a7b0-9eb43301c36f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:30:06 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:30:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:30:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Acquiring lock "0f4fa79b-345a-4e58-a77c-fdfed675e6e7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:30:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Lock "0f4fa79b-345a-4e58-a77c-fdfed675e6e7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:30:07 user nova-compute[75245]: DEBUG nova.compute.manager [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Starting instance... {{(pid=75245) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 16:30:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:30:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:30:07 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75245) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 16:30:07 user nova-compute[75245]: INFO nova.compute.claims [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Claim successful on node user
Nov 29 16:30:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:30:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:30:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:30:07 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:30:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:30:07 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:30:07 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:30:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:30:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:30:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.460s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:30:07 user nova-compute[75245]: DEBUG nova.compute.manager [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Start building networks asynchronously for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 16:30:07 user nova-compute[75245]: DEBUG nova.compute.manager [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Allocating IP information in the background. {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 16:30:07 user nova-compute[75245]: DEBUG nova.network.neutron [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] allocate_for_instance() {{(pid=75245) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 16:30:07 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 16:30:07 user nova-compute[75245]: DEBUG nova.compute.manager [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Start building block device mappings for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 16:30:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:30:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk.rescue --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:30:07 user nova-compute[75245]: DEBUG nova.policy [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4222ccbed0bd4fa084e80d5c72cd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ae03075ca94c57af11198359d26514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75245) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 16:30:07 user nova-compute[75245]: DEBUG nova.compute.manager [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Start spawning the instance on the hypervisor. {{(pid=75245) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 16:30:07 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Creating instance directory {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 16:30:07 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Creating image(s)
Nov 29 16:30:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Acquiring lock "/opt/stack/data/nova/instances/0f4fa79b-345a-4e58-a77c-fdfed675e6e7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:30:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Lock "/opt/stack/data/nova/instances/0f4fa79b-345a-4e58-a77c-fdfed675e6e7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:30:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Lock "/opt/stack/data/nova/instances/0f4fa79b-345a-4e58-a77c-fdfed675e6e7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:30:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:30:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:30:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk.rescue --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:30:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.168s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:30:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Acquiring lock "d654f7206043e05d3525550b0fc885556eb999f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:30:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:30:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:30:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:30:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:30:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.175s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:30:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/0f4fa79b-345a-4e58-a77c-fdfed675e6e7/disk 1073741824 {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:30:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/0f4fa79b-345a-4e58-a77c-fdfed675e6e7/disk 1073741824" returned: 0 in 0.058s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:30:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:30:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:30:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:30:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:30:08 user nova-compute[75245]: DEBUG nova.network.neutron [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Successfully created port: 0b59ddaf-c343-420d-9cf5-93d5fa48bc23 {{(pid=75245) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 16:30:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.185s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:30:08 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0f4fa79b-345a-4e58-a77c-fdfed675e6e7/disk. size=1073741824 {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 16:30:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f4fa79b-345a-4e58-a77c-fdfed675e6e7/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:30:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:30:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78784fb7-a25f-4c6c-9a44-649c994004c7/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:30:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:30:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f4fa79b-345a-4e58-a77c-fdfed675e6e7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:30:08 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Cannot resize image /opt/stack/data/nova/instances/0f4fa79b-345a-4e58-a77c-fdfed675e6e7/disk to a smaller size. {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 16:30:08 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Created local disks {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 16:30:08 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Ensure instance console log exists: /opt/stack/data/nova/instances/0f4fa79b-345a-4e58-a77c-fdfed675e6e7/console.log {{(pid=75245) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 16:30:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:30:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:30:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:30:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78784fb7-a25f-4c6c-9a44-649c994004c7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:30:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78784fb7-a25f-4c6c-9a44-649c994004c7/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:30:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78784fb7-a25f-4c6c-9a44-649c994004c7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:30:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:30:09 user nova-compute[75245]: DEBUG nova.network.neutron [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Successfully updated port: 0b59ddaf-c343-420d-9cf5-93d5fa48bc23 {{(pid=75245) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 16:30:09 user nova-compute[75245]: DEBUG nova.compute.manager [req-23d16d0a-f9ce-4bd8-b5e3-e49a76990856 req-99a2b3f2-4b6a-49f5-8f8d-4576146aa292 service nova] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Received event network-changed-0b59ddaf-c343-420d-9cf5-93d5fa48bc23 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:30:09 user nova-compute[75245]: DEBUG nova.compute.manager [req-23d16d0a-f9ce-4bd8-b5e3-e49a76990856 req-99a2b3f2-4b6a-49f5-8f8d-4576146aa292 service nova] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Refreshing instance network info cache due to event network-changed-0b59ddaf-c343-420d-9cf5-93d5fa48bc23. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:30:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-23d16d0a-f9ce-4bd8-b5e3-e49a76990856 req-99a2b3f2-4b6a-49f5-8f8d-4576146aa292 service nova] Acquiring lock "refresh_cache-0f4fa79b-345a-4e58-a77c-fdfed675e6e7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:30:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-23d16d0a-f9ce-4bd8-b5e3-e49a76990856 req-99a2b3f2-4b6a-49f5-8f8d-4576146aa292 service nova] Acquired lock "refresh_cache-0f4fa79b-345a-4e58-a77c-fdfed675e6e7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:30:09 user nova-compute[75245]: DEBUG nova.network.neutron [req-23d16d0a-f9ce-4bd8-b5e3-e49a76990856 req-99a2b3f2-4b6a-49f5-8f8d-4576146aa292 service nova] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Refreshing network info cache for port 0b59ddaf-c343-420d-9cf5-93d5fa48bc23 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:30:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Acquiring lock "refresh_cache-0f4fa79b-345a-4e58-a77c-fdfed675e6e7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:30:09 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:30:09 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:30:09 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Hypervisor/Node resource view: name=user free_ram=8469MB free_disk=25.170879364013672GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75245) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 16:30:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:30:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:30:09 user nova-compute[75245]: DEBUG nova.network.neutron [req-23d16d0a-f9ce-4bd8-b5e3-e49a76990856 req-99a2b3f2-4b6a-49f5-8f8d-4576146aa292 service nova] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Instance cache missing network info. {{(pid=75245) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 16:30:09 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 8785a3c2-5b7a-4382-b50d-cecd8743329c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:30:09 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 5de7e10c-f216-46b3-8f74-57bac6ab7e56 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:30:09 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:30:09 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance ed9d1ad5-f5d0-4a68-a073-e7a83be772ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:30:09 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 0b629ca7-b69e-471c-a7b0-9eb43301c36f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:30:09 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 78784fb7-a25f-4c6c-9a44-649c994004c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:30:09 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 0f4fa79b-345a-4e58-a77c-fdfed675e6e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:30:09 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 16:30:09 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 16:30:09 user nova-compute[75245]: DEBUG nova.network.neutron [req-23d16d0a-f9ce-4bd8-b5e3-e49a76990856 req-99a2b3f2-4b6a-49f5-8f8d-4576146aa292 service nova] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:30:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-23d16d0a-f9ce-4bd8-b5e3-e49a76990856 req-99a2b3f2-4b6a-49f5-8f8d-4576146aa292 service nova] Releasing lock "refresh_cache-0f4fa79b-345a-4e58-a77c-fdfed675e6e7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:30:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Acquired lock "refresh_cache-0f4fa79b-345a-4e58-a77c-fdfed675e6e7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:30:09 user nova-compute[75245]: DEBUG nova.network.neutron [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 16:30:09 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:30:09 user nova-compute[75245]: DEBUG nova.network.neutron [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Instance cache missing network info. {{(pid=75245) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 16:30:09 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:30:09 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Compute_service record updated for user:user {{(pid=75245) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 16:30:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.484s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:30:09 user nova-compute[75245]: DEBUG nova.network.neutron [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Updating instance_info_cache with network_info: [{"id": "0b59ddaf-c343-420d-9cf5-93d5fa48bc23", "address": "fa:16:3e:12:d2:ca", "network": {"id": "74420114-8c7f-4f7b-9589-8605e1a2b922", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1124145478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12ae03075ca94c57af11198359d26514", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b59ddaf-c3", "ovs_interfaceid": "0b59ddaf-c343-420d-9cf5-93d5fa48bc23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:30:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Releasing lock "refresh_cache-0f4fa79b-345a-4e58-a77c-fdfed675e6e7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:30:10 user nova-compute[75245]: DEBUG nova.compute.manager [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Instance network_info: |[{"id": "0b59ddaf-c343-420d-9cf5-93d5fa48bc23", "address": "fa:16:3e:12:d2:ca", "network": {"id": "74420114-8c7f-4f7b-9589-8605e1a2b922", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1124145478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12ae03075ca94c57af11198359d26514", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b59ddaf-c3", "ovs_interfaceid": "0b59ddaf-c343-420d-9cf5-93d5fa48bc23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 16:30:10 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Start _get_guest_xml network_info=[{"id": "0b59ddaf-c343-420d-9cf5-93d5fa48bc23", "address": "fa:16:3e:12:d2:ca", "network": {"id": "74420114-8c7f-4f7b-9589-8605e1a2b922", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1124145478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12ae03075ca94c57af11198359d26514", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b59ddaf-c3", "ovs_interfaceid": "0b59ddaf-c343-420d-9cf5-93d5fa48bc23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'a291d9c3-be02-4c6c-9649-4b45c5b7f487'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 16:30:10 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:30:10 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:30:10 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 16:30:10 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] CPU controller missing on host. {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 16:30:10 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 16:30:10 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] CPU controller found on host. {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 16:30:10 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75245) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 16:30:10 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T16:06:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 16:30:10 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Flavor limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 16:30:10 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Image limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 16:30:10 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Flavor pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 16:30:10 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Image pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 16:30:10 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 16:30:10 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 16:30:10 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 16:30:10 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Got 1 possible topologies {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 16:30:10 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 16:30:10 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 16:30:10 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:30:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-513385249',display_name='tempest-ServerStableDeviceRescueTest-server-513385249',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-513385249',id=29,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL1Z68o0lP6Hi7Hps1ExPAu//BM0Y3yUpeo20GOYYPdy96iUaa/DNByIByWzZ26Oh5Df0t6c9Eobojc//k6HPkTz9N7Nd3BYUDK2hhL44idE2i+iJ7tKl8lnWLgL/rJ52g==',key_name='tempest-keypair-502202166',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12ae03075ca94c57af11198359d26514',ramdisk_id='',reservation_id='r-xnixzkar',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-101632514',owner_user_name='tempest-ServerStableDeviceRescueTest-101632514-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:30:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4222ccbed0bd4fa084e80d5c72cd9f58',uuid=0f4fa79b-345a-4e58-a77c-fdfed675e6e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b59ddaf-c343-420d-9cf5-93d5fa48bc23", "address": "fa:16:3e:12:d2:ca", "network": {"id": "74420114-8c7f-4f7b-9589-8605e1a2b922", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1124145478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12ae03075ca94c57af11198359d26514", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b59ddaf-c3", "ovs_interfaceid": "0b59ddaf-c343-420d-9cf5-93d5fa48bc23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:30:10 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Converting VIF {"id": "0b59ddaf-c343-420d-9cf5-93d5fa48bc23", "address": "fa:16:3e:12:d2:ca", "network": {"id": "74420114-8c7f-4f7b-9589-8605e1a2b922", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1124145478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12ae03075ca94c57af11198359d26514", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b59ddaf-c3", "ovs_interfaceid": "0b59ddaf-c343-420d-9cf5-93d5fa48bc23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:30:10 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:d2:ca,bridge_name='br-int',has_traffic_filtering=True,id=0b59ddaf-c343-420d-9cf5-93d5fa48bc23,network=Network(74420114-8c7f-4f7b-9589-8605e1a2b922),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b59ddaf-c3') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:30:10 user nova-compute[75245]: DEBUG nova.objects.instance [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Lazy-loading 'pci_devices' on Instance uuid 0f4fa79b-345a-4e58-a77c-fdfed675e6e7 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:30:10 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] End _get_guest_xml xml=<domain type="kvm">
Nov 29 16:30:10 user nova-compute[75245]:   <uuid>0f4fa79b-345a-4e58-a77c-fdfed675e6e7</uuid>
Nov 29 16:30:10 user nova-compute[75245]:   <name>instance-0000001d</name>
Nov 29 16:30:10 user nova-compute[75245]:   <memory>524288</memory>
Nov 29 16:30:10 user nova-compute[75245]:   <vcpu>1</vcpu>
Nov 29 16:30:10 user nova-compute[75245]:   <metadata>
Nov 29 16:30:10 user nova-compute[75245]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 16:30:10 user nova-compute[75245]:       <nova:package version="0.0.0"/>
Nov 29 16:30:10 user nova-compute[75245]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-513385249</nova:name>
Nov 29 16:30:10 user nova-compute[75245]:       <nova:creationTime>2023-11-29 16:30:10</nova:creationTime>
Nov 29 16:30:10 user nova-compute[75245]:       <nova:flavor name="m1.tiny">
Nov 29 16:30:10 user nova-compute[75245]:         <nova:memory>512</nova:memory>
Nov 29 16:30:10 user nova-compute[75245]:         <nova:disk>1</nova:disk>
Nov 29 16:30:10 user nova-compute[75245]:         <nova:swap>0</nova:swap>
Nov 29 16:30:10 user nova-compute[75245]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 16:30:10 user nova-compute[75245]:         <nova:vcpus>1</nova:vcpus>
Nov 29 16:30:10 user nova-compute[75245]:       </nova:flavor>
Nov 29 16:30:10 user nova-compute[75245]:       <nova:owner>
Nov 29 16:30:10 user nova-compute[75245]:         <nova:user uuid="4222ccbed0bd4fa084e80d5c72cd9f58">tempest-ServerStableDeviceRescueTest-101632514-project-member</nova:user>
Nov 29 16:30:10 user nova-compute[75245]:         <nova:project uuid="12ae03075ca94c57af11198359d26514">tempest-ServerStableDeviceRescueTest-101632514</nova:project>
Nov 29 16:30:10 user nova-compute[75245]:       </nova:owner>
Nov 29 16:30:10 user nova-compute[75245]:       <nova:root type="image" uuid="a291d9c3-be02-4c6c-9649-4b45c5b7f487"/>
Nov 29 16:30:10 user nova-compute[75245]:       <nova:ports>
Nov 29 16:30:10 user nova-compute[75245]:         <nova:port uuid="0b59ddaf-c343-420d-9cf5-93d5fa48bc23">
Nov 29 16:30:10 user nova-compute[75245]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 29 16:30:10 user nova-compute[75245]:         </nova:port>
Nov 29 16:30:10 user nova-compute[75245]:       </nova:ports>
Nov 29 16:30:10 user nova-compute[75245]:     </nova:instance>
Nov 29 16:30:10 user nova-compute[75245]:   </metadata>
Nov 29 16:30:10 user nova-compute[75245]:   <sysinfo type="smbios">
Nov 29 16:30:10 user nova-compute[75245]:     <system>
Nov 29 16:30:10 user nova-compute[75245]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 16:30:10 user nova-compute[75245]:       <entry name="product">OpenStack Nova</entry>
Nov 29 16:30:10 user nova-compute[75245]:       <entry name="version">0.0.0</entry>
Nov 29 16:30:10 user nova-compute[75245]:       <entry name="serial">0f4fa79b-345a-4e58-a77c-fdfed675e6e7</entry>
Nov 29 16:30:10 user nova-compute[75245]:       <entry name="uuid">0f4fa79b-345a-4e58-a77c-fdfed675e6e7</entry>
Nov 29 16:30:10 user nova-compute[75245]:       <entry name="family">Virtual Machine</entry>
Nov 29 16:30:10 user nova-compute[75245]:     </system>
Nov 29 16:30:10 user nova-compute[75245]:   </sysinfo>
Nov 29 16:30:10 user nova-compute[75245]:   <os>
Nov 29 16:30:10 user nova-compute[75245]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 16:30:10 user nova-compute[75245]:     <boot dev="hd"/>
Nov 29 16:30:10 user nova-compute[75245]:     <smbios mode="sysinfo"/>
Nov 29 16:30:10 user nova-compute[75245]:   </os>
Nov 29 16:30:10 user nova-compute[75245]:   <features>
Nov 29 16:30:10 user nova-compute[75245]:     <acpi/>
Nov 29 16:30:10 user nova-compute[75245]:     <apic/>
Nov 29 16:30:10 user nova-compute[75245]:     <vmcoreinfo/>
Nov 29 16:30:10 user nova-compute[75245]:   </features>
Nov 29 16:30:10 user nova-compute[75245]:   <clock offset="utc">
Nov 29 16:30:10 user nova-compute[75245]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 16:30:10 user nova-compute[75245]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 16:30:10 user nova-compute[75245]:     <timer name="hpet" present="no"/>
Nov 29 16:30:10 user nova-compute[75245]:   </clock>
Nov 29 16:30:10 user nova-compute[75245]:   <cpu mode="custom" match="exact">
Nov 29 16:30:10 user nova-compute[75245]:     <model>Nehalem</model>
Nov 29 16:30:10 user nova-compute[75245]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 16:30:10 user nova-compute[75245]:   </cpu>
Nov 29 16:30:10 user nova-compute[75245]:   <devices>
Nov 29 16:30:10 user nova-compute[75245]:     <disk type="file" device="disk">
Nov 29 16:30:10 user nova-compute[75245]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 16:30:10 user nova-compute[75245]:       <source file="/opt/stack/data/nova/instances/0f4fa79b-345a-4e58-a77c-fdfed675e6e7/disk"/>
Nov 29 16:30:10 user nova-compute[75245]:       <target dev="vda" bus="virtio"/>
Nov 29 16:30:10 user nova-compute[75245]:     </disk>
Nov 29 16:30:10 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 16:30:10 user nova-compute[75245]:       <mac address="fa:16:3e:12:d2:ca"/>
Nov 29 16:30:10 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:30:10 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 16:30:10 user nova-compute[75245]:       <target dev="tap0b59ddaf-c3"/>
Nov 29 16:30:10 user nova-compute[75245]:     </interface>
Nov 29 16:30:10 user nova-compute[75245]:     <serial type="pty">
Nov 29 16:30:10 user nova-compute[75245]:       <log file="/opt/stack/data/nova/instances/0f4fa79b-345a-4e58-a77c-fdfed675e6e7/console.log" append="off"/>
Nov 29 16:30:10 user nova-compute[75245]:     </serial>
Nov 29 16:30:10 user nova-compute[75245]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 16:30:10 user nova-compute[75245]:     <video>
Nov 29 16:30:10 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:30:10 user nova-compute[75245]:     </video>
Nov 29 16:30:10 user nova-compute[75245]:     <rng model="virtio">
Nov 29 16:30:10 user nova-compute[75245]:       <backend model="random">/dev/urandom</backend>
Nov 29 16:30:10 user nova-compute[75245]:     </rng>
Nov 29 16:30:10 user nova-compute[75245]:     <controller type="usb" index="0" model="none"/>
Nov 29 16:30:10 user nova-compute[75245]:     <memballoon model="virtio">
Nov 29 16:30:10 user nova-compute[75245]:       <stats period="10"/>
Nov 29 16:30:10 user nova-compute[75245]:     </memballoon>
Nov 29 16:30:10 user nova-compute[75245]:   </devices>
Nov 29 16:30:10 user nova-compute[75245]: </domain>
Nov 29 16:30:10 user nova-compute[75245]:  {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 16:30:10 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:30:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-513385249',display_name='tempest-ServerStableDeviceRescueTest-server-513385249',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-513385249',id=29,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL1Z68o0lP6Hi7Hps1ExPAu//BM0Y3yUpeo20GOYYPdy96iUaa/DNByIByWzZ26Oh5Df0t6c9Eobojc//k6HPkTz9N7Nd3BYUDK2hhL44idE2i+iJ7tKl8lnWLgL/rJ52g==',key_name='tempest-keypair-502202166',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12ae03075ca94c57af11198359d26514',ramdisk_id='',reservation_id='r-xnixzkar',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-101632514',owner_user_name='tempest-ServerStableDeviceRescueTest-101632514-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:30:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4222ccbed0bd4fa084e80d5c72cd9f58',uuid=0f4fa79b-345a-4e58-a77c-fdfed675e6e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b59ddaf-c343-420d-9cf5-93d5fa48bc23", "address": "fa:16:3e:12:d2:ca", "network": {"id": "74420114-8c7f-4f7b-9589-8605e1a2b922", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1124145478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12ae03075ca94c57af11198359d26514", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b59ddaf-c3", "ovs_interfaceid": "0b59ddaf-c343-420d-9cf5-93d5fa48bc23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 16:30:10 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Converting VIF {"id": "0b59ddaf-c343-420d-9cf5-93d5fa48bc23", "address": "fa:16:3e:12:d2:ca", "network": {"id": "74420114-8c7f-4f7b-9589-8605e1a2b922", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1124145478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12ae03075ca94c57af11198359d26514", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b59ddaf-c3", "ovs_interfaceid": "0b59ddaf-c343-420d-9cf5-93d5fa48bc23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:30:10 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:d2:ca,bridge_name='br-int',has_traffic_filtering=True,id=0b59ddaf-c343-420d-9cf5-93d5fa48bc23,network=Network(74420114-8c7f-4f7b-9589-8605e1a2b922),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b59ddaf-c3') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:30:10 user nova-compute[75245]: DEBUG os_vif [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:d2:ca,bridge_name='br-int',has_traffic_filtering=True,id=0b59ddaf-c343-420d-9cf5-93d5fa48bc23,network=Network(74420114-8c7f-4f7b-9589-8605e1a2b922),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b59ddaf-c3') {{(pid=75245) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 16:30:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:30:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:30:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 16:30:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:30:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '610bbae7-fe30-51a2-a514-3d56c9a2804e', '_type': 'linux-noop'}}, row=False) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:30:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:30:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:30:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:30:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0b59ddaf-c3, may_exist=True, interface_attrs={}) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:30:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0b59ddaf-c3, col_values=(('qos', UUID('39e9645a-bd67-4f51-ba3f-bbcfd3a5cf82')),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:30:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0b59ddaf-c3, col_values=(('external_ids', {'iface-id': '0b59ddaf-c343-420d-9cf5-93d5fa48bc23', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:d2:ca', 'vm-uuid': '0f4fa79b-345a-4e58-a77c-fdfed675e6e7'}),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:30:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:30:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:30:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:30:10 user nova-compute[75245]: INFO os_vif [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:d2:ca,bridge_name='br-int',has_traffic_filtering=True,id=0b59ddaf-c343-420d-9cf5-93d5fa48bc23,network=Network(74420114-8c7f-4f7b-9589-8605e1a2b922),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b59ddaf-c3')
Nov 29 16:30:10 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:30:10 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] No VIF found with MAC fa:16:3e:12:d2:ca, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:30:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-b9f9cf13-ec12-495b-9626-667bba271cf9 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Acquiring lock "0b629ca7-b69e-471c-a7b0-9eb43301c36f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:30:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-b9f9cf13-ec12-495b-9626-667bba271cf9 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lock "0b629ca7-b69e-471c-a7b0-9eb43301c36f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:30:10 user nova-compute[75245]: INFO nova.compute.manager [None req-b9f9cf13-ec12-495b-9626-667bba271cf9 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Detaching volume 38349e5b-ff4e-436e-8072-9fb91dc48c75
Nov 29 16:30:10 user nova-compute[75245]: INFO nova.virt.block_device [None req-b9f9cf13-ec12-495b-9626-667bba271cf9 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Attempting to driver detach volume 38349e5b-ff4e-436e-8072-9fb91dc48c75 from mountpoint /dev/vdb
Nov 29 16:30:10 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-b9f9cf13-ec12-495b-9626-667bba271cf9 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Attempting to detach device vdb from instance 0b629ca7-b69e-471c-a7b0-9eb43301c36f from the persistent domain config. {{(pid=75245) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 16:30:10 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-b9f9cf13-ec12-495b-9626-667bba271cf9 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 16:30:10 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:30:10 user nova-compute[75245]:   <source dev="/dev/sdb"/>
Nov 29 16:30:10 user nova-compute[75245]:   <target dev="vdb" bus="virtio"/>
Nov 29 16:30:10 user nova-compute[75245]:   <serial>38349e5b-ff4e-436e-8072-9fb91dc48c75</serial>
Nov 29 16:30:10 user nova-compute[75245]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 16:30:10 user nova-compute[75245]: </disk>
Nov 29 16:30:10 user nova-compute[75245]:  {{(pid=75245) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 16:30:10 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-b9f9cf13-ec12-495b-9626-667bba271cf9 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Successfully detached device vdb from instance 0b629ca7-b69e-471c-a7b0-9eb43301c36f from the persistent domain config.
Nov 29 16:30:10 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-b9f9cf13-ec12-495b-9626-667bba271cf9 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0b629ca7-b69e-471c-a7b0-9eb43301c36f from the live domain config. {{(pid=75245) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 16:30:10 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-b9f9cf13-ec12-495b-9626-667bba271cf9 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 16:30:10 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:30:10 user nova-compute[75245]:   <source dev="/dev/sdb"/>
Nov 29 16:30:10 user nova-compute[75245]:   <target dev="vdb" bus="virtio"/>
Nov 29 16:30:10 user nova-compute[75245]:   <serial>38349e5b-ff4e-436e-8072-9fb91dc48c75</serial>
Nov 29 16:30:10 user nova-compute[75245]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 16:30:10 user nova-compute[75245]: </disk>
Nov 29 16:30:10 user nova-compute[75245]:  {{(pid=75245) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 16:30:11 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-b9f9cf13-ec12-495b-9626-667bba271cf9 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0b629ca7-b69e-471c-a7b0-9eb43301c36f {{(pid=75245) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 16:30:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:30:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:30:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:30:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:30:11 user nova-compute[75245]: DEBUG nova.compute.manager [req-cbfcb001-3cd5-444a-ade2-fbc86f608c11 req-cfa3a1ec-393a-4802-a121-f7bb74439739 service nova] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Received event network-vif-plugged-0b59ddaf-c343-420d-9cf5-93d5fa48bc23 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:30:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-cbfcb001-3cd5-444a-ade2-fbc86f608c11 req-cfa3a1ec-393a-4802-a121-f7bb74439739 service nova] Acquiring lock "0f4fa79b-345a-4e58-a77c-fdfed675e6e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:30:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-cbfcb001-3cd5-444a-ade2-fbc86f608c11 req-cfa3a1ec-393a-4802-a121-f7bb74439739 service nova] Lock "0f4fa79b-345a-4e58-a77c-fdfed675e6e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:30:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-cbfcb001-3cd5-444a-ade2-fbc86f608c11 req-cfa3a1ec-393a-4802-a121-f7bb74439739 service nova] Lock "0f4fa79b-345a-4e58-a77c-fdfed675e6e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:30:11 user nova-compute[75245]: DEBUG nova.compute.manager [req-cbfcb001-3cd5-444a-ade2-fbc86f608c11 req-cfa3a1ec-393a-4802-a121-f7bb74439739 service nova] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] No waiting events found dispatching network-vif-plugged-0b59ddaf-c343-420d-9cf5-93d5fa48bc23 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:30:11 user nova-compute[75245]: WARNING nova.compute.manager [req-cbfcb001-3cd5-444a-ade2-fbc86f608c11 req-cfa3a1ec-393a-4802-a121-f7bb74439739 service nova] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Received unexpected event network-vif-plugged-0b59ddaf-c343-420d-9cf5-93d5fa48bc23 for instance with vm_state building and task_state spawning.
Nov 29 16:30:12 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:30:12 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:30:12 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:30:12 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:30:12 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:30:13 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:30:13 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:30:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:30:13 user nova-compute[75245]: DEBUG nova.compute.manager [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Instance event wait completed in 0 seconds for  {{(pid=75245) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 16:30:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Guest created on hypervisor {{(pid=75245) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 16:30:13 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Instance spawned successfully.
Nov 29 16:30:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 16:30:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Found default for hw_cdrom_bus of ide {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:30:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Found default for hw_disk_bus of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:30:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Found default for hw_input_bus of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:30:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Found default for hw_pointer_model of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:30:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Found default for hw_video_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:30:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Found default for hw_vif_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:30:13 user nova-compute[75245]: INFO nova.compute.manager [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Took 5.99 seconds to spawn the instance on the hypervisor.
Nov 29 16:30:13 user nova-compute[75245]: DEBUG nova.compute.manager [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:30:13 user nova-compute[75245]: DEBUG nova.compute.manager [req-d6654c65-0dee-4028-8bd9-729077ed74a3 req-a9688f91-2f71-4c82-b0ce-b6f88ec203e4 service nova] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Received event network-vif-plugged-0b59ddaf-c343-420d-9cf5-93d5fa48bc23 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:30:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d6654c65-0dee-4028-8bd9-729077ed74a3 req-a9688f91-2f71-4c82-b0ce-b6f88ec203e4 service nova] Acquiring lock "0f4fa79b-345a-4e58-a77c-fdfed675e6e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:30:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d6654c65-0dee-4028-8bd9-729077ed74a3 req-a9688f91-2f71-4c82-b0ce-b6f88ec203e4 service nova] Lock "0f4fa79b-345a-4e58-a77c-fdfed675e6e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:30:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d6654c65-0dee-4028-8bd9-729077ed74a3 req-a9688f91-2f71-4c82-b0ce-b6f88ec203e4 service nova] Lock "0f4fa79b-345a-4e58-a77c-fdfed675e6e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:30:13 user nova-compute[75245]: DEBUG nova.compute.manager [req-d6654c65-0dee-4028-8bd9-729077ed74a3 req-a9688f91-2f71-4c82-b0ce-b6f88ec203e4 service nova] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] No waiting events found dispatching network-vif-plugged-0b59ddaf-c343-420d-9cf5-93d5fa48bc23 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:30:13 user nova-compute[75245]: WARNING nova.compute.manager [req-d6654c65-0dee-4028-8bd9-729077ed74a3 req-a9688f91-2f71-4c82-b0ce-b6f88ec203e4 service nova] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Received unexpected event network-vif-plugged-0b59ddaf-c343-420d-9cf5-93d5fa48bc23 for instance with vm_state building and task_state spawning.
Nov 29 16:30:13 user nova-compute[75245]: INFO nova.compute.manager [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Took 6.82 seconds to build instance.
Nov 29 16:30:14 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-87ce0a73-6511-44dd-8ddf-3e1610bd8e21 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Lock "0f4fa79b-345a-4e58-a77c-fdfed675e6e7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.941s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:30:14 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:30:14 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75245) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 16:30:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:30:18 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:30:19 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Acquiring lock "26acb3c4-b081-4670-a6b5-d40583c23592" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:30:19 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "26acb3c4-b081-4670-a6b5-d40583c23592" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:30:19 user nova-compute[75245]: DEBUG nova.compute.manager [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Starting instance... {{(pid=75245) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 16:30:19 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:30:19 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:30:19 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75245) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 16:30:19 user nova-compute[75245]: INFO nova.compute.claims [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Claim successful on node user
Nov 29 16:30:19 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:30:19 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:30:19 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.373s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:30:19 user nova-compute[75245]: DEBUG nova.compute.manager [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Start building networks asynchronously for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 16:30:19 user nova-compute[75245]: DEBUG nova.compute.manager [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Allocating IP information in the background. {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 16:30:19 user nova-compute[75245]: DEBUG nova.network.neutron [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] allocate_for_instance() {{(pid=75245) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 16:30:19 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 16:30:19 user nova-compute[75245]: DEBUG nova.compute.manager [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Start building block device mappings for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 16:30:19 user nova-compute[75245]: INFO nova.virt.block_device [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Booting with volume-backed-image a291d9c3-be02-4c6c-9649-4b45c5b7f487 at /dev/vda
Nov 29 16:30:20 user nova-compute[75245]: DEBUG nova.policy [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4f20e7c9ae22462ea6bc623c93697fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d52776451e947f5a9ef3fa44ac8acbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75245) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 16:30:20 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:30:20 user nova-compute[75245]: DEBUG nova.network.neutron [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Successfully created port: eeb0edc6-31dc-4bbf-abc4-331ed86156a1 {{(pid=75245) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 16:30:21 user nova-compute[75245]: DEBUG nova.network.neutron [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Successfully updated port: eeb0edc6-31dc-4bbf-abc4-331ed86156a1 {{(pid=75245) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 16:30:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Acquiring lock "refresh_cache-26acb3c4-b081-4670-a6b5-d40583c23592" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:30:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Acquired lock "refresh_cache-26acb3c4-b081-4670-a6b5-d40583c23592" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:30:21 user nova-compute[75245]: DEBUG nova.network.neutron [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 16:30:21 user nova-compute[75245]: DEBUG nova.compute.manager [req-562f5464-6b19-4584-9c22-1d5984b4315c req-3275cdba-4f95-4c82-9481-bfd4122b98f4 service nova] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Received event network-changed-eeb0edc6-31dc-4bbf-abc4-331ed86156a1 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:30:21 user nova-compute[75245]: DEBUG nova.compute.manager [req-562f5464-6b19-4584-9c22-1d5984b4315c req-3275cdba-4f95-4c82-9481-bfd4122b98f4 service nova] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Refreshing instance network info cache due to event network-changed-eeb0edc6-31dc-4bbf-abc4-331ed86156a1. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:30:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-562f5464-6b19-4584-9c22-1d5984b4315c req-3275cdba-4f95-4c82-9481-bfd4122b98f4 service nova] Acquiring lock "refresh_cache-26acb3c4-b081-4670-a6b5-d40583c23592" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:30:21 user nova-compute[75245]: DEBUG nova.network.neutron [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Instance cache missing network info. {{(pid=75245) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 16:30:21 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:30:21 user nova-compute[75245]: DEBUG nova.network.neutron [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Updating instance_info_cache with network_info: [{"id": "eeb0edc6-31dc-4bbf-abc4-331ed86156a1", "address": "fa:16:3e:78:78:ae", "network": {"id": "6a7f7426-b595-4aa3-bf80-cc92ba7ce15e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-917300903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d52776451e947f5a9ef3fa44ac8acbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb0edc6-31", "ovs_interfaceid": "eeb0edc6-31dc-4bbf-abc4-331ed86156a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:30:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Releasing lock "refresh_cache-26acb3c4-b081-4670-a6b5-d40583c23592" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:30:21 user nova-compute[75245]: DEBUG nova.compute.manager [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Instance network_info: |[{"id": "eeb0edc6-31dc-4bbf-abc4-331ed86156a1", "address": "fa:16:3e:78:78:ae", "network": {"id": "6a7f7426-b595-4aa3-bf80-cc92ba7ce15e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-917300903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d52776451e947f5a9ef3fa44ac8acbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb0edc6-31", "ovs_interfaceid": "eeb0edc6-31dc-4bbf-abc4-331ed86156a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 16:30:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-562f5464-6b19-4584-9c22-1d5984b4315c req-3275cdba-4f95-4c82-9481-bfd4122b98f4 service nova] Acquired lock "refresh_cache-26acb3c4-b081-4670-a6b5-d40583c23592" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:30:21 user nova-compute[75245]: DEBUG nova.network.neutron [req-562f5464-6b19-4584-9c22-1d5984b4315c req-3275cdba-4f95-4c82-9481-bfd4122b98f4 service nova] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Refreshing network info cache for port eeb0edc6-31dc-4bbf-abc4-331ed86156a1 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:30:21 user nova-compute[75245]: DEBUG nova.network.neutron [req-562f5464-6b19-4584-9c22-1d5984b4315c req-3275cdba-4f95-4c82-9481-bfd4122b98f4 service nova] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Updated VIF entry in instance network info cache for port eeb0edc6-31dc-4bbf-abc4-331ed86156a1. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:30:21 user nova-compute[75245]: DEBUG nova.network.neutron [req-562f5464-6b19-4584-9c22-1d5984b4315c req-3275cdba-4f95-4c82-9481-bfd4122b98f4 service nova] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Updating instance_info_cache with network_info: [{"id": "eeb0edc6-31dc-4bbf-abc4-331ed86156a1", "address": "fa:16:3e:78:78:ae", "network": {"id": "6a7f7426-b595-4aa3-bf80-cc92ba7ce15e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-917300903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d52776451e947f5a9ef3fa44ac8acbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb0edc6-31", "ovs_interfaceid": "eeb0edc6-31dc-4bbf-abc4-331ed86156a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:30:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-562f5464-6b19-4584-9c22-1d5984b4315c req-3275cdba-4f95-4c82-9481-bfd4122b98f4 service nova] Releasing lock "refresh_cache-26acb3c4-b081-4670-a6b5-d40583c23592" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:30:25 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:30:25 user nova-compute[75245]: DEBUG os_brick.utils [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:30:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:30:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:30:25 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[973be1f3-f357-4df5-81f0-f31a77988858]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:69ed8ed87091\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:30:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:30:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:30:25 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9e240d-f340-4383-a7cf-ebbcb3cc6662]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:30:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:30:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:30:25 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c0fd74-a3c5-453c-8af1-7e10b3e29f99]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:30:25 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f12438d-fe97-4449-9f28-f736f3b9bb29]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:30:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Running cmd (subprocess): nvme version {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:30:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] 'nvme version' failed. Not Retrying. {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:30:25 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.nvmeof [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] nvme not present on system {{(pid=75245) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 16:30:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:30:25 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:30:25 user nova-compute[75245]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 16:30:25 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a08f6b9-1379-4f0a-89f0-7d3939cc1766]: (4, '') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:30:25 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75245) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 16:30:25 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 16:30:25 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] LIGHTOS: no hostnqn found. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 16:30:25 user nova-compute[75245]: DEBUG os_brick.utils [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] <== get_connector_properties: return (108ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:69ed8ed87091', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:30:25 user nova-compute[75245]: DEBUG nova.virt.block_device [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Updating existing volume attachment record: e9dbfc5e-2b27-4613-8dea-33d86409391a {{(pid=75245) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 16:30:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:30:30 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:30:31 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-b9f9cf13-ec12-495b-9626-667bba271cf9 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0b629ca7-b69e-471c-a7b0-9eb43301c36f is timed out.
Nov 29 16:30:31 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-b9f9cf13-ec12-495b-9626-667bba271cf9 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Successfully detached device vdb from instance 0b629ca7-b69e-471c-a7b0-9eb43301c36f from the live domain config.
Nov 29 16:30:31 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9f9cf13-ec12-495b-9626-667bba271cf9 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] calling os-brick to detach iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 16:30:31 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f9cf13-ec12-495b-9626-667bba271cf9 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, {'target_iqn': 'iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rEjNxBRa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:30:31 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-b9f9cf13-ec12-495b-9626-667bba271cf9 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:30:31 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-b9f9cf13-ec12-495b-9626-667bba271cf9 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:30:31 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-b9f9cf13-ec12-495b-9626-667bba271cf9 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:30:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:30:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:30:31 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ea15e4-a550-4578-b9f1-9687fda6baeb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:30:31 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f9cf13-ec12-495b-9626-667bba271cf9 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 16:30:31 user nova-compute[75245]: No targets found.
Nov 29 16:30:31 user nova-compute[75245]: iSNS:
Nov 29 16:30:31 user nova-compute[75245]: No targets found.
Nov 29 16:30:31 user nova-compute[75245]: STATIC:
Nov 29 16:30:31 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed
Nov 29 16:30:31 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:30:31 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:30:31 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75
Nov 29 16:30:31 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:30:31 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:30:31 user nova-compute[75245]: FIRMWARE:
Nov 29 16:30:31 user nova-compute[75245]: No targets found.
Nov 29 16:30:31 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:30:31 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f9cf13-ec12-495b-9626-667bba271cf9 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 16:30:31 user nova-compute[75245]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 16:30:31 user nova-compute[75245]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75245) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 16:30:31 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f9cf13-ec12-495b-9626-667bba271cf9 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75', 0)] {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 16:30:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:30:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:30:31 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1913c8e-9c3c-4fb5-9276-65ff45b660a7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:30:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:30:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:30:31 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[679253b4-262a-43f3-b1f5-f793dec83c75]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:30:31 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f9cf13-ec12-495b-9626-667bba271cf9 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)
Nov 29 16:30:31 user nova-compute[75245]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75 (non-flash)
Nov 29 16:30:31 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:30:31 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f9cf13-ec12-495b-9626-667bba271cf9 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)
Nov 29 16:30:31 user nova-compute[75245]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75 (non-flash)
Nov 29 16:30:31 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:30:31 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f9cf13-ec12-495b-9626-667bba271cf9 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0d442e3d00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75'): ({'sdb'}, set())}) {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 16:30:31 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-b9f9cf13-ec12-495b-9626-667bba271cf9 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Removing single pathed devices sdb {{(pid=75245) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 16:30:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:30:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:30:31 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe8ac451-194f-4966-8cb9-501b7affca50]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:30:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:30:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:30:31 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[1715df75-17b1-49b1-891a-7f4794204106]: (4, ('ok\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:30:31 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-b9f9cf13-ec12-495b-9626-667bba271cf9 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Flushing IO for device /dev/sdb {{(pid=75245) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 16:30:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:30:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:30:31 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe09564-1394-43d0-947e-a3a403a12745]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:30:31 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-b9f9cf13-ec12-495b-9626-667bba271cf9 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75245) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 16:30:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:30:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:30:31 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebabee85-ad33-4327-a06d-8c584ac9afe8]: (4, ('1', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:30:31 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-b9f9cf13-ec12-495b-9626-667bba271cf9 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 16:30:31 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-b9f9cf13-ec12-495b-9626-667bba271cf9 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] SCSI volumes sdb have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 16:30:31 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f9cf13-ec12-495b-9626-667bba271cf9 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75')] {{(pid=75245) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 16:30:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:30:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:30:31 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eea9e56-7664-4b2a-a914-bd1e6657d023]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:30:31 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f9cf13-ec12-495b-9626-667bba271cf9 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:30:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75 -p 172.16.0.220:3260 --logout {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:30:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:30:31 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c429ba2-d5d2-4d70-a3a4-dcab32e62527]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:30:31 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f9cf13-ec12-495b-9626-667bba271cf9 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75, portal: 172.16.0.220,3260]
Nov 29 16:30:31 user nova-compute[75245]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75, portal: 172.16.0.220,3260] successful.
Nov 29 16:30:31 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:30:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75 -p 172.16.0.220:3260 --op delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:30:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38349e5b-ff4e-436e-8072-9fb91dc48c75 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:30:31 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd61e3c7-8ea9-4530-aa52-298048490b85]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:30:31 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f9cf13-ec12-495b-9626-667bba271cf9 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:30:31 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-b9f9cf13-ec12-495b-9626-667bba271cf9 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:30:31 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f9cf13-ec12-495b-9626-667bba271cf9 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] <== disconnect_volume: return (302ms) None {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:30:31 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9f9cf13-ec12-495b-9626-667bba271cf9 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Disconnected iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 16:30:32 user nova-compute[75245]: DEBUG nova.objects.instance [None req-b9f9cf13-ec12-495b-9626-667bba271cf9 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lazy-loading 'flavor' on Instance uuid 0b629ca7-b69e-471c-a7b0-9eb43301c36f {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:30:32 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-b9f9cf13-ec12-495b-9626-667bba271cf9 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lock "0b629ca7-b69e-471c-a7b0-9eb43301c36f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.936s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:30:32 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-568d1795-c15e-4f73-949a-70bb843158d3 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Acquiring lock "0b629ca7-b69e-471c-a7b0-9eb43301c36f" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:30:32 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-568d1795-c15e-4f73-949a-70bb843158d3 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lock "0b629ca7-b69e-471c-a7b0-9eb43301c36f" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:30:32 user nova-compute[75245]: DEBUG nova.compute.manager [None req-568d1795-c15e-4f73-949a-70bb843158d3 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:30:32 user nova-compute[75245]: DEBUG nova.compute.manager [None req-568d1795-c15e-4f73-949a-70bb843158d3 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75245) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 29 16:30:32 user nova-compute[75245]: DEBUG nova.objects.instance [None req-568d1795-c15e-4f73-949a-70bb843158d3 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lazy-loading 'flavor' on Instance uuid 0b629ca7-b69e-471c-a7b0-9eb43301c36f {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:30:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:30:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:30:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:30:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG nova.compute.manager [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Start spawning the instance on the hypervisor. {{(pid=75245) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Creating instance directory {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 16:30:33 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Creating image(s)
Nov 29 16:30:33 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Did not create local disks {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Ensure instance console log exists: /opt/stack/data/nova/instances/26acb3c4-b081-4670-a6b5-d40583c23592/console.log {{(pid=75245) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Start _get_guest_xml network_info=[{"id": "eeb0edc6-31dc-4bbf-abc4-331ed86156a1", "address": "fa:16:3e:78:78:ae", "network": {"id": "6a7f7426-b595-4aa3-bf80-cc92ba7ce15e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-917300903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d52776451e947f5a9ef3fa44ac8acbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb0edc6-31", "ovs_interfaceid": "eeb0edc6-31dc-4bbf-abc4-331ed86156a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': 'e9dbfc5e-2b27-4613-8dea-33d86409391a', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dZxsPKjh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '26acb3c4-b081-4670-a6b5-d40583c23592', 'attached_at': '', 'detached_at': '', 'volume_id': 'dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4', 'serial': 'dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'guest_format': None, 'volume_type': None} {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 16:30:33 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:30:33 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:30:33 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] CPU controller missing on host. {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] CPU controller found on host. {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75245) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T16:06:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Flavor limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Image limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Flavor pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Image pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Got 1 possible topologies {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Calling os-brick to attach iSCSI Volume {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dZxsPKjh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:30:33 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:30:33 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:30:33 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:30:33 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:30:33 user nova-compute[75245]: INFO os_brick.initiator.connectors.iscsi [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 16:30:33 user nova-compute[75245]: DEBUG nova.compute.manager [req-b8ef339a-e121-4af5-9a5b-a061788cfd1b req-50381146-49bd-4b3e-b5ec-abcefd914e17 service nova] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Received event network-vif-unplugged-6d28be36-e00b-4f84-9a2b-60515f2e65a1 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b8ef339a-e121-4af5-9a5b-a061788cfd1b req-50381146-49bd-4b3e-b5ec-abcefd914e17 service nova] Acquiring lock "0b629ca7-b69e-471c-a7b0-9eb43301c36f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b8ef339a-e121-4af5-9a5b-a061788cfd1b req-50381146-49bd-4b3e-b5ec-abcefd914e17 service nova] Lock "0b629ca7-b69e-471c-a7b0-9eb43301c36f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b8ef339a-e121-4af5-9a5b-a061788cfd1b req-50381146-49bd-4b3e-b5ec-abcefd914e17 service nova] Lock "0b629ca7-b69e-471c-a7b0-9eb43301c36f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG nova.compute.manager [req-b8ef339a-e121-4af5-9a5b-a061788cfd1b req-50381146-49bd-4b3e-b5ec-abcefd914e17 service nova] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] No waiting events found dispatching network-vif-unplugged-6d28be36-e00b-4f84-9a2b-60515f2e65a1 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:30:33 user nova-compute[75245]: WARNING nova.compute.manager [req-b8ef339a-e121-4af5-9a5b-a061788cfd1b req-50381146-49bd-4b3e-b5ec-abcefd914e17 service nova] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Received unexpected event network-vif-unplugged-6d28be36-e00b-4f84-9a2b-60515f2e65a1 for instance with vm_state active and task_state powering-off.
Nov 29 16:30:33 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4 -p 172.16.0.220:3260 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2bf0267-54a5-4fa2-8e54-384280047f29]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 16:30:33 user nova-compute[75245]:  {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e98ec64-3917-41ce-9d81-f5adb2b00636]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4] added\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4] added
Nov 29 16:30:33 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[db9e3605-4245-497d-8e8a-6927c77a44f9]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[57fadcf6-3e24-4293-8ba2-01674311021f]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dZxsPKjh {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dZxsPKjh" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1bcdaba-ea46-444b-9342-5388d38a96bf]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dZxsPKjh'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[440e7fcd-1507-44af-a155-20df29650c7b]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8352a3-d879-4aec-a7ce-ec3238aa7d50]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)
Nov 29 16:30:33 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)
Nov 29 16:30:33 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4 -p 172.16.0.220:3260 --login {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[0564d4d0-fe0f-4286-9ed5-c645197b10c6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4, portal: 172.16.0.220,3260]
Nov 29 16:30:33 user nova-compute[75245]: Login to [iface: default, target: iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4, portal: 172.16.0.220,3260] successful.
Nov 29 16:30:33 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc397c58-4f40-49e5-8366-16ae03fe21be]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06ab3ef-7dbd-4dc6-af17-7fdc0c2cab70]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)
Nov 29 16:30:33 user nova-compute[75245]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4 (non-flash)
Nov 29 16:30:33 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)
Nov 29 16:30:33 user nova-compute[75245]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4 (non-flash)
Nov 29 16:30:33 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Connected to 172.16.0.220:3260 {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] HCTL ('33', '-', '-', 0) found on session 36 with lun 0 {{(pid=75245) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75245) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[6230e6d9-d315-4250-aa28-21eee82daf23]: (4, ('- - 0', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Searching for a device in session 36 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75245) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dZxsPKjh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:30:33 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Instance destroyed successfully.
Nov 29 16:30:33 user nova-compute[75245]: DEBUG nova.compute.manager [None req-568d1795-c15e-4f73-949a-70bb843158d3 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:30:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-568d1795-c15e-4f73-949a-70bb843158d3 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lock "0b629ca7-b69e-471c-a7b0-9eb43301c36f" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.963s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:30:34 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:30:34 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '23439346465653133', 'path': '/dev/sdb'} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:30:34 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23439346465653133', 'path': '/dev/sdb'} {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 16:30:34 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:30:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-210891752',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-210891752',id=30,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d52776451e947f5a9ef3fa44ac8acbb',ramdisk_id='',reservation_id='r-wn1p5h7d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1780163218',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:30:20Z,user_data=None,user_id='4f20e7c9ae22462ea6bc623c93697fce',uuid=26acb3c4-b081-4670-a6b5-d40583c23592,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eeb0edc6-31dc-4bbf-abc4-331ed86156a1", "address": "fa:16:3e:78:78:ae", "network": {"id": "6a7f7426-b595-4aa3-bf80-cc92ba7ce15e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-917300903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d52776451e947f5a9ef3fa44ac8acbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb0edc6-31", "ovs_interfaceid": "eeb0edc6-31dc-4bbf-abc4-331ed86156a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:30:34 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Converting VIF {"id": "eeb0edc6-31dc-4bbf-abc4-331ed86156a1", "address": "fa:16:3e:78:78:ae", "network": {"id": "6a7f7426-b595-4aa3-bf80-cc92ba7ce15e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-917300903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d52776451e947f5a9ef3fa44ac8acbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb0edc6-31", "ovs_interfaceid": "eeb0edc6-31dc-4bbf-abc4-331ed86156a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:30:34 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:78:ae,bridge_name='br-int',has_traffic_filtering=True,id=eeb0edc6-31dc-4bbf-abc4-331ed86156a1,network=Network(6a7f7426-b595-4aa3-bf80-cc92ba7ce15e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeb0edc6-31') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:30:34 user nova-compute[75245]: DEBUG nova.objects.instance [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lazy-loading 'pci_devices' on Instance uuid 26acb3c4-b081-4670-a6b5-d40583c23592 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:30:34 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] End _get_guest_xml xml=<domain type="kvm">
Nov 29 16:30:34 user nova-compute[75245]:   <uuid>26acb3c4-b081-4670-a6b5-d40583c23592</uuid>
Nov 29 16:30:34 user nova-compute[75245]:   <name>instance-0000001e</name>
Nov 29 16:30:34 user nova-compute[75245]:   <memory>524288</memory>
Nov 29 16:30:34 user nova-compute[75245]:   <vcpu>1</vcpu>
Nov 29 16:30:34 user nova-compute[75245]:   <metadata>
Nov 29 16:30:34 user nova-compute[75245]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 16:30:34 user nova-compute[75245]:       <nova:package version="0.0.0"/>
Nov 29 16:30:34 user nova-compute[75245]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-210891752</nova:name>
Nov 29 16:30:34 user nova-compute[75245]:       <nova:creationTime>2023-11-29 16:30:33</nova:creationTime>
Nov 29 16:30:34 user nova-compute[75245]:       <nova:flavor name="m1.tiny">
Nov 29 16:30:34 user nova-compute[75245]:         <nova:memory>512</nova:memory>
Nov 29 16:30:34 user nova-compute[75245]:         <nova:disk>1</nova:disk>
Nov 29 16:30:34 user nova-compute[75245]:         <nova:swap>0</nova:swap>
Nov 29 16:30:34 user nova-compute[75245]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 16:30:34 user nova-compute[75245]:         <nova:vcpus>1</nova:vcpus>
Nov 29 16:30:34 user nova-compute[75245]:       </nova:flavor>
Nov 29 16:30:34 user nova-compute[75245]:       <nova:owner>
Nov 29 16:30:34 user nova-compute[75245]:         <nova:user uuid="4f20e7c9ae22462ea6bc623c93697fce">tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member</nova:user>
Nov 29 16:30:34 user nova-compute[75245]:         <nova:project uuid="1d52776451e947f5a9ef3fa44ac8acbb">tempest-ServerBootFromVolumeStableRescueTest-1780163218</nova:project>
Nov 29 16:30:34 user nova-compute[75245]:       </nova:owner>
Nov 29 16:30:34 user nova-compute[75245]:       <nova:root type="image" uuid="a291d9c3-be02-4c6c-9649-4b45c5b7f487"/>
Nov 29 16:30:34 user nova-compute[75245]:       <nova:ports>
Nov 29 16:30:34 user nova-compute[75245]:         <nova:port uuid="eeb0edc6-31dc-4bbf-abc4-331ed86156a1">
Nov 29 16:30:34 user nova-compute[75245]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 29 16:30:34 user nova-compute[75245]:         </nova:port>
Nov 29 16:30:34 user nova-compute[75245]:       </nova:ports>
Nov 29 16:30:34 user nova-compute[75245]:     </nova:instance>
Nov 29 16:30:34 user nova-compute[75245]:   </metadata>
Nov 29 16:30:34 user nova-compute[75245]:   <sysinfo type="smbios">
Nov 29 16:30:34 user nova-compute[75245]:     <system>
Nov 29 16:30:34 user nova-compute[75245]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 16:30:34 user nova-compute[75245]:       <entry name="product">OpenStack Nova</entry>
Nov 29 16:30:34 user nova-compute[75245]:       <entry name="version">0.0.0</entry>
Nov 29 16:30:34 user nova-compute[75245]:       <entry name="serial">26acb3c4-b081-4670-a6b5-d40583c23592</entry>
Nov 29 16:30:34 user nova-compute[75245]:       <entry name="uuid">26acb3c4-b081-4670-a6b5-d40583c23592</entry>
Nov 29 16:30:34 user nova-compute[75245]:       <entry name="family">Virtual Machine</entry>
Nov 29 16:30:34 user nova-compute[75245]:     </system>
Nov 29 16:30:34 user nova-compute[75245]:   </sysinfo>
Nov 29 16:30:34 user nova-compute[75245]:   <os>
Nov 29 16:30:34 user nova-compute[75245]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 16:30:34 user nova-compute[75245]:     <boot dev="hd"/>
Nov 29 16:30:34 user nova-compute[75245]:     <smbios mode="sysinfo"/>
Nov 29 16:30:34 user nova-compute[75245]:   </os>
Nov 29 16:30:34 user nova-compute[75245]:   <features>
Nov 29 16:30:34 user nova-compute[75245]:     <acpi/>
Nov 29 16:30:34 user nova-compute[75245]:     <apic/>
Nov 29 16:30:34 user nova-compute[75245]:     <vmcoreinfo/>
Nov 29 16:30:34 user nova-compute[75245]:   </features>
Nov 29 16:30:34 user nova-compute[75245]:   <clock offset="utc">
Nov 29 16:30:34 user nova-compute[75245]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 16:30:34 user nova-compute[75245]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 16:30:34 user nova-compute[75245]:     <timer name="hpet" present="no"/>
Nov 29 16:30:34 user nova-compute[75245]:   </clock>
Nov 29 16:30:34 user nova-compute[75245]:   <cpu mode="custom" match="exact">
Nov 29 16:30:34 user nova-compute[75245]:     <model>Nehalem</model>
Nov 29 16:30:34 user nova-compute[75245]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 16:30:34 user nova-compute[75245]:   </cpu>
Nov 29 16:30:34 user nova-compute[75245]:   <devices>
Nov 29 16:30:34 user nova-compute[75245]:     <disk type="block" device="disk">
Nov 29 16:30:34 user nova-compute[75245]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:30:34 user nova-compute[75245]:       <source dev="/dev/sdb"/>
Nov 29 16:30:34 user nova-compute[75245]:       <target dev="vda" bus="virtio"/>
Nov 29 16:30:34 user nova-compute[75245]:       <serial>dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4</serial>
Nov 29 16:30:34 user nova-compute[75245]:     </disk>
Nov 29 16:30:34 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 16:30:34 user nova-compute[75245]:       <mac address="fa:16:3e:78:78:ae"/>
Nov 29 16:30:34 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:30:34 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 16:30:34 user nova-compute[75245]:       <target dev="tapeeb0edc6-31"/>
Nov 29 16:30:34 user nova-compute[75245]:     </interface>
Nov 29 16:30:34 user nova-compute[75245]:     <serial type="pty">
Nov 29 16:30:34 user nova-compute[75245]:       <log file="/opt/stack/data/nova/instances/26acb3c4-b081-4670-a6b5-d40583c23592/console.log" append="off"/>
Nov 29 16:30:34 user nova-compute[75245]:     </serial>
Nov 29 16:30:34 user nova-compute[75245]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 16:30:34 user nova-compute[75245]:     <video>
Nov 29 16:30:34 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:30:34 user nova-compute[75245]:     </video>
Nov 29 16:30:34 user nova-compute[75245]:     <rng model="virtio">
Nov 29 16:30:34 user nova-compute[75245]:       <backend model="random">/dev/urandom</backend>
Nov 29 16:30:34 user nova-compute[75245]:     </rng>
Nov 29 16:30:34 user nova-compute[75245]:     <controller type="usb" index="0" model="none"/>
Nov 29 16:30:34 user nova-compute[75245]:     <memballoon model="virtio">
Nov 29 16:30:34 user nova-compute[75245]:       <stats period="10"/>
Nov 29 16:30:34 user nova-compute[75245]:     </memballoon>
Nov 29 16:30:34 user nova-compute[75245]:   </devices>
Nov 29 16:30:34 user nova-compute[75245]: </domain>
Nov 29 16:30:34 user nova-compute[75245]:  {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 16:30:34 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:30:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-210891752',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-210891752',id=30,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d52776451e947f5a9ef3fa44ac8acbb',ramdisk_id='',reservation_id='r-wn1p5h7d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1780163218',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:30:20Z,user_data=None,user_id='4f20e7c9ae22462ea6bc623c93697fce',uuid=26acb3c4-b081-4670-a6b5-d40583c23592,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eeb0edc6-31dc-4bbf-abc4-331ed86156a1", "address": "fa:16:3e:78:78:ae", "network": {"id": "6a7f7426-b595-4aa3-bf80-cc92ba7ce15e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-917300903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d52776451e947f5a9ef3fa44ac8acbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb0edc6-31", "ovs_interfaceid": "eeb0edc6-31dc-4bbf-abc4-331ed86156a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 16:30:34 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Converting VIF {"id": "eeb0edc6-31dc-4bbf-abc4-331ed86156a1", "address": "fa:16:3e:78:78:ae", "network": {"id": "6a7f7426-b595-4aa3-bf80-cc92ba7ce15e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-917300903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d52776451e947f5a9ef3fa44ac8acbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb0edc6-31", "ovs_interfaceid": "eeb0edc6-31dc-4bbf-abc4-331ed86156a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:30:34 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:78:ae,bridge_name='br-int',has_traffic_filtering=True,id=eeb0edc6-31dc-4bbf-abc4-331ed86156a1,network=Network(6a7f7426-b595-4aa3-bf80-cc92ba7ce15e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeb0edc6-31') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:30:34 user nova-compute[75245]: DEBUG os_vif [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:78:ae,bridge_name='br-int',has_traffic_filtering=True,id=eeb0edc6-31dc-4bbf-abc4-331ed86156a1,network=Network(6a7f7426-b595-4aa3-bf80-cc92ba7ce15e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeb0edc6-31') {{(pid=75245) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 16:30:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:30:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:30:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 16:30:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:30:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6be27b63-aa19-56a2-97a0-bb274680d98b', '_type': 'linux-noop'}}, row=False) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:30:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:30:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:30:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:30:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:30:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeeb0edc6-31, may_exist=True, interface_attrs={}) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:30:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeeb0edc6-31, col_values=(('qos', UUID('0455b712-1063-45a4-ad40-72cbea8bdc58')),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:30:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeeb0edc6-31, col_values=(('external_ids', {'iface-id': 'eeb0edc6-31dc-4bbf-abc4-331ed86156a1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:78:ae', 'vm-uuid': '26acb3c4-b081-4670-a6b5-d40583c23592'}),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:30:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:30:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:30:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:30:34 user nova-compute[75245]: INFO os_vif [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:78:ae,bridge_name='br-int',has_traffic_filtering=True,id=eeb0edc6-31dc-4bbf-abc4-331ed86156a1,network=Network(6a7f7426-b595-4aa3-bf80-cc92ba7ce15e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeb0edc6-31')
Nov 29 16:30:34 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:30:34 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] No VIF found with MAC fa:16:3e:78:78:ae, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:30:34 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Acquiring lock "24fb8ee5-4eee-4976-bcab-24242ef70d39" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:30:34 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lock "24fb8ee5-4eee-4976-bcab-24242ef70d39" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:30:34 user nova-compute[75245]: DEBUG nova.compute.manager [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Starting instance... {{(pid=75245) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 16:30:35 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:30:35 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:30:35 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75245) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 16:30:35 user nova-compute[75245]: INFO nova.compute.claims [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Claim successful on node user
Nov 29 16:30:35 user nova-compute[75245]: DEBUG nova.compute.manager [req-4736193f-293b-4352-88aa-44818ec32b5b req-ae70d6f7-4111-491f-88c3-1847f8538e55 service nova] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Received event network-vif-plugged-6d28be36-e00b-4f84-9a2b-60515f2e65a1 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:30:35 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-4736193f-293b-4352-88aa-44818ec32b5b req-ae70d6f7-4111-491f-88c3-1847f8538e55 service nova] Acquiring lock "0b629ca7-b69e-471c-a7b0-9eb43301c36f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:30:35 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-4736193f-293b-4352-88aa-44818ec32b5b req-ae70d6f7-4111-491f-88c3-1847f8538e55 service nova] Lock "0b629ca7-b69e-471c-a7b0-9eb43301c36f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:30:35 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-4736193f-293b-4352-88aa-44818ec32b5b req-ae70d6f7-4111-491f-88c3-1847f8538e55 service nova] Lock "0b629ca7-b69e-471c-a7b0-9eb43301c36f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:30:35 user nova-compute[75245]: DEBUG nova.compute.manager [req-4736193f-293b-4352-88aa-44818ec32b5b req-ae70d6f7-4111-491f-88c3-1847f8538e55 service nova] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] No waiting events found dispatching network-vif-plugged-6d28be36-e00b-4f84-9a2b-60515f2e65a1 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:30:35 user nova-compute[75245]: WARNING nova.compute.manager [req-4736193f-293b-4352-88aa-44818ec32b5b req-ae70d6f7-4111-491f-88c3-1847f8538e55 service nova] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Received unexpected event network-vif-plugged-6d28be36-e00b-4f84-9a2b-60515f2e65a1 for instance with vm_state stopped and task_state None.
Nov 29 16:30:35 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:30:35 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:30:35 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.429s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:30:35 user nova-compute[75245]: DEBUG nova.compute.manager [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Start building networks asynchronously for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 16:30:35 user nova-compute[75245]: DEBUG nova.compute.manager [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Allocating IP information in the background. {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 16:30:35 user nova-compute[75245]: DEBUG nova.network.neutron [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] allocate_for_instance() {{(pid=75245) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 16:30:35 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 16:30:35 user nova-compute[75245]: DEBUG nova.compute.manager [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Start building block device mappings for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 16:30:35 user nova-compute[75245]: DEBUG nova.policy [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd876b1e244b14a29ad5b4b422135336b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e12002e1a11f4caf8953371e66e6652e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75245) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 16:30:35 user nova-compute[75245]: DEBUG nova.compute.manager [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Start spawning the instance on the hypervisor. {{(pid=75245) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 16:30:35 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Creating instance directory {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 16:30:35 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Creating image(s)
Nov 29 16:30:35 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Acquiring lock "/opt/stack/data/nova/instances/24fb8ee5-4eee-4976-bcab-24242ef70d39/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:30:35 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lock "/opt/stack/data/nova/instances/24fb8ee5-4eee-4976-bcab-24242ef70d39/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:30:35 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lock "/opt/stack/data/nova/instances/24fb8ee5-4eee-4976-bcab-24242ef70d39/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:30:35 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:30:35 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:30:35 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.190s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:30:35 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Acquiring lock "d654f7206043e05d3525550b0fc885556eb999f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:30:35 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:30:35 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:30:36 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:30:36 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:30:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.272s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:30:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/24fb8ee5-4eee-4976-bcab-24242ef70d39/disk 1073741824 {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:30:36 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:30:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/24fb8ee5-4eee-4976-bcab-24242ef70d39/disk 1073741824" returned: 0 in 0.064s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:30:36 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.342s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:30:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:30:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.227s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:30:36 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Checking if we can resize image /opt/stack/data/nova/instances/24fb8ee5-4eee-4976-bcab-24242ef70d39/disk. size=1073741824 {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 16:30:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24fb8ee5-4eee-4976-bcab-24242ef70d39/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:30:36 user nova-compute[75245]: DEBUG nova.network.neutron [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Successfully created port: 62440fbd-97a8-49eb-8509-a7be044b764a {{(pid=75245) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 16:30:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24fb8ee5-4eee-4976-bcab-24242ef70d39/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:30:36 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Cannot resize image /opt/stack/data/nova/instances/24fb8ee5-4eee-4976-bcab-24242ef70d39/disk to a smaller size. {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 16:30:36 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Created local disks {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 16:30:36 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Ensure instance console log exists: /opt/stack/data/nova/instances/24fb8ee5-4eee-4976-bcab-24242ef70d39/console.log {{(pid=75245) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 16:30:36 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:30:36 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:30:36 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:30:37 user nova-compute[75245]: DEBUG nova.network.neutron [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Successfully updated port: 62440fbd-97a8-49eb-8509-a7be044b764a {{(pid=75245) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 16:30:37 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Acquiring lock "refresh_cache-24fb8ee5-4eee-4976-bcab-24242ef70d39" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:30:37 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Acquired lock "refresh_cache-24fb8ee5-4eee-4976-bcab-24242ef70d39" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:30:37 user nova-compute[75245]: DEBUG nova.network.neutron [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 16:30:37 user nova-compute[75245]: DEBUG nova.compute.manager [req-68c06ea9-fee8-406f-b773-3969de65c324 req-7edba30f-b83f-4078-803a-8d2d4e760be3 service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Received event network-changed-62440fbd-97a8-49eb-8509-a7be044b764a {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:30:37 user nova-compute[75245]: DEBUG nova.compute.manager [req-68c06ea9-fee8-406f-b773-3969de65c324 req-7edba30f-b83f-4078-803a-8d2d4e760be3 service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Refreshing instance network info cache due to event network-changed-62440fbd-97a8-49eb-8509-a7be044b764a. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:30:37 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-68c06ea9-fee8-406f-b773-3969de65c324 req-7edba30f-b83f-4078-803a-8d2d4e760be3 service nova] Acquiring lock "refresh_cache-24fb8ee5-4eee-4976-bcab-24242ef70d39" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:30:37 user nova-compute[75245]: DEBUG nova.compute.manager [req-9816b28f-37a0-473f-9e46-ff852a093d82 req-d98d9b4e-85d2-482c-b753-1f7b5db3198d service nova] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Received event network-vif-plugged-eeb0edc6-31dc-4bbf-abc4-331ed86156a1 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:30:37 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-9816b28f-37a0-473f-9e46-ff852a093d82 req-d98d9b4e-85d2-482c-b753-1f7b5db3198d service nova] Acquiring lock "26acb3c4-b081-4670-a6b5-d40583c23592-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:30:37 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-9816b28f-37a0-473f-9e46-ff852a093d82 req-d98d9b4e-85d2-482c-b753-1f7b5db3198d service nova] Lock "26acb3c4-b081-4670-a6b5-d40583c23592-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:30:37 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-9816b28f-37a0-473f-9e46-ff852a093d82 req-d98d9b4e-85d2-482c-b753-1f7b5db3198d service nova] Lock "26acb3c4-b081-4670-a6b5-d40583c23592-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:30:37 user nova-compute[75245]: DEBUG nova.compute.manager [req-9816b28f-37a0-473f-9e46-ff852a093d82 req-d98d9b4e-85d2-482c-b753-1f7b5db3198d service nova] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] No waiting events found dispatching network-vif-plugged-eeb0edc6-31dc-4bbf-abc4-331ed86156a1 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:30:37 user nova-compute[75245]: WARNING nova.compute.manager [req-9816b28f-37a0-473f-9e46-ff852a093d82 req-d98d9b4e-85d2-482c-b753-1f7b5db3198d service nova] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Received unexpected event network-vif-plugged-eeb0edc6-31dc-4bbf-abc4-331ed86156a1 for instance with vm_state building and task_state spawning.
Nov 29 16:30:37 user nova-compute[75245]: DEBUG nova.compute.manager [req-9816b28f-37a0-473f-9e46-ff852a093d82 req-d98d9b4e-85d2-482c-b753-1f7b5db3198d service nova] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Received event network-vif-plugged-eeb0edc6-31dc-4bbf-abc4-331ed86156a1 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:30:37 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-9816b28f-37a0-473f-9e46-ff852a093d82 req-d98d9b4e-85d2-482c-b753-1f7b5db3198d service nova] Acquiring lock "26acb3c4-b081-4670-a6b5-d40583c23592-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:30:37 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-9816b28f-37a0-473f-9e46-ff852a093d82 req-d98d9b4e-85d2-482c-b753-1f7b5db3198d service nova] Lock "26acb3c4-b081-4670-a6b5-d40583c23592-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:30:37 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-9816b28f-37a0-473f-9e46-ff852a093d82 req-d98d9b4e-85d2-482c-b753-1f7b5db3198d service nova] Lock "26acb3c4-b081-4670-a6b5-d40583c23592-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:30:37 user nova-compute[75245]: DEBUG nova.compute.manager [req-9816b28f-37a0-473f-9e46-ff852a093d82 req-d98d9b4e-85d2-482c-b753-1f7b5db3198d service nova] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] No waiting events found dispatching network-vif-plugged-eeb0edc6-31dc-4bbf-abc4-331ed86156a1 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:30:37 user nova-compute[75245]: WARNING nova.compute.manager [req-9816b28f-37a0-473f-9e46-ff852a093d82 req-d98d9b4e-85d2-482c-b753-1f7b5db3198d service nova] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Received unexpected event network-vif-plugged-eeb0edc6-31dc-4bbf-abc4-331ed86156a1 for instance with vm_state building and task_state spawning.
Nov 29 16:30:37 user nova-compute[75245]: DEBUG nova.network.neutron [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Instance cache missing network info. {{(pid=75245) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 16:30:37 user nova-compute[75245]: DEBUG nova.network.neutron [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Updating instance_info_cache with network_info: [{"id": "62440fbd-97a8-49eb-8509-a7be044b764a", "address": "fa:16:3e:b2:63:34", "network": {"id": "02098e86-68f8-464e-84ee-bf2fb09b881b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085418471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e12002e1a11f4caf8953371e66e6652e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62440fbd-97", "ovs_interfaceid": "62440fbd-97a8-49eb-8509-a7be044b764a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:30:37 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Releasing lock "refresh_cache-24fb8ee5-4eee-4976-bcab-24242ef70d39" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:30:37 user nova-compute[75245]: DEBUG nova.compute.manager [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Instance network_info: |[{"id": "62440fbd-97a8-49eb-8509-a7be044b764a", "address": "fa:16:3e:b2:63:34", "network": {"id": "02098e86-68f8-464e-84ee-bf2fb09b881b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085418471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e12002e1a11f4caf8953371e66e6652e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62440fbd-97", "ovs_interfaceid": "62440fbd-97a8-49eb-8509-a7be044b764a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 16:30:37 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-68c06ea9-fee8-406f-b773-3969de65c324 req-7edba30f-b83f-4078-803a-8d2d4e760be3 service nova] Acquired lock "refresh_cache-24fb8ee5-4eee-4976-bcab-24242ef70d39" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:30:37 user nova-compute[75245]: DEBUG nova.network.neutron [req-68c06ea9-fee8-406f-b773-3969de65c324 req-7edba30f-b83f-4078-803a-8d2d4e760be3 service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Refreshing network info cache for port 62440fbd-97a8-49eb-8509-a7be044b764a {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:30:37 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Start _get_guest_xml network_info=[{"id": "62440fbd-97a8-49eb-8509-a7be044b764a", "address": "fa:16:3e:b2:63:34", "network": {"id": "02098e86-68f8-464e-84ee-bf2fb09b881b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085418471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e12002e1a11f4caf8953371e66e6652e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62440fbd-97", "ovs_interfaceid": "62440fbd-97a8-49eb-8509-a7be044b764a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'a291d9c3-be02-4c6c-9649-4b45c5b7f487'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 16:30:37 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:30:37 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:30:37 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 16:30:37 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] CPU controller missing on host. {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 16:30:37 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 16:30:37 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] CPU controller found on host. {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 16:30:37 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75245) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 16:30:37 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T16:06:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 16:30:37 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Flavor limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 16:30:37 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Image limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 16:30:37 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Flavor pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 16:30:37 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Image pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 16:30:37 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 16:30:37 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 16:30:37 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 16:30:37 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Got 1 possible topologies {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 16:30:37 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 16:30:37 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 16:30:37 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:30:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-640260040',display_name='tempest-ServerRescueNegativeTestJSON-server-640260040',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-640260040',id=31,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBACvKEgq8kStkZ1z3ReTmb3c/dp4mRi1EUgpKQXKqWZlYREEZfw+OWLoIIjh5f+XOK1abUAZHhSpf9SDmRSDBWvCgIJoBwK9h9YoQr9SBb5REV1zRe7b4QTPMqNd5zaDNw==',key_name='tempest-keypair-2048224560',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e12002e1a11f4caf8953371e66e6652e',ramdisk_id='',reservation_id='r-8gg62wg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1013090395',owner_user_name='tempest-ServerRescueNegativeTestJSON-1013090395-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:30:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d876b1e244b14a29ad5b4b422135336b',uuid=24fb8ee5-4eee-4976-bcab-24242ef70d39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "62440fbd-97a8-49eb-8509-a7be044b764a", "address": "fa:16:3e:b2:63:34", "network": {"id": "02098e86-68f8-464e-84ee-bf2fb09b881b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085418471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e12002e1a11f4caf8953371e66e6652e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62440fbd-97", "ovs_interfaceid": "62440fbd-97a8-49eb-8509-a7be044b764a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:30:37 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Converting VIF {"id": "62440fbd-97a8-49eb-8509-a7be044b764a", "address": "fa:16:3e:b2:63:34", "network": {"id": "02098e86-68f8-464e-84ee-bf2fb09b881b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085418471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e12002e1a11f4caf8953371e66e6652e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62440fbd-97", "ovs_interfaceid": "62440fbd-97a8-49eb-8509-a7be044b764a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:30:37 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:63:34,bridge_name='br-int',has_traffic_filtering=True,id=62440fbd-97a8-49eb-8509-a7be044b764a,network=Network(02098e86-68f8-464e-84ee-bf2fb09b881b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62440fbd-97') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:30:37 user nova-compute[75245]: DEBUG nova.objects.instance [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lazy-loading 'pci_devices' on Instance uuid 24fb8ee5-4eee-4976-bcab-24242ef70d39 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:30:37 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] End _get_guest_xml xml=<domain type="kvm">
Nov 29 16:30:37 user nova-compute[75245]:   <uuid>24fb8ee5-4eee-4976-bcab-24242ef70d39</uuid>
Nov 29 16:30:37 user nova-compute[75245]:   <name>instance-0000001f</name>
Nov 29 16:30:37 user nova-compute[75245]:   <memory>524288</memory>
Nov 29 16:30:37 user nova-compute[75245]:   <vcpu>1</vcpu>
Nov 29 16:30:37 user nova-compute[75245]:   <metadata>
Nov 29 16:30:37 user nova-compute[75245]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 16:30:37 user nova-compute[75245]:       <nova:package version="0.0.0"/>
Nov 29 16:30:37 user nova-compute[75245]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-640260040</nova:name>
Nov 29 16:30:37 user nova-compute[75245]:       <nova:creationTime>2023-11-29 16:30:37</nova:creationTime>
Nov 29 16:30:37 user nova-compute[75245]:       <nova:flavor name="m1.tiny">
Nov 29 16:30:37 user nova-compute[75245]:         <nova:memory>512</nova:memory>
Nov 29 16:30:37 user nova-compute[75245]:         <nova:disk>1</nova:disk>
Nov 29 16:30:37 user nova-compute[75245]:         <nova:swap>0</nova:swap>
Nov 29 16:30:37 user nova-compute[75245]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 16:30:37 user nova-compute[75245]:         <nova:vcpus>1</nova:vcpus>
Nov 29 16:30:37 user nova-compute[75245]:       </nova:flavor>
Nov 29 16:30:37 user nova-compute[75245]:       <nova:owner>
Nov 29 16:30:37 user nova-compute[75245]:         <nova:user uuid="d876b1e244b14a29ad5b4b422135336b">tempest-ServerRescueNegativeTestJSON-1013090395-project-member</nova:user>
Nov 29 16:30:37 user nova-compute[75245]:         <nova:project uuid="e12002e1a11f4caf8953371e66e6652e">tempest-ServerRescueNegativeTestJSON-1013090395</nova:project>
Nov 29 16:30:37 user nova-compute[75245]:       </nova:owner>
Nov 29 16:30:37 user nova-compute[75245]:       <nova:root type="image" uuid="a291d9c3-be02-4c6c-9649-4b45c5b7f487"/>
Nov 29 16:30:37 user nova-compute[75245]:       <nova:ports>
Nov 29 16:30:37 user nova-compute[75245]:         <nova:port uuid="62440fbd-97a8-49eb-8509-a7be044b764a">
Nov 29 16:30:37 user nova-compute[75245]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 29 16:30:37 user nova-compute[75245]:         </nova:port>
Nov 29 16:30:37 user nova-compute[75245]:       </nova:ports>
Nov 29 16:30:37 user nova-compute[75245]:     </nova:instance>
Nov 29 16:30:37 user nova-compute[75245]:   </metadata>
Nov 29 16:30:37 user nova-compute[75245]:   <sysinfo type="smbios">
Nov 29 16:30:37 user nova-compute[75245]:     <system>
Nov 29 16:30:37 user nova-compute[75245]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 16:30:37 user nova-compute[75245]:       <entry name="product">OpenStack Nova</entry>
Nov 29 16:30:37 user nova-compute[75245]:       <entry name="version">0.0.0</entry>
Nov 29 16:30:37 user nova-compute[75245]:       <entry name="serial">24fb8ee5-4eee-4976-bcab-24242ef70d39</entry>
Nov 29 16:30:37 user nova-compute[75245]:       <entry name="uuid">24fb8ee5-4eee-4976-bcab-24242ef70d39</entry>
Nov 29 16:30:37 user nova-compute[75245]:       <entry name="family">Virtual Machine</entry>
Nov 29 16:30:37 user nova-compute[75245]:     </system>
Nov 29 16:30:37 user nova-compute[75245]:   </sysinfo>
Nov 29 16:30:37 user nova-compute[75245]:   <os>
Nov 29 16:30:37 user nova-compute[75245]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 16:30:37 user nova-compute[75245]:     <boot dev="hd"/>
Nov 29 16:30:37 user nova-compute[75245]:     <smbios mode="sysinfo"/>
Nov 29 16:30:37 user nova-compute[75245]:   </os>
Nov 29 16:30:37 user nova-compute[75245]:   <features>
Nov 29 16:30:37 user nova-compute[75245]:     <acpi/>
Nov 29 16:30:37 user nova-compute[75245]:     <apic/>
Nov 29 16:30:37 user nova-compute[75245]:     <vmcoreinfo/>
Nov 29 16:30:37 user nova-compute[75245]:   </features>
Nov 29 16:30:37 user nova-compute[75245]:   <clock offset="utc">
Nov 29 16:30:37 user nova-compute[75245]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 16:30:37 user nova-compute[75245]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 16:30:37 user nova-compute[75245]:     <timer name="hpet" present="no"/>
Nov 29 16:30:37 user nova-compute[75245]:   </clock>
Nov 29 16:30:37 user nova-compute[75245]:   <cpu mode="custom" match="exact">
Nov 29 16:30:37 user nova-compute[75245]:     <model>Nehalem</model>
Nov 29 16:30:37 user nova-compute[75245]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 16:30:37 user nova-compute[75245]:   </cpu>
Nov 29 16:30:37 user nova-compute[75245]:   <devices>
Nov 29 16:30:37 user nova-compute[75245]:     <disk type="file" device="disk">
Nov 29 16:30:37 user nova-compute[75245]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 16:30:37 user nova-compute[75245]:       <source file="/opt/stack/data/nova/instances/24fb8ee5-4eee-4976-bcab-24242ef70d39/disk"/>
Nov 29 16:30:37 user nova-compute[75245]:       <target dev="vda" bus="virtio"/>
Nov 29 16:30:37 user nova-compute[75245]:     </disk>
Nov 29 16:30:37 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 16:30:37 user nova-compute[75245]:       <mac address="fa:16:3e:b2:63:34"/>
Nov 29 16:30:37 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:30:37 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 16:30:37 user nova-compute[75245]:       <target dev="tap62440fbd-97"/>
Nov 29 16:30:37 user nova-compute[75245]:     </interface>
Nov 29 16:30:37 user nova-compute[75245]:     <serial type="pty">
Nov 29 16:30:37 user nova-compute[75245]:       <log file="/opt/stack/data/nova/instances/24fb8ee5-4eee-4976-bcab-24242ef70d39/console.log" append="off"/>
Nov 29 16:30:37 user nova-compute[75245]:     </serial>
Nov 29 16:30:37 user nova-compute[75245]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 16:30:37 user nova-compute[75245]:     <video>
Nov 29 16:30:37 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:30:37 user nova-compute[75245]:     </video>
Nov 29 16:30:37 user nova-compute[75245]:     <rng model="virtio">
Nov 29 16:30:37 user nova-compute[75245]:       <backend model="random">/dev/urandom</backend>
Nov 29 16:30:37 user nova-compute[75245]:     </rng>
Nov 29 16:30:37 user nova-compute[75245]:     <controller type="usb" index="0" model="none"/>
Nov 29 16:30:37 user nova-compute[75245]:     <memballoon model="virtio">
Nov 29 16:30:37 user nova-compute[75245]:       <stats period="10"/>
Nov 29 16:30:37 user nova-compute[75245]:     </memballoon>
Nov 29 16:30:37 user nova-compute[75245]:   </devices>
Nov 29 16:30:37 user nova-compute[75245]: </domain>
Nov 29 16:30:37 user nova-compute[75245]:  {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 16:30:37 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:30:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-640260040',display_name='tempest-ServerRescueNegativeTestJSON-server-640260040',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-640260040',id=31,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBACvKEgq8kStkZ1z3ReTmb3c/dp4mRi1EUgpKQXKqWZlYREEZfw+OWLoIIjh5f+XOK1abUAZHhSpf9SDmRSDBWvCgIJoBwK9h9YoQr9SBb5REV1zRe7b4QTPMqNd5zaDNw==',key_name='tempest-keypair-2048224560',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e12002e1a11f4caf8953371e66e6652e',ramdisk_id='',reservation_id='r-8gg62wg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1013090395',owner_user_name='tempest-ServerRescueNegativeTestJSON-1013090395-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:30:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d876b1e244b14a29ad5b4b422135336b',uuid=24fb8ee5-4eee-4976-bcab-24242ef70d39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "62440fbd-97a8-49eb-8509-a7be044b764a", "address": "fa:16:3e:b2:63:34", "network": {"id": "02098e86-68f8-464e-84ee-bf2fb09b881b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085418471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e12002e1a11f4caf8953371e66e6652e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62440fbd-97", "ovs_interfaceid": "62440fbd-97a8-49eb-8509-a7be044b764a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 16:30:37 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Converting VIF {"id": "62440fbd-97a8-49eb-8509-a7be044b764a", "address": "fa:16:3e:b2:63:34", "network": {"id": "02098e86-68f8-464e-84ee-bf2fb09b881b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085418471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e12002e1a11f4caf8953371e66e6652e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62440fbd-97", "ovs_interfaceid": "62440fbd-97a8-49eb-8509-a7be044b764a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:30:37 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:63:34,bridge_name='br-int',has_traffic_filtering=True,id=62440fbd-97a8-49eb-8509-a7be044b764a,network=Network(02098e86-68f8-464e-84ee-bf2fb09b881b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62440fbd-97') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:30:37 user nova-compute[75245]: DEBUG os_vif [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:63:34,bridge_name='br-int',has_traffic_filtering=True,id=62440fbd-97a8-49eb-8509-a7be044b764a,network=Network(02098e86-68f8-464e-84ee-bf2fb09b881b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62440fbd-97') {{(pid=75245) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 16:30:37 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:30:37 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:30:37 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 16:30:37 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:30:37 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ea2fad5c-c9dc-52a2-93c4-c85ce7b29c43', '_type': 'linux-noop'}}, row=False) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:30:37 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:30:37 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:30:37 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:30:37 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:30:37 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap62440fbd-97, may_exist=True, interface_attrs={}) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:30:37 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap62440fbd-97, col_values=(('qos', UUID('0505550a-0331-46b3-b78b-2062ef8bd3fc')),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:30:37 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap62440fbd-97, col_values=(('external_ids', {'iface-id': '62440fbd-97a8-49eb-8509-a7be044b764a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:63:34', 'vm-uuid': '24fb8ee5-4eee-4976-bcab-24242ef70d39'}),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:30:37 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:30:37 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:30:37 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:30:37 user nova-compute[75245]: INFO os_vif [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:63:34,bridge_name='br-int',has_traffic_filtering=True,id=62440fbd-97a8-49eb-8509-a7be044b764a,network=Network(02098e86-68f8-464e-84ee-bf2fb09b881b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62440fbd-97')
Nov 29 16:30:37 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:30:37 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] No VIF found with MAC fa:16:3e:b2:63:34, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:30:38 user nova-compute[75245]: DEBUG nova.network.neutron [req-68c06ea9-fee8-406f-b773-3969de65c324 req-7edba30f-b83f-4078-803a-8d2d4e760be3 service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Updated VIF entry in instance network info cache for port 62440fbd-97a8-49eb-8509-a7be044b764a. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:30:38 user nova-compute[75245]: DEBUG nova.network.neutron [req-68c06ea9-fee8-406f-b773-3969de65c324 req-7edba30f-b83f-4078-803a-8d2d4e760be3 service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Updating instance_info_cache with network_info: [{"id": "62440fbd-97a8-49eb-8509-a7be044b764a", "address": "fa:16:3e:b2:63:34", "network": {"id": "02098e86-68f8-464e-84ee-bf2fb09b881b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085418471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e12002e1a11f4caf8953371e66e6652e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62440fbd-97", "ovs_interfaceid": "62440fbd-97a8-49eb-8509-a7be044b764a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:30:38 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-68c06ea9-fee8-406f-b773-3969de65c324 req-7edba30f-b83f-4078-803a-8d2d4e760be3 service nova] Releasing lock "refresh_cache-24fb8ee5-4eee-4976-bcab-24242ef70d39" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:30:38 user nova-compute[75245]: DEBUG nova.compute.manager [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Instance event wait completed in 0 seconds for  {{(pid=75245) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 16:30:38 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Guest created on hypervisor {{(pid=75245) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 16:30:38 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Instance spawned successfully.
Nov 29 16:30:38 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 16:30:38 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Found default for hw_cdrom_bus of ide {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:30:38 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Found default for hw_disk_bus of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:30:38 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Found default for hw_input_bus of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:30:38 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Found default for hw_pointer_model of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:30:38 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Found default for hw_video_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:30:38 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Found default for hw_vif_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:30:38 user nova-compute[75245]: INFO nova.compute.manager [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Took 5.36 seconds to spawn the instance on the hypervisor.
Nov 29 16:30:38 user nova-compute[75245]: DEBUG nova.compute.manager [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:30:38 user nova-compute[75245]: INFO nova.compute.manager [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Took 19.15 seconds to build instance.
Nov 29 16:30:38 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-080f539c-995a-453f-9e3e-ff26092479e6 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "26acb3c4-b081-4670-a6b5-d40583c23592" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.238s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:30:38 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:30:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:30:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:30:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:30:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:30:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:30:39 user nova-compute[75245]: DEBUG nova.compute.manager [req-acf2dd03-9aa9-4f00-a168-7103d003a3a5 req-2de1749a-6313-4e00-9670-6f13adb05a09 service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Received event network-vif-plugged-62440fbd-97a8-49eb-8509-a7be044b764a {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:30:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-acf2dd03-9aa9-4f00-a168-7103d003a3a5 req-2de1749a-6313-4e00-9670-6f13adb05a09 service nova] Acquiring lock "24fb8ee5-4eee-4976-bcab-24242ef70d39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:30:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-acf2dd03-9aa9-4f00-a168-7103d003a3a5 req-2de1749a-6313-4e00-9670-6f13adb05a09 service nova] Lock "24fb8ee5-4eee-4976-bcab-24242ef70d39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:30:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-acf2dd03-9aa9-4f00-a168-7103d003a3a5 req-2de1749a-6313-4e00-9670-6f13adb05a09 service nova] Lock "24fb8ee5-4eee-4976-bcab-24242ef70d39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:30:39 user nova-compute[75245]: DEBUG nova.compute.manager [req-acf2dd03-9aa9-4f00-a168-7103d003a3a5 req-2de1749a-6313-4e00-9670-6f13adb05a09 service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] No waiting events found dispatching network-vif-plugged-62440fbd-97a8-49eb-8509-a7be044b764a {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:30:39 user nova-compute[75245]: WARNING nova.compute.manager [req-acf2dd03-9aa9-4f00-a168-7103d003a3a5 req-2de1749a-6313-4e00-9670-6f13adb05a09 service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Received unexpected event network-vif-plugged-62440fbd-97a8-49eb-8509-a7be044b764a for instance with vm_state building and task_state spawning.
Nov 29 16:30:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:30:41 user nova-compute[75245]: DEBUG nova.compute.manager [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Instance event wait completed in 0 seconds for  {{(pid=75245) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 16:30:41 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Guest created on hypervisor {{(pid=75245) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 16:30:41 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Instance spawned successfully.
Nov 29 16:30:41 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 16:30:41 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Found default for hw_cdrom_bus of ide {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:30:41 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Found default for hw_disk_bus of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:30:41 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Found default for hw_input_bus of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:30:41 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Found default for hw_pointer_model of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:30:41 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Found default for hw_video_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:30:41 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Found default for hw_vif_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:30:41 user nova-compute[75245]: DEBUG nova.compute.manager [req-67cbb165-9e77-4b69-9fd9-900b91861342 req-cfb326fe-93c9-404a-9191-6b0eaae85bd1 service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Received event network-vif-plugged-62440fbd-97a8-49eb-8509-a7be044b764a {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:30:41 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-67cbb165-9e77-4b69-9fd9-900b91861342 req-cfb326fe-93c9-404a-9191-6b0eaae85bd1 service nova] Acquiring lock "24fb8ee5-4eee-4976-bcab-24242ef70d39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:30:41 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-67cbb165-9e77-4b69-9fd9-900b91861342 req-cfb326fe-93c9-404a-9191-6b0eaae85bd1 service nova] Lock "24fb8ee5-4eee-4976-bcab-24242ef70d39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:30:41 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-67cbb165-9e77-4b69-9fd9-900b91861342 req-cfb326fe-93c9-404a-9191-6b0eaae85bd1 service nova] Lock "24fb8ee5-4eee-4976-bcab-24242ef70d39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:30:41 user nova-compute[75245]: DEBUG nova.compute.manager [req-67cbb165-9e77-4b69-9fd9-900b91861342 req-cfb326fe-93c9-404a-9191-6b0eaae85bd1 service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] No waiting events found dispatching network-vif-plugged-62440fbd-97a8-49eb-8509-a7be044b764a {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:30:41 user nova-compute[75245]: WARNING nova.compute.manager [req-67cbb165-9e77-4b69-9fd9-900b91861342 req-cfb326fe-93c9-404a-9191-6b0eaae85bd1 service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Received unexpected event network-vif-plugged-62440fbd-97a8-49eb-8509-a7be044b764a for instance with vm_state building and task_state spawning.
Nov 29 16:30:41 user nova-compute[75245]: INFO nova.compute.manager [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Took 5.85 seconds to spawn the instance on the hypervisor.
Nov 29 16:30:41 user nova-compute[75245]: DEBUG nova.compute.manager [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:30:41 user nova-compute[75245]: INFO nova.compute.manager [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Took 6.66 seconds to build instance.
Nov 29 16:30:41 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-de663836-b983-485a-b92b-8e600eca58c8 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lock "24fb8ee5-4eee-4976-bcab-24242ef70d39" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.762s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:30:42 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:30:43 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:30:47 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:30:52 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:30:53 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:30:57 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:30:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:31:02 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:31:03 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:31:03 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Starting heal instance info cache {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 16:31:03 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Rebuilding the list of instances to heal {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 16:31:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "refresh_cache-8785a3c2-5b7a-4382-b50d-cecd8743329c" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:31:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquired lock "refresh_cache-8785a3c2-5b7a-4382-b50d-cecd8743329c" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:31:03 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Forcefully refreshing network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 16:31:03 user nova-compute[75245]: DEBUG nova.objects.instance [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lazy-loading 'info_cache' on Instance uuid 8785a3c2-5b7a-4382-b50d-cecd8743329c {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:31:03 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:31:04 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Updating instance_info_cache with network_info: [{"id": "8c7418c2-2459-4bc3-acfb-16df97c78f67", "address": "fa:16:3e:82:d0:d8", "network": {"id": "6a7f7426-b595-4aa3-bf80-cc92ba7ce15e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-917300903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d52776451e947f5a9ef3fa44ac8acbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7418c2-24", "ovs_interfaceid": "8c7418c2-2459-4bc3-acfb-16df97c78f67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:31:04 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Releasing lock "refresh_cache-8785a3c2-5b7a-4382-b50d-cecd8743329c" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:31:04 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Updated the network info_cache for instance {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 16:31:05 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:31:06 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:31:07 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:31:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:31:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:31:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:31:07 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75245) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 16:31:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b629ca7-b69e-471c-a7b0-9eb43301c36f/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:31:07 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:31:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b629ca7-b69e-471c-a7b0-9eb43301c36f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:31:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b629ca7-b69e-471c-a7b0-9eb43301c36f/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:31:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b629ca7-b69e-471c-a7b0-9eb43301c36f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:31:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:31:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:31:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:31:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:31:08 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:31:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:31:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:31:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:31:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:31:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:31:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f4fa79b-345a-4e58-a77c-fdfed675e6e7/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:31:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f4fa79b-345a-4e58-a77c-fdfed675e6e7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:31:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f4fa79b-345a-4e58-a77c-fdfed675e6e7/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:31:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f4fa79b-345a-4e58-a77c-fdfed675e6e7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:31:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk.rescue --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:31:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:31:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk.rescue --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:31:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:31:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:31:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:31:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:31:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:31:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24fb8ee5-4eee-4976-bcab-24242ef70d39/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:31:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24fb8ee5-4eee-4976-bcab-24242ef70d39/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:31:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24fb8ee5-4eee-4976-bcab-24242ef70d39/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:31:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24fb8ee5-4eee-4976-bcab-24242ef70d39/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:31:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78784fb7-a25f-4c6c-9a44-649c994004c7/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:31:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78784fb7-a25f-4c6c-9a44-649c994004c7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:31:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78784fb7-a25f-4c6c-9a44-649c994004c7/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:31:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78784fb7-a25f-4c6c-9a44-649c994004c7/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:31:10 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:31:11 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:31:11 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:31:11 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Hypervisor/Node resource view: name=user free_ram=8154MB free_disk=25.103137969970703GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75245) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 16:31:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:31:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:31:11 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 8785a3c2-5b7a-4382-b50d-cecd8743329c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:31:11 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 5de7e10c-f216-46b3-8f74-57bac6ab7e56 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:31:11 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:31:11 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance ed9d1ad5-f5d0-4a68-a073-e7a83be772ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:31:11 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 0b629ca7-b69e-471c-a7b0-9eb43301c36f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:31:11 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 78784fb7-a25f-4c6c-9a44-649c994004c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:31:11 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 0f4fa79b-345a-4e58-a77c-fdfed675e6e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:31:11 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 26acb3c4-b081-4670-a6b5-d40583c23592 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:31:11 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 24fb8ee5-4eee-4976-bcab-24242ef70d39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:31:11 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 16:31:11 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 16:31:11 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Refreshing inventories for resource provider dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 16:31:11 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Updating ProviderTree inventory for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 16:31:11 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Updating inventory in ProviderTree for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 16:31:11 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Refreshing aggregate associations for resource provider dcc0ed27-167e-4f3a-a0de-183bb144a50c, aggregates: None {{(pid=75245) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 16:31:11 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Refreshing trait associations for resource provider dcc0ed27-167e-4f3a-a0de-183bb144a50c, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG {{(pid=75245) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 16:31:11 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:31:11 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:31:11 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Compute_service record updated for user:user {{(pid=75245) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 16:31:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.665s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:31:11 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:31:11 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Cleaning up deleted instances {{(pid=75245) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 16:31:11 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] There are 0 instances to clean {{(pid=75245) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 16:31:12 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:31:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:31:14 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:31:14 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:31:14 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:31:15 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:31:15 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:31:15 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75245) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 16:31:17 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:31:21 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:31:22 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:31:22 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75245) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 16:31:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:31:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:31:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75245) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 16:31:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:31:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:31:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:31:27 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:31:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:31:37 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:31:37 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:31:37 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75245) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 16:31:37 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:31:37 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:31:37 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:31:42 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:31:47 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:31:52 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:31:52 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:31:52 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75245) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 16:31:52 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:31:52 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:31:52 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:31:57 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:31:58 user nova-compute[75245]: DEBUG nova.compute.manager [req-dc833438-4492-4d76-a51e-56320c410c7f req-2cb80e6b-1e5c-485f-b3d5-b10034b3b2cc service nova] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Received event network-changed-0b59ddaf-c343-420d-9cf5-93d5fa48bc23 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:31:58 user nova-compute[75245]: DEBUG nova.compute.manager [req-dc833438-4492-4d76-a51e-56320c410c7f req-2cb80e6b-1e5c-485f-b3d5-b10034b3b2cc service nova] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Refreshing instance network info cache due to event network-changed-0b59ddaf-c343-420d-9cf5-93d5fa48bc23. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:31:58 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-dc833438-4492-4d76-a51e-56320c410c7f req-2cb80e6b-1e5c-485f-b3d5-b10034b3b2cc service nova] Acquiring lock "refresh_cache-0f4fa79b-345a-4e58-a77c-fdfed675e6e7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:31:58 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-dc833438-4492-4d76-a51e-56320c410c7f req-2cb80e6b-1e5c-485f-b3d5-b10034b3b2cc service nova] Acquired lock "refresh_cache-0f4fa79b-345a-4e58-a77c-fdfed675e6e7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:31:58 user nova-compute[75245]: DEBUG nova.network.neutron [req-dc833438-4492-4d76-a51e-56320c410c7f req-2cb80e6b-1e5c-485f-b3d5-b10034b3b2cc service nova] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Refreshing network info cache for port 0b59ddaf-c343-420d-9cf5-93d5fa48bc23 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:31:58 user nova-compute[75245]: DEBUG nova.network.neutron [req-dc833438-4492-4d76-a51e-56320c410c7f req-2cb80e6b-1e5c-485f-b3d5-b10034b3b2cc service nova] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Updated VIF entry in instance network info cache for port 0b59ddaf-c343-420d-9cf5-93d5fa48bc23. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:31:58 user nova-compute[75245]: DEBUG nova.network.neutron [req-dc833438-4492-4d76-a51e-56320c410c7f req-2cb80e6b-1e5c-485f-b3d5-b10034b3b2cc service nova] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Updating instance_info_cache with network_info: [{"id": "0b59ddaf-c343-420d-9cf5-93d5fa48bc23", "address": "fa:16:3e:12:d2:ca", "network": {"id": "74420114-8c7f-4f7b-9589-8605e1a2b922", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1124145478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12ae03075ca94c57af11198359d26514", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b59ddaf-c3", "ovs_interfaceid": "0b59ddaf-c343-420d-9cf5-93d5fa48bc23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:31:58 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-dc833438-4492-4d76-a51e-56320c410c7f req-2cb80e6b-1e5c-485f-b3d5-b10034b3b2cc service nova] Releasing lock "refresh_cache-0f4fa79b-345a-4e58-a77c-fdfed675e6e7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:31:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:31:59 user nova-compute[75245]: DEBUG nova.compute.manager [None req-d3e66aa6-e018-4599-bc1b-481151c821e2 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:31:59 user nova-compute[75245]: INFO nova.compute.manager [None req-d3e66aa6-e018-4599-bc1b-481151c821e2 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] instance snapshotting
Nov 29 16:31:59 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-d3e66aa6-e018-4599-bc1b-481151c821e2 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Beginning live snapshot process
Nov 29 16:31:59 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-d3e66aa6-e018-4599-bc1b-481151c821e2 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f4fa79b-345a-4e58-a77c-fdfed675e6e7/disk --force-share --output=json -f qcow2 {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:31:59 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-d3e66aa6-e018-4599-bc1b-481151c821e2 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f4fa79b-345a-4e58-a77c-fdfed675e6e7/disk --force-share --output=json -f qcow2" returned: 0 in 0.179s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:31:59 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-d3e66aa6-e018-4599-bc1b-481151c821e2 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f4fa79b-345a-4e58-a77c-fdfed675e6e7/disk --force-share --output=json -f qcow2 {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:31:59 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-d3e66aa6-e018-4599-bc1b-481151c821e2 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f4fa79b-345a-4e58-a77c-fdfed675e6e7/disk --force-share --output=json -f qcow2" returned: 0 in 0.197s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:31:59 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-d3e66aa6-e018-4599-bc1b-481151c821e2 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:31:59 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-d3e66aa6-e018-4599-bc1b-481151c821e2 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.183s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:31:59 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-d3e66aa6-e018-4599-bc1b-481151c821e2 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpu4ae86dk/a329eab638144e63aa838b5c5ac9e0a0.delta 1073741824 {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:32:00 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-d3e66aa6-e018-4599-bc1b-481151c821e2 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpu4ae86dk/a329eab638144e63aa838b5c5ac9e0a0.delta 1073741824" returned: 0 in 0.055s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:32:00 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-d3e66aa6-e018-4599-bc1b-481151c821e2 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 29 16:32:00 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-d3e66aa6-e018-4599-bc1b-481151c821e2 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75245) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 16:32:01 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-d3e66aa6-e018-4599-bc1b-481151c821e2 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75245) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 16:32:01 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-d3e66aa6-e018-4599-bc1b-481151c821e2 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 29 16:32:01 user nova-compute[75245]: DEBUG nova.privsep.utils [None req-d3e66aa6-e018-4599-bc1b-481151c821e2 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75245) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 16:32:01 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-d3e66aa6-e018-4599-bc1b-481151c821e2 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpu4ae86dk/a329eab638144e63aa838b5c5ac9e0a0.delta /opt/stack/data/nova/instances/snapshots/tmpu4ae86dk/a329eab638144e63aa838b5c5ac9e0a0 {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:32:01 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-d3e66aa6-e018-4599-bc1b-481151c821e2 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpu4ae86dk/a329eab638144e63aa838b5c5ac9e0a0.delta /opt/stack/data/nova/instances/snapshots/tmpu4ae86dk/a329eab638144e63aa838b5c5ac9e0a0" returned: 0 in 0.478s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:32:01 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-d3e66aa6-e018-4599-bc1b-481151c821e2 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Snapshot extracted, beginning image upload
Nov 29 16:32:02 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:32:03 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:32:04 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-d3e66aa6-e018-4599-bc1b-481151c821e2 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Snapshot image upload complete
Nov 29 16:32:04 user nova-compute[75245]: INFO nova.compute.manager [None req-d3e66aa6-e018-4599-bc1b-481151c821e2 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Took 5.03 seconds to snapshot the instance on the hypervisor.
Nov 29 16:32:05 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:32:05 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Starting heal instance info cache {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 16:32:05 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "refresh_cache-5de7e10c-f216-46b3-8f74-57bac6ab7e56" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:32:05 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquired lock "refresh_cache-5de7e10c-f216-46b3-8f74-57bac6ab7e56" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:32:05 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Forcefully refreshing network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 16:32:05 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Updating instance_info_cache with network_info: [{"id": "116d08d0-5549-4438-b689-0bbda3a5934f", "address": "fa:16:3e:97:fb:c7", "network": {"id": "6a7f7426-b595-4aa3-bf80-cc92ba7ce15e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-917300903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d52776451e947f5a9ef3fa44ac8acbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap116d08d0-55", "ovs_interfaceid": "116d08d0-5549-4438-b689-0bbda3a5934f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:32:05 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Releasing lock "refresh_cache-5de7e10c-f216-46b3-8f74-57bac6ab7e56" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:32:05 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Updated the network info_cache for instance {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 16:32:06 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:32:07 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:32:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:32:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:32:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:32:07 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75245) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 16:32:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b629ca7-b69e-471c-a7b0-9eb43301c36f/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:32:07 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:32:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b629ca7-b69e-471c-a7b0-9eb43301c36f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:32:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b629ca7-b69e-471c-a7b0-9eb43301c36f/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:32:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b629ca7-b69e-471c-a7b0-9eb43301c36f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:32:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:32:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:32:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:32:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:32:08 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:32:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:32:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:32:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:32:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:32:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:32:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f4fa79b-345a-4e58-a77c-fdfed675e6e7/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:32:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f4fa79b-345a-4e58-a77c-fdfed675e6e7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:32:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f4fa79b-345a-4e58-a77c-fdfed675e6e7/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:32:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f4fa79b-345a-4e58-a77c-fdfed675e6e7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:32:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk.rescue --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:32:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:32:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk.rescue --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:32:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:32:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:32:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:32:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:32:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:32:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24fb8ee5-4eee-4976-bcab-24242ef70d39/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:32:10 user nova-compute[75245]: INFO nova.compute.manager [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Rescuing
Nov 29 16:32:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Acquiring lock "refresh_cache-26acb3c4-b081-4670-a6b5-d40583c23592" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:32:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Acquired lock "refresh_cache-26acb3c4-b081-4670-a6b5-d40583c23592" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:32:10 user nova-compute[75245]: DEBUG nova.network.neutron [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 16:32:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24fb8ee5-4eee-4976-bcab-24242ef70d39/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:32:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24fb8ee5-4eee-4976-bcab-24242ef70d39/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:32:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24fb8ee5-4eee-4976-bcab-24242ef70d39/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:32:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78784fb7-a25f-4c6c-9a44-649c994004c7/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:32:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78784fb7-a25f-4c6c-9a44-649c994004c7/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:32:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78784fb7-a25f-4c6c-9a44-649c994004c7/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:32:10 user nova-compute[75245]: DEBUG nova.network.neutron [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Updating instance_info_cache with network_info: [{"id": "eeb0edc6-31dc-4bbf-abc4-331ed86156a1", "address": "fa:16:3e:78:78:ae", "network": {"id": "6a7f7426-b595-4aa3-bf80-cc92ba7ce15e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-917300903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d52776451e947f5a9ef3fa44ac8acbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb0edc6-31", "ovs_interfaceid": "eeb0edc6-31dc-4bbf-abc4-331ed86156a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:32:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Releasing lock "refresh_cache-26acb3c4-b081-4670-a6b5-d40583c23592" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:32:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78784fb7-a25f-4c6c-9a44-649c994004c7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:32:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:32:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:32:11 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:32:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:32:11 user nova-compute[75245]: DEBUG nova.compute.manager [req-e55fe8ae-ecd3-41e2-9239-46edbda17a11 req-ad805f8f-bf93-45be-94e0-f54d04621eb2 service nova] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Received event network-vif-unplugged-eeb0edc6-31dc-4bbf-abc4-331ed86156a1 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:32:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-e55fe8ae-ecd3-41e2-9239-46edbda17a11 req-ad805f8f-bf93-45be-94e0-f54d04621eb2 service nova] Acquiring lock "26acb3c4-b081-4670-a6b5-d40583c23592-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:32:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-e55fe8ae-ecd3-41e2-9239-46edbda17a11 req-ad805f8f-bf93-45be-94e0-f54d04621eb2 service nova] Lock "26acb3c4-b081-4670-a6b5-d40583c23592-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:32:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-e55fe8ae-ecd3-41e2-9239-46edbda17a11 req-ad805f8f-bf93-45be-94e0-f54d04621eb2 service nova] Lock "26acb3c4-b081-4670-a6b5-d40583c23592-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:32:11 user nova-compute[75245]: DEBUG nova.compute.manager [req-e55fe8ae-ecd3-41e2-9239-46edbda17a11 req-ad805f8f-bf93-45be-94e0-f54d04621eb2 service nova] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] No waiting events found dispatching network-vif-unplugged-eeb0edc6-31dc-4bbf-abc4-331ed86156a1 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:32:11 user nova-compute[75245]: WARNING nova.compute.manager [req-e55fe8ae-ecd3-41e2-9239-46edbda17a11 req-ad805f8f-bf93-45be-94e0-f54d04621eb2 service nova] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Received unexpected event network-vif-unplugged-eeb0edc6-31dc-4bbf-abc4-331ed86156a1 for instance with vm_state active and task_state rescuing.
Nov 29 16:32:11 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Instance destroyed successfully.
Nov 29 16:32:11 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:32:11 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:32:11 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Hypervisor/Node resource view: name=user free_ram=8257MB free_disk=25.053272247314453GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75245) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 16:32:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:32:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:32:11 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Attempting a stable device rescue
Nov 29 16:32:11 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75245) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 29 16:32:11 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Instance directory exists: not creating {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 16:32:11 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Creating image(s)
Nov 29 16:32:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Acquiring lock "/opt/stack/data/nova/instances/26acb3c4-b081-4670-a6b5-d40583c23592/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:32:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "/opt/stack/data/nova/instances/26acb3c4-b081-4670-a6b5-d40583c23592/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:32:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "/opt/stack/data/nova/instances/26acb3c4-b081-4670-a6b5-d40583c23592/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:32:11 user nova-compute[75245]: DEBUG nova.objects.instance [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lazy-loading 'trusted_certs' on Instance uuid 26acb3c4-b081-4670-a6b5-d40583c23592 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:32:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Acquiring lock "3da94cdb71c42a63e00a6479f569c325643a68c0" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:32:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "3da94cdb71c42a63e00a6479f569c325643a68c0" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:32:11 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 8785a3c2-5b7a-4382-b50d-cecd8743329c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:32:11 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 5de7e10c-f216-46b3-8f74-57bac6ab7e56 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:32:11 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:32:11 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance ed9d1ad5-f5d0-4a68-a073-e7a83be772ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:32:11 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 0b629ca7-b69e-471c-a7b0-9eb43301c36f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:32:11 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 78784fb7-a25f-4c6c-9a44-649c994004c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:32:11 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 0f4fa79b-345a-4e58-a77c-fdfed675e6e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:32:11 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 26acb3c4-b081-4670-a6b5-d40583c23592 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:32:11 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 24fb8ee5-4eee-4976-bcab-24242ef70d39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:32:11 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 16:32:11 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 16:32:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3da94cdb71c42a63e00a6479f569c325643a68c0.part --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:32:12 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:32:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3da94cdb71c42a63e00a6479f569c325643a68c0.part --force-share --output=json" returned: 0 in 0.180s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:32:12 user nova-compute[75245]: DEBUG nova.virt.images [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] 105cd411-0c84-4153-b467-bbef8006b52b was qcow2, converting to raw {{(pid=75245) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 16:32:12 user nova-compute[75245]: DEBUG nova.privsep.utils [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75245) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 16:32:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3da94cdb71c42a63e00a6479f569c325643a68c0.part /opt/stack/data/nova/instances/_base/3da94cdb71c42a63e00a6479f569c325643a68c0.converted {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:32:13 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:32:13 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:32:13 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3da94cdb71c42a63e00a6479f569c325643a68c0.part /opt/stack/data/nova/instances/_base/3da94cdb71c42a63e00a6479f569c325643a68c0.converted" returned: 0 in 0.220s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:32:13 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3da94cdb71c42a63e00a6479f569c325643a68c0.converted --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:32:13 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Compute_service record updated for user:user {{(pid=75245) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 16:32:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.374s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:32:13 user nova-compute[75245]: DEBUG nova.compute.manager [req-c1d0e382-0095-4248-9f5f-7fa34a1b7a9e req-fca90829-9e64-483f-9a93-ea3ca824f277 service nova] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Received event network-vif-plugged-eeb0edc6-31dc-4bbf-abc4-331ed86156a1 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:32:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-c1d0e382-0095-4248-9f5f-7fa34a1b7a9e req-fca90829-9e64-483f-9a93-ea3ca824f277 service nova] Acquiring lock "26acb3c4-b081-4670-a6b5-d40583c23592-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:32:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-c1d0e382-0095-4248-9f5f-7fa34a1b7a9e req-fca90829-9e64-483f-9a93-ea3ca824f277 service nova] Lock "26acb3c4-b081-4670-a6b5-d40583c23592-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:32:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-c1d0e382-0095-4248-9f5f-7fa34a1b7a9e req-fca90829-9e64-483f-9a93-ea3ca824f277 service nova] Lock "26acb3c4-b081-4670-a6b5-d40583c23592-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:32:13 user nova-compute[75245]: DEBUG nova.compute.manager [req-c1d0e382-0095-4248-9f5f-7fa34a1b7a9e req-fca90829-9e64-483f-9a93-ea3ca824f277 service nova] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] No waiting events found dispatching network-vif-plugged-eeb0edc6-31dc-4bbf-abc4-331ed86156a1 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:32:13 user nova-compute[75245]: WARNING nova.compute.manager [req-c1d0e382-0095-4248-9f5f-7fa34a1b7a9e req-fca90829-9e64-483f-9a93-ea3ca824f277 service nova] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Received unexpected event network-vif-plugged-eeb0edc6-31dc-4bbf-abc4-331ed86156a1 for instance with vm_state active and task_state rescuing.
Nov 29 16:32:13 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3da94cdb71c42a63e00a6479f569c325643a68c0.converted --force-share --output=json" returned: 0 in 0.178s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:32:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "3da94cdb71c42a63e00a6479f569c325643a68c0" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.427s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:32:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Acquiring lock "3da94cdb71c42a63e00a6479f569c325643a68c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:32:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "3da94cdb71c42a63e00a6479f569c325643a68c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:32:13 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3da94cdb71c42a63e00a6479f569c325643a68c0 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:32:13 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3da94cdb71c42a63e00a6479f569c325643a68c0 --force-share --output=json" returned: 0 in 0.172s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:32:13 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3da94cdb71c42a63e00a6479f569c325643a68c0,backing_fmt=raw /opt/stack/data/nova/instances/26acb3c4-b081-4670-a6b5-d40583c23592/disk.rescue {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:32:13 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3da94cdb71c42a63e00a6479f569c325643a68c0,backing_fmt=raw /opt/stack/data/nova/instances/26acb3c4-b081-4670-a6b5-d40583c23592/disk.rescue" returned: 0 in 0.051s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:32:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "3da94cdb71c42a63e00a6479f569c325643a68c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:32:13 user nova-compute[75245]: DEBUG nova.objects.instance [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lazy-loading 'migration_context' on Instance uuid 26acb3c4-b081-4670-a6b5-d40583c23592 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:32:13 user nova-compute[75245]: DEBUG nova.objects.base [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Object Instance<26acb3c4-b081-4670-a6b5-d40583c23592> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75245) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 16:32:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Created local disks {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 16:32:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Start _get_guest_xml network_info=[{"id": "eeb0edc6-31dc-4bbf-abc4-331ed86156a1", "address": "fa:16:3e:78:78:ae", "network": {"id": "6a7f7426-b595-4aa3-bf80-cc92ba7ce15e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-917300903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-917300903-network", "vif_mac": "fa:16:3e:78:78:ae"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d52776451e947f5a9ef3fa44ac8acbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb0edc6-31", "ovs_interfaceid": "eeb0edc6-31dc-4bbf-abc4-331ed86156a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '105cd411-0c84-4153-b467-bbef8006b52b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': 'e9dbfc5e-2b27-4613-8dea-33d86409391a', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dZxsPKjh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '26acb3c4-b081-4670-a6b5-d40583c23592', 'attached_at': '', 'detached_at': '', 'volume_id': 'dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4', 'serial': 'dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'guest_format': None, 'volume_type': None} {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 16:32:13 user nova-compute[75245]: DEBUG nova.objects.instance [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lazy-loading 'resources' on Instance uuid 26acb3c4-b081-4670-a6b5-d40583c23592 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:32:13 user nova-compute[75245]: DEBUG nova.objects.base [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Object Instance<26acb3c4-b081-4670-a6b5-d40583c23592> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75245) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 16:32:13 user nova-compute[75245]: DEBUG nova.objects.instance [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lazy-loading 'numa_topology' on Instance uuid 26acb3c4-b081-4670-a6b5-d40583c23592 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:32:13 user nova-compute[75245]: DEBUG nova.objects.base [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Object Instance<26acb3c4-b081-4670-a6b5-d40583c23592> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75245) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 16:32:13 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:32:13 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:32:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 16:32:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] CPU controller missing on host. {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 16:32:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:32:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 16:32:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] CPU controller found on host. {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 16:32:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75245) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 16:32:13 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T16:06:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 16:32:13 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Flavor limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 16:32:13 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Image limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 16:32:13 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Flavor pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 16:32:13 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Image pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 16:32:13 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 16:32:13 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 16:32:13 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 16:32:13 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Got 1 possible topologies {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 16:32:13 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 16:32:13 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 16:32:13 user nova-compute[75245]: DEBUG nova.objects.instance [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lazy-loading 'vcpu_model' on Instance uuid 26acb3c4-b081-4670-a6b5-d40583c23592 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:32:13 user nova-compute[75245]: DEBUG nova.objects.base [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Object Instance<26acb3c4-b081-4670-a6b5-d40583c23592> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75245) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 16:32:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Calling os-brick to attach iSCSI Volume {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 16:32:13 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dZxsPKjh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:32:13 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:32:13 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:32:13 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:32:13 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:32:13 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:32:13 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:32:13 user nova-compute[75245]: INFO os_brick.initiator.connectors.iscsi [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 16:32:13 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4 -p 172.16.0.220:3260 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:32:13 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4 -p 172.16.0.220:3260" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:32:13 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[463c61fc-bfa8-40ef-8794-cf6dd7dac234]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = dZxsPKjh\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:32:13 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 29 16:32:13 user nova-compute[75245]: node.name = iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4
Nov 29 16:32:13 user nova-compute[75245]: node.tpgt = -1
Nov 29 16:32:13 user nova-compute[75245]: node.startup = automatic
Nov 29 16:32:13 user nova-compute[75245]: node.leading_login = No
Nov 29 16:32:13 user nova-compute[75245]: iface.iscsi_ifacename = default
Nov 29 16:32:13 user nova-compute[75245]: iface.net_ifacename = <empty>
Nov 29 16:32:13 user nova-compute[75245]: iface.ipaddress = <empty>
Nov 29 16:32:13 user nova-compute[75245]: iface.prefix_len = 0
Nov 29 16:32:13 user nova-compute[75245]: iface.hwaddress = <empty>
Nov 29 16:32:13 user nova-compute[75245]: iface.transport_name = tcp
Nov 29 16:32:13 user nova-compute[75245]: iface.initiatorname = <empty>
Nov 29 16:32:13 user nova-compute[75245]: iface.state = <empty>
Nov 29 16:32:13 user nova-compute[75245]: iface.vlan_id = 0
Nov 29 16:32:13 user nova-compute[75245]: iface.vlan_priority = 0
Nov 29 16:32:13 user nova-compute[75245]: iface.vlan_state = <empty>
Nov 29 16:32:13 user nova-compute[75245]: iface.iface_num = 0
Nov 29 16:32:13 user nova-compute[75245]: iface.mtu = 0
Nov 29 16:32:13 user nova-compute[75245]: iface.port = 0
Nov 29 16:32:13 user nova-compute[75245]: iface.bootproto = <empty>
Nov 29 16:32:13 user nova-compute[75245]: iface.subnet_mask = <empty>
Nov 29 16:32:13 user nova-compute[75245]: iface.gateway = <empty>
Nov 29 16:32:13 user nova-compute[75245]: iface.dhcp_alt_client_id_state = <empty>
Nov 29 16:32:13 user nova-compute[75245]: iface.dhcp_alt_client_id = <empty>
Nov 29 16:32:13 user nova-compute[75245]: iface.dhcp_dns = <empty>
Nov 29 16:32:13 user nova-compute[75245]: iface.dhcp_learn_iqn = <empty>
Nov 29 16:32:13 user nova-compute[75245]: iface.dhcp_req_vendor_id_state = <empty>
Nov 29 16:32:13 user nova-compute[75245]: iface.dhcp_vendor_id_state = <empty>
Nov 29 16:32:13 user nova-compute[75245]: iface.dhcp_vendor_id = <empty>
Nov 29 16:32:13 user nova-compute[75245]: iface.dhcp_slp_da = <empty>
Nov 29 16:32:13 user nova-compute[75245]: iface.fragmentation = <empty>
Nov 29 16:32:13 user nova-compute[75245]: iface.gratuitous_arp = <empty>
Nov 29 16:32:13 user nova-compute[75245]: iface.incoming_forwarding = <empty>
Nov 29 16:32:13 user nova-compute[75245]: iface.tos_state = <empty>
Nov 29 16:32:13 user nova-compute[75245]: iface.tos = 0
Nov 29 16:32:13 user nova-compute[75245]: iface.ttl = 0
Nov 29 16:32:13 user nova-compute[75245]: iface.delayed_ack = <empty>
Nov 29 16:32:13 user nova-compute[75245]: iface.tcp_nagle = <empty>
Nov 29 16:32:13 user nova-compute[75245]: iface.tcp_wsf_state = <empty>
Nov 29 16:32:13 user nova-compute[75245]: iface.tcp_wsf = 0
Nov 29 16:32:13 user nova-compute[75245]: iface.tcp_timer_scale = 0
Nov 29 16:32:13 user nova-compute[75245]: iface.tcp_timestamp = <empty>
Nov 29 16:32:13 user nova-compute[75245]: iface.redirect = <empty>
Nov 29 16:32:13 user nova-compute[75245]: iface.def_task_mgmt_timeout = 0
Nov 29 16:32:13 user nova-compute[75245]: iface.header_digest = <empty>
Nov 29 16:32:13 user nova-compute[75245]: iface.data_digest = <empty>
Nov 29 16:32:13 user nova-compute[75245]: iface.immediate_data = <empty>
Nov 29 16:32:13 user nova-compute[75245]: iface.initial_r2t = <empty>
Nov 29 16:32:13 user nova-compute[75245]: iface.data_seq_inorder = <empty>
Nov 29 16:32:13 user nova-compute[75245]: iface.data_pdu_inorder = <empty>
Nov 29 16:32:13 user nova-compute[75245]: iface.erl = 0
Nov 29 16:32:13 user nova-compute[75245]: iface.max_receive_data_len = 0
Nov 29 16:32:13 user nova-compute[75245]: iface.first_burst_len = 0
Nov 29 16:32:13 user nova-compute[75245]: iface.max_outstanding_r2t = 0
Nov 29 16:32:13 user nova-compute[75245]: iface.max_burst_len = 0
Nov 29 16:32:13 user nova-compute[75245]: iface.chap_auth = <empty>
Nov 29 16:32:13 user nova-compute[75245]: iface.bidi_chap = <empty>
Nov 29 16:32:13 user nova-compute[75245]: iface.strict_login_compliance = <empty>
Nov 29 16:32:13 user nova-compute[75245]: iface.discovery_auth = <empty>
Nov 29 16:32:13 user nova-compute[75245]: iface.discovery_logout = <empty>
Nov 29 16:32:13 user nova-compute[75245]: node.discovery_address = <empty>
Nov 29 16:32:13 user nova-compute[75245]: node.discovery_port = 0
Nov 29 16:32:13 user nova-compute[75245]: node.discovery_type = static
Nov 29 16:32:13 user nova-compute[75245]: node.session.initial_cmdsn = 0
Nov 29 16:32:13 user nova-compute[75245]: node.session.initial_login_retry_max = 8
Nov 29 16:32:13 user nova-compute[75245]: node.session.xmit_thread_priority = -20
Nov 29 16:32:13 user nova-compute[75245]: node.session.cmds_max = 128
Nov 29 16:32:13 user nova-compute[75245]: node.session.queue_depth = 32
Nov 29 16:32:13 user nova-compute[75245]: node.session.nr_sessions = 1
Nov 29 16:32:13 user nova-compute[75245]: node.session.auth.authmethod = CHAP
Nov 29 16:32:13 user nova-compute[75245]: node.session.auth.username = dZxsPKjh
Nov 29 16:32:13 user nova-compute[75245]: node.session.auth.password = ***
Nov 29 16:32:13 user nova-compute[75245]: node.session.auth.username_in = <empty>
Nov 29 16:32:13 user nova-compute[75245]: node.session.auth.password_in = <empty>
Nov 29 16:32:13 user nova-compute[75245]: node.session.auth.chap_algs = MD5
Nov 29 16:32:13 user nova-compute[75245]: node.session.timeo.replacement_timeout = 120
Nov 29 16:32:13 user nova-compute[75245]: node.session.err_timeo.abort_timeout = 15
Nov 29 16:32:13 user nova-compute[75245]: node.session.err_timeo.lu_reset_timeout = 30
Nov 29 16:32:13 user nova-compute[75245]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 29 16:32:13 user nova-compute[75245]: node.session.err_timeo.host_reset_timeout = 60
Nov 29 16:32:13 user nova-compute[75245]: node.session.iscsi.FastAbort = Yes
Nov 29 16:32:13 user nova-compute[75245]: node.session.iscsi.InitialR2T = No
Nov 29 16:32:13 user nova-compute[75245]: node.session.iscsi.ImmediateData = Yes
Nov 29 16:32:13 user nova-compute[75245]: node.session.iscsi.FirstBurstLength = 262144
Nov 29 16:32:13 user nova-compute[75245]: node.session.iscsi.MaxBurstLength = 16776192
Nov 29 16:32:13 user nova-compute[75245]: node.session.iscsi.DefaultTime2Retain = 0
Nov 29 16:32:13 user nova-compute[75245]: node.session.iscsi.DefaultTime2Wait = 2
Nov 29 16:32:13 user nova-compute[75245]: node.session.iscsi.MaxConnections = 1
Nov 29 16:32:13 user nova-compute[75245]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 29 16:32:13 user nova-compute[75245]: node.session.iscsi.ERL = 0
Nov 29 16:32:13 user nova-compute[75245]: node.session.scan = manual
Nov 29 16:32:13 user nova-compute[75245]: node.session.reopen_max = 0
Nov 29 16:32:13 user nova-compute[75245]: node.conn[0].address = 172.16.0.220
Nov 29 16:32:13 user nova-compute[75245]: node.conn[0].port = 3260
Nov 29 16:32:13 user nova-compute[75245]: node.conn[0].startup = manual
Nov 29 16:32:13 user nova-compute[75245]: node.conn[0].tcp.window_size = 524288
Nov 29 16:32:13 user nova-compute[75245]: node.conn[0].tcp.type_of_service = 0
Nov 29 16:32:13 user nova-compute[75245]: node.conn[0].timeo.logout_timeout = 15
Nov 29 16:32:13 user nova-compute[75245]: node.conn[0].timeo.login_timeout = 15
Nov 29 16:32:13 user nova-compute[75245]: node.conn[0].timeo.auth_timeout = 45
Nov 29 16:32:13 user nova-compute[75245]: node.conn[0].timeo.noop_out_interval = 5
Nov 29 16:32:13 user nova-compute[75245]: node.conn[0].timeo.noop_out_timeout = 5
Nov 29 16:32:13 user nova-compute[75245]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 29 16:32:13 user nova-compute[75245]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 29 16:32:13 user nova-compute[75245]: node.conn[0].iscsi.HeaderDigest = None
Nov 29 16:32:13 user nova-compute[75245]: node.conn[0].iscsi.DataDigest = None
Nov 29 16:32:13 user nova-compute[75245]: node.conn[0].iscsi.IFMarker = No
Nov 29 16:32:13 user nova-compute[75245]: node.conn[0].iscsi.OFMarker = No
Nov 29 16:32:13 user nova-compute[75245]: # END RECORD
Nov 29 16:32:13 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:32:13 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:32:13 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:32:13 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df5cd8a-af57-4bc2-b917-fed1a409fe4a]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:32:13 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:32:13 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:32:13 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:32:13 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[63dd8985-7487-4db1-9cb9-852c80a20d63]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:32:13 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:32:13 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dZxsPKjh {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:32:13 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dZxsPKjh" returned: 0 in 0.023s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:32:13 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[5269a16e-780a-49a8-938a-d09eccee6d04]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:32:13 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dZxsPKjh'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:32:13 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:32:13 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:32:13 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[8375775f-56f7-4bc9-a6f2-e4f290425118]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:32:13 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:32:13 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:32:13 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:32:13 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7fae345-0784-48d5-9e25-33a39f0ee0bd]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:32:13 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)
Nov 29 16:32:13 user nova-compute[75245]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4 (non-flash)
Nov 29 16:32:13 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:32:13 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)
Nov 29 16:32:13 user nova-compute[75245]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4 (non-flash)
Nov 29 16:32:13 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:32:13 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.171s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:32:13 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Connected to 172.16.0.220:3260 {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 16:32:14 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] HCTL ('33', '0', '0', 0) found on session 36 with lun 0 {{(pid=75245) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 16:32:14 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=75245) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 16:32:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:32:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.012s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:32:14 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c82afc-ac6a-4a21-afbd-767940ffb3f6]: (4, ('0 0 0', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:32:14 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Searching for a device in session 36 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=75245) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 16:32:14 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dZxsPKjh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 16:32:14 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.194s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:32:14 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] <== connect_volume: return (195ms) {'type': 'block', 'scsi_wwn': '23439346465653133', 'path': '/dev/sdb'} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:32:14 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23439346465653133', 'path': '/dev/sdb'} {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 16:32:14 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:30:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-210891752',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-210891752',id=30,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:30:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1d52776451e947f5a9ef3fa44ac8acbb',ramdisk_id='',reservation_id='r-wn1p5h7d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1780163218',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:30:39Z,user_data=None,user_id='4f20e7c9ae22462ea6bc623c93697fce',uuid=26acb3c4-b081-4670-a6b5-d40583c23592,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eeb0edc6-31dc-4bbf-abc4-331ed86156a1", "address": "fa:16:3e:78:78:ae", "network": {"id": "6a7f7426-b595-4aa3-bf80-cc92ba7ce15e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-917300903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-917300903-network", "vif_mac": "fa:16:3e:78:78:ae"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d52776451e947f5a9ef3fa44ac8acbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb0edc6-31", "ovs_interfaceid": "eeb0edc6-31dc-4bbf-abc4-331ed86156a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:32:14 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Converting VIF {"id": "eeb0edc6-31dc-4bbf-abc4-331ed86156a1", "address": "fa:16:3e:78:78:ae", "network": {"id": "6a7f7426-b595-4aa3-bf80-cc92ba7ce15e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-917300903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-917300903-network", "vif_mac": "fa:16:3e:78:78:ae"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d52776451e947f5a9ef3fa44ac8acbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb0edc6-31", "ovs_interfaceid": "eeb0edc6-31dc-4bbf-abc4-331ed86156a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:32:14 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:78:78:ae,bridge_name='br-int',has_traffic_filtering=True,id=eeb0edc6-31dc-4bbf-abc4-331ed86156a1,network=Network(6a7f7426-b595-4aa3-bf80-cc92ba7ce15e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeb0edc6-31') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:32:14 user nova-compute[75245]: DEBUG nova.objects.instance [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lazy-loading 'pci_devices' on Instance uuid 26acb3c4-b081-4670-a6b5-d40583c23592 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:32:14 user nova-compute[75245]: DEBUG nova.objects.base [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Object Instance<26acb3c4-b081-4670-a6b5-d40583c23592> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75245) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 16:32:14 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] End _get_guest_xml xml=<domain type="kvm">
Nov 29 16:32:14 user nova-compute[75245]:   <uuid>26acb3c4-b081-4670-a6b5-d40583c23592</uuid>
Nov 29 16:32:14 user nova-compute[75245]:   <name>instance-0000001e</name>
Nov 29 16:32:14 user nova-compute[75245]:   <memory>524288</memory>
Nov 29 16:32:14 user nova-compute[75245]:   <vcpu>1</vcpu>
Nov 29 16:32:14 user nova-compute[75245]:   <metadata>
Nov 29 16:32:14 user nova-compute[75245]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 16:32:14 user nova-compute[75245]:       <nova:package version="0.0.0"/>
Nov 29 16:32:14 user nova-compute[75245]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-210891752</nova:name>
Nov 29 16:32:14 user nova-compute[75245]:       <nova:creationTime>2023-11-29 16:32:13</nova:creationTime>
Nov 29 16:32:14 user nova-compute[75245]:       <nova:flavor name="m1.tiny">
Nov 29 16:32:14 user nova-compute[75245]:         <nova:memory>512</nova:memory>
Nov 29 16:32:14 user nova-compute[75245]:         <nova:disk>1</nova:disk>
Nov 29 16:32:14 user nova-compute[75245]:         <nova:swap>0</nova:swap>
Nov 29 16:32:14 user nova-compute[75245]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 16:32:14 user nova-compute[75245]:         <nova:vcpus>1</nova:vcpus>
Nov 29 16:32:14 user nova-compute[75245]:       </nova:flavor>
Nov 29 16:32:14 user nova-compute[75245]:       <nova:owner>
Nov 29 16:32:14 user nova-compute[75245]:         <nova:user uuid="4f20e7c9ae22462ea6bc623c93697fce">tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member</nova:user>
Nov 29 16:32:14 user nova-compute[75245]:         <nova:project uuid="1d52776451e947f5a9ef3fa44ac8acbb">tempest-ServerBootFromVolumeStableRescueTest-1780163218</nova:project>
Nov 29 16:32:14 user nova-compute[75245]:       </nova:owner>
Nov 29 16:32:14 user nova-compute[75245]:       <nova:root type="image" uuid="a291d9c3-be02-4c6c-9649-4b45c5b7f487"/>
Nov 29 16:32:14 user nova-compute[75245]:       <nova:ports>
Nov 29 16:32:14 user nova-compute[75245]:         <nova:port uuid="eeb0edc6-31dc-4bbf-abc4-331ed86156a1">
Nov 29 16:32:14 user nova-compute[75245]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 29 16:32:14 user nova-compute[75245]:         </nova:port>
Nov 29 16:32:14 user nova-compute[75245]:       </nova:ports>
Nov 29 16:32:14 user nova-compute[75245]:     </nova:instance>
Nov 29 16:32:14 user nova-compute[75245]:   </metadata>
Nov 29 16:32:14 user nova-compute[75245]:   <sysinfo type="smbios">
Nov 29 16:32:14 user nova-compute[75245]:     <system>
Nov 29 16:32:14 user nova-compute[75245]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 16:32:14 user nova-compute[75245]:       <entry name="product">OpenStack Nova</entry>
Nov 29 16:32:14 user nova-compute[75245]:       <entry name="version">0.0.0</entry>
Nov 29 16:32:14 user nova-compute[75245]:       <entry name="serial">26acb3c4-b081-4670-a6b5-d40583c23592</entry>
Nov 29 16:32:14 user nova-compute[75245]:       <entry name="uuid">26acb3c4-b081-4670-a6b5-d40583c23592</entry>
Nov 29 16:32:14 user nova-compute[75245]:       <entry name="family">Virtual Machine</entry>
Nov 29 16:32:14 user nova-compute[75245]:     </system>
Nov 29 16:32:14 user nova-compute[75245]:   </sysinfo>
Nov 29 16:32:14 user nova-compute[75245]:   <os>
Nov 29 16:32:14 user nova-compute[75245]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 16:32:14 user nova-compute[75245]:     <smbios mode="sysinfo"/>
Nov 29 16:32:14 user nova-compute[75245]:   </os>
Nov 29 16:32:14 user nova-compute[75245]:   <features>
Nov 29 16:32:14 user nova-compute[75245]:     <acpi/>
Nov 29 16:32:14 user nova-compute[75245]:     <apic/>
Nov 29 16:32:14 user nova-compute[75245]:     <vmcoreinfo/>
Nov 29 16:32:14 user nova-compute[75245]:   </features>
Nov 29 16:32:14 user nova-compute[75245]:   <clock offset="utc">
Nov 29 16:32:14 user nova-compute[75245]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 16:32:14 user nova-compute[75245]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 16:32:14 user nova-compute[75245]:     <timer name="hpet" present="no"/>
Nov 29 16:32:14 user nova-compute[75245]:   </clock>
Nov 29 16:32:14 user nova-compute[75245]:   <cpu mode="custom" match="exact">
Nov 29 16:32:14 user nova-compute[75245]:     <model>Nehalem</model>
Nov 29 16:32:14 user nova-compute[75245]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 16:32:14 user nova-compute[75245]:   </cpu>
Nov 29 16:32:14 user nova-compute[75245]:   <devices>
Nov 29 16:32:14 user nova-compute[75245]:     <disk type="block" device="disk">
Nov 29 16:32:14 user nova-compute[75245]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:32:14 user nova-compute[75245]:       <source dev="/dev/sdb"/>
Nov 29 16:32:14 user nova-compute[75245]:       <target dev="vda" bus="virtio"/>
Nov 29 16:32:14 user nova-compute[75245]:       <serial>dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4</serial>
Nov 29 16:32:14 user nova-compute[75245]:     </disk>
Nov 29 16:32:14 user nova-compute[75245]:     <disk type="file" device="disk">
Nov 29 16:32:14 user nova-compute[75245]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 16:32:14 user nova-compute[75245]:       <source file="/opt/stack/data/nova/instances/26acb3c4-b081-4670-a6b5-d40583c23592/disk.rescue"/>
Nov 29 16:32:14 user nova-compute[75245]:       <target dev="vdb" bus="virtio"/>
Nov 29 16:32:14 user nova-compute[75245]:       <boot order="1"/>
Nov 29 16:32:14 user nova-compute[75245]:     </disk>
Nov 29 16:32:14 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 16:32:14 user nova-compute[75245]:       <mac address="fa:16:3e:78:78:ae"/>
Nov 29 16:32:14 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:32:14 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 16:32:14 user nova-compute[75245]:       <target dev="tapeeb0edc6-31"/>
Nov 29 16:32:14 user nova-compute[75245]:     </interface>
Nov 29 16:32:14 user nova-compute[75245]:     <serial type="pty">
Nov 29 16:32:14 user nova-compute[75245]:       <log file="/opt/stack/data/nova/instances/26acb3c4-b081-4670-a6b5-d40583c23592/console.log" append="off"/>
Nov 29 16:32:14 user nova-compute[75245]:     </serial>
Nov 29 16:32:14 user nova-compute[75245]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 16:32:14 user nova-compute[75245]:     <video>
Nov 29 16:32:14 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:32:14 user nova-compute[75245]:     </video>
Nov 29 16:32:14 user nova-compute[75245]:     <rng model="virtio">
Nov 29 16:32:14 user nova-compute[75245]:       <backend model="random">/dev/urandom</backend>
Nov 29 16:32:14 user nova-compute[75245]:     </rng>
Nov 29 16:32:14 user nova-compute[75245]:     <controller type="usb" index="0" model="none"/>
Nov 29 16:32:14 user nova-compute[75245]:     <memballoon model="virtio">
Nov 29 16:32:14 user nova-compute[75245]:       <stats period="10"/>
Nov 29 16:32:14 user nova-compute[75245]:     </memballoon>
Nov 29 16:32:14 user nova-compute[75245]:   </devices>
Nov 29 16:32:14 user nova-compute[75245]: </domain>
Nov 29 16:32:14 user nova-compute[75245]:  {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 16:32:14 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Instance destroyed successfully.
Nov 29 16:32:14 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:32:14 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:32:14 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] No VIF found with MAC fa:16:3e:78:78:ae, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:32:14 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:32:14 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:32:14 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:32:14 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:32:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:32:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:32:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:32:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:32:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:32:15 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:32:15 user nova-compute[75245]: DEBUG nova.compute.manager [req-3bda6619-d1a3-42ff-aba7-1c7ca61c3574 req-a792dd7a-4e64-4882-b660-e8cca5757cc2 service nova] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Received event network-vif-plugged-eeb0edc6-31dc-4bbf-abc4-331ed86156a1 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:32:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-3bda6619-d1a3-42ff-aba7-1c7ca61c3574 req-a792dd7a-4e64-4882-b660-e8cca5757cc2 service nova] Acquiring lock "26acb3c4-b081-4670-a6b5-d40583c23592-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:32:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-3bda6619-d1a3-42ff-aba7-1c7ca61c3574 req-a792dd7a-4e64-4882-b660-e8cca5757cc2 service nova] Lock "26acb3c4-b081-4670-a6b5-d40583c23592-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:32:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-3bda6619-d1a3-42ff-aba7-1c7ca61c3574 req-a792dd7a-4e64-4882-b660-e8cca5757cc2 service nova] Lock "26acb3c4-b081-4670-a6b5-d40583c23592-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:32:15 user nova-compute[75245]: DEBUG nova.compute.manager [req-3bda6619-d1a3-42ff-aba7-1c7ca61c3574 req-a792dd7a-4e64-4882-b660-e8cca5757cc2 service nova] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] No waiting events found dispatching network-vif-plugged-eeb0edc6-31dc-4bbf-abc4-331ed86156a1 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:32:15 user nova-compute[75245]: WARNING nova.compute.manager [req-3bda6619-d1a3-42ff-aba7-1c7ca61c3574 req-a792dd7a-4e64-4882-b660-e8cca5757cc2 service nova] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Received unexpected event network-vif-plugged-eeb0edc6-31dc-4bbf-abc4-331ed86156a1 for instance with vm_state active and task_state rescuing.
Nov 29 16:32:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:32:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:32:17 user nova-compute[75245]: DEBUG nova.compute.manager [None req-574c865b-54e9-46f0-8bc2-cfbc3d3ac4f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:32:17 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:32:17 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75245) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 16:32:17 user nova-compute[75245]: DEBUG nova.compute.manager [req-51cc5f60-c8a3-4f3e-9fbb-eac005662042 req-489ebe32-848c-4201-a20a-e668054cebf5 service nova] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Received event network-vif-plugged-eeb0edc6-31dc-4bbf-abc4-331ed86156a1 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:32:17 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-51cc5f60-c8a3-4f3e-9fbb-eac005662042 req-489ebe32-848c-4201-a20a-e668054cebf5 service nova] Acquiring lock "26acb3c4-b081-4670-a6b5-d40583c23592-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:32:17 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-51cc5f60-c8a3-4f3e-9fbb-eac005662042 req-489ebe32-848c-4201-a20a-e668054cebf5 service nova] Lock "26acb3c4-b081-4670-a6b5-d40583c23592-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:32:17 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-51cc5f60-c8a3-4f3e-9fbb-eac005662042 req-489ebe32-848c-4201-a20a-e668054cebf5 service nova] Lock "26acb3c4-b081-4670-a6b5-d40583c23592-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:32:17 user nova-compute[75245]: DEBUG nova.compute.manager [req-51cc5f60-c8a3-4f3e-9fbb-eac005662042 req-489ebe32-848c-4201-a20a-e668054cebf5 service nova] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] No waiting events found dispatching network-vif-plugged-eeb0edc6-31dc-4bbf-abc4-331ed86156a1 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:32:17 user nova-compute[75245]: WARNING nova.compute.manager [req-51cc5f60-c8a3-4f3e-9fbb-eac005662042 req-489ebe32-848c-4201-a20a-e668054cebf5 service nova] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Received unexpected event network-vif-plugged-eeb0edc6-31dc-4bbf-abc4-331ed86156a1 for instance with vm_state rescued and task_state None.
Nov 29 16:32:17 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:32:18 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:32:21 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:32:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:32:23 user nova-compute[75245]: DEBUG nova.objects.instance [None req-846c622e-9fc6-4e0f-9839-57ef2330f59d tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lazy-loading 'flavor' on Instance uuid 0b629ca7-b69e-471c-a7b0-9eb43301c36f {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:32:23 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-846c622e-9fc6-4e0f-9839-57ef2330f59d tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Acquiring lock "refresh_cache-0b629ca7-b69e-471c-a7b0-9eb43301c36f" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:32:23 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-846c622e-9fc6-4e0f-9839-57ef2330f59d tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Acquired lock "refresh_cache-0b629ca7-b69e-471c-a7b0-9eb43301c36f" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:32:23 user nova-compute[75245]: DEBUG nova.network.neutron [None req-846c622e-9fc6-4e0f-9839-57ef2330f59d tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 16:32:23 user nova-compute[75245]: DEBUG nova.objects.instance [None req-846c622e-9fc6-4e0f-9839-57ef2330f59d tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lazy-loading 'info_cache' on Instance uuid 0b629ca7-b69e-471c-a7b0-9eb43301c36f {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:32:23 user nova-compute[75245]: DEBUG nova.objects.base [None req-846c622e-9fc6-4e0f-9839-57ef2330f59d tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Object Instance<0b629ca7-b69e-471c-a7b0-9eb43301c36f> lazy-loaded attributes: flavor,info_cache {{(pid=75245) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 16:32:23 user nova-compute[75245]: DEBUG nova.network.neutron [None req-846c622e-9fc6-4e0f-9839-57ef2330f59d tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Updating instance_info_cache with network_info: [{"id": "6d28be36-e00b-4f84-9a2b-60515f2e65a1", "address": "fa:16:3e:90:6c:6b", "network": {"id": "2110162d-c25f-4c3d-9a67-18e52f6caf43", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1854809203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba4d99c1c6c4472be06502d8b0e75a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d28be36-e0", "ovs_interfaceid": "6d28be36-e00b-4f84-9a2b-60515f2e65a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:32:23 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-846c622e-9fc6-4e0f-9839-57ef2330f59d tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Releasing lock "refresh_cache-0b629ca7-b69e-471c-a7b0-9eb43301c36f" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:32:24 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Instance destroyed successfully.
Nov 29 16:32:24 user nova-compute[75245]: DEBUG nova.objects.instance [None req-846c622e-9fc6-4e0f-9839-57ef2330f59d tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lazy-loading 'resources' on Instance uuid 0b629ca7-b69e-471c-a7b0-9eb43301c36f {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:32:24 user nova-compute[75245]: DEBUG nova.objects.base [None req-846c622e-9fc6-4e0f-9839-57ef2330f59d tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Object Instance<0b629ca7-b69e-471c-a7b0-9eb43301c36f> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75245) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 16:32:24 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-846c622e-9fc6-4e0f-9839-57ef2330f59d tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:24:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-871835871',display_name='tempest-AttachVolumeTestJSON-server-871835871',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-871835871',id=27,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTIsqUKP4igeT4gYnfCqdp6pLBcrk+0/CaYGDmMNaIt3Zkf1GMFiqF0F/vVjvbmae59TIWFlaDJkZXQ3lbtxQKuqPvpidiCFuJrrX+TZL7X+RQDx6md7i0ExrSBiMAnKw==',key_name='tempest-keypair-721153735',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:24:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='0ba4d99c1c6c4472be06502d8b0e75a4',ramdisk_id='',reservation_id='r-1rsjawj5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-280497743',owner_user_name='tempest-AttachVolumeTestJSON-280497743-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:30:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d5d3377c73648b8ba9044cfddbfc759',uuid=0b629ca7-b69e-471c-a7b0-9eb43301c36f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "6d28be36-e00b-4f84-9a2b-60515f2e65a1", "address": "fa:16:3e:90:6c:6b", "network": {"id": "2110162d-c25f-4c3d-9a67-18e52f6caf43", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1854809203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba4d99c1c6c4472be06502d8b0e75a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d28be36-e0", "ovs_interfaceid": "6d28be36-e00b-4f84-9a2b-60515f2e65a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 16:32:24 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-846c622e-9fc6-4e0f-9839-57ef2330f59d tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Converting VIF {"id": "6d28be36-e00b-4f84-9a2b-60515f2e65a1", "address": "fa:16:3e:90:6c:6b", "network": {"id": "2110162d-c25f-4c3d-9a67-18e52f6caf43", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1854809203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba4d99c1c6c4472be06502d8b0e75a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d28be36-e0", "ovs_interfaceid": "6d28be36-e00b-4f84-9a2b-60515f2e65a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:32:24 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-846c622e-9fc6-4e0f-9839-57ef2330f59d tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:6c:6b,bridge_name='br-int',has_traffic_filtering=True,id=6d28be36-e00b-4f84-9a2b-60515f2e65a1,network=Network(2110162d-c25f-4c3d-9a67-18e52f6caf43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d28be36-e0') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:32:24 user nova-compute[75245]: DEBUG os_vif [None req-846c622e-9fc6-4e0f-9839-57ef2330f59d tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:6c:6b,bridge_name='br-int',has_traffic_filtering=True,id=6d28be36-e00b-4f84-9a2b-60515f2e65a1,network=Network(2110162d-c25f-4c3d-9a67-18e52f6caf43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d28be36-e0') {{(pid=75245) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 16:32:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:32:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6d28be36-e0, bridge=br-int, if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:32:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:32:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:32:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d3922258-78ea-4250-ba08-ea0fdfc47e2b) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:32:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:32:24 user nova-compute[75245]: INFO os_vif [None req-846c622e-9fc6-4e0f-9839-57ef2330f59d tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:6c:6b,bridge_name='br-int',has_traffic_filtering=True,id=6d28be36-e00b-4f84-9a2b-60515f2e65a1,network=Network(2110162d-c25f-4c3d-9a67-18e52f6caf43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d28be36-e0')
Nov 29 16:32:24 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-846c622e-9fc6-4e0f-9839-57ef2330f59d tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Start _get_guest_xml network_info=[{"id": "6d28be36-e00b-4f84-9a2b-60515f2e65a1", "address": "fa:16:3e:90:6c:6b", "network": {"id": "2110162d-c25f-4c3d-9a67-18e52f6caf43", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1854809203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba4d99c1c6c4472be06502d8b0e75a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d28be36-e0", "ovs_interfaceid": "6d28be36-e00b-4f84-9a2b-60515f2e65a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'a291d9c3-be02-4c6c-9649-4b45c5b7f487'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 16:32:24 user nova-compute[75245]: DEBUG nova.objects.instance [None req-846c622e-9fc6-4e0f-9839-57ef2330f59d tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lazy-loading 'numa_topology' on Instance uuid 0b629ca7-b69e-471c-a7b0-9eb43301c36f {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:32:24 user nova-compute[75245]: DEBUG nova.objects.base [None req-846c622e-9fc6-4e0f-9839-57ef2330f59d tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Object Instance<0b629ca7-b69e-471c-a7b0-9eb43301c36f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75245) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 16:32:24 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-846c622e-9fc6-4e0f-9839-57ef2330f59d tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:32:24 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-846c622e-9fc6-4e0f-9839-57ef2330f59d tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:32:24 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-846c622e-9fc6-4e0f-9839-57ef2330f59d tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 16:32:24 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-846c622e-9fc6-4e0f-9839-57ef2330f59d tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] CPU controller missing on host. {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 16:32:24 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-846c622e-9fc6-4e0f-9839-57ef2330f59d tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 16:32:24 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-846c622e-9fc6-4e0f-9839-57ef2330f59d tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] CPU controller found on host. {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 16:32:24 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-846c622e-9fc6-4e0f-9839-57ef2330f59d tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75245) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 16:32:24 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-846c622e-9fc6-4e0f-9839-57ef2330f59d tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T16:06:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 16:32:24 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-846c622e-9fc6-4e0f-9839-57ef2330f59d tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Flavor limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 16:32:24 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-846c622e-9fc6-4e0f-9839-57ef2330f59d tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Image limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 16:32:24 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-846c622e-9fc6-4e0f-9839-57ef2330f59d tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Flavor pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 16:32:24 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-846c622e-9fc6-4e0f-9839-57ef2330f59d tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Image pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 16:32:24 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-846c622e-9fc6-4e0f-9839-57ef2330f59d tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 16:32:24 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-846c622e-9fc6-4e0f-9839-57ef2330f59d tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 16:32:24 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-846c622e-9fc6-4e0f-9839-57ef2330f59d tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 16:32:24 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-846c622e-9fc6-4e0f-9839-57ef2330f59d tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Got 1 possible topologies {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 16:32:24 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-846c622e-9fc6-4e0f-9839-57ef2330f59d tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 16:32:24 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-846c622e-9fc6-4e0f-9839-57ef2330f59d tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 16:32:24 user nova-compute[75245]: DEBUG nova.objects.instance [None req-846c622e-9fc6-4e0f-9839-57ef2330f59d tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0b629ca7-b69e-471c-a7b0-9eb43301c36f {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:32:24 user nova-compute[75245]: DEBUG nova.objects.base [None req-846c622e-9fc6-4e0f-9839-57ef2330f59d tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Object Instance<0b629ca7-b69e-471c-a7b0-9eb43301c36f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75245) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 16:32:24 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-846c622e-9fc6-4e0f-9839-57ef2330f59d tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:24:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-871835871',display_name='tempest-AttachVolumeTestJSON-server-871835871',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-871835871',id=27,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTIsqUKP4igeT4gYnfCqdp6pLBcrk+0/CaYGDmMNaIt3Zkf1GMFiqF0F/vVjvbmae59TIWFlaDJkZXQ3lbtxQKuqPvpidiCFuJrrX+TZL7X+RQDx6md7i0ExrSBiMAnKw==',key_name='tempest-keypair-721153735',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:24:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='0ba4d99c1c6c4472be06502d8b0e75a4',ramdisk_id='',reservation_id='r-1rsjawj5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-280497743',owner_user_name='tempest-AttachVolumeTestJSON-280497743-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:30:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d5d3377c73648b8ba9044cfddbfc759',uuid=0b629ca7-b69e-471c-a7b0-9eb43301c36f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "6d28be36-e00b-4f84-9a2b-60515f2e65a1", "address": "fa:16:3e:90:6c:6b", "network": {"id": "2110162d-c25f-4c3d-9a67-18e52f6caf43", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1854809203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba4d99c1c6c4472be06502d8b0e75a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d28be36-e0", "ovs_interfaceid": "6d28be36-e00b-4f84-9a2b-60515f2e65a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:32:24 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-846c622e-9fc6-4e0f-9839-57ef2330f59d tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Converting VIF {"id": "6d28be36-e00b-4f84-9a2b-60515f2e65a1", "address": "fa:16:3e:90:6c:6b", "network": {"id": "2110162d-c25f-4c3d-9a67-18e52f6caf43", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1854809203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba4d99c1c6c4472be06502d8b0e75a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d28be36-e0", "ovs_interfaceid": "6d28be36-e00b-4f84-9a2b-60515f2e65a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:32:24 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-846c622e-9fc6-4e0f-9839-57ef2330f59d tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:6c:6b,bridge_name='br-int',has_traffic_filtering=True,id=6d28be36-e00b-4f84-9a2b-60515f2e65a1,network=Network(2110162d-c25f-4c3d-9a67-18e52f6caf43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d28be36-e0') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:32:24 user nova-compute[75245]: DEBUG nova.objects.instance [None req-846c622e-9fc6-4e0f-9839-57ef2330f59d tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lazy-loading 'pci_devices' on Instance uuid 0b629ca7-b69e-471c-a7b0-9eb43301c36f {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:32:24 user nova-compute[75245]: DEBUG nova.objects.base [None req-846c622e-9fc6-4e0f-9839-57ef2330f59d tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Object Instance<0b629ca7-b69e-471c-a7b0-9eb43301c36f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75245) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 16:32:24 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-846c622e-9fc6-4e0f-9839-57ef2330f59d tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] End _get_guest_xml xml=<domain type="kvm">
Nov 29 16:32:24 user nova-compute[75245]:   <uuid>0b629ca7-b69e-471c-a7b0-9eb43301c36f</uuid>
Nov 29 16:32:24 user nova-compute[75245]:   <name>instance-0000001b</name>
Nov 29 16:32:24 user nova-compute[75245]:   <memory>524288</memory>
Nov 29 16:32:24 user nova-compute[75245]:   <vcpu>1</vcpu>
Nov 29 16:32:24 user nova-compute[75245]:   <metadata>
Nov 29 16:32:24 user nova-compute[75245]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 16:32:24 user nova-compute[75245]:       <nova:package version="0.0.0"/>
Nov 29 16:32:24 user nova-compute[75245]:       <nova:name>tempest-AttachVolumeTestJSON-server-871835871</nova:name>
Nov 29 16:32:24 user nova-compute[75245]:       <nova:creationTime>2023-11-29 16:32:24</nova:creationTime>
Nov 29 16:32:24 user nova-compute[75245]:       <nova:flavor name="m1.tiny">
Nov 29 16:32:24 user nova-compute[75245]:         <nova:memory>512</nova:memory>
Nov 29 16:32:24 user nova-compute[75245]:         <nova:disk>1</nova:disk>
Nov 29 16:32:24 user nova-compute[75245]:         <nova:swap>0</nova:swap>
Nov 29 16:32:24 user nova-compute[75245]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 16:32:24 user nova-compute[75245]:         <nova:vcpus>1</nova:vcpus>
Nov 29 16:32:24 user nova-compute[75245]:       </nova:flavor>
Nov 29 16:32:24 user nova-compute[75245]:       <nova:owner>
Nov 29 16:32:24 user nova-compute[75245]:         <nova:user uuid="6d5d3377c73648b8ba9044cfddbfc759">tempest-AttachVolumeTestJSON-280497743-project-member</nova:user>
Nov 29 16:32:24 user nova-compute[75245]:         <nova:project uuid="0ba4d99c1c6c4472be06502d8b0e75a4">tempest-AttachVolumeTestJSON-280497743</nova:project>
Nov 29 16:32:24 user nova-compute[75245]:       </nova:owner>
Nov 29 16:32:24 user nova-compute[75245]:       <nova:root type="image" uuid="a291d9c3-be02-4c6c-9649-4b45c5b7f487"/>
Nov 29 16:32:24 user nova-compute[75245]:       <nova:ports>
Nov 29 16:32:24 user nova-compute[75245]:         <nova:port uuid="6d28be36-e00b-4f84-9a2b-60515f2e65a1">
Nov 29 16:32:24 user nova-compute[75245]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 16:32:24 user nova-compute[75245]:         </nova:port>
Nov 29 16:32:24 user nova-compute[75245]:       </nova:ports>
Nov 29 16:32:24 user nova-compute[75245]:     </nova:instance>
Nov 29 16:32:24 user nova-compute[75245]:   </metadata>
Nov 29 16:32:24 user nova-compute[75245]:   <sysinfo type="smbios">
Nov 29 16:32:24 user nova-compute[75245]:     <system>
Nov 29 16:32:24 user nova-compute[75245]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 16:32:24 user nova-compute[75245]:       <entry name="product">OpenStack Nova</entry>
Nov 29 16:32:24 user nova-compute[75245]:       <entry name="version">0.0.0</entry>
Nov 29 16:32:24 user nova-compute[75245]:       <entry name="serial">0b629ca7-b69e-471c-a7b0-9eb43301c36f</entry>
Nov 29 16:32:24 user nova-compute[75245]:       <entry name="uuid">0b629ca7-b69e-471c-a7b0-9eb43301c36f</entry>
Nov 29 16:32:24 user nova-compute[75245]:       <entry name="family">Virtual Machine</entry>
Nov 29 16:32:24 user nova-compute[75245]:     </system>
Nov 29 16:32:24 user nova-compute[75245]:   </sysinfo>
Nov 29 16:32:24 user nova-compute[75245]:   <os>
Nov 29 16:32:24 user nova-compute[75245]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 16:32:24 user nova-compute[75245]:     <boot dev="hd"/>
Nov 29 16:32:24 user nova-compute[75245]:     <smbios mode="sysinfo"/>
Nov 29 16:32:24 user nova-compute[75245]:   </os>
Nov 29 16:32:24 user nova-compute[75245]:   <features>
Nov 29 16:32:24 user nova-compute[75245]:     <acpi/>
Nov 29 16:32:24 user nova-compute[75245]:     <apic/>
Nov 29 16:32:24 user nova-compute[75245]:     <vmcoreinfo/>
Nov 29 16:32:24 user nova-compute[75245]:   </features>
Nov 29 16:32:24 user nova-compute[75245]:   <clock offset="utc">
Nov 29 16:32:24 user nova-compute[75245]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 16:32:24 user nova-compute[75245]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 16:32:24 user nova-compute[75245]:     <timer name="hpet" present="no"/>
Nov 29 16:32:24 user nova-compute[75245]:   </clock>
Nov 29 16:32:24 user nova-compute[75245]:   <cpu mode="custom" match="exact">
Nov 29 16:32:24 user nova-compute[75245]:     <model>Nehalem</model>
Nov 29 16:32:24 user nova-compute[75245]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 16:32:24 user nova-compute[75245]:   </cpu>
Nov 29 16:32:24 user nova-compute[75245]:   <devices>
Nov 29 16:32:24 user nova-compute[75245]:     <disk type="file" device="disk">
Nov 29 16:32:24 user nova-compute[75245]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 16:32:24 user nova-compute[75245]:       <source file="/opt/stack/data/nova/instances/0b629ca7-b69e-471c-a7b0-9eb43301c36f/disk"/>
Nov 29 16:32:24 user nova-compute[75245]:       <target dev="vda" bus="virtio"/>
Nov 29 16:32:24 user nova-compute[75245]:     </disk>
Nov 29 16:32:24 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 16:32:24 user nova-compute[75245]:       <mac address="fa:16:3e:90:6c:6b"/>
Nov 29 16:32:24 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:32:24 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 16:32:24 user nova-compute[75245]:       <target dev="tap6d28be36-e0"/>
Nov 29 16:32:24 user nova-compute[75245]:     </interface>
Nov 29 16:32:24 user nova-compute[75245]:     <serial type="pty">
Nov 29 16:32:24 user nova-compute[75245]:       <log file="/opt/stack/data/nova/instances/0b629ca7-b69e-471c-a7b0-9eb43301c36f/console.log" append="off"/>
Nov 29 16:32:24 user nova-compute[75245]:     </serial>
Nov 29 16:32:24 user nova-compute[75245]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 16:32:24 user nova-compute[75245]:     <video>
Nov 29 16:32:24 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:32:24 user nova-compute[75245]:     </video>
Nov 29 16:32:24 user nova-compute[75245]:     <rng model="virtio">
Nov 29 16:32:24 user nova-compute[75245]:       <backend model="random">/dev/urandom</backend>
Nov 29 16:32:24 user nova-compute[75245]:     </rng>
Nov 29 16:32:24 user nova-compute[75245]:     <controller type="usb" index="0" model="none"/>
Nov 29 16:32:24 user nova-compute[75245]:     <memballoon model="virtio">
Nov 29 16:32:24 user nova-compute[75245]:       <stats period="10"/>
Nov 29 16:32:24 user nova-compute[75245]:     </memballoon>
Nov 29 16:32:24 user nova-compute[75245]:   </devices>
Nov 29 16:32:24 user nova-compute[75245]: </domain>
Nov 29 16:32:24 user nova-compute[75245]:  {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 16:32:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-846c622e-9fc6-4e0f-9839-57ef2330f59d tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b629ca7-b69e-471c-a7b0-9eb43301c36f/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:32:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-846c622e-9fc6-4e0f-9839-57ef2330f59d tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b629ca7-b69e-471c-a7b0-9eb43301c36f/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:32:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-846c622e-9fc6-4e0f-9839-57ef2330f59d tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b629ca7-b69e-471c-a7b0-9eb43301c36f/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:32:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-846c622e-9fc6-4e0f-9839-57ef2330f59d tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b629ca7-b69e-471c-a7b0-9eb43301c36f/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:32:24 user nova-compute[75245]: DEBUG nova.objects.instance [None req-846c622e-9fc6-4e0f-9839-57ef2330f59d tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0b629ca7-b69e-471c-a7b0-9eb43301c36f {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:32:24 user nova-compute[75245]: DEBUG nova.objects.base [None req-846c622e-9fc6-4e0f-9839-57ef2330f59d tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Object Instance<0b629ca7-b69e-471c-a7b0-9eb43301c36f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75245) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 16:32:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-846c622e-9fc6-4e0f-9839-57ef2330f59d tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:32:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-846c622e-9fc6-4e0f-9839-57ef2330f59d tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.171s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:32:24 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-846c622e-9fc6-4e0f-9839-57ef2330f59d tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0b629ca7-b69e-471c-a7b0-9eb43301c36f/disk. size=1073741824 {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 16:32:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-846c622e-9fc6-4e0f-9839-57ef2330f59d tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b629ca7-b69e-471c-a7b0-9eb43301c36f/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:32:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-846c622e-9fc6-4e0f-9839-57ef2330f59d tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b629ca7-b69e-471c-a7b0-9eb43301c36f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:32:24 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-846c622e-9fc6-4e0f-9839-57ef2330f59d tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Cannot resize image /opt/stack/data/nova/instances/0b629ca7-b69e-471c-a7b0-9eb43301c36f/disk to a smaller size. {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 16:32:24 user nova-compute[75245]: DEBUG nova.objects.instance [None req-846c622e-9fc6-4e0f-9839-57ef2330f59d tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lazy-loading 'migration_context' on Instance uuid 0b629ca7-b69e-471c-a7b0-9eb43301c36f {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:32:24 user nova-compute[75245]: DEBUG nova.objects.base [None req-846c622e-9fc6-4e0f-9839-57ef2330f59d tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Object Instance<0b629ca7-b69e-471c-a7b0-9eb43301c36f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75245) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 16:32:24 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-846c622e-9fc6-4e0f-9839-57ef2330f59d tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:24:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-871835871',display_name='tempest-AttachVolumeTestJSON-server-871835871',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-871835871',id=27,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTIsqUKP4igeT4gYnfCqdp6pLBcrk+0/CaYGDmMNaIt3Zkf1GMFiqF0F/vVjvbmae59TIWFlaDJkZXQ3lbtxQKuqPvpidiCFuJrrX+TZL7X+RQDx6md7i0ExrSBiMAnKw==',key_name='tempest-keypair-721153735',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:24:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='0ba4d99c1c6c4472be06502d8b0e75a4',ramdisk_id='',reservation_id='r-1rsjawj5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-280497743',owner_user_name='tempest-AttachVolumeTestJSON-280497743-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:30:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d5d3377c73648b8ba9044cfddbfc759',uuid=0b629ca7-b69e-471c-a7b0-9eb43301c36f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "6d28be36-e00b-4f84-9a2b-60515f2e65a1", "address": "fa:16:3e:90:6c:6b", "network": {"id": "2110162d-c25f-4c3d-9a67-18e52f6caf43", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1854809203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba4d99c1c6c4472be06502d8b0e75a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d28be36-e0", "ovs_interfaceid": "6d28be36-e00b-4f84-9a2b-60515f2e65a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 16:32:24 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-846c622e-9fc6-4e0f-9839-57ef2330f59d tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Converting VIF {"id": "6d28be36-e00b-4f84-9a2b-60515f2e65a1", "address": "fa:16:3e:90:6c:6b", "network": {"id": "2110162d-c25f-4c3d-9a67-18e52f6caf43", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1854809203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba4d99c1c6c4472be06502d8b0e75a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d28be36-e0", "ovs_interfaceid": "6d28be36-e00b-4f84-9a2b-60515f2e65a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:32:24 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-846c622e-9fc6-4e0f-9839-57ef2330f59d tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:6c:6b,bridge_name='br-int',has_traffic_filtering=True,id=6d28be36-e00b-4f84-9a2b-60515f2e65a1,network=Network(2110162d-c25f-4c3d-9a67-18e52f6caf43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d28be36-e0') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:32:24 user nova-compute[75245]: DEBUG os_vif [None req-846c622e-9fc6-4e0f-9839-57ef2330f59d tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:6c:6b,bridge_name='br-int',has_traffic_filtering=True,id=6d28be36-e00b-4f84-9a2b-60515f2e65a1,network=Network(2110162d-c25f-4c3d-9a67-18e52f6caf43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d28be36-e0') {{(pid=75245) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 16:32:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:32:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:32:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 16:32:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:32:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd295f6e0-8b9c-5dc8-ba46-5fbf089bf478', '_type': 'linux-noop'}}, row=False) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:32:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:32:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:32:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:32:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6d28be36-e0, may_exist=True, interface_attrs={}) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:32:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6d28be36-e0, col_values=(('qos', UUID('e9db32b4-477d-41af-b5d7-5b26f89c5ff4')),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:32:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6d28be36-e0, col_values=(('external_ids', {'iface-id': '6d28be36-e00b-4f84-9a2b-60515f2e65a1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:90:6c:6b', 'vm-uuid': '0b629ca7-b69e-471c-a7b0-9eb43301c36f'}),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:32:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:32:25 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:32:25 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:32:25 user nova-compute[75245]: INFO os_vif [None req-846c622e-9fc6-4e0f-9839-57ef2330f59d tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:6c:6b,bridge_name='br-int',has_traffic_filtering=True,id=6d28be36-e00b-4f84-9a2b-60515f2e65a1,network=Network(2110162d-c25f-4c3d-9a67-18e52f6caf43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d28be36-e0')
Nov 29 16:32:25 user nova-compute[75245]: DEBUG nova.compute.manager [req-b09f6f1f-0aa9-410b-a1a0-96c6c991b6e3 req-759faf46-f3fd-4afa-b5a4-05d74a2684a3 service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Received event network-changed-62440fbd-97a8-49eb-8509-a7be044b764a {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:32:25 user nova-compute[75245]: DEBUG nova.compute.manager [req-b09f6f1f-0aa9-410b-a1a0-96c6c991b6e3 req-759faf46-f3fd-4afa-b5a4-05d74a2684a3 service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Refreshing instance network info cache due to event network-changed-62440fbd-97a8-49eb-8509-a7be044b764a. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:32:25 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b09f6f1f-0aa9-410b-a1a0-96c6c991b6e3 req-759faf46-f3fd-4afa-b5a4-05d74a2684a3 service nova] Acquiring lock "refresh_cache-24fb8ee5-4eee-4976-bcab-24242ef70d39" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:32:25 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b09f6f1f-0aa9-410b-a1a0-96c6c991b6e3 req-759faf46-f3fd-4afa-b5a4-05d74a2684a3 service nova] Acquired lock "refresh_cache-24fb8ee5-4eee-4976-bcab-24242ef70d39" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:32:25 user nova-compute[75245]: DEBUG nova.network.neutron [req-b09f6f1f-0aa9-410b-a1a0-96c6c991b6e3 req-759faf46-f3fd-4afa-b5a4-05d74a2684a3 service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Refreshing network info cache for port 62440fbd-97a8-49eb-8509-a7be044b764a {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:32:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-441276d7-ac14-40e6-b234-1836120f3086 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Acquiring lock "24fb8ee5-4eee-4976-bcab-24242ef70d39" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:32:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-441276d7-ac14-40e6-b234-1836120f3086 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lock "24fb8ee5-4eee-4976-bcab-24242ef70d39" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:32:26 user nova-compute[75245]: DEBUG nova.objects.instance [None req-441276d7-ac14-40e6-b234-1836120f3086 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lazy-loading 'flavor' on Instance uuid 24fb8ee5-4eee-4976-bcab-24242ef70d39 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:32:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-441276d7-ac14-40e6-b234-1836120f3086 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lock "24fb8ee5-4eee-4976-bcab-24242ef70d39" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:32:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-441276d7-ac14-40e6-b234-1836120f3086 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Acquiring lock "24fb8ee5-4eee-4976-bcab-24242ef70d39" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:32:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-441276d7-ac14-40e6-b234-1836120f3086 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lock "24fb8ee5-4eee-4976-bcab-24242ef70d39" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:32:26 user nova-compute[75245]: INFO nova.compute.manager [None req-441276d7-ac14-40e6-b234-1836120f3086 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Attaching volume 298a22d2-7a11-4639-bfae-04f0e4a0716e to /dev/vdb
Nov 29 16:32:26 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:32:26 user nova-compute[75245]: DEBUG os_brick.utils [None req-441276d7-ac14-40e6-b234-1836120f3086 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:32:26 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:32:26 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:32:26 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:32:26 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb8c829-c66e-48a3-af55-b0ba588f36d8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:69ed8ed87091\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:32:26 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:32:26 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:32:26 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[721a832e-0681-4f96-8998-202815692892]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:32:26 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:32:26 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:32:26 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77572f8-c5aa-4ff0-b4d3-85ca66c46c85]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:32:26 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52cd30b-16fd-4fbd-80af-cfe101e212f3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:32:26 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-441276d7-ac14-40e6-b234-1836120f3086 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Running cmd (subprocess): nvme version {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:32:26 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-441276d7-ac14-40e6-b234-1836120f3086 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] 'nvme version' failed. Not Retrying. {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:32:26 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.nvmeof [None req-441276d7-ac14-40e6-b234-1836120f3086 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] nvme not present on system {{(pid=75245) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 16:32:26 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:32:26 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:32:26 user nova-compute[75245]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 16:32:26 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[c85cca2a-9b93-478c-b6c8-1ed5bc1f97f0]: (4, '') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:32:26 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-441276d7-ac14-40e6-b234-1836120f3086 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75245) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 16:32:26 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-441276d7-ac14-40e6-b234-1836120f3086 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 16:32:26 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-441276d7-ac14-40e6-b234-1836120f3086 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] LIGHTOS: no hostnqn found. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 16:32:26 user nova-compute[75245]: DEBUG os_brick.utils [None req-441276d7-ac14-40e6-b234-1836120f3086 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] <== get_connector_properties: return (164ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:69ed8ed87091', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:32:26 user nova-compute[75245]: DEBUG nova.virt.block_device [None req-441276d7-ac14-40e6-b234-1836120f3086 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Updating existing volume attachment record: 6ce6888b-dc30-400d-93d4-7c70c8ce6e1f {{(pid=75245) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 16:32:26 user nova-compute[75245]: DEBUG nova.compute.manager [req-96584fdb-a139-47e1-a998-3bfbadec1ca3 req-eff1e44f-a5f1-4372-bc7e-88b59c4083b8 service nova] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Received event network-vif-plugged-6d28be36-e00b-4f84-9a2b-60515f2e65a1 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:32:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-96584fdb-a139-47e1-a998-3bfbadec1ca3 req-eff1e44f-a5f1-4372-bc7e-88b59c4083b8 service nova] Acquiring lock "0b629ca7-b69e-471c-a7b0-9eb43301c36f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:32:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-96584fdb-a139-47e1-a998-3bfbadec1ca3 req-eff1e44f-a5f1-4372-bc7e-88b59c4083b8 service nova] Lock "0b629ca7-b69e-471c-a7b0-9eb43301c36f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:32:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-96584fdb-a139-47e1-a998-3bfbadec1ca3 req-eff1e44f-a5f1-4372-bc7e-88b59c4083b8 service nova] Lock "0b629ca7-b69e-471c-a7b0-9eb43301c36f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:32:26 user nova-compute[75245]: DEBUG nova.compute.manager [req-96584fdb-a139-47e1-a998-3bfbadec1ca3 req-eff1e44f-a5f1-4372-bc7e-88b59c4083b8 service nova] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] No waiting events found dispatching network-vif-plugged-6d28be36-e00b-4f84-9a2b-60515f2e65a1 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:32:26 user nova-compute[75245]: WARNING nova.compute.manager [req-96584fdb-a139-47e1-a998-3bfbadec1ca3 req-eff1e44f-a5f1-4372-bc7e-88b59c4083b8 service nova] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Received unexpected event network-vif-plugged-6d28be36-e00b-4f84-9a2b-60515f2e65a1 for instance with vm_state stopped and task_state powering-on.
Nov 29 16:32:26 user nova-compute[75245]: DEBUG nova.network.neutron [req-b09f6f1f-0aa9-410b-a1a0-96c6c991b6e3 req-759faf46-f3fd-4afa-b5a4-05d74a2684a3 service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Updated VIF entry in instance network info cache for port 62440fbd-97a8-49eb-8509-a7be044b764a. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:32:26 user nova-compute[75245]: DEBUG nova.network.neutron [req-b09f6f1f-0aa9-410b-a1a0-96c6c991b6e3 req-759faf46-f3fd-4afa-b5a4-05d74a2684a3 service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Updating instance_info_cache with network_info: [{"id": "62440fbd-97a8-49eb-8509-a7be044b764a", "address": "fa:16:3e:b2:63:34", "network": {"id": "02098e86-68f8-464e-84ee-bf2fb09b881b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085418471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e12002e1a11f4caf8953371e66e6652e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62440fbd-97", "ovs_interfaceid": "62440fbd-97a8-49eb-8509-a7be044b764a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:32:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b09f6f1f-0aa9-410b-a1a0-96c6c991b6e3 req-759faf46-f3fd-4afa-b5a4-05d74a2684a3 service nova] Releasing lock "refresh_cache-24fb8ee5-4eee-4976-bcab-24242ef70d39" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:32:27 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:32:27 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:32:27 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:32:28 user nova-compute[75245]: DEBUG nova.compute.manager [req-b75e4b88-5cfe-47a0-8e3d-4e3bb11c0d54 req-92f266a3-2888-4de9-a827-caa40f05a295 service nova] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Received event network-vif-plugged-6d28be36-e00b-4f84-9a2b-60515f2e65a1 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:32:28 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b75e4b88-5cfe-47a0-8e3d-4e3bb11c0d54 req-92f266a3-2888-4de9-a827-caa40f05a295 service nova] Acquiring lock "0b629ca7-b69e-471c-a7b0-9eb43301c36f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:32:28 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b75e4b88-5cfe-47a0-8e3d-4e3bb11c0d54 req-92f266a3-2888-4de9-a827-caa40f05a295 service nova] Lock "0b629ca7-b69e-471c-a7b0-9eb43301c36f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:32:28 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b75e4b88-5cfe-47a0-8e3d-4e3bb11c0d54 req-92f266a3-2888-4de9-a827-caa40f05a295 service nova] Lock "0b629ca7-b69e-471c-a7b0-9eb43301c36f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:32:28 user nova-compute[75245]: DEBUG nova.compute.manager [req-b75e4b88-5cfe-47a0-8e3d-4e3bb11c0d54 req-92f266a3-2888-4de9-a827-caa40f05a295 service nova] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] No waiting events found dispatching network-vif-plugged-6d28be36-e00b-4f84-9a2b-60515f2e65a1 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:32:28 user nova-compute[75245]: WARNING nova.compute.manager [req-b75e4b88-5cfe-47a0-8e3d-4e3bb11c0d54 req-92f266a3-2888-4de9-a827-caa40f05a295 service nova] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Received unexpected event network-vif-plugged-6d28be36-e00b-4f84-9a2b-60515f2e65a1 for instance with vm_state stopped and task_state powering-on.
Nov 29 16:32:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:32:28 user nova-compute[75245]: DEBUG nova.compute.manager [None req-846c622e-9fc6-4e0f-9839-57ef2330f59d tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Instance event wait completed in 0 seconds for  {{(pid=75245) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 16:32:28 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Instance rebooted successfully.
Nov 29 16:32:28 user nova-compute[75245]: DEBUG nova.compute.manager [None req-846c622e-9fc6-4e0f-9839-57ef2330f59d tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:32:30 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:32:33 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:32:34 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-441276d7-ac14-40e6-b234-1836120f3086 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Calling os-brick to attach iSCSI Volume {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 16:32:34 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-441276d7-ac14-40e6-b234-1836120f3086 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:298a22d2-7a11-4639-bfae-04f0e4a0716e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XQeBzoDW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:32:34 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-441276d7-ac14-40e6-b234-1836120f3086 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:32:34 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-441276d7-ac14-40e6-b234-1836120f3086 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:32:34 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-441276d7-ac14-40e6-b234-1836120f3086 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:32:34 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-441276d7-ac14-40e6-b234-1836120f3086 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:32:34 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-441276d7-ac14-40e6-b234-1836120f3086 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:298a22d2-7a11-4639-bfae-04f0e4a0716e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:32:34 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-441276d7-ac14-40e6-b234-1836120f3086 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:298a22d2-7a11-4639-bfae-04f0e4a0716e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:32:34 user nova-compute[75245]: INFO os_brick.initiator.connectors.iscsi [None req-441276d7-ac14-40e6-b234-1836120f3086 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 16:32:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:298a22d2-7a11-4639-bfae-04f0e4a0716e -p 172.16.0.220:3260 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:32:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:298a22d2-7a11-4639-bfae-04f0e4a0716e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:32:34 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d96ad20-1afd-43d5-b90c-b87cc7b8d834]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:32:34 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-441276d7-ac14-40e6-b234-1836120f3086 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 16:32:34 user nova-compute[75245]:  {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:32:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:298a22d2-7a11-4639-bfae-04f0e4a0716e -p 172.16.0.220:3260 --interface default --op new {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:32:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:298a22d2-7a11-4639-bfae-04f0e4a0716e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:32:34 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[45257e83-cf10-4a4a-b3b4-3e84cbb68b6a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:298a22d2-7a11-4639-bfae-04f0e4a0716e] added\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:32:34 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-441276d7-ac14-40e6-b234-1836120f3086 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:298a22d2-7a11-4639-bfae-04f0e4a0716e] added
Nov 29 16:32:34 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:32:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:298a22d2-7a11-4639-bfae-04f0e4a0716e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:32:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:298a22d2-7a11-4639-bfae-04f0e4a0716e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:32:34 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ec45d9-e06a-4d8a-a059-f62b9ff43c1f]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:32:34 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-441276d7-ac14-40e6-b234-1836120f3086 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:32:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:298a22d2-7a11-4639-bfae-04f0e4a0716e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:32:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:298a22d2-7a11-4639-bfae-04f0e4a0716e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:32:34 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[8266f58d-e790-4eec-9de5-b0d3e3762f47]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:32:34 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-441276d7-ac14-40e6-b234-1836120f3086 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:32:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:298a22d2-7a11-4639-bfae-04f0e4a0716e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XQeBzoDW {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:32:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:298a22d2-7a11-4639-bfae-04f0e4a0716e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XQeBzoDW" returned: 0 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:32:34 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90b74a9-423d-4eb1-9b07-67b3a9f1e9a3]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:32:34 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-441276d7-ac14-40e6-b234-1836120f3086 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XQeBzoDW'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:32:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:298a22d2-7a11-4639-bfae-04f0e4a0716e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:32:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:298a22d2-7a11-4639-bfae-04f0e4a0716e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:32:34 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec502e18-c4ba-4a62-8815-233744d2a868]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:32:34 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-441276d7-ac14-40e6-b234-1836120f3086 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:32:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:32:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:32:34 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69e2de7-7468-41bb-a37b-f9b933bb4f3a]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:32:34 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-441276d7-ac14-40e6-b234-1836120f3086 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)
Nov 29 16:32:34 user nova-compute[75245]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4 (non-flash)
Nov 29 16:32:34 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:32:34 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-441276d7-ac14-40e6-b234-1836120f3086 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)
Nov 29 16:32:34 user nova-compute[75245]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4 (non-flash)
Nov 29 16:32:34 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:32:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:298a22d2-7a11-4639-bfae-04f0e4a0716e -p 172.16.0.220:3260 --login {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:32:35 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:32:35 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:298a22d2-7a11-4639-bfae-04f0e4a0716e -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:32:35 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a428d1-d983-4e7c-b9fa-0b4f5e65d145]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:298a22d2-7a11-4639-bfae-04f0e4a0716e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:298a22d2-7a11-4639-bfae-04f0e4a0716e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:32:35 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-441276d7-ac14-40e6-b234-1836120f3086 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:298a22d2-7a11-4639-bfae-04f0e4a0716e, portal: 172.16.0.220,3260]
Nov 29 16:32:35 user nova-compute[75245]: Login to [iface: default, target: iqn.2010-10.org.openstack:298a22d2-7a11-4639-bfae-04f0e4a0716e, portal: 172.16.0.220,3260] successful.
Nov 29 16:32:35 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:32:35 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:298a22d2-7a11-4639-bfae-04f0e4a0716e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:32:35 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:298a22d2-7a11-4639-bfae-04f0e4a0716e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:32:35 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[429b8fc5-42d5-4737-abb7-03f536d6ba05]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:32:35 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-441276d7-ac14-40e6-b234-1836120f3086 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:32:35 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:32:35 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:32:35 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ef6f2f-645a-40c2-a74f-87e493e0894e]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298a22d2-7a11-4639-bfae-04f0e4a0716e (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:32:35 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-441276d7-ac14-40e6-b234-1836120f3086 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)
Nov 29 16:32:35 user nova-compute[75245]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4 (non-flash)
Nov 29 16:32:35 user nova-compute[75245]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298a22d2-7a11-4639-bfae-04f0e4a0716e (non-flash)
Nov 29 16:32:35 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:32:35 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-441276d7-ac14-40e6-b234-1836120f3086 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)
Nov 29 16:32:35 user nova-compute[75245]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4 (non-flash)
Nov 29 16:32:35 user nova-compute[75245]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298a22d2-7a11-4639-bfae-04f0e4a0716e (non-flash)
Nov 29 16:32:35 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:32:35 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-441276d7-ac14-40e6-b234-1836120f3086 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:298a22d2-7a11-4639-bfae-04f0e4a0716e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:32:35 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-441276d7-ac14-40e6-b234-1836120f3086 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Connected to 172.16.0.220:3260 {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 16:32:35 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-441276d7-ac14-40e6-b234-1836120f3086 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] HCTL ('34', '-', '-', 0) found on session 37 with lun 0 {{(pid=75245) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 16:32:35 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-441276d7-ac14-40e6-b234-1836120f3086 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75245) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 16:32:35 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:32:35 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:32:35 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f5160a1-6c6a-4f1e-9aa8-ff6487ad95dc]: (4, ('- - 0', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:32:35 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-441276d7-ac14-40e6-b234-1836120f3086 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Searching for a device in session 37 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75245) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 16:32:35 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-441276d7-ac14-40e6-b234-1836120f3086 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:298a22d2-7a11-4639-bfae-04f0e4a0716e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XQeBzoDW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 16:32:36 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-441276d7-ac14-40e6-b234-1836120f3086 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:32:36 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-441276d7-ac14-40e6-b234-1836120f3086 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '23161356638343536', 'path': '/dev/sdc'} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:32:36 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-441276d7-ac14-40e6-b234-1836120f3086 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23161356638343536', 'path': '/dev/sdc'} {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 16:32:36 user nova-compute[75245]: DEBUG nova.objects.instance [None req-441276d7-ac14-40e6-b234-1836120f3086 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lazy-loading 'flavor' on Instance uuid 24fb8ee5-4eee-4976-bcab-24242ef70d39 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:32:36 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-441276d7-ac14-40e6-b234-1836120f3086 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 16:32:36 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:32:36 user nova-compute[75245]:   <source dev="/dev/sdc"/>
Nov 29 16:32:36 user nova-compute[75245]:   <target dev="vdb" bus="virtio"/>
Nov 29 16:32:36 user nova-compute[75245]:   <serial>298a22d2-7a11-4639-bfae-04f0e4a0716e</serial>
Nov 29 16:32:36 user nova-compute[75245]: </disk>
Nov 29 16:32:36 user nova-compute[75245]:  {{(pid=75245) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 16:32:36 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-441276d7-ac14-40e6-b234-1836120f3086 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:32:36 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-441276d7-ac14-40e6-b234-1836120f3086 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:32:36 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-441276d7-ac14-40e6-b234-1836120f3086 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] No VIF found with MAC fa:16:3e:b2:63:34, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:32:36 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-441276d7-ac14-40e6-b234-1836120f3086 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lock "24fb8ee5-4eee-4976-bcab-24242ef70d39" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.570s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:32:37 user nova-compute[75245]: INFO nova.compute.manager [None req-3f36477f-5a96-4b3c-b3a7-15062ea04f55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Rescuing
Nov 29 16:32:37 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3f36477f-5a96-4b3c-b3a7-15062ea04f55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Acquiring lock "refresh_cache-24fb8ee5-4eee-4976-bcab-24242ef70d39" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:32:37 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3f36477f-5a96-4b3c-b3a7-15062ea04f55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Acquired lock "refresh_cache-24fb8ee5-4eee-4976-bcab-24242ef70d39" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:32:37 user nova-compute[75245]: DEBUG nova.network.neutron [None req-3f36477f-5a96-4b3c-b3a7-15062ea04f55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 16:32:37 user nova-compute[75245]: DEBUG nova.network.neutron [None req-3f36477f-5a96-4b3c-b3a7-15062ea04f55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Updating instance_info_cache with network_info: [{"id": "62440fbd-97a8-49eb-8509-a7be044b764a", "address": "fa:16:3e:b2:63:34", "network": {"id": "02098e86-68f8-464e-84ee-bf2fb09b881b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085418471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e12002e1a11f4caf8953371e66e6652e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62440fbd-97", "ovs_interfaceid": "62440fbd-97a8-49eb-8509-a7be044b764a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:32:37 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3f36477f-5a96-4b3c-b3a7-15062ea04f55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Releasing lock "refresh_cache-24fb8ee5-4eee-4976-bcab-24242ef70d39" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:32:38 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:32:38 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:32:38 user nova-compute[75245]: DEBUG nova.compute.manager [req-b2622ad9-9def-4bba-b4c9-866ce8119bf5 req-16d7731d-a7f6-4b30-8392-2e56c387e6f4 service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Received event network-vif-unplugged-62440fbd-97a8-49eb-8509-a7be044b764a {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:32:38 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b2622ad9-9def-4bba-b4c9-866ce8119bf5 req-16d7731d-a7f6-4b30-8392-2e56c387e6f4 service nova] Acquiring lock "24fb8ee5-4eee-4976-bcab-24242ef70d39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:32:38 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b2622ad9-9def-4bba-b4c9-866ce8119bf5 req-16d7731d-a7f6-4b30-8392-2e56c387e6f4 service nova] Lock "24fb8ee5-4eee-4976-bcab-24242ef70d39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:32:38 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b2622ad9-9def-4bba-b4c9-866ce8119bf5 req-16d7731d-a7f6-4b30-8392-2e56c387e6f4 service nova] Lock "24fb8ee5-4eee-4976-bcab-24242ef70d39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:32:38 user nova-compute[75245]: DEBUG nova.compute.manager [req-b2622ad9-9def-4bba-b4c9-866ce8119bf5 req-16d7731d-a7f6-4b30-8392-2e56c387e6f4 service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] No waiting events found dispatching network-vif-unplugged-62440fbd-97a8-49eb-8509-a7be044b764a {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:32:38 user nova-compute[75245]: WARNING nova.compute.manager [req-b2622ad9-9def-4bba-b4c9-866ce8119bf5 req-16d7731d-a7f6-4b30-8392-2e56c387e6f4 service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Received unexpected event network-vif-unplugged-62440fbd-97a8-49eb-8509-a7be044b764a for instance with vm_state active and task_state rescuing.
Nov 29 16:32:38 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:32:38 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:32:38 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:32:38 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:32:38 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:32:38 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:32:38 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Instance destroyed successfully.
Nov 29 16:32:38 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-3f36477f-5a96-4b3c-b3a7-15062ea04f55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Attempting rescue
Nov 29 16:32:38 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-3f36477f-5a96-4b3c-b3a7-15062ea04f55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75245) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 29 16:32:38 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:32:38 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-3f36477f-5a96-4b3c-b3a7-15062ea04f55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Instance directory exists: not creating {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 16:32:38 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-3f36477f-5a96-4b3c-b3a7-15062ea04f55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Creating image(s)
Nov 29 16:32:38 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3f36477f-5a96-4b3c-b3a7-15062ea04f55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Acquiring lock "/opt/stack/data/nova/instances/24fb8ee5-4eee-4976-bcab-24242ef70d39/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:32:38 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3f36477f-5a96-4b3c-b3a7-15062ea04f55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lock "/opt/stack/data/nova/instances/24fb8ee5-4eee-4976-bcab-24242ef70d39/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:32:38 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3f36477f-5a96-4b3c-b3a7-15062ea04f55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lock "/opt/stack/data/nova/instances/24fb8ee5-4eee-4976-bcab-24242ef70d39/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:32:38 user nova-compute[75245]: DEBUG nova.objects.instance [None req-3f36477f-5a96-4b3c-b3a7-15062ea04f55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lazy-loading 'trusted_certs' on Instance uuid 24fb8ee5-4eee-4976-bcab-24242ef70d39 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:32:38 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3f36477f-5a96-4b3c-b3a7-15062ea04f55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Acquiring lock "d654f7206043e05d3525550b0fc885556eb999f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:32:38 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3f36477f-5a96-4b3c-b3a7-15062ea04f55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:32:38 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-3f36477f-5a96-4b3c-b3a7-15062ea04f55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:32:38 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:32:38 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:32:38 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-3f36477f-5a96-4b3c-b3a7-15062ea04f55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.186s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:32:38 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-3f36477f-5a96-4b3c-b3a7-15062ea04f55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/24fb8ee5-4eee-4976-bcab-24242ef70d39/disk.rescue {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:32:39 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-3f36477f-5a96-4b3c-b3a7-15062ea04f55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/24fb8ee5-4eee-4976-bcab-24242ef70d39/disk.rescue" returned: 0 in 0.066s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:32:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3f36477f-5a96-4b3c-b3a7-15062ea04f55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:32:39 user nova-compute[75245]: DEBUG nova.objects.instance [None req-3f36477f-5a96-4b3c-b3a7-15062ea04f55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lazy-loading 'migration_context' on Instance uuid 24fb8ee5-4eee-4976-bcab-24242ef70d39 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:32:39 user nova-compute[75245]: DEBUG nova.objects.base [None req-3f36477f-5a96-4b3c-b3a7-15062ea04f55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Object Instance<24fb8ee5-4eee-4976-bcab-24242ef70d39> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75245) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 16:32:39 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-3f36477f-5a96-4b3c-b3a7-15062ea04f55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Created local disks {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 16:32:39 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-3f36477f-5a96-4b3c-b3a7-15062ea04f55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Start _get_guest_xml network_info=[{"id": "62440fbd-97a8-49eb-8509-a7be044b764a", "address": "fa:16:3e:b2:63:34", "network": {"id": "02098e86-68f8-464e-84ee-bf2fb09b881b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085418471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-2085418471-network", "vif_mac": "fa:16:3e:b2:63:34"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e12002e1a11f4caf8953371e66e6652e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62440fbd-97", "ovs_interfaceid": "62440fbd-97a8-49eb-8509-a7be044b764a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'a291d9c3-be02-4c6c-9649-4b45c5b7f487', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 16:32:39 user nova-compute[75245]: DEBUG nova.objects.instance [None req-3f36477f-5a96-4b3c-b3a7-15062ea04f55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lazy-loading 'resources' on Instance uuid 24fb8ee5-4eee-4976-bcab-24242ef70d39 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:32:39 user nova-compute[75245]: DEBUG nova.objects.base [None req-3f36477f-5a96-4b3c-b3a7-15062ea04f55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Object Instance<24fb8ee5-4eee-4976-bcab-24242ef70d39> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75245) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 16:32:39 user nova-compute[75245]: DEBUG nova.objects.instance [None req-3f36477f-5a96-4b3c-b3a7-15062ea04f55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lazy-loading 'numa_topology' on Instance uuid 24fb8ee5-4eee-4976-bcab-24242ef70d39 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:32:39 user nova-compute[75245]: DEBUG nova.objects.base [None req-3f36477f-5a96-4b3c-b3a7-15062ea04f55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Object Instance<24fb8ee5-4eee-4976-bcab-24242ef70d39> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75245) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 16:32:39 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-3f36477f-5a96-4b3c-b3a7-15062ea04f55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:32:39 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-3f36477f-5a96-4b3c-b3a7-15062ea04f55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:32:39 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-3f36477f-5a96-4b3c-b3a7-15062ea04f55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 16:32:39 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-3f36477f-5a96-4b3c-b3a7-15062ea04f55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] CPU controller missing on host. {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 16:32:39 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-3f36477f-5a96-4b3c-b3a7-15062ea04f55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 16:32:39 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-3f36477f-5a96-4b3c-b3a7-15062ea04f55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] CPU controller found on host. {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 16:32:39 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-3f36477f-5a96-4b3c-b3a7-15062ea04f55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75245) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 16:32:39 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-3f36477f-5a96-4b3c-b3a7-15062ea04f55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T16:06:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 16:32:39 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-3f36477f-5a96-4b3c-b3a7-15062ea04f55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Flavor limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 16:32:39 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-3f36477f-5a96-4b3c-b3a7-15062ea04f55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Image limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 16:32:39 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-3f36477f-5a96-4b3c-b3a7-15062ea04f55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Flavor pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 16:32:39 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-3f36477f-5a96-4b3c-b3a7-15062ea04f55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Image pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 16:32:39 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-3f36477f-5a96-4b3c-b3a7-15062ea04f55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 16:32:39 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-3f36477f-5a96-4b3c-b3a7-15062ea04f55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 16:32:39 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-3f36477f-5a96-4b3c-b3a7-15062ea04f55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 16:32:39 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-3f36477f-5a96-4b3c-b3a7-15062ea04f55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Got 1 possible topologies {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 16:32:39 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-3f36477f-5a96-4b3c-b3a7-15062ea04f55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 16:32:39 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-3f36477f-5a96-4b3c-b3a7-15062ea04f55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 16:32:39 user nova-compute[75245]: DEBUG nova.objects.instance [None req-3f36477f-5a96-4b3c-b3a7-15062ea04f55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lazy-loading 'vcpu_model' on Instance uuid 24fb8ee5-4eee-4976-bcab-24242ef70d39 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:32:39 user nova-compute[75245]: DEBUG nova.objects.base [None req-3f36477f-5a96-4b3c-b3a7-15062ea04f55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Object Instance<24fb8ee5-4eee-4976-bcab-24242ef70d39> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75245) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 16:32:39 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-3f36477f-5a96-4b3c-b3a7-15062ea04f55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:30:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-640260040',display_name='tempest-ServerRescueNegativeTestJSON-server-640260040',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-640260040',id=31,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBACvKEgq8kStkZ1z3ReTmb3c/dp4mRi1EUgpKQXKqWZlYREEZfw+OWLoIIjh5f+XOK1abUAZHhSpf9SDmRSDBWvCgIJoBwK9h9YoQr9SBb5REV1zRe7b4QTPMqNd5zaDNw==',key_name='tempest-keypair-2048224560',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:30:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e12002e1a11f4caf8953371e66e6652e',ramdisk_id='',reservation_id='r-8gg62wg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1013090395',owner_user_name='tempest-ServerRescueNegativeTestJSON-1013090395-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:30:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d876b1e244b14a29ad5b4b422135336b',uuid=24fb8ee5-4eee-4976-bcab-24242ef70d39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "62440fbd-97a8-49eb-8509-a7be044b764a", "address": "fa:16:3e:b2:63:34", "network": {"id": "02098e86-68f8-464e-84ee-bf2fb09b881b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085418471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-2085418471-network", "vif_mac": "fa:16:3e:b2:63:34"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e12002e1a11f4caf8953371e66e6652e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62440fbd-97", "ovs_interfaceid": "62440fbd-97a8-49eb-8509-a7be044b764a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:32:39 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-3f36477f-5a96-4b3c-b3a7-15062ea04f55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Converting VIF {"id": "62440fbd-97a8-49eb-8509-a7be044b764a", "address": "fa:16:3e:b2:63:34", "network": {"id": "02098e86-68f8-464e-84ee-bf2fb09b881b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085418471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-2085418471-network", "vif_mac": "fa:16:3e:b2:63:34"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e12002e1a11f4caf8953371e66e6652e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62440fbd-97", "ovs_interfaceid": "62440fbd-97a8-49eb-8509-a7be044b764a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:32:39 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-3f36477f-5a96-4b3c-b3a7-15062ea04f55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b2:63:34,bridge_name='br-int',has_traffic_filtering=True,id=62440fbd-97a8-49eb-8509-a7be044b764a,network=Network(02098e86-68f8-464e-84ee-bf2fb09b881b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62440fbd-97') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:32:39 user nova-compute[75245]: DEBUG nova.objects.instance [None req-3f36477f-5a96-4b3c-b3a7-15062ea04f55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lazy-loading 'pci_devices' on Instance uuid 24fb8ee5-4eee-4976-bcab-24242ef70d39 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:32:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:32:39 user nova-compute[75245]: DEBUG nova.objects.base [None req-3f36477f-5a96-4b3c-b3a7-15062ea04f55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Object Instance<24fb8ee5-4eee-4976-bcab-24242ef70d39> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75245) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 16:32:39 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-3f36477f-5a96-4b3c-b3a7-15062ea04f55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] End _get_guest_xml xml=<domain type="kvm">
Nov 29 16:32:39 user nova-compute[75245]:   <uuid>24fb8ee5-4eee-4976-bcab-24242ef70d39</uuid>
Nov 29 16:32:39 user nova-compute[75245]:   <name>instance-0000001f</name>
Nov 29 16:32:39 user nova-compute[75245]:   <memory>524288</memory>
Nov 29 16:32:39 user nova-compute[75245]:   <vcpu>1</vcpu>
Nov 29 16:32:39 user nova-compute[75245]:   <metadata>
Nov 29 16:32:39 user nova-compute[75245]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 16:32:39 user nova-compute[75245]:       <nova:package version="0.0.0"/>
Nov 29 16:32:39 user nova-compute[75245]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-640260040</nova:name>
Nov 29 16:32:39 user nova-compute[75245]:       <nova:creationTime>2023-11-29 16:32:39</nova:creationTime>
Nov 29 16:32:39 user nova-compute[75245]:       <nova:flavor name="m1.tiny">
Nov 29 16:32:39 user nova-compute[75245]:         <nova:memory>512</nova:memory>
Nov 29 16:32:39 user nova-compute[75245]:         <nova:disk>1</nova:disk>
Nov 29 16:32:39 user nova-compute[75245]:         <nova:swap>0</nova:swap>
Nov 29 16:32:39 user nova-compute[75245]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 16:32:39 user nova-compute[75245]:         <nova:vcpus>1</nova:vcpus>
Nov 29 16:32:39 user nova-compute[75245]:       </nova:flavor>
Nov 29 16:32:39 user nova-compute[75245]:       <nova:owner>
Nov 29 16:32:39 user nova-compute[75245]:         <nova:user uuid="d876b1e244b14a29ad5b4b422135336b">tempest-ServerRescueNegativeTestJSON-1013090395-project-member</nova:user>
Nov 29 16:32:39 user nova-compute[75245]:         <nova:project uuid="e12002e1a11f4caf8953371e66e6652e">tempest-ServerRescueNegativeTestJSON-1013090395</nova:project>
Nov 29 16:32:39 user nova-compute[75245]:       </nova:owner>
Nov 29 16:32:39 user nova-compute[75245]:       <nova:root type="image" uuid="a291d9c3-be02-4c6c-9649-4b45c5b7f487"/>
Nov 29 16:32:39 user nova-compute[75245]:       <nova:ports>
Nov 29 16:32:39 user nova-compute[75245]:         <nova:port uuid="62440fbd-97a8-49eb-8509-a7be044b764a">
Nov 29 16:32:39 user nova-compute[75245]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 29 16:32:39 user nova-compute[75245]:         </nova:port>
Nov 29 16:32:39 user nova-compute[75245]:       </nova:ports>
Nov 29 16:32:39 user nova-compute[75245]:     </nova:instance>
Nov 29 16:32:39 user nova-compute[75245]:   </metadata>
Nov 29 16:32:39 user nova-compute[75245]:   <sysinfo type="smbios">
Nov 29 16:32:39 user nova-compute[75245]:     <system>
Nov 29 16:32:39 user nova-compute[75245]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 16:32:39 user nova-compute[75245]:       <entry name="product">OpenStack Nova</entry>
Nov 29 16:32:39 user nova-compute[75245]:       <entry name="version">0.0.0</entry>
Nov 29 16:32:39 user nova-compute[75245]:       <entry name="serial">24fb8ee5-4eee-4976-bcab-24242ef70d39</entry>
Nov 29 16:32:39 user nova-compute[75245]:       <entry name="uuid">24fb8ee5-4eee-4976-bcab-24242ef70d39</entry>
Nov 29 16:32:39 user nova-compute[75245]:       <entry name="family">Virtual Machine</entry>
Nov 29 16:32:39 user nova-compute[75245]:     </system>
Nov 29 16:32:39 user nova-compute[75245]:   </sysinfo>
Nov 29 16:32:39 user nova-compute[75245]:   <os>
Nov 29 16:32:39 user nova-compute[75245]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 16:32:39 user nova-compute[75245]:     <smbios mode="sysinfo"/>
Nov 29 16:32:39 user nova-compute[75245]:   </os>
Nov 29 16:32:39 user nova-compute[75245]:   <features>
Nov 29 16:32:39 user nova-compute[75245]:     <acpi/>
Nov 29 16:32:39 user nova-compute[75245]:     <apic/>
Nov 29 16:32:39 user nova-compute[75245]:     <vmcoreinfo/>
Nov 29 16:32:39 user nova-compute[75245]:   </features>
Nov 29 16:32:39 user nova-compute[75245]:   <clock offset="utc">
Nov 29 16:32:39 user nova-compute[75245]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 16:32:39 user nova-compute[75245]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 16:32:39 user nova-compute[75245]:     <timer name="hpet" present="no"/>
Nov 29 16:32:39 user nova-compute[75245]:   </clock>
Nov 29 16:32:39 user nova-compute[75245]:   <cpu mode="custom" match="exact">
Nov 29 16:32:39 user nova-compute[75245]:     <model>Nehalem</model>
Nov 29 16:32:39 user nova-compute[75245]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 16:32:39 user nova-compute[75245]:   </cpu>
Nov 29 16:32:39 user nova-compute[75245]:   <devices>
Nov 29 16:32:39 user nova-compute[75245]:     <disk type="file" device="disk">
Nov 29 16:32:39 user nova-compute[75245]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 16:32:39 user nova-compute[75245]:       <source file="/opt/stack/data/nova/instances/24fb8ee5-4eee-4976-bcab-24242ef70d39/disk.rescue"/>
Nov 29 16:32:39 user nova-compute[75245]:       <target dev="vda" bus="virtio"/>
Nov 29 16:32:39 user nova-compute[75245]:     </disk>
Nov 29 16:32:39 user nova-compute[75245]:     <disk type="file" device="disk">
Nov 29 16:32:39 user nova-compute[75245]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 16:32:39 user nova-compute[75245]:       <source file="/opt/stack/data/nova/instances/24fb8ee5-4eee-4976-bcab-24242ef70d39/disk"/>
Nov 29 16:32:39 user nova-compute[75245]:       <target dev="vdb" bus="virtio"/>
Nov 29 16:32:39 user nova-compute[75245]:     </disk>
Nov 29 16:32:39 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 16:32:39 user nova-compute[75245]:       <mac address="fa:16:3e:b2:63:34"/>
Nov 29 16:32:39 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:32:39 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 16:32:39 user nova-compute[75245]:       <target dev="tap62440fbd-97"/>
Nov 29 16:32:39 user nova-compute[75245]:     </interface>
Nov 29 16:32:39 user nova-compute[75245]:     <serial type="pty">
Nov 29 16:32:39 user nova-compute[75245]:       <log file="/opt/stack/data/nova/instances/24fb8ee5-4eee-4976-bcab-24242ef70d39/console.log" append="off"/>
Nov 29 16:32:39 user nova-compute[75245]:     </serial>
Nov 29 16:32:39 user nova-compute[75245]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 16:32:39 user nova-compute[75245]:     <video>
Nov 29 16:32:39 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:32:39 user nova-compute[75245]:     </video>
Nov 29 16:32:39 user nova-compute[75245]:     <rng model="virtio">
Nov 29 16:32:39 user nova-compute[75245]:       <backend model="random">/dev/urandom</backend>
Nov 29 16:32:39 user nova-compute[75245]:     </rng>
Nov 29 16:32:39 user nova-compute[75245]:     <controller type="usb" index="0" model="none"/>
Nov 29 16:32:39 user nova-compute[75245]:     <memballoon model="virtio">
Nov 29 16:32:39 user nova-compute[75245]:       <stats period="10"/>
Nov 29 16:32:39 user nova-compute[75245]:     </memballoon>
Nov 29 16:32:39 user nova-compute[75245]:   </devices>
Nov 29 16:32:39 user nova-compute[75245]: </domain>
Nov 29 16:32:39 user nova-compute[75245]:  {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 16:32:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:32:39 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Instance destroyed successfully.
Nov 29 16:32:39 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-3f36477f-5a96-4b3c-b3a7-15062ea04f55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:32:39 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-3f36477f-5a96-4b3c-b3a7-15062ea04f55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:32:39 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-3f36477f-5a96-4b3c-b3a7-15062ea04f55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] No VIF found with MAC fa:16:3e:b2:63:34, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:32:40 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:32:40 user nova-compute[75245]: DEBUG nova.compute.manager [req-108fe263-5c11-4201-b804-954614d4c9a7 req-4fadeac5-b50c-4684-856f-46d4fe45c462 service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Received event network-vif-plugged-62440fbd-97a8-49eb-8509-a7be044b764a {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:32:40 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-108fe263-5c11-4201-b804-954614d4c9a7 req-4fadeac5-b50c-4684-856f-46d4fe45c462 service nova] Acquiring lock "24fb8ee5-4eee-4976-bcab-24242ef70d39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:32:40 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-108fe263-5c11-4201-b804-954614d4c9a7 req-4fadeac5-b50c-4684-856f-46d4fe45c462 service nova] Lock "24fb8ee5-4eee-4976-bcab-24242ef70d39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:32:40 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-108fe263-5c11-4201-b804-954614d4c9a7 req-4fadeac5-b50c-4684-856f-46d4fe45c462 service nova] Lock "24fb8ee5-4eee-4976-bcab-24242ef70d39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:32:40 user nova-compute[75245]: DEBUG nova.compute.manager [req-108fe263-5c11-4201-b804-954614d4c9a7 req-4fadeac5-b50c-4684-856f-46d4fe45c462 service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] No waiting events found dispatching network-vif-plugged-62440fbd-97a8-49eb-8509-a7be044b764a {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:32:40 user nova-compute[75245]: WARNING nova.compute.manager [req-108fe263-5c11-4201-b804-954614d4c9a7 req-4fadeac5-b50c-4684-856f-46d4fe45c462 service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Received unexpected event network-vif-plugged-62440fbd-97a8-49eb-8509-a7be044b764a for instance with vm_state active and task_state rescuing.
Nov 29 16:32:40 user nova-compute[75245]: DEBUG nova.compute.manager [req-108fe263-5c11-4201-b804-954614d4c9a7 req-4fadeac5-b50c-4684-856f-46d4fe45c462 service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Received event network-vif-plugged-62440fbd-97a8-49eb-8509-a7be044b764a {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:32:40 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-108fe263-5c11-4201-b804-954614d4c9a7 req-4fadeac5-b50c-4684-856f-46d4fe45c462 service nova] Acquiring lock "24fb8ee5-4eee-4976-bcab-24242ef70d39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:32:40 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-108fe263-5c11-4201-b804-954614d4c9a7 req-4fadeac5-b50c-4684-856f-46d4fe45c462 service nova] Lock "24fb8ee5-4eee-4976-bcab-24242ef70d39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:32:40 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-108fe263-5c11-4201-b804-954614d4c9a7 req-4fadeac5-b50c-4684-856f-46d4fe45c462 service nova] Lock "24fb8ee5-4eee-4976-bcab-24242ef70d39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:32:40 user nova-compute[75245]: DEBUG nova.compute.manager [req-108fe263-5c11-4201-b804-954614d4c9a7 req-4fadeac5-b50c-4684-856f-46d4fe45c462 service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] No waiting events found dispatching network-vif-plugged-62440fbd-97a8-49eb-8509-a7be044b764a {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:32:40 user nova-compute[75245]: WARNING nova.compute.manager [req-108fe263-5c11-4201-b804-954614d4c9a7 req-4fadeac5-b50c-4684-856f-46d4fe45c462 service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Received unexpected event network-vif-plugged-62440fbd-97a8-49eb-8509-a7be044b764a for instance with vm_state active and task_state rescuing.
Nov 29 16:32:40 user nova-compute[75245]: DEBUG nova.compute.manager [req-108fe263-5c11-4201-b804-954614d4c9a7 req-4fadeac5-b50c-4684-856f-46d4fe45c462 service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Received event network-vif-plugged-62440fbd-97a8-49eb-8509-a7be044b764a {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:32:40 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-108fe263-5c11-4201-b804-954614d4c9a7 req-4fadeac5-b50c-4684-856f-46d4fe45c462 service nova] Acquiring lock "24fb8ee5-4eee-4976-bcab-24242ef70d39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:32:40 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-108fe263-5c11-4201-b804-954614d4c9a7 req-4fadeac5-b50c-4684-856f-46d4fe45c462 service nova] Lock "24fb8ee5-4eee-4976-bcab-24242ef70d39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:32:40 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-108fe263-5c11-4201-b804-954614d4c9a7 req-4fadeac5-b50c-4684-856f-46d4fe45c462 service nova] Lock "24fb8ee5-4eee-4976-bcab-24242ef70d39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:32:40 user nova-compute[75245]: DEBUG nova.compute.manager [req-108fe263-5c11-4201-b804-954614d4c9a7 req-4fadeac5-b50c-4684-856f-46d4fe45c462 service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] No waiting events found dispatching network-vif-plugged-62440fbd-97a8-49eb-8509-a7be044b764a {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:32:40 user nova-compute[75245]: WARNING nova.compute.manager [req-108fe263-5c11-4201-b804-954614d4c9a7 req-4fadeac5-b50c-4684-856f-46d4fe45c462 service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Received unexpected event network-vif-plugged-62440fbd-97a8-49eb-8509-a7be044b764a for instance with vm_state active and task_state rescuing.
Nov 29 16:32:40 user nova-compute[75245]: DEBUG nova.compute.manager [req-108fe263-5c11-4201-b804-954614d4c9a7 req-4fadeac5-b50c-4684-856f-46d4fe45c462 service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Received event network-vif-unplugged-62440fbd-97a8-49eb-8509-a7be044b764a {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:32:40 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-108fe263-5c11-4201-b804-954614d4c9a7 req-4fadeac5-b50c-4684-856f-46d4fe45c462 service nova] Acquiring lock "24fb8ee5-4eee-4976-bcab-24242ef70d39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:32:40 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-108fe263-5c11-4201-b804-954614d4c9a7 req-4fadeac5-b50c-4684-856f-46d4fe45c462 service nova] Lock "24fb8ee5-4eee-4976-bcab-24242ef70d39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:32:40 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-108fe263-5c11-4201-b804-954614d4c9a7 req-4fadeac5-b50c-4684-856f-46d4fe45c462 service nova] Lock "24fb8ee5-4eee-4976-bcab-24242ef70d39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:32:40 user nova-compute[75245]: DEBUG nova.compute.manager [req-108fe263-5c11-4201-b804-954614d4c9a7 req-4fadeac5-b50c-4684-856f-46d4fe45c462 service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] No waiting events found dispatching network-vif-unplugged-62440fbd-97a8-49eb-8509-a7be044b764a {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:32:40 user nova-compute[75245]: WARNING nova.compute.manager [req-108fe263-5c11-4201-b804-954614d4c9a7 req-4fadeac5-b50c-4684-856f-46d4fe45c462 service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Received unexpected event network-vif-unplugged-62440fbd-97a8-49eb-8509-a7be044b764a for instance with vm_state active and task_state rescuing.
Nov 29 16:32:40 user nova-compute[75245]: DEBUG nova.compute.manager [req-108fe263-5c11-4201-b804-954614d4c9a7 req-4fadeac5-b50c-4684-856f-46d4fe45c462 service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Received event network-vif-plugged-62440fbd-97a8-49eb-8509-a7be044b764a {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:32:40 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-108fe263-5c11-4201-b804-954614d4c9a7 req-4fadeac5-b50c-4684-856f-46d4fe45c462 service nova] Acquiring lock "24fb8ee5-4eee-4976-bcab-24242ef70d39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:32:40 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-108fe263-5c11-4201-b804-954614d4c9a7 req-4fadeac5-b50c-4684-856f-46d4fe45c462 service nova] Lock "24fb8ee5-4eee-4976-bcab-24242ef70d39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:32:40 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-108fe263-5c11-4201-b804-954614d4c9a7 req-4fadeac5-b50c-4684-856f-46d4fe45c462 service nova] Lock "24fb8ee5-4eee-4976-bcab-24242ef70d39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:32:40 user nova-compute[75245]: DEBUG nova.compute.manager [req-108fe263-5c11-4201-b804-954614d4c9a7 req-4fadeac5-b50c-4684-856f-46d4fe45c462 service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] No waiting events found dispatching network-vif-plugged-62440fbd-97a8-49eb-8509-a7be044b764a {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:32:40 user nova-compute[75245]: WARNING nova.compute.manager [req-108fe263-5c11-4201-b804-954614d4c9a7 req-4fadeac5-b50c-4684-856f-46d4fe45c462 service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Received unexpected event network-vif-plugged-62440fbd-97a8-49eb-8509-a7be044b764a for instance with vm_state active and task_state rescuing.
Nov 29 16:32:40 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:32:40 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:32:40 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:32:40 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:32:40 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:32:40 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:32:42 user nova-compute[75245]: DEBUG nova.compute.manager [req-8af35886-bd0d-4e45-ad99-9277f6870ff7 req-bbe5c625-bfff-42d8-a276-416cef1e893f service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Received event network-vif-plugged-62440fbd-97a8-49eb-8509-a7be044b764a {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:32:42 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-8af35886-bd0d-4e45-ad99-9277f6870ff7 req-bbe5c625-bfff-42d8-a276-416cef1e893f service nova] Acquiring lock "24fb8ee5-4eee-4976-bcab-24242ef70d39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:32:42 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-8af35886-bd0d-4e45-ad99-9277f6870ff7 req-bbe5c625-bfff-42d8-a276-416cef1e893f service nova] Lock "24fb8ee5-4eee-4976-bcab-24242ef70d39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:32:42 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-8af35886-bd0d-4e45-ad99-9277f6870ff7 req-bbe5c625-bfff-42d8-a276-416cef1e893f service nova] Lock "24fb8ee5-4eee-4976-bcab-24242ef70d39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:32:42 user nova-compute[75245]: DEBUG nova.compute.manager [req-8af35886-bd0d-4e45-ad99-9277f6870ff7 req-bbe5c625-bfff-42d8-a276-416cef1e893f service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] No waiting events found dispatching network-vif-plugged-62440fbd-97a8-49eb-8509-a7be044b764a {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:32:42 user nova-compute[75245]: WARNING nova.compute.manager [req-8af35886-bd0d-4e45-ad99-9277f6870ff7 req-bbe5c625-bfff-42d8-a276-416cef1e893f service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Received unexpected event network-vif-plugged-62440fbd-97a8-49eb-8509-a7be044b764a for instance with vm_state active and task_state rescuing.
Nov 29 16:32:42 user nova-compute[75245]: DEBUG nova.compute.manager [req-8af35886-bd0d-4e45-ad99-9277f6870ff7 req-bbe5c625-bfff-42d8-a276-416cef1e893f service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Received event network-vif-plugged-62440fbd-97a8-49eb-8509-a7be044b764a {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:32:42 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-8af35886-bd0d-4e45-ad99-9277f6870ff7 req-bbe5c625-bfff-42d8-a276-416cef1e893f service nova] Acquiring lock "24fb8ee5-4eee-4976-bcab-24242ef70d39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:32:42 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-8af35886-bd0d-4e45-ad99-9277f6870ff7 req-bbe5c625-bfff-42d8-a276-416cef1e893f service nova] Lock "24fb8ee5-4eee-4976-bcab-24242ef70d39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:32:42 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-8af35886-bd0d-4e45-ad99-9277f6870ff7 req-bbe5c625-bfff-42d8-a276-416cef1e893f service nova] Lock "24fb8ee5-4eee-4976-bcab-24242ef70d39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:32:42 user nova-compute[75245]: DEBUG nova.compute.manager [req-8af35886-bd0d-4e45-ad99-9277f6870ff7 req-bbe5c625-bfff-42d8-a276-416cef1e893f service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] No waiting events found dispatching network-vif-plugged-62440fbd-97a8-49eb-8509-a7be044b764a {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:32:42 user nova-compute[75245]: WARNING nova.compute.manager [req-8af35886-bd0d-4e45-ad99-9277f6870ff7 req-bbe5c625-bfff-42d8-a276-416cef1e893f service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Received unexpected event network-vif-plugged-62440fbd-97a8-49eb-8509-a7be044b764a for instance with vm_state active and task_state rescuing.
Nov 29 16:32:42 user nova-compute[75245]: DEBUG nova.compute.manager [None req-3f36477f-5a96-4b3c-b3a7-15062ea04f55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:32:43 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:32:45 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:32:48 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:32:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:32:53 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:32:55 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:32:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:33:00 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:33:03 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:33:05 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:33:06 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:33:06 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Starting heal instance info cache {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 16:33:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "refresh_cache-35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:33:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquired lock "refresh_cache-35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:33:06 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Forcefully refreshing network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 16:33:06 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Updating instance_info_cache with network_info: [{"id": "545bae30-b03e-41ac-8dd9-f86e85b590d1", "address": "fa:16:3e:26:46:35", "network": {"id": "02098e86-68f8-464e-84ee-bf2fb09b881b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085418471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e12002e1a11f4caf8953371e66e6652e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap545bae30-b0", "ovs_interfaceid": "545bae30-b03e-41ac-8dd9-f86e85b590d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:33:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Releasing lock "refresh_cache-35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:33:06 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Updated the network info_cache for instance {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 16:33:07 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:33:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:33:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:33:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:33:07 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75245) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 16:33:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b629ca7-b69e-471c-a7b0-9eb43301c36f/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:33:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b629ca7-b69e-471c-a7b0-9eb43301c36f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:33:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b629ca7-b69e-471c-a7b0-9eb43301c36f/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:33:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b629ca7-b69e-471c-a7b0-9eb43301c36f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:33:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:33:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:33:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:33:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:33:08 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:33:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:33:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:33:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:33:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:33:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:33:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f4fa79b-345a-4e58-a77c-fdfed675e6e7/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:33:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f4fa79b-345a-4e58-a77c-fdfed675e6e7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:33:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f4fa79b-345a-4e58-a77c-fdfed675e6e7/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:33:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f4fa79b-345a-4e58-a77c-fdfed675e6e7/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:33:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk.rescue --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:33:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:33:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk.rescue --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:33:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:33:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:33:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:33:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:33:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:33:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24fb8ee5-4eee-4976-bcab-24242ef70d39/disk.rescue --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:33:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:33:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24fb8ee5-4eee-4976-bcab-24242ef70d39/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:33:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24fb8ee5-4eee-4976-bcab-24242ef70d39/disk.rescue --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:33:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24fb8ee5-4eee-4976-bcab-24242ef70d39/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:33:10 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /opt/stack/data/nova/instances/24fb8ee5-4eee-4976-bcab-24242ef70d39/disk (vdb) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:33:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78784fb7-a25f-4c6c-9a44-649c994004c7/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:33:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78784fb7-a25f-4c6c-9a44-649c994004c7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:33:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78784fb7-a25f-4c6c-9a44-649c994004c7/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:33:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78784fb7-a25f-4c6c-9a44-649c994004c7/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:33:10 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:33:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26acb3c4-b081-4670-a6b5-d40583c23592/disk.rescue --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:33:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26acb3c4-b081-4670-a6b5-d40583c23592/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:33:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26acb3c4-b081-4670-a6b5-d40583c23592/disk.rescue --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:33:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26acb3c4-b081-4670-a6b5-d40583c23592/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:33:11 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:33:11 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:33:11 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Hypervisor/Node resource view: name=user free_ram=8054MB free_disk=24.953990936279297GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75245) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 16:33:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:33:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:33:11 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 8785a3c2-5b7a-4382-b50d-cecd8743329c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:33:11 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 5de7e10c-f216-46b3-8f74-57bac6ab7e56 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:33:11 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:33:11 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance ed9d1ad5-f5d0-4a68-a073-e7a83be772ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:33:11 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 0b629ca7-b69e-471c-a7b0-9eb43301c36f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:33:11 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 78784fb7-a25f-4c6c-9a44-649c994004c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:33:11 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 0f4fa79b-345a-4e58-a77c-fdfed675e6e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:33:11 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 26acb3c4-b081-4670-a6b5-d40583c23592 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:33:11 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 24fb8ee5-4eee-4976-bcab-24242ef70d39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:33:11 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 16:33:11 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 16:33:11 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:33:11 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:33:11 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Compute_service record updated for user:user {{(pid=75245) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 16:33:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.431s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:33:12 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:33:12 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:33:12 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:33:13 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:33:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:33:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:33:15 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:33:17 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:33:19 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:33:19 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75245) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 16:33:20 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:33:25 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:33:30 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:33:35 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:33:35 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:33:35 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75245) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 16:33:35 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:33:35 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:33:35 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:33:40 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:33:45 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:33:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:33:50 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-bf084702-ab76-489d-a04f-0ea059dd9e13 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Acquiring lock "0f4fa79b-345a-4e58-a77c-fdfed675e6e7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:33:50 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-bf084702-ab76-489d-a04f-0ea059dd9e13 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Lock "0f4fa79b-345a-4e58-a77c-fdfed675e6e7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:33:50 user nova-compute[75245]: DEBUG nova.objects.instance [None req-bf084702-ab76-489d-a04f-0ea059dd9e13 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Lazy-loading 'flavor' on Instance uuid 0f4fa79b-345a-4e58-a77c-fdfed675e6e7 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:33:50 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-bf084702-ab76-489d-a04f-0ea059dd9e13 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Lock "0f4fa79b-345a-4e58-a77c-fdfed675e6e7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:33:50 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-bf084702-ab76-489d-a04f-0ea059dd9e13 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Acquiring lock "0f4fa79b-345a-4e58-a77c-fdfed675e6e7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:33:50 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-bf084702-ab76-489d-a04f-0ea059dd9e13 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Lock "0f4fa79b-345a-4e58-a77c-fdfed675e6e7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:33:50 user nova-compute[75245]: INFO nova.compute.manager [None req-bf084702-ab76-489d-a04f-0ea059dd9e13 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Attaching volume 5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf to /dev/vdb
Nov 29 16:33:50 user nova-compute[75245]: DEBUG os_brick.utils [None req-bf084702-ab76-489d-a04f-0ea059dd9e13 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:33:50 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:33:50 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.177s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:33:50 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[23629a1f-d8f8-4faf-907d-9fa315d932c2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:69ed8ed87091\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:33:50 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:33:50 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:33:50 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a04cd5-e333-49ee-9b99-0de43e910ea4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:33:50 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:33:50 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:33:50 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc4ceb9-d90d-482c-befa-446b667a1bec]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:33:50 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c1b6fc-33d6-4c44-af65-df2c3c407602]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:33:50 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-bf084702-ab76-489d-a04f-0ea059dd9e13 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Running cmd (subprocess): nvme version {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:33:50 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-bf084702-ab76-489d-a04f-0ea059dd9e13 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] 'nvme version' failed. Not Retrying. {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:33:50 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bf084702-ab76-489d-a04f-0ea059dd9e13 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] nvme not present on system {{(pid=75245) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 16:33:50 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:33:50 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:33:50 user nova-compute[75245]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 16:33:50 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6bf354b-ed1a-47b7-99d3-ba8569d7bbfc]: (4, '') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:33:50 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-bf084702-ab76-489d-a04f-0ea059dd9e13 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75245) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 16:33:50 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-bf084702-ab76-489d-a04f-0ea059dd9e13 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 16:33:50 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-bf084702-ab76-489d-a04f-0ea059dd9e13 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] LIGHTOS: no hostnqn found. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 16:33:50 user nova-compute[75245]: DEBUG os_brick.utils [None req-bf084702-ab76-489d-a04f-0ea059dd9e13 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] <== get_connector_properties: return (290ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:69ed8ed87091', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:33:50 user nova-compute[75245]: DEBUG nova.virt.block_device [None req-bf084702-ab76-489d-a04f-0ea059dd9e13 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Updating existing volume attachment record: 4d0921e8-6d6a-4584-8798-7effdaa1c43e {{(pid=75245) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 16:33:55 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:33:58 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf084702-ab76-489d-a04f-0ea059dd9e13 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Calling os-brick to attach iSCSI Volume {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 16:33:58 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf084702-ab76-489d-a04f-0ea059dd9e13 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lDgMFYAT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:33:58 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-bf084702-ab76-489d-a04f-0ea059dd9e13 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:33:58 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-bf084702-ab76-489d-a04f-0ea059dd9e13 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:33:58 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-bf084702-ab76-489d-a04f-0ea059dd9e13 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:33:58 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-bf084702-ab76-489d-a04f-0ea059dd9e13 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:33:58 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-bf084702-ab76-489d-a04f-0ea059dd9e13 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:33:58 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-bf084702-ab76-489d-a04f-0ea059dd9e13 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:33:58 user nova-compute[75245]: INFO os_brick.initiator.connectors.iscsi [None req-bf084702-ab76-489d-a04f-0ea059dd9e13 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 16:33:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf -p 172.16.0.220:3260 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:33:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:33:58 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82e7d7d-0ab0-4f13-b61f-f0862565b71d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:33:58 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf084702-ab76-489d-a04f-0ea059dd9e13 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 16:33:58 user nova-compute[75245]:  {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:33:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf -p 172.16.0.220:3260 --interface default --op new {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:33:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:33:58 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[5248d0e8-f091-4917-a8e5-b4753769d2b7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf] added\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:33:58 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf084702-ab76-489d-a04f-0ea059dd9e13 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf] added
Nov 29 16:33:58 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:33:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:33:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.035s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:33:58 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[58abf357-c97b-4e36-a364-aa6a83648f39]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:33:58 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf084702-ab76-489d-a04f-0ea059dd9e13 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:33:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:33:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:33:58 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb48b590-6496-4e64-92e8-11cf1de9fa3b]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:33:58 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf084702-ab76-489d-a04f-0ea059dd9e13 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:33:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lDgMFYAT {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:33:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lDgMFYAT" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:33:58 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3220f47-e38d-4543-a8b7-e6daa4541bcf]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:33:58 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf084702-ab76-489d-a04f-0ea059dd9e13 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lDgMFYAT'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:33:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:33:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:33:58 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ad3f4d-b15e-488e-b49c-24e954437351]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:33:58 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf084702-ab76-489d-a04f-0ea059dd9e13 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:33:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:33:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:33:58 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef3e636-0a46-4fc2-ab1b-0bf3e12fc255]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298a22d2-7a11-4639-bfae-04f0e4a0716e (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:33:58 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf084702-ab76-489d-a04f-0ea059dd9e13 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)
Nov 29 16:33:58 user nova-compute[75245]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4 (non-flash)
Nov 29 16:33:58 user nova-compute[75245]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298a22d2-7a11-4639-bfae-04f0e4a0716e (non-flash)
Nov 29 16:33:58 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:33:58 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf084702-ab76-489d-a04f-0ea059dd9e13 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)
Nov 29 16:33:58 user nova-compute[75245]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4 (non-flash)
Nov 29 16:33:58 user nova-compute[75245]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298a22d2-7a11-4639-bfae-04f0e4a0716e (non-flash)
Nov 29 16:33:58 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:33:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf -p 172.16.0.220:3260 --login {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:33:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:33:58 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fbd90a7-3276-4ecb-8a66-4e6000037bd8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:33:58 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf084702-ab76-489d-a04f-0ea059dd9e13 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf, portal: 172.16.0.220,3260]
Nov 29 16:33:58 user nova-compute[75245]: Login to [iface: default, target: iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf, portal: 172.16.0.220,3260] successful.
Nov 29 16:33:58 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:33:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:33:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:33:58 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa86f04-2131-49f8-ae84-145316a7e505]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:33:58 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf084702-ab76-489d-a04f-0ea059dd9e13 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:33:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:33:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:33:58 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d64026-ef7e-49e4-905c-671be3ecdee7]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298a22d2-7a11-4639-bfae-04f0e4a0716e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:33:58 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf084702-ab76-489d-a04f-0ea059dd9e13 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)
Nov 29 16:33:58 user nova-compute[75245]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4 (non-flash)
Nov 29 16:33:58 user nova-compute[75245]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298a22d2-7a11-4639-bfae-04f0e4a0716e (non-flash)
Nov 29 16:33:58 user nova-compute[75245]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf (non-flash)
Nov 29 16:33:58 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:33:58 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf084702-ab76-489d-a04f-0ea059dd9e13 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)
Nov 29 16:33:58 user nova-compute[75245]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4 (non-flash)
Nov 29 16:33:58 user nova-compute[75245]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298a22d2-7a11-4639-bfae-04f0e4a0716e (non-flash)
Nov 29 16:33:58 user nova-compute[75245]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf (non-flash)
Nov 29 16:33:58 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:33:58 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-bf084702-ab76-489d-a04f-0ea059dd9e13 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:33:58 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf084702-ab76-489d-a04f-0ea059dd9e13 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Connected to 172.16.0.220:3260 {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 16:33:58 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-bf084702-ab76-489d-a04f-0ea059dd9e13 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] HCTL ('35', '-', '-', 0) found on session 38 with lun 0 {{(pid=75245) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 16:33:58 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-bf084702-ab76-489d-a04f-0ea059dd9e13 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75245) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 16:33:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:33:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:33:58 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[923f0745-c94a-49d4-851d-227ed4ed1c68]: (4, ('- - 0', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:33:58 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-bf084702-ab76-489d-a04f-0ea059dd9e13 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Searching for a device in session 38 and hctl ['35', '*', '*', 0] yield: None {{(pid=75245) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 16:33:59 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-bf084702-ab76-489d-a04f-0ea059dd9e13 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Searching for a device in session 38 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75245) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 16:33:59 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf084702-ab76-489d-a04f-0ea059dd9e13 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lDgMFYAT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 16:33:59 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-bf084702-ab76-489d-a04f-0ea059dd9e13 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:33:59 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf084702-ab76-489d-a04f-0ea059dd9e13 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '26134663332366264', 'path': '/dev/sdd'} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:33:59 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf084702-ab76-489d-a04f-0ea059dd9e13 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26134663332366264', 'path': '/dev/sdd'} {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 16:33:59 user nova-compute[75245]: DEBUG nova.objects.instance [None req-bf084702-ab76-489d-a04f-0ea059dd9e13 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Lazy-loading 'flavor' on Instance uuid 0f4fa79b-345a-4e58-a77c-fdfed675e6e7 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:33:59 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-bf084702-ab76-489d-a04f-0ea059dd9e13 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 16:33:59 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:33:59 user nova-compute[75245]:   <source dev="/dev/sdd"/>
Nov 29 16:33:59 user nova-compute[75245]:   <target dev="vdb" bus="virtio"/>
Nov 29 16:33:59 user nova-compute[75245]:   <serial>5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf</serial>
Nov 29 16:33:59 user nova-compute[75245]: </disk>
Nov 29 16:33:59 user nova-compute[75245]:  {{(pid=75245) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 16:33:59 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-bf084702-ab76-489d-a04f-0ea059dd9e13 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:33:59 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-bf084702-ab76-489d-a04f-0ea059dd9e13 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:33:59 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-bf084702-ab76-489d-a04f-0ea059dd9e13 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] No VIF found with MAC fa:16:3e:12:d2:ca, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:34:00 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-bf084702-ab76-489d-a04f-0ea059dd9e13 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Lock "0f4fa79b-345a-4e58-a77c-fdfed675e6e7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.515s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:34:00 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:34:00 user nova-compute[75245]: INFO nova.compute.manager [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Rescuing
Nov 29 16:34:00 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Acquiring lock "refresh_cache-0f4fa79b-345a-4e58-a77c-fdfed675e6e7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:34:00 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Acquired lock "refresh_cache-0f4fa79b-345a-4e58-a77c-fdfed675e6e7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:34:00 user nova-compute[75245]: DEBUG nova.network.neutron [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 16:34:00 user nova-compute[75245]: INFO nova.compute.manager [None req-a3b6117b-1909-4bb2-a226-7c3b25993437 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Unrescuing
Nov 29 16:34:00 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-a3b6117b-1909-4bb2-a226-7c3b25993437 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Acquiring lock "refresh_cache-26acb3c4-b081-4670-a6b5-d40583c23592" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:34:00 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-a3b6117b-1909-4bb2-a226-7c3b25993437 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Acquired lock "refresh_cache-26acb3c4-b081-4670-a6b5-d40583c23592" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:34:00 user nova-compute[75245]: DEBUG nova.network.neutron [None req-a3b6117b-1909-4bb2-a226-7c3b25993437 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 16:34:00 user nova-compute[75245]: DEBUG nova.network.neutron [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Updating instance_info_cache with network_info: [{"id": "0b59ddaf-c343-420d-9cf5-93d5fa48bc23", "address": "fa:16:3e:12:d2:ca", "network": {"id": "74420114-8c7f-4f7b-9589-8605e1a2b922", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1124145478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12ae03075ca94c57af11198359d26514", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b59ddaf-c3", "ovs_interfaceid": "0b59ddaf-c343-420d-9cf5-93d5fa48bc23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:34:01 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Releasing lock "refresh_cache-0f4fa79b-345a-4e58-a77c-fdfed675e6e7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:34:01 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:34:01 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:34:01 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:34:01 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:34:01 user nova-compute[75245]: DEBUG nova.network.neutron [None req-a3b6117b-1909-4bb2-a226-7c3b25993437 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Updating instance_info_cache with network_info: [{"id": "eeb0edc6-31dc-4bbf-abc4-331ed86156a1", "address": "fa:16:3e:78:78:ae", "network": {"id": "6a7f7426-b595-4aa3-bf80-cc92ba7ce15e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-917300903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d52776451e947f5a9ef3fa44ac8acbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb0edc6-31", "ovs_interfaceid": "eeb0edc6-31dc-4bbf-abc4-331ed86156a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:34:01 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-a3b6117b-1909-4bb2-a226-7c3b25993437 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Releasing lock "refresh_cache-26acb3c4-b081-4670-a6b5-d40583c23592" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:34:01 user nova-compute[75245]: DEBUG nova.objects.instance [None req-a3b6117b-1909-4bb2-a226-7c3b25993437 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lazy-loading 'flavor' on Instance uuid 26acb3c4-b081-4670-a6b5-d40583c23592 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:34:01 user nova-compute[75245]: DEBUG nova.compute.manager [req-5df7452f-5979-47d7-9723-931f3cf268ad req-5e51037f-3a01-47a5-acaf-2bdc5ce47ba4 service nova] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Received event network-vif-unplugged-0b59ddaf-c343-420d-9cf5-93d5fa48bc23 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:34:01 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-5df7452f-5979-47d7-9723-931f3cf268ad req-5e51037f-3a01-47a5-acaf-2bdc5ce47ba4 service nova] Acquiring lock "0f4fa79b-345a-4e58-a77c-fdfed675e6e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:34:01 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-5df7452f-5979-47d7-9723-931f3cf268ad req-5e51037f-3a01-47a5-acaf-2bdc5ce47ba4 service nova] Lock "0f4fa79b-345a-4e58-a77c-fdfed675e6e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:34:01 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-5df7452f-5979-47d7-9723-931f3cf268ad req-5e51037f-3a01-47a5-acaf-2bdc5ce47ba4 service nova] Lock "0f4fa79b-345a-4e58-a77c-fdfed675e6e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:34:01 user nova-compute[75245]: DEBUG nova.compute.manager [req-5df7452f-5979-47d7-9723-931f3cf268ad req-5e51037f-3a01-47a5-acaf-2bdc5ce47ba4 service nova] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] No waiting events found dispatching network-vif-unplugged-0b59ddaf-c343-420d-9cf5-93d5fa48bc23 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:34:01 user nova-compute[75245]: WARNING nova.compute.manager [req-5df7452f-5979-47d7-9723-931f3cf268ad req-5e51037f-3a01-47a5-acaf-2bdc5ce47ba4 service nova] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Received unexpected event network-vif-unplugged-0b59ddaf-c343-420d-9cf5-93d5fa48bc23 for instance with vm_state active and task_state rescuing.
Nov 29 16:34:01 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:34:01 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:34:01 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:34:01 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:34:01 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:34:02 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:34:02 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:34:02 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:34:02 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:34:02 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Instance destroyed successfully.
Nov 29 16:34:02 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Attempting a stable device rescue
Nov 29 16:34:02 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Instance destroyed successfully.
Nov 29 16:34:02 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:34:02 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=75245) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 29 16:34:02 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Instance directory exists: not creating {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 16:34:02 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Creating image(s)
Nov 29 16:34:02 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Acquiring lock "/opt/stack/data/nova/instances/0f4fa79b-345a-4e58-a77c-fdfed675e6e7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:34:02 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Lock "/opt/stack/data/nova/instances/0f4fa79b-345a-4e58-a77c-fdfed675e6e7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:34:02 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Lock "/opt/stack/data/nova/instances/0f4fa79b-345a-4e58-a77c-fdfed675e6e7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:34:02 user nova-compute[75245]: DEBUG nova.objects.instance [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0f4fa79b-345a-4e58-a77c-fdfed675e6e7 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:34:02 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Acquiring lock "573aa58529069529738f3e1c5de4a66818b0e23d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:34:02 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Lock "573aa58529069529738f3e1c5de4a66818b0e23d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:34:02 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:34:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/573aa58529069529738f3e1c5de4a66818b0e23d.part --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:34:03 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:34:03 user nova-compute[75245]: DEBUG nova.compute.manager [req-63ee8f59-9f1e-4524-b783-70ad24ace954 req-08ad4fa2-bafd-4305-80fb-7262ec844be2 service nova] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Received event network-vif-plugged-0b59ddaf-c343-420d-9cf5-93d5fa48bc23 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:34:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-63ee8f59-9f1e-4524-b783-70ad24ace954 req-08ad4fa2-bafd-4305-80fb-7262ec844be2 service nova] Acquiring lock "0f4fa79b-345a-4e58-a77c-fdfed675e6e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:34:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-63ee8f59-9f1e-4524-b783-70ad24ace954 req-08ad4fa2-bafd-4305-80fb-7262ec844be2 service nova] Lock "0f4fa79b-345a-4e58-a77c-fdfed675e6e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:34:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-63ee8f59-9f1e-4524-b783-70ad24ace954 req-08ad4fa2-bafd-4305-80fb-7262ec844be2 service nova] Lock "0f4fa79b-345a-4e58-a77c-fdfed675e6e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:34:03 user nova-compute[75245]: DEBUG nova.compute.manager [req-63ee8f59-9f1e-4524-b783-70ad24ace954 req-08ad4fa2-bafd-4305-80fb-7262ec844be2 service nova] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] No waiting events found dispatching network-vif-plugged-0b59ddaf-c343-420d-9cf5-93d5fa48bc23 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:34:03 user nova-compute[75245]: WARNING nova.compute.manager [req-63ee8f59-9f1e-4524-b783-70ad24ace954 req-08ad4fa2-bafd-4305-80fb-7262ec844be2 service nova] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Received unexpected event network-vif-plugged-0b59ddaf-c343-420d-9cf5-93d5fa48bc23 for instance with vm_state active and task_state rescuing.
Nov 29 16:34:03 user nova-compute[75245]: DEBUG nova.compute.manager [req-63ee8f59-9f1e-4524-b783-70ad24ace954 req-08ad4fa2-bafd-4305-80fb-7262ec844be2 service nova] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Received event network-vif-unplugged-eeb0edc6-31dc-4bbf-abc4-331ed86156a1 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:34:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-63ee8f59-9f1e-4524-b783-70ad24ace954 req-08ad4fa2-bafd-4305-80fb-7262ec844be2 service nova] Acquiring lock "26acb3c4-b081-4670-a6b5-d40583c23592-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:34:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-63ee8f59-9f1e-4524-b783-70ad24ace954 req-08ad4fa2-bafd-4305-80fb-7262ec844be2 service nova] Lock "26acb3c4-b081-4670-a6b5-d40583c23592-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:34:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-63ee8f59-9f1e-4524-b783-70ad24ace954 req-08ad4fa2-bafd-4305-80fb-7262ec844be2 service nova] Lock "26acb3c4-b081-4670-a6b5-d40583c23592-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:34:03 user nova-compute[75245]: DEBUG nova.compute.manager [req-63ee8f59-9f1e-4524-b783-70ad24ace954 req-08ad4fa2-bafd-4305-80fb-7262ec844be2 service nova] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] No waiting events found dispatching network-vif-unplugged-eeb0edc6-31dc-4bbf-abc4-331ed86156a1 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:34:03 user nova-compute[75245]: WARNING nova.compute.manager [req-63ee8f59-9f1e-4524-b783-70ad24ace954 req-08ad4fa2-bafd-4305-80fb-7262ec844be2 service nova] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Received unexpected event network-vif-unplugged-eeb0edc6-31dc-4bbf-abc4-331ed86156a1 for instance with vm_state rescued and task_state unrescuing.
Nov 29 16:34:03 user nova-compute[75245]: DEBUG nova.compute.manager [req-63ee8f59-9f1e-4524-b783-70ad24ace954 req-08ad4fa2-bafd-4305-80fb-7262ec844be2 service nova] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Received event network-vif-plugged-eeb0edc6-31dc-4bbf-abc4-331ed86156a1 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:34:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-63ee8f59-9f1e-4524-b783-70ad24ace954 req-08ad4fa2-bafd-4305-80fb-7262ec844be2 service nova] Acquiring lock "26acb3c4-b081-4670-a6b5-d40583c23592-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:34:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-63ee8f59-9f1e-4524-b783-70ad24ace954 req-08ad4fa2-bafd-4305-80fb-7262ec844be2 service nova] Lock "26acb3c4-b081-4670-a6b5-d40583c23592-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:34:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-63ee8f59-9f1e-4524-b783-70ad24ace954 req-08ad4fa2-bafd-4305-80fb-7262ec844be2 service nova] Lock "26acb3c4-b081-4670-a6b5-d40583c23592-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:34:03 user nova-compute[75245]: DEBUG nova.compute.manager [req-63ee8f59-9f1e-4524-b783-70ad24ace954 req-08ad4fa2-bafd-4305-80fb-7262ec844be2 service nova] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] No waiting events found dispatching network-vif-plugged-eeb0edc6-31dc-4bbf-abc4-331ed86156a1 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:34:03 user nova-compute[75245]: WARNING nova.compute.manager [req-63ee8f59-9f1e-4524-b783-70ad24ace954 req-08ad4fa2-bafd-4305-80fb-7262ec844be2 service nova] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Received unexpected event network-vif-plugged-eeb0edc6-31dc-4bbf-abc4-331ed86156a1 for instance with vm_state rescued and task_state unrescuing.
Nov 29 16:34:03 user nova-compute[75245]: DEBUG nova.compute.manager [req-63ee8f59-9f1e-4524-b783-70ad24ace954 req-08ad4fa2-bafd-4305-80fb-7262ec844be2 service nova] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Received event network-vif-plugged-eeb0edc6-31dc-4bbf-abc4-331ed86156a1 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:34:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-63ee8f59-9f1e-4524-b783-70ad24ace954 req-08ad4fa2-bafd-4305-80fb-7262ec844be2 service nova] Acquiring lock "26acb3c4-b081-4670-a6b5-d40583c23592-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:34:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-63ee8f59-9f1e-4524-b783-70ad24ace954 req-08ad4fa2-bafd-4305-80fb-7262ec844be2 service nova] Lock "26acb3c4-b081-4670-a6b5-d40583c23592-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:34:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-63ee8f59-9f1e-4524-b783-70ad24ace954 req-08ad4fa2-bafd-4305-80fb-7262ec844be2 service nova] Lock "26acb3c4-b081-4670-a6b5-d40583c23592-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:34:03 user nova-compute[75245]: DEBUG nova.compute.manager [req-63ee8f59-9f1e-4524-b783-70ad24ace954 req-08ad4fa2-bafd-4305-80fb-7262ec844be2 service nova] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] No waiting events found dispatching network-vif-plugged-eeb0edc6-31dc-4bbf-abc4-331ed86156a1 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:34:03 user nova-compute[75245]: WARNING nova.compute.manager [req-63ee8f59-9f1e-4524-b783-70ad24ace954 req-08ad4fa2-bafd-4305-80fb-7262ec844be2 service nova] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Received unexpected event network-vif-plugged-eeb0edc6-31dc-4bbf-abc4-331ed86156a1 for instance with vm_state rescued and task_state unrescuing.
Nov 29 16:34:03 user nova-compute[75245]: DEBUG nova.compute.manager [req-63ee8f59-9f1e-4524-b783-70ad24ace954 req-08ad4fa2-bafd-4305-80fb-7262ec844be2 service nova] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Received event network-vif-plugged-eeb0edc6-31dc-4bbf-abc4-331ed86156a1 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:34:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-63ee8f59-9f1e-4524-b783-70ad24ace954 req-08ad4fa2-bafd-4305-80fb-7262ec844be2 service nova] Acquiring lock "26acb3c4-b081-4670-a6b5-d40583c23592-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:34:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-63ee8f59-9f1e-4524-b783-70ad24ace954 req-08ad4fa2-bafd-4305-80fb-7262ec844be2 service nova] Lock "26acb3c4-b081-4670-a6b5-d40583c23592-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:34:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-63ee8f59-9f1e-4524-b783-70ad24ace954 req-08ad4fa2-bafd-4305-80fb-7262ec844be2 service nova] Lock "26acb3c4-b081-4670-a6b5-d40583c23592-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:34:03 user nova-compute[75245]: DEBUG nova.compute.manager [req-63ee8f59-9f1e-4524-b783-70ad24ace954 req-08ad4fa2-bafd-4305-80fb-7262ec844be2 service nova] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] No waiting events found dispatching network-vif-plugged-eeb0edc6-31dc-4bbf-abc4-331ed86156a1 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:34:03 user nova-compute[75245]: WARNING nova.compute.manager [req-63ee8f59-9f1e-4524-b783-70ad24ace954 req-08ad4fa2-bafd-4305-80fb-7262ec844be2 service nova] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Received unexpected event network-vif-plugged-eeb0edc6-31dc-4bbf-abc4-331ed86156a1 for instance with vm_state rescued and task_state unrescuing.
Nov 29 16:34:03 user nova-compute[75245]: DEBUG nova.compute.manager [req-63ee8f59-9f1e-4524-b783-70ad24ace954 req-08ad4fa2-bafd-4305-80fb-7262ec844be2 service nova] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Received event network-vif-unplugged-eeb0edc6-31dc-4bbf-abc4-331ed86156a1 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:34:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-63ee8f59-9f1e-4524-b783-70ad24ace954 req-08ad4fa2-bafd-4305-80fb-7262ec844be2 service nova] Acquiring lock "26acb3c4-b081-4670-a6b5-d40583c23592-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:34:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-63ee8f59-9f1e-4524-b783-70ad24ace954 req-08ad4fa2-bafd-4305-80fb-7262ec844be2 service nova] Lock "26acb3c4-b081-4670-a6b5-d40583c23592-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:34:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-63ee8f59-9f1e-4524-b783-70ad24ace954 req-08ad4fa2-bafd-4305-80fb-7262ec844be2 service nova] Lock "26acb3c4-b081-4670-a6b5-d40583c23592-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:34:03 user nova-compute[75245]: DEBUG nova.compute.manager [req-63ee8f59-9f1e-4524-b783-70ad24ace954 req-08ad4fa2-bafd-4305-80fb-7262ec844be2 service nova] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] No waiting events found dispatching network-vif-unplugged-eeb0edc6-31dc-4bbf-abc4-331ed86156a1 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:34:03 user nova-compute[75245]: WARNING nova.compute.manager [req-63ee8f59-9f1e-4524-b783-70ad24ace954 req-08ad4fa2-bafd-4305-80fb-7262ec844be2 service nova] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Received unexpected event network-vif-unplugged-eeb0edc6-31dc-4bbf-abc4-331ed86156a1 for instance with vm_state rescued and task_state unrescuing.
Nov 29 16:34:03 user nova-compute[75245]: DEBUG nova.compute.manager [req-63ee8f59-9f1e-4524-b783-70ad24ace954 req-08ad4fa2-bafd-4305-80fb-7262ec844be2 service nova] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Received event network-vif-plugged-eeb0edc6-31dc-4bbf-abc4-331ed86156a1 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:34:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-63ee8f59-9f1e-4524-b783-70ad24ace954 req-08ad4fa2-bafd-4305-80fb-7262ec844be2 service nova] Acquiring lock "26acb3c4-b081-4670-a6b5-d40583c23592-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:34:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-63ee8f59-9f1e-4524-b783-70ad24ace954 req-08ad4fa2-bafd-4305-80fb-7262ec844be2 service nova] Lock "26acb3c4-b081-4670-a6b5-d40583c23592-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:34:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-63ee8f59-9f1e-4524-b783-70ad24ace954 req-08ad4fa2-bafd-4305-80fb-7262ec844be2 service nova] Lock "26acb3c4-b081-4670-a6b5-d40583c23592-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:34:03 user nova-compute[75245]: DEBUG nova.compute.manager [req-63ee8f59-9f1e-4524-b783-70ad24ace954 req-08ad4fa2-bafd-4305-80fb-7262ec844be2 service nova] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] No waiting events found dispatching network-vif-plugged-eeb0edc6-31dc-4bbf-abc4-331ed86156a1 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:34:03 user nova-compute[75245]: WARNING nova.compute.manager [req-63ee8f59-9f1e-4524-b783-70ad24ace954 req-08ad4fa2-bafd-4305-80fb-7262ec844be2 service nova] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Received unexpected event network-vif-plugged-eeb0edc6-31dc-4bbf-abc4-331ed86156a1 for instance with vm_state rescued and task_state unrescuing.
Nov 29 16:34:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/573aa58529069529738f3e1c5de4a66818b0e23d.part --force-share --output=json" returned: 0 in 0.182s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:34:03 user nova-compute[75245]: DEBUG nova.virt.images [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] d42fa991-056c-4740-9019-486b8ab31322 was qcow2, converting to raw {{(pid=75245) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 16:34:03 user nova-compute[75245]: DEBUG nova.privsep.utils [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75245) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 16:34:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/573aa58529069529738f3e1c5de4a66818b0e23d.part /opt/stack/data/nova/instances/_base/573aa58529069529738f3e1c5de4a66818b0e23d.converted {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:34:03 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:34:03 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:34:03 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:34:03 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:34:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/573aa58529069529738f3e1c5de4a66818b0e23d.part /opt/stack/data/nova/instances/_base/573aa58529069529738f3e1c5de4a66818b0e23d.converted" returned: 0 in 0.255s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:34:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/573aa58529069529738f3e1c5de4a66818b0e23d.converted --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/573aa58529069529738f3e1c5de4a66818b0e23d.converted --force-share --output=json" returned: 0 in 0.175s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Lock "573aa58529069529738f3e1c5de4a66818b0e23d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.749s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Acquiring lock "573aa58529069529738f3e1c5de4a66818b0e23d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Lock "573aa58529069529738f3e1c5de4a66818b0e23d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/573aa58529069529738f3e1c5de4a66818b0e23d --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/573aa58529069529738f3e1c5de4a66818b0e23d --force-share --output=json" returned: 0 in 0.173s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/573aa58529069529738f3e1c5de4a66818b0e23d,backing_fmt=raw /opt/stack/data/nova/instances/0f4fa79b-345a-4e58-a77c-fdfed675e6e7/disk.rescue {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/573aa58529069529738f3e1c5de4a66818b0e23d,backing_fmt=raw /opt/stack/data/nova/instances/0f4fa79b-345a-4e58-a77c-fdfed675e6e7/disk.rescue" returned: 0 in 0.048s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Lock "573aa58529069529738f3e1c5de4a66818b0e23d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG nova.objects.instance [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Lazy-loading 'migration_context' on Instance uuid 0f4fa79b-345a-4e58-a77c-fdfed675e6e7 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG nova.objects.base [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Object Instance<0f4fa79b-345a-4e58-a77c-fdfed675e6e7> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75245) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Created local disks {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Start _get_guest_xml network_info=[{"id": "0b59ddaf-c343-420d-9cf5-93d5fa48bc23", "address": "fa:16:3e:12:d2:ca", "network": {"id": "74420114-8c7f-4f7b-9589-8605e1a2b922", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1124145478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1124145478-network", "vif_mac": "fa:16:3e:12:d2:ca"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12ae03075ca94c57af11198359d26514", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b59ddaf-c3", "ovs_interfaceid": "0b59ddaf-c343-420d-9cf5-93d5fa48bc23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'd42fa991-056c-4740-9019-486b8ab31322', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'a291d9c3-be02-4c6c-9649-4b45c5b7f487'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'attachment_id': '4d0921e8-6d6a-4584-8798-7effdaa1c43e', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lDgMFYAT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '0f4fa79b-345a-4e58-a77c-fdfed675e6e7', 'attached_at': '', 'detached_at': '', 'volume_id': '5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf', 'serial': '5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'guest_format': None, 'volume_type': None} {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG nova.objects.instance [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Lazy-loading 'resources' on Instance uuid 0f4fa79b-345a-4e58-a77c-fdfed675e6e7 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG nova.objects.base [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Object Instance<0f4fa79b-345a-4e58-a77c-fdfed675e6e7> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75245) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG nova.objects.instance [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Lazy-loading 'numa_topology' on Instance uuid 0f4fa79b-345a-4e58-a77c-fdfed675e6e7 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG nova.objects.base [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Object Instance<0f4fa79b-345a-4e58-a77c-fdfed675e6e7> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75245) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 16:34:04 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:34:04 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:34:04 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] CPU controller missing on host. {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] CPU controller found on host. {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75245) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T16:06:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Flavor limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Image limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Flavor pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Image pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Got 1 possible topologies {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG nova.objects.instance [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0f4fa79b-345a-4e58-a77c-fdfed675e6e7 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG nova.objects.base [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Object Instance<0f4fa79b-345a-4e58-a77c-fdfed675e6e7> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75245) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Calling os-brick to attach iSCSI Volume {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lDgMFYAT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:34:04 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:34:04 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:34:04 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:34:04 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:34:04 user nova-compute[75245]: INFO os_brick.initiator.connectors.iscsi [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 16:34:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf -p 172.16.0.220:3260 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[1030c231-fb7b-43df-9550-1dd1e3402b8c]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = lDgMFYAT\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 29 16:34:04 user nova-compute[75245]: node.name = iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf
Nov 29 16:34:04 user nova-compute[75245]: node.tpgt = -1
Nov 29 16:34:04 user nova-compute[75245]: node.startup = automatic
Nov 29 16:34:04 user nova-compute[75245]: node.leading_login = No
Nov 29 16:34:04 user nova-compute[75245]: iface.iscsi_ifacename = default
Nov 29 16:34:04 user nova-compute[75245]: iface.net_ifacename = <empty>
Nov 29 16:34:04 user nova-compute[75245]: iface.ipaddress = <empty>
Nov 29 16:34:04 user nova-compute[75245]: iface.prefix_len = 0
Nov 29 16:34:04 user nova-compute[75245]: iface.hwaddress = <empty>
Nov 29 16:34:04 user nova-compute[75245]: iface.transport_name = tcp
Nov 29 16:34:04 user nova-compute[75245]: iface.initiatorname = <empty>
Nov 29 16:34:04 user nova-compute[75245]: iface.state = <empty>
Nov 29 16:34:04 user nova-compute[75245]: iface.vlan_id = 0
Nov 29 16:34:04 user nova-compute[75245]: iface.vlan_priority = 0
Nov 29 16:34:04 user nova-compute[75245]: iface.vlan_state = <empty>
Nov 29 16:34:04 user nova-compute[75245]: iface.iface_num = 0
Nov 29 16:34:04 user nova-compute[75245]: iface.mtu = 0
Nov 29 16:34:04 user nova-compute[75245]: iface.port = 0
Nov 29 16:34:04 user nova-compute[75245]: iface.bootproto = <empty>
Nov 29 16:34:04 user nova-compute[75245]: iface.subnet_mask = <empty>
Nov 29 16:34:04 user nova-compute[75245]: iface.gateway = <empty>
Nov 29 16:34:04 user nova-compute[75245]: iface.dhcp_alt_client_id_state = <empty>
Nov 29 16:34:04 user nova-compute[75245]: iface.dhcp_alt_client_id = <empty>
Nov 29 16:34:04 user nova-compute[75245]: iface.dhcp_dns = <empty>
Nov 29 16:34:04 user nova-compute[75245]: iface.dhcp_learn_iqn = <empty>
Nov 29 16:34:04 user nova-compute[75245]: iface.dhcp_req_vendor_id_state = <empty>
Nov 29 16:34:04 user nova-compute[75245]: iface.dhcp_vendor_id_state = <empty>
Nov 29 16:34:04 user nova-compute[75245]: iface.dhcp_vendor_id = <empty>
Nov 29 16:34:04 user nova-compute[75245]: iface.dhcp_slp_da = <empty>
Nov 29 16:34:04 user nova-compute[75245]: iface.fragmentation = <empty>
Nov 29 16:34:04 user nova-compute[75245]: iface.gratuitous_arp = <empty>
Nov 29 16:34:04 user nova-compute[75245]: iface.incoming_forwarding = <empty>
Nov 29 16:34:04 user nova-compute[75245]: iface.tos_state = <empty>
Nov 29 16:34:04 user nova-compute[75245]: iface.tos = 0
Nov 29 16:34:04 user nova-compute[75245]: iface.ttl = 0
Nov 29 16:34:04 user nova-compute[75245]: iface.delayed_ack = <empty>
Nov 29 16:34:04 user nova-compute[75245]: iface.tcp_nagle = <empty>
Nov 29 16:34:04 user nova-compute[75245]: iface.tcp_wsf_state = <empty>
Nov 29 16:34:04 user nova-compute[75245]: iface.tcp_wsf = 0
Nov 29 16:34:04 user nova-compute[75245]: iface.tcp_timer_scale = 0
Nov 29 16:34:04 user nova-compute[75245]: iface.tcp_timestamp = <empty>
Nov 29 16:34:04 user nova-compute[75245]: iface.redirect = <empty>
Nov 29 16:34:04 user nova-compute[75245]: iface.def_task_mgmt_timeout = 0
Nov 29 16:34:04 user nova-compute[75245]: iface.header_digest = <empty>
Nov 29 16:34:04 user nova-compute[75245]: iface.data_digest = <empty>
Nov 29 16:34:04 user nova-compute[75245]: iface.immediate_data = <empty>
Nov 29 16:34:04 user nova-compute[75245]: iface.initial_r2t = <empty>
Nov 29 16:34:04 user nova-compute[75245]: iface.data_seq_inorder = <empty>
Nov 29 16:34:04 user nova-compute[75245]: iface.data_pdu_inorder = <empty>
Nov 29 16:34:04 user nova-compute[75245]: iface.erl = 0
Nov 29 16:34:04 user nova-compute[75245]: iface.max_receive_data_len = 0
Nov 29 16:34:04 user nova-compute[75245]: iface.first_burst_len = 0
Nov 29 16:34:04 user nova-compute[75245]: iface.max_outstanding_r2t = 0
Nov 29 16:34:04 user nova-compute[75245]: iface.max_burst_len = 0
Nov 29 16:34:04 user nova-compute[75245]: iface.chap_auth = <empty>
Nov 29 16:34:04 user nova-compute[75245]: iface.bidi_chap = <empty>
Nov 29 16:34:04 user nova-compute[75245]: iface.strict_login_compliance = <empty>
Nov 29 16:34:04 user nova-compute[75245]: iface.discovery_auth = <empty>
Nov 29 16:34:04 user nova-compute[75245]: iface.discovery_logout = <empty>
Nov 29 16:34:04 user nova-compute[75245]: node.discovery_address = <empty>
Nov 29 16:34:04 user nova-compute[75245]: node.discovery_port = 0
Nov 29 16:34:04 user nova-compute[75245]: node.discovery_type = static
Nov 29 16:34:04 user nova-compute[75245]: node.session.initial_cmdsn = 0
Nov 29 16:34:04 user nova-compute[75245]: node.session.initial_login_retry_max = 8
Nov 29 16:34:04 user nova-compute[75245]: node.session.xmit_thread_priority = -20
Nov 29 16:34:04 user nova-compute[75245]: node.session.cmds_max = 128
Nov 29 16:34:04 user nova-compute[75245]: node.session.queue_depth = 32
Nov 29 16:34:04 user nova-compute[75245]: node.session.nr_sessions = 1
Nov 29 16:34:04 user nova-compute[75245]: node.session.auth.authmethod = CHAP
Nov 29 16:34:04 user nova-compute[75245]: node.session.auth.username = lDgMFYAT
Nov 29 16:34:04 user nova-compute[75245]: node.session.auth.password = ***
Nov 29 16:34:04 user nova-compute[75245]: node.session.auth.username_in = <empty>
Nov 29 16:34:04 user nova-compute[75245]: node.session.auth.password_in = <empty>
Nov 29 16:34:04 user nova-compute[75245]: node.session.auth.chap_algs = MD5
Nov 29 16:34:04 user nova-compute[75245]: node.session.timeo.replacement_timeout = 120
Nov 29 16:34:04 user nova-compute[75245]: node.session.err_timeo.abort_timeout = 15
Nov 29 16:34:04 user nova-compute[75245]: node.session.err_timeo.lu_reset_timeout = 30
Nov 29 16:34:04 user nova-compute[75245]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 29 16:34:04 user nova-compute[75245]: node.session.err_timeo.host_reset_timeout = 60
Nov 29 16:34:04 user nova-compute[75245]: node.session.iscsi.FastAbort = Yes
Nov 29 16:34:04 user nova-compute[75245]: node.session.iscsi.InitialR2T = No
Nov 29 16:34:04 user nova-compute[75245]: node.session.iscsi.ImmediateData = Yes
Nov 29 16:34:04 user nova-compute[75245]: node.session.iscsi.FirstBurstLength = 262144
Nov 29 16:34:04 user nova-compute[75245]: node.session.iscsi.MaxBurstLength = 16776192
Nov 29 16:34:04 user nova-compute[75245]: node.session.iscsi.DefaultTime2Retain = 0
Nov 29 16:34:04 user nova-compute[75245]: node.session.iscsi.DefaultTime2Wait = 2
Nov 29 16:34:04 user nova-compute[75245]: node.session.iscsi.MaxConnections = 1
Nov 29 16:34:04 user nova-compute[75245]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 29 16:34:04 user nova-compute[75245]: node.session.iscsi.ERL = 0
Nov 29 16:34:04 user nova-compute[75245]: node.session.scan = manual
Nov 29 16:34:04 user nova-compute[75245]: node.session.reopen_max = 0
Nov 29 16:34:04 user nova-compute[75245]: node.conn[0].address = 172.16.0.220
Nov 29 16:34:04 user nova-compute[75245]: node.conn[0].port = 3260
Nov 29 16:34:04 user nova-compute[75245]: node.conn[0].startup = manual
Nov 29 16:34:04 user nova-compute[75245]: node.conn[0].tcp.window_size = 524288
Nov 29 16:34:04 user nova-compute[75245]: node.conn[0].tcp.type_of_service = 0
Nov 29 16:34:04 user nova-compute[75245]: node.conn[0].timeo.logout_timeout = 15
Nov 29 16:34:04 user nova-compute[75245]: node.conn[0].timeo.login_timeout = 15
Nov 29 16:34:04 user nova-compute[75245]: node.conn[0].timeo.auth_timeout = 45
Nov 29 16:34:04 user nova-compute[75245]: node.conn[0].timeo.noop_out_interval = 5
Nov 29 16:34:04 user nova-compute[75245]: node.conn[0].timeo.noop_out_timeout = 5
Nov 29 16:34:04 user nova-compute[75245]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 29 16:34:04 user nova-compute[75245]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 29 16:34:04 user nova-compute[75245]: node.conn[0].iscsi.HeaderDigest = None
Nov 29 16:34:04 user nova-compute[75245]: node.conn[0].iscsi.DataDigest = None
Nov 29 16:34:04 user nova-compute[75245]: node.conn[0].iscsi.IFMarker = No
Nov 29 16:34:04 user nova-compute[75245]: node.conn[0].iscsi.OFMarker = No
Nov 29 16:34:04 user nova-compute[75245]: # END RECORD
Nov 29 16:34:04 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.063s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4933f7f-8b41-49ca-83ad-da90b2a1ada1]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[14572aaf-6ee9-4f48-9c32-4484490b23a5]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lDgMFYAT {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lDgMFYAT" returned: 0 in 0.024s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a48df7c-4840-48dd-a7ef-573834299c52]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lDgMFYAT'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[406d1e98-87b7-4efc-99e2-fb02ad6bb002]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[67cab27a-e78f-4c8b-8587-362dd27c3c9b]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298a22d2-7a11-4639-bfae-04f0e4a0716e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)
Nov 29 16:34:04 user nova-compute[75245]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4 (non-flash)
Nov 29 16:34:04 user nova-compute[75245]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298a22d2-7a11-4639-bfae-04f0e4a0716e (non-flash)
Nov 29 16:34:04 user nova-compute[75245]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf (non-flash)
Nov 29 16:34:04 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)
Nov 29 16:34:04 user nova-compute[75245]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4 (non-flash)
Nov 29 16:34:04 user nova-compute[75245]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298a22d2-7a11-4639-bfae-04f0e4a0716e (non-flash)
Nov 29 16:34:04 user nova-compute[75245]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf (non-flash)
Nov 29 16:34:04 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.207s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Connected to 172.16.0.220:3260 {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] HCTL ('35', '0', '0', 0) found on session 38 with lun 0 {{(pid=75245) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=75245) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.013s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[a970ad2d-d12b-421b-8ee3-2da38fdab333]: (4, ('0 0 0', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Searching for a device in session 38 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=75245) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lDgMFYAT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.230s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] <== connect_volume: return (232ms) {'type': 'block', 'scsi_wwn': '26134663332366264', 'path': '/dev/sdd'} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26134663332366264', 'path': '/dev/sdd'} {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:30:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-513385249',display_name='tempest-ServerStableDeviceRescueTest-server-513385249',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-513385249',id=29,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL1Z68o0lP6Hi7Hps1ExPAu//BM0Y3yUpeo20GOYYPdy96iUaa/DNByIByWzZ26Oh5Df0t6c9Eobojc//k6HPkTz9N7Nd3BYUDK2hhL44idE2i+iJ7tKl8lnWLgL/rJ52g==',key_name='tempest-keypair-502202166',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:30:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='12ae03075ca94c57af11198359d26514',ramdisk_id='',reservation_id='r-xnixzkar',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-101632514',owner_user_name='tempest-ServerStableDeviceRescueTest-101632514-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:32:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4222ccbed0bd4fa084e80d5c72cd9f58',uuid=0f4fa79b-345a-4e58-a77c-fdfed675e6e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0b59ddaf-c343-420d-9cf5-93d5fa48bc23", "address": "fa:16:3e:12:d2:ca", "network": {"id": "74420114-8c7f-4f7b-9589-8605e1a2b922", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1124145478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1124145478-network", "vif_mac": "fa:16:3e:12:d2:ca"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12ae03075ca94c57af11198359d26514", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b59ddaf-c3", "ovs_interfaceid": "0b59ddaf-c343-420d-9cf5-93d5fa48bc23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Converting VIF {"id": "0b59ddaf-c343-420d-9cf5-93d5fa48bc23", "address": "fa:16:3e:12:d2:ca", "network": {"id": "74420114-8c7f-4f7b-9589-8605e1a2b922", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1124145478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1124145478-network", "vif_mac": "fa:16:3e:12:d2:ca"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12ae03075ca94c57af11198359d26514", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b59ddaf-c3", "ovs_interfaceid": "0b59ddaf-c343-420d-9cf5-93d5fa48bc23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:12:d2:ca,bridge_name='br-int',has_traffic_filtering=True,id=0b59ddaf-c343-420d-9cf5-93d5fa48bc23,network=Network(74420114-8c7f-4f7b-9589-8605e1a2b922),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b59ddaf-c3') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG nova.objects.instance [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Lazy-loading 'pci_devices' on Instance uuid 0f4fa79b-345a-4e58-a77c-fdfed675e6e7 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG nova.objects.base [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Object Instance<0f4fa79b-345a-4e58-a77c-fdfed675e6e7> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75245) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] End _get_guest_xml xml=<domain type="kvm">
Nov 29 16:34:04 user nova-compute[75245]:   <uuid>0f4fa79b-345a-4e58-a77c-fdfed675e6e7</uuid>
Nov 29 16:34:04 user nova-compute[75245]:   <name>instance-0000001d</name>
Nov 29 16:34:04 user nova-compute[75245]:   <memory>524288</memory>
Nov 29 16:34:04 user nova-compute[75245]:   <vcpu>1</vcpu>
Nov 29 16:34:04 user nova-compute[75245]:   <metadata>
Nov 29 16:34:04 user nova-compute[75245]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 16:34:04 user nova-compute[75245]:       <nova:package version="0.0.0"/>
Nov 29 16:34:04 user nova-compute[75245]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-513385249</nova:name>
Nov 29 16:34:04 user nova-compute[75245]:       <nova:creationTime>2023-11-29 16:34:04</nova:creationTime>
Nov 29 16:34:04 user nova-compute[75245]:       <nova:flavor name="m1.tiny">
Nov 29 16:34:04 user nova-compute[75245]:         <nova:memory>512</nova:memory>
Nov 29 16:34:04 user nova-compute[75245]:         <nova:disk>1</nova:disk>
Nov 29 16:34:04 user nova-compute[75245]:         <nova:swap>0</nova:swap>
Nov 29 16:34:04 user nova-compute[75245]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 16:34:04 user nova-compute[75245]:         <nova:vcpus>1</nova:vcpus>
Nov 29 16:34:04 user nova-compute[75245]:       </nova:flavor>
Nov 29 16:34:04 user nova-compute[75245]:       <nova:owner>
Nov 29 16:34:04 user nova-compute[75245]:         <nova:user uuid="4222ccbed0bd4fa084e80d5c72cd9f58">tempest-ServerStableDeviceRescueTest-101632514-project-member</nova:user>
Nov 29 16:34:04 user nova-compute[75245]:         <nova:project uuid="12ae03075ca94c57af11198359d26514">tempest-ServerStableDeviceRescueTest-101632514</nova:project>
Nov 29 16:34:04 user nova-compute[75245]:       </nova:owner>
Nov 29 16:34:04 user nova-compute[75245]:       <nova:root type="image" uuid="a291d9c3-be02-4c6c-9649-4b45c5b7f487"/>
Nov 29 16:34:04 user nova-compute[75245]:       <nova:ports>
Nov 29 16:34:04 user nova-compute[75245]:         <nova:port uuid="0b59ddaf-c343-420d-9cf5-93d5fa48bc23">
Nov 29 16:34:04 user nova-compute[75245]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 29 16:34:04 user nova-compute[75245]:         </nova:port>
Nov 29 16:34:04 user nova-compute[75245]:       </nova:ports>
Nov 29 16:34:04 user nova-compute[75245]:     </nova:instance>
Nov 29 16:34:04 user nova-compute[75245]:   </metadata>
Nov 29 16:34:04 user nova-compute[75245]:   <sysinfo type="smbios">
Nov 29 16:34:04 user nova-compute[75245]:     <system>
Nov 29 16:34:04 user nova-compute[75245]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 16:34:04 user nova-compute[75245]:       <entry name="product">OpenStack Nova</entry>
Nov 29 16:34:04 user nova-compute[75245]:       <entry name="version">0.0.0</entry>
Nov 29 16:34:04 user nova-compute[75245]:       <entry name="serial">0f4fa79b-345a-4e58-a77c-fdfed675e6e7</entry>
Nov 29 16:34:04 user nova-compute[75245]:       <entry name="uuid">0f4fa79b-345a-4e58-a77c-fdfed675e6e7</entry>
Nov 29 16:34:04 user nova-compute[75245]:       <entry name="family">Virtual Machine</entry>
Nov 29 16:34:04 user nova-compute[75245]:     </system>
Nov 29 16:34:04 user nova-compute[75245]:   </sysinfo>
Nov 29 16:34:04 user nova-compute[75245]:   <os>
Nov 29 16:34:04 user nova-compute[75245]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 16:34:04 user nova-compute[75245]:     <smbios mode="sysinfo"/>
Nov 29 16:34:04 user nova-compute[75245]:   </os>
Nov 29 16:34:04 user nova-compute[75245]:   <features>
Nov 29 16:34:04 user nova-compute[75245]:     <acpi/>
Nov 29 16:34:04 user nova-compute[75245]:     <apic/>
Nov 29 16:34:04 user nova-compute[75245]:     <vmcoreinfo/>
Nov 29 16:34:04 user nova-compute[75245]:   </features>
Nov 29 16:34:04 user nova-compute[75245]:   <clock offset="utc">
Nov 29 16:34:04 user nova-compute[75245]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 16:34:04 user nova-compute[75245]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 16:34:04 user nova-compute[75245]:     <timer name="hpet" present="no"/>
Nov 29 16:34:04 user nova-compute[75245]:   </clock>
Nov 29 16:34:04 user nova-compute[75245]:   <cpu mode="custom" match="exact">
Nov 29 16:34:04 user nova-compute[75245]:     <model>Nehalem</model>
Nov 29 16:34:04 user nova-compute[75245]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 16:34:04 user nova-compute[75245]:   </cpu>
Nov 29 16:34:04 user nova-compute[75245]:   <devices>
Nov 29 16:34:04 user nova-compute[75245]:     <disk type="file" device="disk">
Nov 29 16:34:04 user nova-compute[75245]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 16:34:04 user nova-compute[75245]:       <source file="/opt/stack/data/nova/instances/0f4fa79b-345a-4e58-a77c-fdfed675e6e7/disk"/>
Nov 29 16:34:04 user nova-compute[75245]:       <target dev="vda" bus="virtio"/>
Nov 29 16:34:04 user nova-compute[75245]:     </disk>
Nov 29 16:34:04 user nova-compute[75245]:     <disk type="block" device="disk">
Nov 29 16:34:04 user nova-compute[75245]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:34:04 user nova-compute[75245]:       <source dev="/dev/sdd"/>
Nov 29 16:34:04 user nova-compute[75245]:       <target dev="vdb" bus="virtio"/>
Nov 29 16:34:04 user nova-compute[75245]:       <serial>5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf</serial>
Nov 29 16:34:04 user nova-compute[75245]:     </disk>
Nov 29 16:34:04 user nova-compute[75245]:     <disk type="file" device="disk">
Nov 29 16:34:04 user nova-compute[75245]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 16:34:04 user nova-compute[75245]:       <source file="/opt/stack/data/nova/instances/0f4fa79b-345a-4e58-a77c-fdfed675e6e7/disk.rescue"/>
Nov 29 16:34:04 user nova-compute[75245]:       <target dev="vdc" bus="virtio"/>
Nov 29 16:34:04 user nova-compute[75245]:       <boot order="1"/>
Nov 29 16:34:04 user nova-compute[75245]:     </disk>
Nov 29 16:34:04 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 16:34:04 user nova-compute[75245]:       <mac address="fa:16:3e:12:d2:ca"/>
Nov 29 16:34:04 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:34:04 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 16:34:04 user nova-compute[75245]:       <target dev="tap0b59ddaf-c3"/>
Nov 29 16:34:04 user nova-compute[75245]:     </interface>
Nov 29 16:34:04 user nova-compute[75245]:     <serial type="pty">
Nov 29 16:34:04 user nova-compute[75245]:       <log file="/opt/stack/data/nova/instances/0f4fa79b-345a-4e58-a77c-fdfed675e6e7/console.log" append="off"/>
Nov 29 16:34:04 user nova-compute[75245]:     </serial>
Nov 29 16:34:04 user nova-compute[75245]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 16:34:04 user nova-compute[75245]:     <video>
Nov 29 16:34:04 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:34:04 user nova-compute[75245]:     </video>
Nov 29 16:34:04 user nova-compute[75245]:     <rng model="virtio">
Nov 29 16:34:04 user nova-compute[75245]:       <backend model="random">/dev/urandom</backend>
Nov 29 16:34:04 user nova-compute[75245]:     </rng>
Nov 29 16:34:04 user nova-compute[75245]:     <controller type="usb" index="0" model="none"/>
Nov 29 16:34:04 user nova-compute[75245]:     <memballoon model="virtio">
Nov 29 16:34:04 user nova-compute[75245]:       <stats period="10"/>
Nov 29 16:34:04 user nova-compute[75245]:     </memballoon>
Nov 29 16:34:04 user nova-compute[75245]:   </devices>
Nov 29 16:34:04 user nova-compute[75245]: </domain>
Nov 29 16:34:04 user nova-compute[75245]:  {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 16:34:04 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Instance destroyed successfully.
Nov 29 16:34:04 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:34:04 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] No VIF found with MAC fa:16:3e:12:d2:ca, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:34:05 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:34:05 user nova-compute[75245]: DEBUG nova.compute.manager [req-68c2d245-6be4-45b4-b173-687aa991cba3 req-01480522-22ba-4f5f-b7f1-946cfb5f710c service nova] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Received event network-vif-plugged-eeb0edc6-31dc-4bbf-abc4-331ed86156a1 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:34:05 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-68c2d245-6be4-45b4-b173-687aa991cba3 req-01480522-22ba-4f5f-b7f1-946cfb5f710c service nova] Acquiring lock "26acb3c4-b081-4670-a6b5-d40583c23592-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:34:05 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-68c2d245-6be4-45b4-b173-687aa991cba3 req-01480522-22ba-4f5f-b7f1-946cfb5f710c service nova] Lock "26acb3c4-b081-4670-a6b5-d40583c23592-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:34:05 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-68c2d245-6be4-45b4-b173-687aa991cba3 req-01480522-22ba-4f5f-b7f1-946cfb5f710c service nova] Lock "26acb3c4-b081-4670-a6b5-d40583c23592-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:34:05 user nova-compute[75245]: DEBUG nova.compute.manager [req-68c2d245-6be4-45b4-b173-687aa991cba3 req-01480522-22ba-4f5f-b7f1-946cfb5f710c service nova] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] No waiting events found dispatching network-vif-plugged-eeb0edc6-31dc-4bbf-abc4-331ed86156a1 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:34:05 user nova-compute[75245]: WARNING nova.compute.manager [req-68c2d245-6be4-45b4-b173-687aa991cba3 req-01480522-22ba-4f5f-b7f1-946cfb5f710c service nova] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Received unexpected event network-vif-plugged-eeb0edc6-31dc-4bbf-abc4-331ed86156a1 for instance with vm_state rescued and task_state unrescuing.
Nov 29 16:34:05 user nova-compute[75245]: DEBUG nova.compute.manager [req-68c2d245-6be4-45b4-b173-687aa991cba3 req-01480522-22ba-4f5f-b7f1-946cfb5f710c service nova] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Received event network-vif-plugged-eeb0edc6-31dc-4bbf-abc4-331ed86156a1 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:34:05 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-68c2d245-6be4-45b4-b173-687aa991cba3 req-01480522-22ba-4f5f-b7f1-946cfb5f710c service nova] Acquiring lock "26acb3c4-b081-4670-a6b5-d40583c23592-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:34:05 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-68c2d245-6be4-45b4-b173-687aa991cba3 req-01480522-22ba-4f5f-b7f1-946cfb5f710c service nova] Lock "26acb3c4-b081-4670-a6b5-d40583c23592-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:34:05 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-68c2d245-6be4-45b4-b173-687aa991cba3 req-01480522-22ba-4f5f-b7f1-946cfb5f710c service nova] Lock "26acb3c4-b081-4670-a6b5-d40583c23592-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:34:05 user nova-compute[75245]: DEBUG nova.compute.manager [req-68c2d245-6be4-45b4-b173-687aa991cba3 req-01480522-22ba-4f5f-b7f1-946cfb5f710c service nova] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] No waiting events found dispatching network-vif-plugged-eeb0edc6-31dc-4bbf-abc4-331ed86156a1 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:34:05 user nova-compute[75245]: WARNING nova.compute.manager [req-68c2d245-6be4-45b4-b173-687aa991cba3 req-01480522-22ba-4f5f-b7f1-946cfb5f710c service nova] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Received unexpected event network-vif-plugged-eeb0edc6-31dc-4bbf-abc4-331ed86156a1 for instance with vm_state rescued and task_state unrescuing.
Nov 29 16:34:05 user nova-compute[75245]: DEBUG nova.compute.manager [None req-a3b6117b-1909-4bb2-a226-7c3b25993437 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:34:06 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:34:06 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:34:06 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:34:06 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:34:06 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:34:06 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:34:07 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:34:07 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Starting heal instance info cache {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 16:34:07 user nova-compute[75245]: DEBUG nova.compute.manager [req-9dd792c2-7994-42d9-bf44-e80ec376e3a7 req-663b129b-d581-4372-9537-0c2e27e5bbee service nova] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Received event network-vif-plugged-0b59ddaf-c343-420d-9cf5-93d5fa48bc23 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:34:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-9dd792c2-7994-42d9-bf44-e80ec376e3a7 req-663b129b-d581-4372-9537-0c2e27e5bbee service nova] Acquiring lock "0f4fa79b-345a-4e58-a77c-fdfed675e6e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:34:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-9dd792c2-7994-42d9-bf44-e80ec376e3a7 req-663b129b-d581-4372-9537-0c2e27e5bbee service nova] Lock "0f4fa79b-345a-4e58-a77c-fdfed675e6e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:34:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-9dd792c2-7994-42d9-bf44-e80ec376e3a7 req-663b129b-d581-4372-9537-0c2e27e5bbee service nova] Lock "0f4fa79b-345a-4e58-a77c-fdfed675e6e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:34:07 user nova-compute[75245]: DEBUG nova.compute.manager [req-9dd792c2-7994-42d9-bf44-e80ec376e3a7 req-663b129b-d581-4372-9537-0c2e27e5bbee service nova] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] No waiting events found dispatching network-vif-plugged-0b59ddaf-c343-420d-9cf5-93d5fa48bc23 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:34:07 user nova-compute[75245]: WARNING nova.compute.manager [req-9dd792c2-7994-42d9-bf44-e80ec376e3a7 req-663b129b-d581-4372-9537-0c2e27e5bbee service nova] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Received unexpected event network-vif-plugged-0b59ddaf-c343-420d-9cf5-93d5fa48bc23 for instance with vm_state active and task_state rescuing.
Nov 29 16:34:07 user nova-compute[75245]: DEBUG nova.compute.manager [req-9dd792c2-7994-42d9-bf44-e80ec376e3a7 req-663b129b-d581-4372-9537-0c2e27e5bbee service nova] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Received event network-vif-plugged-0b59ddaf-c343-420d-9cf5-93d5fa48bc23 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:34:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-9dd792c2-7994-42d9-bf44-e80ec376e3a7 req-663b129b-d581-4372-9537-0c2e27e5bbee service nova] Acquiring lock "0f4fa79b-345a-4e58-a77c-fdfed675e6e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:34:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-9dd792c2-7994-42d9-bf44-e80ec376e3a7 req-663b129b-d581-4372-9537-0c2e27e5bbee service nova] Lock "0f4fa79b-345a-4e58-a77c-fdfed675e6e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:34:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-9dd792c2-7994-42d9-bf44-e80ec376e3a7 req-663b129b-d581-4372-9537-0c2e27e5bbee service nova] Lock "0f4fa79b-345a-4e58-a77c-fdfed675e6e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:34:07 user nova-compute[75245]: DEBUG nova.compute.manager [req-9dd792c2-7994-42d9-bf44-e80ec376e3a7 req-663b129b-d581-4372-9537-0c2e27e5bbee service nova] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] No waiting events found dispatching network-vif-plugged-0b59ddaf-c343-420d-9cf5-93d5fa48bc23 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:34:07 user nova-compute[75245]: WARNING nova.compute.manager [req-9dd792c2-7994-42d9-bf44-e80ec376e3a7 req-663b129b-d581-4372-9537-0c2e27e5bbee service nova] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Received unexpected event network-vif-plugged-0b59ddaf-c343-420d-9cf5-93d5fa48bc23 for instance with vm_state active and task_state rescuing.
Nov 29 16:34:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "refresh_cache-ed9d1ad5-f5d0-4a68-a073-e7a83be772ea" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:34:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquired lock "refresh_cache-ed9d1ad5-f5d0-4a68-a073-e7a83be772ea" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:34:07 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Forcefully refreshing network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 16:34:08 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Updating instance_info_cache with network_info: [{"id": "592b836b-e112-414f-b9a9-60e5f65b8f98", "address": "fa:16:3e:90:86:e1", "network": {"id": "02098e86-68f8-464e-84ee-bf2fb09b881b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085418471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e12002e1a11f4caf8953371e66e6652e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592b836b-e1", "ovs_interfaceid": "592b836b-e112-414f-b9a9-60e5f65b8f98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:34:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Releasing lock "refresh_cache-ed9d1ad5-f5d0-4a68-a073-e7a83be772ea" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:34:08 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Updated the network info_cache for instance {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 16:34:08 user nova-compute[75245]: DEBUG nova.compute.manager [None req-bf2aa1b1-2326-43f5-95d7-bcc2c620ca37 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:34:08 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:34:08 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:34:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:34:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:34:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:34:08 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75245) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 16:34:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b629ca7-b69e-471c-a7b0-9eb43301c36f/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:34:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:34:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b629ca7-b69e-471c-a7b0-9eb43301c36f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:34:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b629ca7-b69e-471c-a7b0-9eb43301c36f/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:34:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b629ca7-b69e-471c-a7b0-9eb43301c36f/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:34:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:34:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:34:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:34:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:34:09 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:34:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:34:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:34:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:34:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:34:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f4fa79b-345a-4e58-a77c-fdfed675e6e7/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:34:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:34:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f4fa79b-345a-4e58-a77c-fdfed675e6e7/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:34:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f4fa79b-345a-4e58-a77c-fdfed675e6e7/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:34:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f4fa79b-345a-4e58-a77c-fdfed675e6e7/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:34:10 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:34:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f4fa79b-345a-4e58-a77c-fdfed675e6e7/disk.rescue --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:34:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f4fa79b-345a-4e58-a77c-fdfed675e6e7/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:34:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f4fa79b-345a-4e58-a77c-fdfed675e6e7/disk.rescue --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:34:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f4fa79b-345a-4e58-a77c-fdfed675e6e7/disk.rescue --force-share --output=json" returned: 0 in 0.221s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:34:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk.rescue --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:34:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:34:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk.rescue --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:34:11 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk.rescue --force-share --output=json" returned: 0 in 0.230s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:34:11 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:34:11 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:34:11 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:34:11 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:34:11 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24fb8ee5-4eee-4976-bcab-24242ef70d39/disk.rescue --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:34:11 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24fb8ee5-4eee-4976-bcab-24242ef70d39/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:34:11 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24fb8ee5-4eee-4976-bcab-24242ef70d39/disk.rescue --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:34:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24fb8ee5-4eee-4976-bcab-24242ef70d39/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:34:12 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /opt/stack/data/nova/instances/24fb8ee5-4eee-4976-bcab-24242ef70d39/disk (vdb) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:34:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78784fb7-a25f-4c6c-9a44-649c994004c7/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:34:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78784fb7-a25f-4c6c-9a44-649c994004c7/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:34:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78784fb7-a25f-4c6c-9a44-649c994004c7/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:34:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78784fb7-a25f-4c6c-9a44-649c994004c7/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:34:12 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:34:12 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:34:12 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:34:12 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Hypervisor/Node resource view: name=user free_ram=8229MB free_disk=24.85873031616211GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75245) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 16:34:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:34:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:34:12 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 8785a3c2-5b7a-4382-b50d-cecd8743329c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:34:12 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 5de7e10c-f216-46b3-8f74-57bac6ab7e56 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:34:12 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:34:12 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance ed9d1ad5-f5d0-4a68-a073-e7a83be772ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:34:12 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 0b629ca7-b69e-471c-a7b0-9eb43301c36f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:34:12 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 78784fb7-a25f-4c6c-9a44-649c994004c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:34:12 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 0f4fa79b-345a-4e58-a77c-fdfed675e6e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:34:12 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 26acb3c4-b081-4670-a6b5-d40583c23592 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:34:12 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 24fb8ee5-4eee-4976-bcab-24242ef70d39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:34:12 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 16:34:12 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 16:34:13 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:34:13 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:34:13 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Compute_service record updated for user:user {{(pid=75245) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 16:34:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.399s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:34:14 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-bda93fd2-fab6-4d5a-a88f-00013bfe41a2 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Acquiring lock "0b629ca7-b69e-471c-a7b0-9eb43301c36f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:34:14 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-bda93fd2-fab6-4d5a-a88f-00013bfe41a2 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lock "0b629ca7-b69e-471c-a7b0-9eb43301c36f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:34:14 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-bda93fd2-fab6-4d5a-a88f-00013bfe41a2 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Acquiring lock "0b629ca7-b69e-471c-a7b0-9eb43301c36f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:34:14 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-bda93fd2-fab6-4d5a-a88f-00013bfe41a2 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lock "0b629ca7-b69e-471c-a7b0-9eb43301c36f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:34:14 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-bda93fd2-fab6-4d5a-a88f-00013bfe41a2 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lock "0b629ca7-b69e-471c-a7b0-9eb43301c36f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:34:14 user nova-compute[75245]: INFO nova.compute.manager [None req-bda93fd2-fab6-4d5a-a88f-00013bfe41a2 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Terminating instance
Nov 29 16:34:14 user nova-compute[75245]: DEBUG nova.compute.manager [None req-bda93fd2-fab6-4d5a-a88f-00013bfe41a2 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Start destroying the instance on the hypervisor. {{(pid=75245) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 16:34:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:34:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:34:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:34:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:34:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:34:14 user nova-compute[75245]: DEBUG nova.compute.manager [req-57b528bf-7b8d-4742-acbc-af2b6c6df4a7 req-4548ef85-ad48-4905-8763-6ab9166e5728 service nova] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Received event network-vif-unplugged-6d28be36-e00b-4f84-9a2b-60515f2e65a1 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:34:14 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-57b528bf-7b8d-4742-acbc-af2b6c6df4a7 req-4548ef85-ad48-4905-8763-6ab9166e5728 service nova] Acquiring lock "0b629ca7-b69e-471c-a7b0-9eb43301c36f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:34:14 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-57b528bf-7b8d-4742-acbc-af2b6c6df4a7 req-4548ef85-ad48-4905-8763-6ab9166e5728 service nova] Lock "0b629ca7-b69e-471c-a7b0-9eb43301c36f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:34:14 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-57b528bf-7b8d-4742-acbc-af2b6c6df4a7 req-4548ef85-ad48-4905-8763-6ab9166e5728 service nova] Lock "0b629ca7-b69e-471c-a7b0-9eb43301c36f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:34:14 user nova-compute[75245]: DEBUG nova.compute.manager [req-57b528bf-7b8d-4742-acbc-af2b6c6df4a7 req-4548ef85-ad48-4905-8763-6ab9166e5728 service nova] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] No waiting events found dispatching network-vif-unplugged-6d28be36-e00b-4f84-9a2b-60515f2e65a1 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:34:14 user nova-compute[75245]: DEBUG nova.compute.manager [req-57b528bf-7b8d-4742-acbc-af2b6c6df4a7 req-4548ef85-ad48-4905-8763-6ab9166e5728 service nova] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Received event network-vif-unplugged-6d28be36-e00b-4f84-9a2b-60515f2e65a1 for instance with task_state deleting. {{(pid=75245) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 16:34:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:34:15 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:34:15 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:34:15 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:34:15 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Instance destroyed successfully.
Nov 29 16:34:15 user nova-compute[75245]: DEBUG nova.objects.instance [None req-bda93fd2-fab6-4d5a-a88f-00013bfe41a2 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lazy-loading 'resources' on Instance uuid 0b629ca7-b69e-471c-a7b0-9eb43301c36f {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:34:15 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-bda93fd2-fab6-4d5a-a88f-00013bfe41a2 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:24:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-871835871',display_name='tempest-AttachVolumeTestJSON-server-871835871',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-871835871',id=27,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTIsqUKP4igeT4gYnfCqdp6pLBcrk+0/CaYGDmMNaIt3Zkf1GMFiqF0F/vVjvbmae59TIWFlaDJkZXQ3lbtxQKuqPvpidiCFuJrrX+TZL7X+RQDx6md7i0ExrSBiMAnKw==',key_name='tempest-keypair-721153735',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:24:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ba4d99c1c6c4472be06502d8b0e75a4',ramdisk_id='',reservation_id='r-1rsjawj5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-280497743',owner_user_name='tempest-AttachVolumeTestJSON-280497743-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:32:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d5d3377c73648b8ba9044cfddbfc759',uuid=0b629ca7-b69e-471c-a7b0-9eb43301c36f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6d28be36-e00b-4f84-9a2b-60515f2e65a1", "address": "fa:16:3e:90:6c:6b", "network": {"id": "2110162d-c25f-4c3d-9a67-18e52f6caf43", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1854809203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba4d99c1c6c4472be06502d8b0e75a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d28be36-e0", "ovs_interfaceid": "6d28be36-e00b-4f84-9a2b-60515f2e65a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 16:34:15 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-bda93fd2-fab6-4d5a-a88f-00013bfe41a2 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Converting VIF {"id": "6d28be36-e00b-4f84-9a2b-60515f2e65a1", "address": "fa:16:3e:90:6c:6b", "network": {"id": "2110162d-c25f-4c3d-9a67-18e52f6caf43", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1854809203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba4d99c1c6c4472be06502d8b0e75a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d28be36-e0", "ovs_interfaceid": "6d28be36-e00b-4f84-9a2b-60515f2e65a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:34:15 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-bda93fd2-fab6-4d5a-a88f-00013bfe41a2 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:6c:6b,bridge_name='br-int',has_traffic_filtering=True,id=6d28be36-e00b-4f84-9a2b-60515f2e65a1,network=Network(2110162d-c25f-4c3d-9a67-18e52f6caf43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d28be36-e0') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:34:15 user nova-compute[75245]: DEBUG os_vif [None req-bda93fd2-fab6-4d5a-a88f-00013bfe41a2 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:6c:6b,bridge_name='br-int',has_traffic_filtering=True,id=6d28be36-e00b-4f84-9a2b-60515f2e65a1,network=Network(2110162d-c25f-4c3d-9a67-18e52f6caf43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d28be36-e0') {{(pid=75245) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 16:34:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:34:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6d28be36-e0, bridge=br-int, if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:34:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:34:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:34:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:34:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e9db32b4-477d-41af-b5d7-5b26f89c5ff4) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:34:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:34:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:34:15 user nova-compute[75245]: INFO os_vif [None req-bda93fd2-fab6-4d5a-a88f-00013bfe41a2 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:6c:6b,bridge_name='br-int',has_traffic_filtering=True,id=6d28be36-e00b-4f84-9a2b-60515f2e65a1,network=Network(2110162d-c25f-4c3d-9a67-18e52f6caf43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d28be36-e0')
Nov 29 16:34:15 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-bda93fd2-fab6-4d5a-a88f-00013bfe41a2 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Deleting instance files /opt/stack/data/nova/instances/0b629ca7-b69e-471c-a7b0-9eb43301c36f_del
Nov 29 16:34:15 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-bda93fd2-fab6-4d5a-a88f-00013bfe41a2 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Deletion of /opt/stack/data/nova/instances/0b629ca7-b69e-471c-a7b0-9eb43301c36f_del complete
Nov 29 16:34:15 user nova-compute[75245]: INFO nova.compute.manager [None req-bda93fd2-fab6-4d5a-a88f-00013bfe41a2 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 29 16:34:15 user nova-compute[75245]: DEBUG oslo.service.loopingcall [None req-bda93fd2-fab6-4d5a-a88f-00013bfe41a2 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75245) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 16:34:15 user nova-compute[75245]: DEBUG nova.compute.manager [-] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Deallocating network for instance {{(pid=75245) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 16:34:15 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] deallocate_for_instance() {{(pid=75245) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 16:34:16 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:34:16 user nova-compute[75245]: DEBUG nova.compute.manager [req-6ac0c33b-2495-4fe1-a261-7e1e19275136 req-50f75368-9d1f-4428-8d8d-c3bc1f366ffe service nova] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Received event network-vif-deleted-6d28be36-e00b-4f84-9a2b-60515f2e65a1 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:34:16 user nova-compute[75245]: INFO nova.compute.manager [req-6ac0c33b-2495-4fe1-a261-7e1e19275136 req-50f75368-9d1f-4428-8d8d-c3bc1f366ffe service nova] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Neutron deleted interface 6d28be36-e00b-4f84-9a2b-60515f2e65a1; detaching it from the instance and deleting it from the info cache
Nov 29 16:34:16 user nova-compute[75245]: DEBUG nova.network.neutron [req-6ac0c33b-2495-4fe1-a261-7e1e19275136 req-50f75368-9d1f-4428-8d8d-c3bc1f366ffe service nova] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:34:16 user nova-compute[75245]: INFO nova.compute.manager [-] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Took 0.78 seconds to deallocate network for instance.
Nov 29 16:34:16 user nova-compute[75245]: DEBUG nova.compute.manager [req-6ac0c33b-2495-4fe1-a261-7e1e19275136 req-50f75368-9d1f-4428-8d8d-c3bc1f366ffe service nova] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Detach interface failed, port_id=6d28be36-e00b-4f84-9a2b-60515f2e65a1, reason: Instance 0b629ca7-b69e-471c-a7b0-9eb43301c36f could not be found. {{(pid=75245) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 16:34:16 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-bda93fd2-fab6-4d5a-a88f-00013bfe41a2 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:34:16 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-bda93fd2-fab6-4d5a-a88f-00013bfe41a2 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:34:16 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-bda93fd2-fab6-4d5a-a88f-00013bfe41a2 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:34:16 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-bda93fd2-fab6-4d5a-a88f-00013bfe41a2 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:34:16 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-bda93fd2-fab6-4d5a-a88f-00013bfe41a2 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.301s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:34:16 user nova-compute[75245]: INFO nova.scheduler.client.report [None req-bda93fd2-fab6-4d5a-a88f-00013bfe41a2 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Deleted allocations for instance 0b629ca7-b69e-471c-a7b0-9eb43301c36f
Nov 29 16:34:16 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-bda93fd2-fab6-4d5a-a88f-00013bfe41a2 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lock "0b629ca7-b69e-471c-a7b0-9eb43301c36f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.124s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:34:17 user nova-compute[75245]: DEBUG nova.compute.manager [req-5fe739aa-88fd-408b-a1e7-f07bcb1ca89b req-8ec478a0-6f7c-4a72-8bbe-caa834fb4a63 service nova] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Received event network-vif-plugged-6d28be36-e00b-4f84-9a2b-60515f2e65a1 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:34:17 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-5fe739aa-88fd-408b-a1e7-f07bcb1ca89b req-8ec478a0-6f7c-4a72-8bbe-caa834fb4a63 service nova] Acquiring lock "0b629ca7-b69e-471c-a7b0-9eb43301c36f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:34:17 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-5fe739aa-88fd-408b-a1e7-f07bcb1ca89b req-8ec478a0-6f7c-4a72-8bbe-caa834fb4a63 service nova] Lock "0b629ca7-b69e-471c-a7b0-9eb43301c36f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:34:17 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-5fe739aa-88fd-408b-a1e7-f07bcb1ca89b req-8ec478a0-6f7c-4a72-8bbe-caa834fb4a63 service nova] Lock "0b629ca7-b69e-471c-a7b0-9eb43301c36f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:34:17 user nova-compute[75245]: DEBUG nova.compute.manager [req-5fe739aa-88fd-408b-a1e7-f07bcb1ca89b req-8ec478a0-6f7c-4a72-8bbe-caa834fb4a63 service nova] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] No waiting events found dispatching network-vif-plugged-6d28be36-e00b-4f84-9a2b-60515f2e65a1 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:34:17 user nova-compute[75245]: WARNING nova.compute.manager [req-5fe739aa-88fd-408b-a1e7-f07bcb1ca89b req-8ec478a0-6f7c-4a72-8bbe-caa834fb4a63 service nova] [instance: 0b629ca7-b69e-471c-a7b0-9eb43301c36f] Received unexpected event network-vif-plugged-6d28be36-e00b-4f84-9a2b-60515f2e65a1 for instance with vm_state deleted and task_state None.
Nov 29 16:34:17 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:34:18 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:34:18 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:34:20 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:34:21 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:34:21 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75245) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 16:34:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:34:24 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:34:25 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:34:28 user nova-compute[75245]: INFO nova.compute.manager [None req-ffe52460-96fa-44ea-bd61-6b7ee9d73dee tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Unrescuing
Nov 29 16:34:28 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-ffe52460-96fa-44ea-bd61-6b7ee9d73dee tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Acquiring lock "refresh_cache-24fb8ee5-4eee-4976-bcab-24242ef70d39" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:34:28 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-ffe52460-96fa-44ea-bd61-6b7ee9d73dee tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Acquired lock "refresh_cache-24fb8ee5-4eee-4976-bcab-24242ef70d39" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:34:28 user nova-compute[75245]: DEBUG nova.network.neutron [None req-ffe52460-96fa-44ea-bd61-6b7ee9d73dee tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 16:34:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:34:28 user nova-compute[75245]: DEBUG nova.network.neutron [None req-ffe52460-96fa-44ea-bd61-6b7ee9d73dee tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Updating instance_info_cache with network_info: [{"id": "62440fbd-97a8-49eb-8509-a7be044b764a", "address": "fa:16:3e:b2:63:34", "network": {"id": "02098e86-68f8-464e-84ee-bf2fb09b881b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085418471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e12002e1a11f4caf8953371e66e6652e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62440fbd-97", "ovs_interfaceid": "62440fbd-97a8-49eb-8509-a7be044b764a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:34:28 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-ffe52460-96fa-44ea-bd61-6b7ee9d73dee tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Releasing lock "refresh_cache-24fb8ee5-4eee-4976-bcab-24242ef70d39" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:34:28 user nova-compute[75245]: DEBUG nova.objects.instance [None req-ffe52460-96fa-44ea-bd61-6b7ee9d73dee tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lazy-loading 'flavor' on Instance uuid 24fb8ee5-4eee-4976-bcab-24242ef70d39 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:34:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:34:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:34:29 user nova-compute[75245]: DEBUG nova.compute.manager [req-5f20b068-c814-487a-ac2d-a7d877834497 req-ae96ebb1-cbdf-4093-a7cd-5772daeb317b service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Received event network-vif-unplugged-62440fbd-97a8-49eb-8509-a7be044b764a {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:34:29 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-5f20b068-c814-487a-ac2d-a7d877834497 req-ae96ebb1-cbdf-4093-a7cd-5772daeb317b service nova] Acquiring lock "24fb8ee5-4eee-4976-bcab-24242ef70d39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:34:29 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-5f20b068-c814-487a-ac2d-a7d877834497 req-ae96ebb1-cbdf-4093-a7cd-5772daeb317b service nova] Lock "24fb8ee5-4eee-4976-bcab-24242ef70d39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:34:29 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-5f20b068-c814-487a-ac2d-a7d877834497 req-ae96ebb1-cbdf-4093-a7cd-5772daeb317b service nova] Lock "24fb8ee5-4eee-4976-bcab-24242ef70d39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:34:29 user nova-compute[75245]: DEBUG nova.compute.manager [req-5f20b068-c814-487a-ac2d-a7d877834497 req-ae96ebb1-cbdf-4093-a7cd-5772daeb317b service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] No waiting events found dispatching network-vif-unplugged-62440fbd-97a8-49eb-8509-a7be044b764a {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:34:29 user nova-compute[75245]: WARNING nova.compute.manager [req-5f20b068-c814-487a-ac2d-a7d877834497 req-ae96ebb1-cbdf-4093-a7cd-5772daeb317b service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Received unexpected event network-vif-unplugged-62440fbd-97a8-49eb-8509-a7be044b764a for instance with vm_state rescued and task_state unrescuing.
Nov 29 16:34:29 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:34:29 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:34:29 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Instance destroyed successfully.
Nov 29 16:34:30 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:34:30 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:34:30 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:34:30 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:34:30 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:34:30 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:34:31 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:34:31 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:34:31 user nova-compute[75245]: DEBUG nova.compute.manager [req-c79e6ad5-efc9-483a-b88f-c275907833c6 req-143d029f-9c21-4fbe-b058-6a1a9088118f service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Received event network-vif-plugged-62440fbd-97a8-49eb-8509-a7be044b764a {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:34:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-c79e6ad5-efc9-483a-b88f-c275907833c6 req-143d029f-9c21-4fbe-b058-6a1a9088118f service nova] Acquiring lock "24fb8ee5-4eee-4976-bcab-24242ef70d39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:34:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-c79e6ad5-efc9-483a-b88f-c275907833c6 req-143d029f-9c21-4fbe-b058-6a1a9088118f service nova] Lock "24fb8ee5-4eee-4976-bcab-24242ef70d39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:34:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-c79e6ad5-efc9-483a-b88f-c275907833c6 req-143d029f-9c21-4fbe-b058-6a1a9088118f service nova] Lock "24fb8ee5-4eee-4976-bcab-24242ef70d39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:34:31 user nova-compute[75245]: DEBUG nova.compute.manager [req-c79e6ad5-efc9-483a-b88f-c275907833c6 req-143d029f-9c21-4fbe-b058-6a1a9088118f service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] No waiting events found dispatching network-vif-plugged-62440fbd-97a8-49eb-8509-a7be044b764a {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:34:31 user nova-compute[75245]: WARNING nova.compute.manager [req-c79e6ad5-efc9-483a-b88f-c275907833c6 req-143d029f-9c21-4fbe-b058-6a1a9088118f service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Received unexpected event network-vif-plugged-62440fbd-97a8-49eb-8509-a7be044b764a for instance with vm_state rescued and task_state unrescuing.
Nov 29 16:34:31 user nova-compute[75245]: DEBUG nova.compute.manager [req-c79e6ad5-efc9-483a-b88f-c275907833c6 req-143d029f-9c21-4fbe-b058-6a1a9088118f service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Received event network-vif-plugged-62440fbd-97a8-49eb-8509-a7be044b764a {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:34:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-c79e6ad5-efc9-483a-b88f-c275907833c6 req-143d029f-9c21-4fbe-b058-6a1a9088118f service nova] Acquiring lock "24fb8ee5-4eee-4976-bcab-24242ef70d39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:34:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-c79e6ad5-efc9-483a-b88f-c275907833c6 req-143d029f-9c21-4fbe-b058-6a1a9088118f service nova] Lock "24fb8ee5-4eee-4976-bcab-24242ef70d39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:34:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-c79e6ad5-efc9-483a-b88f-c275907833c6 req-143d029f-9c21-4fbe-b058-6a1a9088118f service nova] Lock "24fb8ee5-4eee-4976-bcab-24242ef70d39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:34:31 user nova-compute[75245]: DEBUG nova.compute.manager [req-c79e6ad5-efc9-483a-b88f-c275907833c6 req-143d029f-9c21-4fbe-b058-6a1a9088118f service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] No waiting events found dispatching network-vif-plugged-62440fbd-97a8-49eb-8509-a7be044b764a {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:34:31 user nova-compute[75245]: WARNING nova.compute.manager [req-c79e6ad5-efc9-483a-b88f-c275907833c6 req-143d029f-9c21-4fbe-b058-6a1a9088118f service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Received unexpected event network-vif-plugged-62440fbd-97a8-49eb-8509-a7be044b764a for instance with vm_state rescued and task_state unrescuing.
Nov 29 16:34:31 user nova-compute[75245]: DEBUG nova.compute.manager [req-c79e6ad5-efc9-483a-b88f-c275907833c6 req-143d029f-9c21-4fbe-b058-6a1a9088118f service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Received event network-vif-plugged-62440fbd-97a8-49eb-8509-a7be044b764a {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:34:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-c79e6ad5-efc9-483a-b88f-c275907833c6 req-143d029f-9c21-4fbe-b058-6a1a9088118f service nova] Acquiring lock "24fb8ee5-4eee-4976-bcab-24242ef70d39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:34:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-c79e6ad5-efc9-483a-b88f-c275907833c6 req-143d029f-9c21-4fbe-b058-6a1a9088118f service nova] Lock "24fb8ee5-4eee-4976-bcab-24242ef70d39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:34:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-c79e6ad5-efc9-483a-b88f-c275907833c6 req-143d029f-9c21-4fbe-b058-6a1a9088118f service nova] Lock "24fb8ee5-4eee-4976-bcab-24242ef70d39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:34:31 user nova-compute[75245]: DEBUG nova.compute.manager [req-c79e6ad5-efc9-483a-b88f-c275907833c6 req-143d029f-9c21-4fbe-b058-6a1a9088118f service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] No waiting events found dispatching network-vif-plugged-62440fbd-97a8-49eb-8509-a7be044b764a {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:34:31 user nova-compute[75245]: WARNING nova.compute.manager [req-c79e6ad5-efc9-483a-b88f-c275907833c6 req-143d029f-9c21-4fbe-b058-6a1a9088118f service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Received unexpected event network-vif-plugged-62440fbd-97a8-49eb-8509-a7be044b764a for instance with vm_state rescued and task_state unrescuing.
Nov 29 16:34:32 user nova-compute[75245]: DEBUG nova.compute.manager [None req-ffe52460-96fa-44ea-bd61-6b7ee9d73dee tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:34:33 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:34:35 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:34:38 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:34:40 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:34:45 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:34:48 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:34:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:34:53 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:34:55 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:34:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:35:00 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:35:03 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:35:05 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:35:05 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:35:07 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:35:07 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Starting heal instance info cache {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 16:35:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "refresh_cache-78784fb7-a25f-4c6c-9a44-649c994004c7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:35:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquired lock "refresh_cache-78784fb7-a25f-4c6c-9a44-649c994004c7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:35:07 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 78784fb7-a25f-4c6c-9a44-649c994004c7] Forcefully refreshing network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 16:35:08 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 78784fb7-a25f-4c6c-9a44-649c994004c7] Updating instance_info_cache with network_info: [{"id": "be7f7c96-525a-4895-933d-a680c6bbf4f2", "address": "fa:16:3e:f3:a2:bb", "network": {"id": "6a7f7426-b595-4aa3-bf80-cc92ba7ce15e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-917300903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d52776451e947f5a9ef3fa44ac8acbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe7f7c96-52", "ovs_interfaceid": "be7f7c96-525a-4895-933d-a680c6bbf4f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:35:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Releasing lock "refresh_cache-78784fb7-a25f-4c6c-9a44-649c994004c7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:35:08 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 78784fb7-a25f-4c6c-9a44-649c994004c7] Updated the network info_cache for instance {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 16:35:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Acquiring lock "2b150aa0-612b-4ccd-87d3-3b38c1af96d7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:35:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lock "2b150aa0-612b-4ccd-87d3-3b38c1af96d7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:35:08 user nova-compute[75245]: DEBUG nova.compute.manager [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] Starting instance... {{(pid=75245) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 16:35:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:35:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:35:08 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75245) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 16:35:08 user nova-compute[75245]: INFO nova.compute.claims [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] Claim successful on node user
Nov 29 16:35:08 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:35:08 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:35:08 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:35:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.369s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:35:08 user nova-compute[75245]: DEBUG nova.compute.manager [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] Start building networks asynchronously for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 16:35:08 user nova-compute[75245]: DEBUG nova.compute.manager [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] Allocating IP information in the background. {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 16:35:08 user nova-compute[75245]: DEBUG nova.network.neutron [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] allocate_for_instance() {{(pid=75245) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 16:35:08 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 16:35:08 user nova-compute[75245]: DEBUG nova.compute.manager [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] Start building block device mappings for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 16:35:08 user nova-compute[75245]: DEBUG nova.policy [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6d5d3377c73648b8ba9044cfddbfc759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba4d99c1c6c4472be06502d8b0e75a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75245) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 16:35:09 user nova-compute[75245]: DEBUG nova.compute.manager [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] Start spawning the instance on the hypervisor. {{(pid=75245) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 16:35:09 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] Creating instance directory {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 16:35:09 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] Creating image(s)
Nov 29 16:35:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Acquiring lock "/opt/stack/data/nova/instances/2b150aa0-612b-4ccd-87d3-3b38c1af96d7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:35:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lock "/opt/stack/data/nova/instances/2b150aa0-612b-4ccd-87d3-3b38c1af96d7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:35:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lock "/opt/stack/data/nova/instances/2b150aa0-612b-4ccd-87d3-3b38c1af96d7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:35:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:35:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.211s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:35:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Acquiring lock "d654f7206043e05d3525550b0fc885556eb999f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:35:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:35:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:35:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.178s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:35:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/2b150aa0-612b-4ccd-87d3-3b38c1af96d7/disk 1073741824 {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:35:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/2b150aa0-612b-4ccd-87d3-3b38c1af96d7/disk 1073741824" returned: 0 in 0.057s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:35:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:35:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:35:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.202s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:35:09 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2b150aa0-612b-4ccd-87d3-3b38c1af96d7/disk. size=1073741824 {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 16:35:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b150aa0-612b-4ccd-87d3-3b38c1af96d7/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:35:09 user nova-compute[75245]: DEBUG nova.network.neutron [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] Successfully created port: bb7dda5f-1f48-4d4f-bd7c-3e983aab8a26 {{(pid=75245) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 16:35:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b150aa0-612b-4ccd-87d3-3b38c1af96d7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:35:09 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Cannot resize image /opt/stack/data/nova/instances/2b150aa0-612b-4ccd-87d3-3b38c1af96d7/disk to a smaller size. {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 16:35:09 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] Created local disks {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 16:35:09 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] Ensure instance console log exists: /opt/stack/data/nova/instances/2b150aa0-612b-4ccd-87d3-3b38c1af96d7/console.log {{(pid=75245) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 16:35:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:35:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:35:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:35:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:35:10 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:35:10 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:35:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:35:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:35:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:35:10 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75245) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 16:35:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:35:10 user nova-compute[75245]: DEBUG nova.network.neutron [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] Successfully updated port: bb7dda5f-1f48-4d4f-bd7c-3e983aab8a26 {{(pid=75245) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 16:35:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Acquiring lock "refresh_cache-2b150aa0-612b-4ccd-87d3-3b38c1af96d7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:35:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Acquired lock "refresh_cache-2b150aa0-612b-4ccd-87d3-3b38c1af96d7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:35:10 user nova-compute[75245]: DEBUG nova.network.neutron [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 16:35:10 user nova-compute[75245]: DEBUG nova.compute.manager [req-6e9f0b7f-eac2-4669-bb0c-165781027c9e req-006c7ac4-7478-4dfb-b25b-eea16fd9ff86 service nova] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] Received event network-changed-bb7dda5f-1f48-4d4f-bd7c-3e983aab8a26 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:35:10 user nova-compute[75245]: DEBUG nova.compute.manager [req-6e9f0b7f-eac2-4669-bb0c-165781027c9e req-006c7ac4-7478-4dfb-b25b-eea16fd9ff86 service nova] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] Refreshing instance network info cache due to event network-changed-bb7dda5f-1f48-4d4f-bd7c-3e983aab8a26. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:35:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-6e9f0b7f-eac2-4669-bb0c-165781027c9e req-006c7ac4-7478-4dfb-b25b-eea16fd9ff86 service nova] Acquiring lock "refresh_cache-2b150aa0-612b-4ccd-87d3-3b38c1af96d7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:35:10 user nova-compute[75245]: DEBUG nova.network.neutron [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] Instance cache missing network info. {{(pid=75245) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 16:35:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:35:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:35:11 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:35:11 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:35:11 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:35:11 user nova-compute[75245]: DEBUG nova.network.neutron [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] Updating instance_info_cache with network_info: [{"id": "bb7dda5f-1f48-4d4f-bd7c-3e983aab8a26", "address": "fa:16:3e:41:c6:08", "network": {"id": "2110162d-c25f-4c3d-9a67-18e52f6caf43", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1854809203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba4d99c1c6c4472be06502d8b0e75a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb7dda5f-1f", "ovs_interfaceid": "bb7dda5f-1f48-4d4f-bd7c-3e983aab8a26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:35:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Releasing lock "refresh_cache-2b150aa0-612b-4ccd-87d3-3b38c1af96d7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:35:11 user nova-compute[75245]: DEBUG nova.compute.manager [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] Instance network_info: |[{"id": "bb7dda5f-1f48-4d4f-bd7c-3e983aab8a26", "address": "fa:16:3e:41:c6:08", "network": {"id": "2110162d-c25f-4c3d-9a67-18e52f6caf43", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1854809203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba4d99c1c6c4472be06502d8b0e75a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb7dda5f-1f", "ovs_interfaceid": "bb7dda5f-1f48-4d4f-bd7c-3e983aab8a26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 16:35:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-6e9f0b7f-eac2-4669-bb0c-165781027c9e req-006c7ac4-7478-4dfb-b25b-eea16fd9ff86 service nova] Acquired lock "refresh_cache-2b150aa0-612b-4ccd-87d3-3b38c1af96d7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:35:11 user nova-compute[75245]: DEBUG nova.network.neutron [req-6e9f0b7f-eac2-4669-bb0c-165781027c9e req-006c7ac4-7478-4dfb-b25b-eea16fd9ff86 service nova] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] Refreshing network info cache for port bb7dda5f-1f48-4d4f-bd7c-3e983aab8a26 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:35:11 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] Start _get_guest_xml network_info=[{"id": "bb7dda5f-1f48-4d4f-bd7c-3e983aab8a26", "address": "fa:16:3e:41:c6:08", "network": {"id": "2110162d-c25f-4c3d-9a67-18e52f6caf43", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1854809203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba4d99c1c6c4472be06502d8b0e75a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb7dda5f-1f", "ovs_interfaceid": "bb7dda5f-1f48-4d4f-bd7c-3e983aab8a26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'a291d9c3-be02-4c6c-9649-4b45c5b7f487'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 16:35:11 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:35:11 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:35:11 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 16:35:11 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] CPU controller missing on host. {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 16:35:11 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 16:35:11 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] CPU controller found on host. {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 16:35:11 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75245) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 16:35:11 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T16:06:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 16:35:11 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Flavor limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 16:35:11 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Image limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 16:35:11 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Flavor pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 16:35:11 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Image pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 16:35:11 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 16:35:11 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 16:35:11 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 16:35:11 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Got 1 possible topologies {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 16:35:11 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 16:35:11 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 16:35:11 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:35:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-577505168',display_name='tempest-AttachVolumeTestJSON-server-577505168',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-577505168',id=32,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDl5KUNKB25OXpQsfrKezppTSS89KIYC595W9NtQqLaMbPEUNL/dKatCma44RpD5RD/0pGyrN3YrnfRHyENZSoWd3wLxJynvyWYKeunc0iJG6sSXUl3TttmuEOuv7+1Slg==',key_name='tempest-keypair-1236278888',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ba4d99c1c6c4472be06502d8b0e75a4',ramdisk_id='',reservation_id='r-lttd3tvq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-280497743',owner_user_name='tempest-AttachVolumeTestJSON-280497743-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:35:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d5d3377c73648b8ba9044cfddbfc759',uuid=2b150aa0-612b-4ccd-87d3-3b38c1af96d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bb7dda5f-1f48-4d4f-bd7c-3e983aab8a26", "address": "fa:16:3e:41:c6:08", "network": {"id": "2110162d-c25f-4c3d-9a67-18e52f6caf43", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1854809203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba4d99c1c6c4472be06502d8b0e75a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb7dda5f-1f", "ovs_interfaceid": "bb7dda5f-1f48-4d4f-bd7c-3e983aab8a26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:35:11 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Converting VIF {"id": "bb7dda5f-1f48-4d4f-bd7c-3e983aab8a26", "address": "fa:16:3e:41:c6:08", "network": {"id": "2110162d-c25f-4c3d-9a67-18e52f6caf43", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1854809203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba4d99c1c6c4472be06502d8b0e75a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb7dda5f-1f", "ovs_interfaceid": "bb7dda5f-1f48-4d4f-bd7c-3e983aab8a26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:35:11 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:c6:08,bridge_name='br-int',has_traffic_filtering=True,id=bb7dda5f-1f48-4d4f-bd7c-3e983aab8a26,network=Network(2110162d-c25f-4c3d-9a67-18e52f6caf43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb7dda5f-1f') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:35:11 user nova-compute[75245]: DEBUG nova.objects.instance [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lazy-loading 'pci_devices' on Instance uuid 2b150aa0-612b-4ccd-87d3-3b38c1af96d7 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:35:11 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] End _get_guest_xml xml=<domain type="kvm">
Nov 29 16:35:11 user nova-compute[75245]:   <uuid>2b150aa0-612b-4ccd-87d3-3b38c1af96d7</uuid>
Nov 29 16:35:11 user nova-compute[75245]:   <name>instance-00000020</name>
Nov 29 16:35:11 user nova-compute[75245]:   <memory>524288</memory>
Nov 29 16:35:11 user nova-compute[75245]:   <vcpu>1</vcpu>
Nov 29 16:35:11 user nova-compute[75245]:   <metadata>
Nov 29 16:35:11 user nova-compute[75245]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 16:35:11 user nova-compute[75245]:       <nova:package version="0.0.0"/>
Nov 29 16:35:11 user nova-compute[75245]:       <nova:name>tempest-AttachVolumeTestJSON-server-577505168</nova:name>
Nov 29 16:35:11 user nova-compute[75245]:       <nova:creationTime>2023-11-29 16:35:11</nova:creationTime>
Nov 29 16:35:11 user nova-compute[75245]:       <nova:flavor name="m1.tiny">
Nov 29 16:35:11 user nova-compute[75245]:         <nova:memory>512</nova:memory>
Nov 29 16:35:11 user nova-compute[75245]:         <nova:disk>1</nova:disk>
Nov 29 16:35:11 user nova-compute[75245]:         <nova:swap>0</nova:swap>
Nov 29 16:35:11 user nova-compute[75245]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 16:35:11 user nova-compute[75245]:         <nova:vcpus>1</nova:vcpus>
Nov 29 16:35:11 user nova-compute[75245]:       </nova:flavor>
Nov 29 16:35:11 user nova-compute[75245]:       <nova:owner>
Nov 29 16:35:11 user nova-compute[75245]:         <nova:user uuid="6d5d3377c73648b8ba9044cfddbfc759">tempest-AttachVolumeTestJSON-280497743-project-member</nova:user>
Nov 29 16:35:11 user nova-compute[75245]:         <nova:project uuid="0ba4d99c1c6c4472be06502d8b0e75a4">tempest-AttachVolumeTestJSON-280497743</nova:project>
Nov 29 16:35:11 user nova-compute[75245]:       </nova:owner>
Nov 29 16:35:11 user nova-compute[75245]:       <nova:root type="image" uuid="a291d9c3-be02-4c6c-9649-4b45c5b7f487"/>
Nov 29 16:35:11 user nova-compute[75245]:       <nova:ports>
Nov 29 16:35:11 user nova-compute[75245]:         <nova:port uuid="bb7dda5f-1f48-4d4f-bd7c-3e983aab8a26">
Nov 29 16:35:11 user nova-compute[75245]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 29 16:35:11 user nova-compute[75245]:         </nova:port>
Nov 29 16:35:11 user nova-compute[75245]:       </nova:ports>
Nov 29 16:35:11 user nova-compute[75245]:     </nova:instance>
Nov 29 16:35:11 user nova-compute[75245]:   </metadata>
Nov 29 16:35:11 user nova-compute[75245]:   <sysinfo type="smbios">
Nov 29 16:35:11 user nova-compute[75245]:     <system>
Nov 29 16:35:11 user nova-compute[75245]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 16:35:11 user nova-compute[75245]:       <entry name="product">OpenStack Nova</entry>
Nov 29 16:35:11 user nova-compute[75245]:       <entry name="version">0.0.0</entry>
Nov 29 16:35:11 user nova-compute[75245]:       <entry name="serial">2b150aa0-612b-4ccd-87d3-3b38c1af96d7</entry>
Nov 29 16:35:11 user nova-compute[75245]:       <entry name="uuid">2b150aa0-612b-4ccd-87d3-3b38c1af96d7</entry>
Nov 29 16:35:11 user nova-compute[75245]:       <entry name="family">Virtual Machine</entry>
Nov 29 16:35:11 user nova-compute[75245]:     </system>
Nov 29 16:35:11 user nova-compute[75245]:   </sysinfo>
Nov 29 16:35:11 user nova-compute[75245]:   <os>
Nov 29 16:35:11 user nova-compute[75245]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 16:35:11 user nova-compute[75245]:     <boot dev="hd"/>
Nov 29 16:35:11 user nova-compute[75245]:     <smbios mode="sysinfo"/>
Nov 29 16:35:11 user nova-compute[75245]:   </os>
Nov 29 16:35:11 user nova-compute[75245]:   <features>
Nov 29 16:35:11 user nova-compute[75245]:     <acpi/>
Nov 29 16:35:11 user nova-compute[75245]:     <apic/>
Nov 29 16:35:11 user nova-compute[75245]:     <vmcoreinfo/>
Nov 29 16:35:11 user nova-compute[75245]:   </features>
Nov 29 16:35:11 user nova-compute[75245]:   <clock offset="utc">
Nov 29 16:35:11 user nova-compute[75245]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 16:35:11 user nova-compute[75245]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 16:35:11 user nova-compute[75245]:     <timer name="hpet" present="no"/>
Nov 29 16:35:11 user nova-compute[75245]:   </clock>
Nov 29 16:35:11 user nova-compute[75245]:   <cpu mode="custom" match="exact">
Nov 29 16:35:11 user nova-compute[75245]:     <model>Nehalem</model>
Nov 29 16:35:11 user nova-compute[75245]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 16:35:11 user nova-compute[75245]:   </cpu>
Nov 29 16:35:11 user nova-compute[75245]:   <devices>
Nov 29 16:35:11 user nova-compute[75245]:     <disk type="file" device="disk">
Nov 29 16:35:11 user nova-compute[75245]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 16:35:11 user nova-compute[75245]:       <source file="/opt/stack/data/nova/instances/2b150aa0-612b-4ccd-87d3-3b38c1af96d7/disk"/>
Nov 29 16:35:11 user nova-compute[75245]:       <target dev="vda" bus="virtio"/>
Nov 29 16:35:11 user nova-compute[75245]:     </disk>
Nov 29 16:35:11 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 16:35:11 user nova-compute[75245]:       <mac address="fa:16:3e:41:c6:08"/>
Nov 29 16:35:11 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:35:11 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 16:35:11 user nova-compute[75245]:       <target dev="tapbb7dda5f-1f"/>
Nov 29 16:35:11 user nova-compute[75245]:     </interface>
Nov 29 16:35:11 user nova-compute[75245]:     <serial type="pty">
Nov 29 16:35:11 user nova-compute[75245]:       <log file="/opt/stack/data/nova/instances/2b150aa0-612b-4ccd-87d3-3b38c1af96d7/console.log" append="off"/>
Nov 29 16:35:11 user nova-compute[75245]:     </serial>
Nov 29 16:35:11 user nova-compute[75245]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 16:35:11 user nova-compute[75245]:     <video>
Nov 29 16:35:11 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:35:11 user nova-compute[75245]:     </video>
Nov 29 16:35:11 user nova-compute[75245]:     <rng model="virtio">
Nov 29 16:35:11 user nova-compute[75245]:       <backend model="random">/dev/urandom</backend>
Nov 29 16:35:11 user nova-compute[75245]:     </rng>
Nov 29 16:35:11 user nova-compute[75245]:     <controller type="usb" index="0" model="none"/>
Nov 29 16:35:11 user nova-compute[75245]:     <memballoon model="virtio">
Nov 29 16:35:11 user nova-compute[75245]:       <stats period="10"/>
Nov 29 16:35:11 user nova-compute[75245]:     </memballoon>
Nov 29 16:35:11 user nova-compute[75245]:   </devices>
Nov 29 16:35:11 user nova-compute[75245]: </domain>
Nov 29 16:35:11 user nova-compute[75245]:  {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 16:35:11 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:35:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-577505168',display_name='tempest-AttachVolumeTestJSON-server-577505168',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-577505168',id=32,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDl5KUNKB25OXpQsfrKezppTSS89KIYC595W9NtQqLaMbPEUNL/dKatCma44RpD5RD/0pGyrN3YrnfRHyENZSoWd3wLxJynvyWYKeunc0iJG6sSXUl3TttmuEOuv7+1Slg==',key_name='tempest-keypair-1236278888',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ba4d99c1c6c4472be06502d8b0e75a4',ramdisk_id='',reservation_id='r-lttd3tvq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-280497743',owner_user_name='tempest-AttachVolumeTestJSON-280497743-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:35:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d5d3377c73648b8ba9044cfddbfc759',uuid=2b150aa0-612b-4ccd-87d3-3b38c1af96d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bb7dda5f-1f48-4d4f-bd7c-3e983aab8a26", "address": "fa:16:3e:41:c6:08", "network": {"id": "2110162d-c25f-4c3d-9a67-18e52f6caf43", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1854809203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba4d99c1c6c4472be06502d8b0e75a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb7dda5f-1f", "ovs_interfaceid": "bb7dda5f-1f48-4d4f-bd7c-3e983aab8a26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 16:35:11 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Converting VIF {"id": "bb7dda5f-1f48-4d4f-bd7c-3e983aab8a26", "address": "fa:16:3e:41:c6:08", "network": {"id": "2110162d-c25f-4c3d-9a67-18e52f6caf43", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1854809203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba4d99c1c6c4472be06502d8b0e75a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb7dda5f-1f", "ovs_interfaceid": "bb7dda5f-1f48-4d4f-bd7c-3e983aab8a26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:35:11 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:c6:08,bridge_name='br-int',has_traffic_filtering=True,id=bb7dda5f-1f48-4d4f-bd7c-3e983aab8a26,network=Network(2110162d-c25f-4c3d-9a67-18e52f6caf43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb7dda5f-1f') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:35:11 user nova-compute[75245]: DEBUG os_vif [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:c6:08,bridge_name='br-int',has_traffic_filtering=True,id=bb7dda5f-1f48-4d4f-bd7c-3e983aab8a26,network=Network(2110162d-c25f-4c3d-9a67-18e52f6caf43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb7dda5f-1f') {{(pid=75245) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 16:35:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:35:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:35:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 16:35:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:35:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '15bf5345-45df-5661-9267-1a3e96338950', '_type': 'linux-noop'}}, row=False) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:35:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:35:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:35:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbb7dda5f-1f, may_exist=True, interface_attrs={}) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:35:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbb7dda5f-1f, col_values=(('qos', UUID('b2366426-abcc-4d09-b273-f021b4bc2cb2')),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:35:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbb7dda5f-1f, col_values=(('external_ids', {'iface-id': 'bb7dda5f-1f48-4d4f-bd7c-3e983aab8a26', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:c6:08', 'vm-uuid': '2b150aa0-612b-4ccd-87d3-3b38c1af96d7'}),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:35:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:35:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:35:11 user nova-compute[75245]: INFO os_vif [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:c6:08,bridge_name='br-int',has_traffic_filtering=True,id=bb7dda5f-1f48-4d4f-bd7c-3e983aab8a26,network=Network(2110162d-c25f-4c3d-9a67-18e52f6caf43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb7dda5f-1f')
Nov 29 16:35:11 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:35:11 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:35:11 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:35:11 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] No VIF found with MAC fa:16:3e:41:c6:08, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:35:11 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:35:11 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f4fa79b-345a-4e58-a77c-fdfed675e6e7/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:35:11 user nova-compute[75245]: DEBUG nova.network.neutron [req-6e9f0b7f-eac2-4669-bb0c-165781027c9e req-006c7ac4-7478-4dfb-b25b-eea16fd9ff86 service nova] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] Updated VIF entry in instance network info cache for port bb7dda5f-1f48-4d4f-bd7c-3e983aab8a26. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:35:11 user nova-compute[75245]: DEBUG nova.network.neutron [req-6e9f0b7f-eac2-4669-bb0c-165781027c9e req-006c7ac4-7478-4dfb-b25b-eea16fd9ff86 service nova] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] Updating instance_info_cache with network_info: [{"id": "bb7dda5f-1f48-4d4f-bd7c-3e983aab8a26", "address": "fa:16:3e:41:c6:08", "network": {"id": "2110162d-c25f-4c3d-9a67-18e52f6caf43", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1854809203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba4d99c1c6c4472be06502d8b0e75a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb7dda5f-1f", "ovs_interfaceid": "bb7dda5f-1f48-4d4f-bd7c-3e983aab8a26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:35:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-6e9f0b7f-eac2-4669-bb0c-165781027c9e req-006c7ac4-7478-4dfb-b25b-eea16fd9ff86 service nova] Releasing lock "refresh_cache-2b150aa0-612b-4ccd-87d3-3b38c1af96d7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:35:11 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f4fa79b-345a-4e58-a77c-fdfed675e6e7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:35:11 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f4fa79b-345a-4e58-a77c-fdfed675e6e7/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:35:11 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f4fa79b-345a-4e58-a77c-fdfed675e6e7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:35:11 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:35:11 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f4fa79b-345a-4e58-a77c-fdfed675e6e7/disk.rescue --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:35:11 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f4fa79b-345a-4e58-a77c-fdfed675e6e7/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:35:11 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f4fa79b-345a-4e58-a77c-fdfed675e6e7/disk.rescue --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:35:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f4fa79b-345a-4e58-a77c-fdfed675e6e7/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:35:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk.rescue --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:35:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:35:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk.rescue --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:35:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:35:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:35:12 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:35:12 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:35:12 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:35:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:35:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:35:12 user nova-compute[75245]: DEBUG nova.compute.manager [req-484d455b-2868-4b6a-a51b-e875c1310996 req-aca92e88-6645-44e4-bde8-52335ef4ba1e service nova] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] Received event network-vif-plugged-bb7dda5f-1f48-4d4f-bd7c-3e983aab8a26 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:35:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-484d455b-2868-4b6a-a51b-e875c1310996 req-aca92e88-6645-44e4-bde8-52335ef4ba1e service nova] Acquiring lock "2b150aa0-612b-4ccd-87d3-3b38c1af96d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:35:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-484d455b-2868-4b6a-a51b-e875c1310996 req-aca92e88-6645-44e4-bde8-52335ef4ba1e service nova] Lock "2b150aa0-612b-4ccd-87d3-3b38c1af96d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:35:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-484d455b-2868-4b6a-a51b-e875c1310996 req-aca92e88-6645-44e4-bde8-52335ef4ba1e service nova] Lock "2b150aa0-612b-4ccd-87d3-3b38c1af96d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:35:12 user nova-compute[75245]: DEBUG nova.compute.manager [req-484d455b-2868-4b6a-a51b-e875c1310996 req-aca92e88-6645-44e4-bde8-52335ef4ba1e service nova] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] No waiting events found dispatching network-vif-plugged-bb7dda5f-1f48-4d4f-bd7c-3e983aab8a26 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:35:12 user nova-compute[75245]: WARNING nova.compute.manager [req-484d455b-2868-4b6a-a51b-e875c1310996 req-aca92e88-6645-44e4-bde8-52335ef4ba1e service nova] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] Received unexpected event network-vif-plugged-bb7dda5f-1f48-4d4f-bd7c-3e983aab8a26 for instance with vm_state building and task_state spawning.
Nov 29 16:35:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:35:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24fb8ee5-4eee-4976-bcab-24242ef70d39/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:35:13 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24fb8ee5-4eee-4976-bcab-24242ef70d39/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:35:13 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24fb8ee5-4eee-4976-bcab-24242ef70d39/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:35:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:35:13 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24fb8ee5-4eee-4976-bcab-24242ef70d39/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:35:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:35:13 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78784fb7-a25f-4c6c-9a44-649c994004c7/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:35:13 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78784fb7-a25f-4c6c-9a44-649c994004c7/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:35:13 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78784fb7-a25f-4c6c-9a44-649c994004c7/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:35:13 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78784fb7-a25f-4c6c-9a44-649c994004c7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:35:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:35:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:35:14 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:35:14 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:35:14 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Hypervisor/Node resource view: name=user free_ram=8191MB free_disk=24.883590698242188GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75245) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 16:35:14 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:35:14 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:35:14 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 8785a3c2-5b7a-4382-b50d-cecd8743329c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:35:14 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 5de7e10c-f216-46b3-8f74-57bac6ab7e56 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:35:14 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:35:14 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance ed9d1ad5-f5d0-4a68-a073-e7a83be772ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:35:14 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 78784fb7-a25f-4c6c-9a44-649c994004c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:35:14 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 0f4fa79b-345a-4e58-a77c-fdfed675e6e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:35:14 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 26acb3c4-b081-4670-a6b5-d40583c23592 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:35:14 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 24fb8ee5-4eee-4976-bcab-24242ef70d39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:35:14 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 2b150aa0-612b-4ccd-87d3-3b38c1af96d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:35:14 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 16:35:14 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 16:35:14 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:35:14 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:35:14 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Compute_service record updated for user:user {{(pid=75245) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 16:35:14 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.400s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:35:14 user nova-compute[75245]: DEBUG nova.compute.manager [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] Instance event wait completed in 0 seconds for  {{(pid=75245) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 16:35:14 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] Guest created on hypervisor {{(pid=75245) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 16:35:14 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] Instance spawned successfully.
Nov 29 16:35:14 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 16:35:14 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] Found default for hw_cdrom_bus of ide {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:35:14 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] Found default for hw_disk_bus of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:35:14 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] Found default for hw_input_bus of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:35:14 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] Found default for hw_pointer_model of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:35:14 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] Found default for hw_video_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:35:14 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] Found default for hw_vif_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:35:14 user nova-compute[75245]: INFO nova.compute.manager [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] Took 5.74 seconds to spawn the instance on the hypervisor.
Nov 29 16:35:14 user nova-compute[75245]: DEBUG nova.compute.manager [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:35:14 user nova-compute[75245]: DEBUG nova.compute.manager [req-de515ef1-d546-49ec-826f-758a5d571ed3 req-f1e99f0a-5353-46cf-a855-28c8acfe4264 service nova] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] Received event network-vif-plugged-bb7dda5f-1f48-4d4f-bd7c-3e983aab8a26 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:35:14 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-de515ef1-d546-49ec-826f-758a5d571ed3 req-f1e99f0a-5353-46cf-a855-28c8acfe4264 service nova] Acquiring lock "2b150aa0-612b-4ccd-87d3-3b38c1af96d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:35:14 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-de515ef1-d546-49ec-826f-758a5d571ed3 req-f1e99f0a-5353-46cf-a855-28c8acfe4264 service nova] Lock "2b150aa0-612b-4ccd-87d3-3b38c1af96d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:35:14 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-de515ef1-d546-49ec-826f-758a5d571ed3 req-f1e99f0a-5353-46cf-a855-28c8acfe4264 service nova] Lock "2b150aa0-612b-4ccd-87d3-3b38c1af96d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:35:14 user nova-compute[75245]: DEBUG nova.compute.manager [req-de515ef1-d546-49ec-826f-758a5d571ed3 req-f1e99f0a-5353-46cf-a855-28c8acfe4264 service nova] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] No waiting events found dispatching network-vif-plugged-bb7dda5f-1f48-4d4f-bd7c-3e983aab8a26 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:35:14 user nova-compute[75245]: WARNING nova.compute.manager [req-de515ef1-d546-49ec-826f-758a5d571ed3 req-f1e99f0a-5353-46cf-a855-28c8acfe4264 service nova] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] Received unexpected event network-vif-plugged-bb7dda5f-1f48-4d4f-bd7c-3e983aab8a26 for instance with vm_state building and task_state spawning.
Nov 29 16:35:14 user nova-compute[75245]: INFO nova.compute.manager [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] Took 6.46 seconds to build instance.
Nov 29 16:35:14 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-14dd2fac-e081-4578-b6df-8670bde16f22 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lock "2b150aa0-612b-4ccd-87d3-3b38c1af96d7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.568s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:35:16 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:35:18 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:35:18 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:35:18 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:35:19 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:35:19 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:35:21 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:35:22 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:35:22 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75245) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 16:35:26 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:35:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:35:31 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:35:33 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:35:36 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:35:38 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:35:41 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:35:43 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:35:46 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:35:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:35:51 user nova-compute[75245]: INFO nova.compute.manager [None req-0d7e5c41-632a-4da5-a772-931b54309c32 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Unrescuing
Nov 29 16:35:51 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-0d7e5c41-632a-4da5-a772-931b54309c32 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Acquiring lock "refresh_cache-0f4fa79b-345a-4e58-a77c-fdfed675e6e7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:35:51 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-0d7e5c41-632a-4da5-a772-931b54309c32 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Acquired lock "refresh_cache-0f4fa79b-345a-4e58-a77c-fdfed675e6e7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:35:51 user nova-compute[75245]: DEBUG nova.network.neutron [None req-0d7e5c41-632a-4da5-a772-931b54309c32 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 16:35:51 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4046f06c-11e9-408a-a583-a194fb8919f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Acquiring lock "26acb3c4-b081-4670-a6b5-d40583c23592" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:35:51 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4046f06c-11e9-408a-a583-a194fb8919f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "26acb3c4-b081-4670-a6b5-d40583c23592" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:35:51 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4046f06c-11e9-408a-a583-a194fb8919f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Acquiring lock "26acb3c4-b081-4670-a6b5-d40583c23592-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:35:51 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4046f06c-11e9-408a-a583-a194fb8919f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "26acb3c4-b081-4670-a6b5-d40583c23592-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:35:51 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4046f06c-11e9-408a-a583-a194fb8919f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "26acb3c4-b081-4670-a6b5-d40583c23592-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:35:51 user nova-compute[75245]: INFO nova.compute.manager [None req-4046f06c-11e9-408a-a583-a194fb8919f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Terminating instance
Nov 29 16:35:51 user nova-compute[75245]: DEBUG nova.compute.manager [None req-4046f06c-11e9-408a-a583-a194fb8919f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Start destroying the instance on the hypervisor. {{(pid=75245) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 16:35:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:35:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:35:51 user nova-compute[75245]: DEBUG nova.network.neutron [None req-0d7e5c41-632a-4da5-a772-931b54309c32 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Updating instance_info_cache with network_info: [{"id": "0b59ddaf-c343-420d-9cf5-93d5fa48bc23", "address": "fa:16:3e:12:d2:ca", "network": {"id": "74420114-8c7f-4f7b-9589-8605e1a2b922", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1124145478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12ae03075ca94c57af11198359d26514", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b59ddaf-c3", "ovs_interfaceid": "0b59ddaf-c343-420d-9cf5-93d5fa48bc23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:35:51 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-0d7e5c41-632a-4da5-a772-931b54309c32 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Releasing lock "refresh_cache-0f4fa79b-345a-4e58-a77c-fdfed675e6e7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:35:51 user nova-compute[75245]: DEBUG nova.objects.instance [None req-0d7e5c41-632a-4da5-a772-931b54309c32 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Lazy-loading 'flavor' on Instance uuid 0f4fa79b-345a-4e58-a77c-fdfed675e6e7 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:35:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:35:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:35:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:35:52 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:35:52 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:35:52 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:35:52 user nova-compute[75245]: DEBUG nova.compute.manager [req-746546de-cd10-440e-af94-d13a559db409 req-387beb08-0f0e-4500-b6a2-8a9156d948ae service nova] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Received event network-vif-unplugged-eeb0edc6-31dc-4bbf-abc4-331ed86156a1 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:35:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-746546de-cd10-440e-af94-d13a559db409 req-387beb08-0f0e-4500-b6a2-8a9156d948ae service nova] Acquiring lock "26acb3c4-b081-4670-a6b5-d40583c23592-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:35:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-746546de-cd10-440e-af94-d13a559db409 req-387beb08-0f0e-4500-b6a2-8a9156d948ae service nova] Lock "26acb3c4-b081-4670-a6b5-d40583c23592-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:35:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-746546de-cd10-440e-af94-d13a559db409 req-387beb08-0f0e-4500-b6a2-8a9156d948ae service nova] Lock "26acb3c4-b081-4670-a6b5-d40583c23592-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:35:52 user nova-compute[75245]: DEBUG nova.compute.manager [req-746546de-cd10-440e-af94-d13a559db409 req-387beb08-0f0e-4500-b6a2-8a9156d948ae service nova] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] No waiting events found dispatching network-vif-unplugged-eeb0edc6-31dc-4bbf-abc4-331ed86156a1 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:35:52 user nova-compute[75245]: DEBUG nova.compute.manager [req-746546de-cd10-440e-af94-d13a559db409 req-387beb08-0f0e-4500-b6a2-8a9156d948ae service nova] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Received event network-vif-unplugged-eeb0edc6-31dc-4bbf-abc4-331ed86156a1 for instance with task_state deleting. {{(pid=75245) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 16:35:52 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:35:52 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:35:52 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:35:52 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:35:52 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:35:52 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:35:52 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Instance destroyed successfully.
Nov 29 16:35:52 user nova-compute[75245]: DEBUG nova.objects.instance [None req-4046f06c-11e9-408a-a583-a194fb8919f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lazy-loading 'resources' on Instance uuid 26acb3c4-b081-4670-a6b5-d40583c23592 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:35:52 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-4046f06c-11e9-408a-a583-a194fb8919f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:30:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-210891752',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-210891752',id=30,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:32:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1d52776451e947f5a9ef3fa44ac8acbb',ramdisk_id='',reservation_id='r-wn1p5h7d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1780163218',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:34:06Z,user_data=None,user_id='4f20e7c9ae22462ea6bc623c93697fce',uuid=26acb3c4-b081-4670-a6b5-d40583c23592,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eeb0edc6-31dc-4bbf-abc4-331ed86156a1", "address": "fa:16:3e:78:78:ae", "network": {"id": "6a7f7426-b595-4aa3-bf80-cc92ba7ce15e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-917300903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d52776451e947f5a9ef3fa44ac8acbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb0edc6-31", "ovs_interfaceid": "eeb0edc6-31dc-4bbf-abc4-331ed86156a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 16:35:52 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-4046f06c-11e9-408a-a583-a194fb8919f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Converting VIF {"id": "eeb0edc6-31dc-4bbf-abc4-331ed86156a1", "address": "fa:16:3e:78:78:ae", "network": {"id": "6a7f7426-b595-4aa3-bf80-cc92ba7ce15e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-917300903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d52776451e947f5a9ef3fa44ac8acbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb0edc6-31", "ovs_interfaceid": "eeb0edc6-31dc-4bbf-abc4-331ed86156a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:35:52 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-4046f06c-11e9-408a-a583-a194fb8919f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:78:78:ae,bridge_name='br-int',has_traffic_filtering=True,id=eeb0edc6-31dc-4bbf-abc4-331ed86156a1,network=Network(6a7f7426-b595-4aa3-bf80-cc92ba7ce15e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeb0edc6-31') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:35:52 user nova-compute[75245]: DEBUG os_vif [None req-4046f06c-11e9-408a-a583-a194fb8919f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:78:ae,bridge_name='br-int',has_traffic_filtering=True,id=eeb0edc6-31dc-4bbf-abc4-331ed86156a1,network=Network(6a7f7426-b595-4aa3-bf80-cc92ba7ce15e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeb0edc6-31') {{(pid=75245) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 16:35:52 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:35:52 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeeb0edc6-31, bridge=br-int, if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:35:52 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:35:52 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Instance destroyed successfully.
Nov 29 16:35:52 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:35:52 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:35:52 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0455b712-1063-45a4-ad40-72cbea8bdc58) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:35:52 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:35:52 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:35:52 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:35:52 user nova-compute[75245]: INFO os_vif [None req-4046f06c-11e9-408a-a583-a194fb8919f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:78:ae,bridge_name='br-int',has_traffic_filtering=True,id=eeb0edc6-31dc-4bbf-abc4-331ed86156a1,network=Network(6a7f7426-b595-4aa3-bf80-cc92ba7ce15e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeb0edc6-31')
Nov 29 16:35:52 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4046f06c-11e9-408a-a583-a194fb8919f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] calling os-brick to detach iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 16:35:52 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-4046f06c-11e9-408a-a583-a194fb8919f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, {'target_iqn': 'iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dZxsPKjh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:35:52 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-4046f06c-11e9-408a-a583-a194fb8919f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:35:52 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-4046f06c-11e9-408a-a583-a194fb8919f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:35:52 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-4046f06c-11e9-408a-a583-a194fb8919f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:35:52 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:35:52 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:35:52 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:35:52 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6c36ea-f785-40e4-a0b5-cfb6db630ba2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:298a22d2-7a11-4639-bfae-04f0e4a0716e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:35:52 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-4046f06c-11e9-408a-a583-a194fb8919f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 16:35:52 user nova-compute[75245]: No targets found.
Nov 29 16:35:52 user nova-compute[75245]: iSNS:
Nov 29 16:35:52 user nova-compute[75245]: No targets found.
Nov 29 16:35:52 user nova-compute[75245]: STATIC:
Nov 29 16:35:52 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:298a22d2-7a11-4639-bfae-04f0e4a0716e
Nov 29 16:35:52 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:35:52 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:35:52 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf
Nov 29 16:35:52 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:35:52 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:35:52 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4
Nov 29 16:35:52 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:35:52 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:35:52 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed
Nov 29 16:35:52 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:35:52 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:35:52 user nova-compute[75245]: FIRMWARE:
Nov 29 16:35:52 user nova-compute[75245]: No targets found.
Nov 29 16:35:52 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:35:52 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-4046f06c-11e9-408a-a583-a194fb8919f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 16:35:52 user nova-compute[75245]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 16:35:52 user nova-compute[75245]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75245) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 16:35:52 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-4046f06c-11e9-408a-a583-a194fb8919f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4', 0)] {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 16:35:52 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:35:52 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:35:52 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:35:52 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a2eb41-a8bf-4486-bdf4-d01cc8d55530]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:298a22d2-7a11-4639-bfae-04f0e4a0716e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:35:52 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:35:52 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:35:52 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[f98edfc3-e90b-40af-b485-bf0bc4ddc26f]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298a22d2-7a11-4639-bfae-04f0e4a0716e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:35:52 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-4046f06c-11e9-408a-a583-a194fb8919f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)
Nov 29 16:35:52 user nova-compute[75245]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4 (non-flash)
Nov 29 16:35:52 user nova-compute[75245]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298a22d2-7a11-4639-bfae-04f0e4a0716e (non-flash)
Nov 29 16:35:52 user nova-compute[75245]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf (non-flash)
Nov 29 16:35:52 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:35:52 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-4046f06c-11e9-408a-a583-a194fb8919f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)
Nov 29 16:35:52 user nova-compute[75245]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4 (non-flash)
Nov 29 16:35:52 user nova-compute[75245]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298a22d2-7a11-4639-bfae-04f0e4a0716e (non-flash)
Nov 29 16:35:52 user nova-compute[75245]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf (non-flash)
Nov 29 16:35:52 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:35:52 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-4046f06c-11e9-408a-a583-a194fb8919f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0d206dca60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4'): ({'sdb'}, set())}) {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 16:35:52 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-4046f06c-11e9-408a-a583-a194fb8919f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Removing single pathed devices sdb {{(pid=75245) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 16:35:52 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:35:52 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:35:52 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4da3a4-c288-4852-96b5-338547e15311]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:35:52 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:35:52 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:35:52 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea09f91-2200-4803-a1b4-b1b0aea60cda]: (4, ('ok\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:35:52 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-4046f06c-11e9-408a-a583-a194fb8919f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Flushing IO for device /dev/sdb {{(pid=75245) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 16:35:52 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:35:53 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:35:53 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[48dd8970-145c-4868-94ca-a239b7534c96]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:35:53 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-4046f06c-11e9-408a-a583-a194fb8919f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75245) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 16:35:53 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:35:53 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:35:53 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d166b59-591b-4edd-9060-832aa8efb949]: (4, ('1', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:35:53 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-4046f06c-11e9-408a-a583-a194fb8919f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 16:35:53 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-4046f06c-11e9-408a-a583-a194fb8919f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] SCSI volumes sdb have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 16:35:53 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-4046f06c-11e9-408a-a583-a194fb8919f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4')] {{(pid=75245) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 16:35:53 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:35:53 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:35:53 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5c13fc-d9fe-4d6c-975c-7b0c10443f84]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:35:53 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-4046f06c-11e9-408a-a583-a194fb8919f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:35:53 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4 -p 172.16.0.220:3260 --logout {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:35:53 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:35:53 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb35d2d-7ff1-429b-a985-325b93e3b816]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:35:53 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-4046f06c-11e9-408a-a583-a194fb8919f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4, portal: 172.16.0.220,3260]
Nov 29 16:35:53 user nova-compute[75245]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4, portal: 172.16.0.220,3260] successful.
Nov 29 16:35:53 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:35:53 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4 -p 172.16.0.220:3260 --op delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:35:53 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd43ed1a-52a2-4bda-bbe0-d7f9649efcb4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:35:53 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c27b985-e4f6-4168-bfdc-c51332d5c887]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:35:53 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-4046f06c-11e9-408a-a583-a194fb8919f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:35:53 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-4046f06c-11e9-408a-a583-a194fb8919f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:35:53 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-4046f06c-11e9-408a-a583-a194fb8919f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] <== disconnect_volume: return (337ms) None {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:35:53 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4046f06c-11e9-408a-a583-a194fb8919f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Disconnected iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 16:35:53 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-4046f06c-11e9-408a-a583-a194fb8919f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Deleting instance files /opt/stack/data/nova/instances/26acb3c4-b081-4670-a6b5-d40583c23592_del
Nov 29 16:35:53 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-4046f06c-11e9-408a-a583-a194fb8919f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Deletion of /opt/stack/data/nova/instances/26acb3c4-b081-4670-a6b5-d40583c23592_del complete
Nov 29 16:35:53 user nova-compute[75245]: INFO nova.compute.manager [None req-4046f06c-11e9-408a-a583-a194fb8919f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Took 1.60 seconds to destroy the instance on the hypervisor.
Nov 29 16:35:53 user nova-compute[75245]: DEBUG oslo.service.loopingcall [None req-4046f06c-11e9-408a-a583-a194fb8919f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75245) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 16:35:53 user nova-compute[75245]: DEBUG nova.compute.manager [-] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Deallocating network for instance {{(pid=75245) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 16:35:53 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] deallocate_for_instance() {{(pid=75245) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 16:35:53 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:35:53 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:35:53 user nova-compute[75245]: INFO nova.compute.manager [-] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Took 0.56 seconds to deallocate network for instance.
Nov 29 16:35:53 user nova-compute[75245]: DEBUG nova.compute.manager [req-71e91420-b5ea-4ec0-acf0-6edecc61a5eb req-89ca6492-bc73-428c-b908-114c9ae2d40f service nova] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Received event network-vif-deleted-eeb0edc6-31dc-4bbf-abc4-331ed86156a1 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:35:53 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:35:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:35:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:35:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:35:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:35:54 user nova-compute[75245]: DEBUG nova.compute.manager [req-0ec77fd1-5f65-49c6-977e-c6b41eca1420 req-8f3d2207-bbf0-4290-aafd-be73c8dce5bc service nova] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Received event network-vif-plugged-eeb0edc6-31dc-4bbf-abc4-331ed86156a1 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:35:54 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-0ec77fd1-5f65-49c6-977e-c6b41eca1420 req-8f3d2207-bbf0-4290-aafd-be73c8dce5bc service nova] Acquiring lock "26acb3c4-b081-4670-a6b5-d40583c23592-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:35:54 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-0ec77fd1-5f65-49c6-977e-c6b41eca1420 req-8f3d2207-bbf0-4290-aafd-be73c8dce5bc service nova] Lock "26acb3c4-b081-4670-a6b5-d40583c23592-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:35:54 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-0ec77fd1-5f65-49c6-977e-c6b41eca1420 req-8f3d2207-bbf0-4290-aafd-be73c8dce5bc service nova] Lock "26acb3c4-b081-4670-a6b5-d40583c23592-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:35:54 user nova-compute[75245]: DEBUG nova.compute.manager [req-0ec77fd1-5f65-49c6-977e-c6b41eca1420 req-8f3d2207-bbf0-4290-aafd-be73c8dce5bc service nova] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] No waiting events found dispatching network-vif-plugged-eeb0edc6-31dc-4bbf-abc4-331ed86156a1 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:35:54 user nova-compute[75245]: WARNING nova.compute.manager [req-0ec77fd1-5f65-49c6-977e-c6b41eca1420 req-8f3d2207-bbf0-4290-aafd-be73c8dce5bc service nova] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Received unexpected event network-vif-plugged-eeb0edc6-31dc-4bbf-abc4-331ed86156a1 for instance with vm_state active and task_state deleting.
Nov 29 16:35:54 user nova-compute[75245]: DEBUG nova.compute.manager [req-0ec77fd1-5f65-49c6-977e-c6b41eca1420 req-8f3d2207-bbf0-4290-aafd-be73c8dce5bc service nova] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Received event network-vif-unplugged-0b59ddaf-c343-420d-9cf5-93d5fa48bc23 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:35:54 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-0ec77fd1-5f65-49c6-977e-c6b41eca1420 req-8f3d2207-bbf0-4290-aafd-be73c8dce5bc service nova] Acquiring lock "0f4fa79b-345a-4e58-a77c-fdfed675e6e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:35:54 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-0ec77fd1-5f65-49c6-977e-c6b41eca1420 req-8f3d2207-bbf0-4290-aafd-be73c8dce5bc service nova] Lock "0f4fa79b-345a-4e58-a77c-fdfed675e6e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:35:54 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-0ec77fd1-5f65-49c6-977e-c6b41eca1420 req-8f3d2207-bbf0-4290-aafd-be73c8dce5bc service nova] Lock "0f4fa79b-345a-4e58-a77c-fdfed675e6e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:35:54 user nova-compute[75245]: DEBUG nova.compute.manager [req-0ec77fd1-5f65-49c6-977e-c6b41eca1420 req-8f3d2207-bbf0-4290-aafd-be73c8dce5bc service nova] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] No waiting events found dispatching network-vif-unplugged-0b59ddaf-c343-420d-9cf5-93d5fa48bc23 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:35:54 user nova-compute[75245]: WARNING nova.compute.manager [req-0ec77fd1-5f65-49c6-977e-c6b41eca1420 req-8f3d2207-bbf0-4290-aafd-be73c8dce5bc service nova] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Received unexpected event network-vif-unplugged-0b59ddaf-c343-420d-9cf5-93d5fa48bc23 for instance with vm_state rescued and task_state unrescuing.
Nov 29 16:35:54 user nova-compute[75245]: DEBUG nova.compute.manager [req-0ec77fd1-5f65-49c6-977e-c6b41eca1420 req-8f3d2207-bbf0-4290-aafd-be73c8dce5bc service nova] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Received event network-changed-0b59ddaf-c343-420d-9cf5-93d5fa48bc23 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:35:54 user nova-compute[75245]: DEBUG nova.compute.manager [req-0ec77fd1-5f65-49c6-977e-c6b41eca1420 req-8f3d2207-bbf0-4290-aafd-be73c8dce5bc service nova] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Refreshing instance network info cache due to event network-changed-0b59ddaf-c343-420d-9cf5-93d5fa48bc23. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:35:54 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-0ec77fd1-5f65-49c6-977e-c6b41eca1420 req-8f3d2207-bbf0-4290-aafd-be73c8dce5bc service nova] Acquiring lock "refresh_cache-0f4fa79b-345a-4e58-a77c-fdfed675e6e7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:35:54 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-0ec77fd1-5f65-49c6-977e-c6b41eca1420 req-8f3d2207-bbf0-4290-aafd-be73c8dce5bc service nova] Acquired lock "refresh_cache-0f4fa79b-345a-4e58-a77c-fdfed675e6e7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:35:54 user nova-compute[75245]: DEBUG nova.network.neutron [req-0ec77fd1-5f65-49c6-977e-c6b41eca1420 req-8f3d2207-bbf0-4290-aafd-be73c8dce5bc service nova] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Refreshing network info cache for port 0b59ddaf-c343-420d-9cf5-93d5fa48bc23 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:35:54 user nova-compute[75245]: INFO nova.compute.manager [None req-4046f06c-11e9-408a-a583-a194fb8919f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Took 0.90 seconds to detach 1 volumes for instance.
Nov 29 16:35:54 user nova-compute[75245]: DEBUG nova.network.neutron [req-0ec77fd1-5f65-49c6-977e-c6b41eca1420 req-8f3d2207-bbf0-4290-aafd-be73c8dce5bc service nova] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Updated VIF entry in instance network info cache for port 0b59ddaf-c343-420d-9cf5-93d5fa48bc23. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:35:54 user nova-compute[75245]: DEBUG nova.network.neutron [req-0ec77fd1-5f65-49c6-977e-c6b41eca1420 req-8f3d2207-bbf0-4290-aafd-be73c8dce5bc service nova] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Updating instance_info_cache with network_info: [{"id": "0b59ddaf-c343-420d-9cf5-93d5fa48bc23", "address": "fa:16:3e:12:d2:ca", "network": {"id": "74420114-8c7f-4f7b-9589-8605e1a2b922", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1124145478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12ae03075ca94c57af11198359d26514", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b59ddaf-c3", "ovs_interfaceid": "0b59ddaf-c343-420d-9cf5-93d5fa48bc23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:35:54 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4046f06c-11e9-408a-a583-a194fb8919f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:35:54 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4046f06c-11e9-408a-a583-a194fb8919f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:35:54 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-0ec77fd1-5f65-49c6-977e-c6b41eca1420 req-8f3d2207-bbf0-4290-aafd-be73c8dce5bc service nova] Releasing lock "refresh_cache-0f4fa79b-345a-4e58-a77c-fdfed675e6e7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:35:54 user nova-compute[75245]: DEBUG nova.compute.manager [req-0ec77fd1-5f65-49c6-977e-c6b41eca1420 req-8f3d2207-bbf0-4290-aafd-be73c8dce5bc service nova] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Received event network-vif-plugged-0b59ddaf-c343-420d-9cf5-93d5fa48bc23 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:35:54 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-0ec77fd1-5f65-49c6-977e-c6b41eca1420 req-8f3d2207-bbf0-4290-aafd-be73c8dce5bc service nova] Acquiring lock "0f4fa79b-345a-4e58-a77c-fdfed675e6e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:35:54 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-0ec77fd1-5f65-49c6-977e-c6b41eca1420 req-8f3d2207-bbf0-4290-aafd-be73c8dce5bc service nova] Lock "0f4fa79b-345a-4e58-a77c-fdfed675e6e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:35:54 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-0ec77fd1-5f65-49c6-977e-c6b41eca1420 req-8f3d2207-bbf0-4290-aafd-be73c8dce5bc service nova] Lock "0f4fa79b-345a-4e58-a77c-fdfed675e6e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:35:54 user nova-compute[75245]: DEBUG nova.compute.manager [req-0ec77fd1-5f65-49c6-977e-c6b41eca1420 req-8f3d2207-bbf0-4290-aafd-be73c8dce5bc service nova] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] No waiting events found dispatching network-vif-plugged-0b59ddaf-c343-420d-9cf5-93d5fa48bc23 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:35:54 user nova-compute[75245]: WARNING nova.compute.manager [req-0ec77fd1-5f65-49c6-977e-c6b41eca1420 req-8f3d2207-bbf0-4290-aafd-be73c8dce5bc service nova] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Received unexpected event network-vif-plugged-0b59ddaf-c343-420d-9cf5-93d5fa48bc23 for instance with vm_state rescued and task_state unrescuing.
Nov 29 16:35:54 user nova-compute[75245]: DEBUG nova.compute.manager [req-0ec77fd1-5f65-49c6-977e-c6b41eca1420 req-8f3d2207-bbf0-4290-aafd-be73c8dce5bc service nova] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Received event network-changed-0b59ddaf-c343-420d-9cf5-93d5fa48bc23 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:35:54 user nova-compute[75245]: DEBUG nova.compute.manager [req-0ec77fd1-5f65-49c6-977e-c6b41eca1420 req-8f3d2207-bbf0-4290-aafd-be73c8dce5bc service nova] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Refreshing instance network info cache due to event network-changed-0b59ddaf-c343-420d-9cf5-93d5fa48bc23. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:35:54 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-0ec77fd1-5f65-49c6-977e-c6b41eca1420 req-8f3d2207-bbf0-4290-aafd-be73c8dce5bc service nova] Acquiring lock "refresh_cache-0f4fa79b-345a-4e58-a77c-fdfed675e6e7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:35:54 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-0ec77fd1-5f65-49c6-977e-c6b41eca1420 req-8f3d2207-bbf0-4290-aafd-be73c8dce5bc service nova] Acquired lock "refresh_cache-0f4fa79b-345a-4e58-a77c-fdfed675e6e7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:35:54 user nova-compute[75245]: DEBUG nova.network.neutron [req-0ec77fd1-5f65-49c6-977e-c6b41eca1420 req-8f3d2207-bbf0-4290-aafd-be73c8dce5bc service nova] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Refreshing network info cache for port 0b59ddaf-c343-420d-9cf5-93d5fa48bc23 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:35:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:35:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:35:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:35:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:35:55 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-4046f06c-11e9-408a-a583-a194fb8919f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:35:55 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-4046f06c-11e9-408a-a583-a194fb8919f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:35:55 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4046f06c-11e9-408a-a583-a194fb8919f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.339s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:35:55 user nova-compute[75245]: INFO nova.scheduler.client.report [None req-4046f06c-11e9-408a-a583-a194fb8919f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Deleted allocations for instance 26acb3c4-b081-4670-a6b5-d40583c23592
Nov 29 16:35:55 user nova-compute[75245]: DEBUG nova.network.neutron [req-0ec77fd1-5f65-49c6-977e-c6b41eca1420 req-8f3d2207-bbf0-4290-aafd-be73c8dce5bc service nova] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Updated VIF entry in instance network info cache for port 0b59ddaf-c343-420d-9cf5-93d5fa48bc23. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:35:55 user nova-compute[75245]: DEBUG nova.network.neutron [req-0ec77fd1-5f65-49c6-977e-c6b41eca1420 req-8f3d2207-bbf0-4290-aafd-be73c8dce5bc service nova] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Updating instance_info_cache with network_info: [{"id": "0b59ddaf-c343-420d-9cf5-93d5fa48bc23", "address": "fa:16:3e:12:d2:ca", "network": {"id": "74420114-8c7f-4f7b-9589-8605e1a2b922", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1124145478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12ae03075ca94c57af11198359d26514", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b59ddaf-c3", "ovs_interfaceid": "0b59ddaf-c343-420d-9cf5-93d5fa48bc23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:35:55 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-0ec77fd1-5f65-49c6-977e-c6b41eca1420 req-8f3d2207-bbf0-4290-aafd-be73c8dce5bc service nova] Releasing lock "refresh_cache-0f4fa79b-345a-4e58-a77c-fdfed675e6e7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:35:55 user nova-compute[75245]: DEBUG nova.compute.manager [req-0ec77fd1-5f65-49c6-977e-c6b41eca1420 req-8f3d2207-bbf0-4290-aafd-be73c8dce5bc service nova] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Received event network-vif-plugged-eeb0edc6-31dc-4bbf-abc4-331ed86156a1 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:35:55 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-0ec77fd1-5f65-49c6-977e-c6b41eca1420 req-8f3d2207-bbf0-4290-aafd-be73c8dce5bc service nova] Acquiring lock "26acb3c4-b081-4670-a6b5-d40583c23592-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:35:55 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-0ec77fd1-5f65-49c6-977e-c6b41eca1420 req-8f3d2207-bbf0-4290-aafd-be73c8dce5bc service nova] Lock "26acb3c4-b081-4670-a6b5-d40583c23592-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:35:55 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-0ec77fd1-5f65-49c6-977e-c6b41eca1420 req-8f3d2207-bbf0-4290-aafd-be73c8dce5bc service nova] Lock "26acb3c4-b081-4670-a6b5-d40583c23592-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:35:55 user nova-compute[75245]: DEBUG nova.compute.manager [req-0ec77fd1-5f65-49c6-977e-c6b41eca1420 req-8f3d2207-bbf0-4290-aafd-be73c8dce5bc service nova] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] No waiting events found dispatching network-vif-plugged-eeb0edc6-31dc-4bbf-abc4-331ed86156a1 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:35:55 user nova-compute[75245]: WARNING nova.compute.manager [req-0ec77fd1-5f65-49c6-977e-c6b41eca1420 req-8f3d2207-bbf0-4290-aafd-be73c8dce5bc service nova] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Received unexpected event network-vif-plugged-eeb0edc6-31dc-4bbf-abc4-331ed86156a1 for instance with vm_state active and task_state deleting.
Nov 29 16:35:55 user nova-compute[75245]: DEBUG nova.compute.manager [req-0ec77fd1-5f65-49c6-977e-c6b41eca1420 req-8f3d2207-bbf0-4290-aafd-be73c8dce5bc service nova] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Received event network-vif-plugged-eeb0edc6-31dc-4bbf-abc4-331ed86156a1 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:35:55 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-0ec77fd1-5f65-49c6-977e-c6b41eca1420 req-8f3d2207-bbf0-4290-aafd-be73c8dce5bc service nova] Acquiring lock "26acb3c4-b081-4670-a6b5-d40583c23592-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:35:55 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-0ec77fd1-5f65-49c6-977e-c6b41eca1420 req-8f3d2207-bbf0-4290-aafd-be73c8dce5bc service nova] Lock "26acb3c4-b081-4670-a6b5-d40583c23592-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:35:55 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-0ec77fd1-5f65-49c6-977e-c6b41eca1420 req-8f3d2207-bbf0-4290-aafd-be73c8dce5bc service nova] Lock "26acb3c4-b081-4670-a6b5-d40583c23592-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:35:55 user nova-compute[75245]: DEBUG nova.compute.manager [req-0ec77fd1-5f65-49c6-977e-c6b41eca1420 req-8f3d2207-bbf0-4290-aafd-be73c8dce5bc service nova] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] No waiting events found dispatching network-vif-plugged-eeb0edc6-31dc-4bbf-abc4-331ed86156a1 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:35:55 user nova-compute[75245]: WARNING nova.compute.manager [req-0ec77fd1-5f65-49c6-977e-c6b41eca1420 req-8f3d2207-bbf0-4290-aafd-be73c8dce5bc service nova] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Received unexpected event network-vif-plugged-eeb0edc6-31dc-4bbf-abc4-331ed86156a1 for instance with vm_state active and task_state deleting.
Nov 29 16:35:55 user nova-compute[75245]: DEBUG nova.compute.manager [req-0ec77fd1-5f65-49c6-977e-c6b41eca1420 req-8f3d2207-bbf0-4290-aafd-be73c8dce5bc service nova] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Received event network-vif-unplugged-eeb0edc6-31dc-4bbf-abc4-331ed86156a1 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:35:55 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-0ec77fd1-5f65-49c6-977e-c6b41eca1420 req-8f3d2207-bbf0-4290-aafd-be73c8dce5bc service nova] Acquiring lock "26acb3c4-b081-4670-a6b5-d40583c23592-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:35:55 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-0ec77fd1-5f65-49c6-977e-c6b41eca1420 req-8f3d2207-bbf0-4290-aafd-be73c8dce5bc service nova] Lock "26acb3c4-b081-4670-a6b5-d40583c23592-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:35:55 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-0ec77fd1-5f65-49c6-977e-c6b41eca1420 req-8f3d2207-bbf0-4290-aafd-be73c8dce5bc service nova] Lock "26acb3c4-b081-4670-a6b5-d40583c23592-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:35:55 user nova-compute[75245]: DEBUG nova.compute.manager [req-0ec77fd1-5f65-49c6-977e-c6b41eca1420 req-8f3d2207-bbf0-4290-aafd-be73c8dce5bc service nova] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] No waiting events found dispatching network-vif-unplugged-eeb0edc6-31dc-4bbf-abc4-331ed86156a1 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:35:55 user nova-compute[75245]: DEBUG nova.compute.manager [req-0ec77fd1-5f65-49c6-977e-c6b41eca1420 req-8f3d2207-bbf0-4290-aafd-be73c8dce5bc service nova] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Received event network-vif-unplugged-eeb0edc6-31dc-4bbf-abc4-331ed86156a1 for instance with task_state deleting. {{(pid=75245) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 16:35:55 user nova-compute[75245]: DEBUG nova.compute.manager [req-0ec77fd1-5f65-49c6-977e-c6b41eca1420 req-8f3d2207-bbf0-4290-aafd-be73c8dce5bc service nova] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Received event network-vif-plugged-eeb0edc6-31dc-4bbf-abc4-331ed86156a1 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:35:55 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-0ec77fd1-5f65-49c6-977e-c6b41eca1420 req-8f3d2207-bbf0-4290-aafd-be73c8dce5bc service nova] Acquiring lock "26acb3c4-b081-4670-a6b5-d40583c23592-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:35:55 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-0ec77fd1-5f65-49c6-977e-c6b41eca1420 req-8f3d2207-bbf0-4290-aafd-be73c8dce5bc service nova] Lock "26acb3c4-b081-4670-a6b5-d40583c23592-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:35:55 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-0ec77fd1-5f65-49c6-977e-c6b41eca1420 req-8f3d2207-bbf0-4290-aafd-be73c8dce5bc service nova] Lock "26acb3c4-b081-4670-a6b5-d40583c23592-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:35:55 user nova-compute[75245]: DEBUG nova.compute.manager [req-0ec77fd1-5f65-49c6-977e-c6b41eca1420 req-8f3d2207-bbf0-4290-aafd-be73c8dce5bc service nova] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] No waiting events found dispatching network-vif-plugged-eeb0edc6-31dc-4bbf-abc4-331ed86156a1 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:35:55 user nova-compute[75245]: WARNING nova.compute.manager [req-0ec77fd1-5f65-49c6-977e-c6b41eca1420 req-8f3d2207-bbf0-4290-aafd-be73c8dce5bc service nova] [instance: 26acb3c4-b081-4670-a6b5-d40583c23592] Received unexpected event network-vif-plugged-eeb0edc6-31dc-4bbf-abc4-331ed86156a1 for instance with vm_state active and task_state deleting.
Nov 29 16:35:55 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4046f06c-11e9-408a-a583-a194fb8919f8 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "26acb3c4-b081-4670-a6b5-d40583c23592" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.622s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:35:56 user nova-compute[75245]: DEBUG nova.compute.manager [req-5f0afca3-6e17-467b-95a0-8ac45e851b28 req-a4fe1fef-5883-4634-bfed-e969dd0e8da8 service nova] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Received event network-vif-plugged-0b59ddaf-c343-420d-9cf5-93d5fa48bc23 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:35:56 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-5f0afca3-6e17-467b-95a0-8ac45e851b28 req-a4fe1fef-5883-4634-bfed-e969dd0e8da8 service nova] Acquiring lock "0f4fa79b-345a-4e58-a77c-fdfed675e6e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:35:56 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-5f0afca3-6e17-467b-95a0-8ac45e851b28 req-a4fe1fef-5883-4634-bfed-e969dd0e8da8 service nova] Lock "0f4fa79b-345a-4e58-a77c-fdfed675e6e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:35:56 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-5f0afca3-6e17-467b-95a0-8ac45e851b28 req-a4fe1fef-5883-4634-bfed-e969dd0e8da8 service nova] Lock "0f4fa79b-345a-4e58-a77c-fdfed675e6e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:35:56 user nova-compute[75245]: DEBUG nova.compute.manager [req-5f0afca3-6e17-467b-95a0-8ac45e851b28 req-a4fe1fef-5883-4634-bfed-e969dd0e8da8 service nova] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] No waiting events found dispatching network-vif-plugged-0b59ddaf-c343-420d-9cf5-93d5fa48bc23 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:35:56 user nova-compute[75245]: WARNING nova.compute.manager [req-5f0afca3-6e17-467b-95a0-8ac45e851b28 req-a4fe1fef-5883-4634-bfed-e969dd0e8da8 service nova] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Received unexpected event network-vif-plugged-0b59ddaf-c343-420d-9cf5-93d5fa48bc23 for instance with vm_state rescued and task_state unrescuing.
Nov 29 16:35:56 user nova-compute[75245]: DEBUG nova.compute.manager [req-5f0afca3-6e17-467b-95a0-8ac45e851b28 req-a4fe1fef-5883-4634-bfed-e969dd0e8da8 service nova] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Received event network-vif-plugged-0b59ddaf-c343-420d-9cf5-93d5fa48bc23 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:35:56 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-5f0afca3-6e17-467b-95a0-8ac45e851b28 req-a4fe1fef-5883-4634-bfed-e969dd0e8da8 service nova] Acquiring lock "0f4fa79b-345a-4e58-a77c-fdfed675e6e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:35:56 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-5f0afca3-6e17-467b-95a0-8ac45e851b28 req-a4fe1fef-5883-4634-bfed-e969dd0e8da8 service nova] Lock "0f4fa79b-345a-4e58-a77c-fdfed675e6e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:35:56 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-5f0afca3-6e17-467b-95a0-8ac45e851b28 req-a4fe1fef-5883-4634-bfed-e969dd0e8da8 service nova] Lock "0f4fa79b-345a-4e58-a77c-fdfed675e6e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:35:56 user nova-compute[75245]: DEBUG nova.compute.manager [req-5f0afca3-6e17-467b-95a0-8ac45e851b28 req-a4fe1fef-5883-4634-bfed-e969dd0e8da8 service nova] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] No waiting events found dispatching network-vif-plugged-0b59ddaf-c343-420d-9cf5-93d5fa48bc23 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:35:56 user nova-compute[75245]: WARNING nova.compute.manager [req-5f0afca3-6e17-467b-95a0-8ac45e851b28 req-a4fe1fef-5883-4634-bfed-e969dd0e8da8 service nova] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Received unexpected event network-vif-plugged-0b59ddaf-c343-420d-9cf5-93d5fa48bc23 for instance with vm_state rescued and task_state unrescuing.
Nov 29 16:35:56 user nova-compute[75245]: DEBUG nova.compute.manager [None req-0d7e5c41-632a-4da5-a772-931b54309c32 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:35:57 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:35:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:36:02 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:36:03 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:36:07 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:36:08 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:36:08 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Starting heal instance info cache {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 16:36:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "refresh_cache-0f4fa79b-345a-4e58-a77c-fdfed675e6e7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:36:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquired lock "refresh_cache-0f4fa79b-345a-4e58-a77c-fdfed675e6e7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:36:08 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Forcefully refreshing network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 16:36:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:36:08 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Updating instance_info_cache with network_info: [{"id": "0b59ddaf-c343-420d-9cf5-93d5fa48bc23", "address": "fa:16:3e:12:d2:ca", "network": {"id": "74420114-8c7f-4f7b-9589-8605e1a2b922", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1124145478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12ae03075ca94c57af11198359d26514", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b59ddaf-c3", "ovs_interfaceid": "0b59ddaf-c343-420d-9cf5-93d5fa48bc23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:36:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Releasing lock "refresh_cache-0f4fa79b-345a-4e58-a77c-fdfed675e6e7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:36:08 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Updated the network info_cache for instance {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 16:36:10 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:36:10 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:36:10 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Cleaning up deleted instances {{(pid=75245) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 16:36:10 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] There are 0 instances to clean {{(pid=75245) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 16:36:11 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:36:12 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:36:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:36:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:36:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:36:12 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75245) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 16:36:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b150aa0-612b-4ccd-87d3-3b38c1af96d7/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:36:12 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:36:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b150aa0-612b-4ccd-87d3-3b38c1af96d7/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:36:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b150aa0-612b-4ccd-87d3-3b38c1af96d7/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:36:13 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b150aa0-612b-4ccd-87d3-3b38c1af96d7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:36:13 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:36:13 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:36:13 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:36:13 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:36:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:36:13 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:36:13 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:36:13 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:36:13 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:36:13 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f4fa79b-345a-4e58-a77c-fdfed675e6e7/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:36:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:36:13 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f4fa79b-345a-4e58-a77c-fdfed675e6e7/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:36:13 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f4fa79b-345a-4e58-a77c-fdfed675e6e7/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:36:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f4fa79b-345a-4e58-a77c-fdfed675e6e7/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:36:14 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:36:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk.rescue --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:36:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:36:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk.rescue --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:36:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:36:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:36:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:36:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:36:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:36:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24fb8ee5-4eee-4976-bcab-24242ef70d39/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:36:15 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24fb8ee5-4eee-4976-bcab-24242ef70d39/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:36:15 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24fb8ee5-4eee-4976-bcab-24242ef70d39/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:36:15 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24fb8ee5-4eee-4976-bcab-24242ef70d39/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:36:15 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:36:15 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78784fb7-a25f-4c6c-9a44-649c994004c7/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:36:15 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78784fb7-a25f-4c6c-9a44-649c994004c7/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:36:15 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78784fb7-a25f-4c6c-9a44-649c994004c7/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:36:15 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78784fb7-a25f-4c6c-9a44-649c994004c7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:36:16 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:36:16 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:36:16 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Hypervisor/Node resource view: name=user free_ram=8122MB free_disk=24.838973999023438GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75245) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 16:36:16 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:36:16 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:36:16 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 8785a3c2-5b7a-4382-b50d-cecd8743329c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:36:16 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 5de7e10c-f216-46b3-8f74-57bac6ab7e56 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:36:16 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:36:16 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance ed9d1ad5-f5d0-4a68-a073-e7a83be772ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:36:16 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 78784fb7-a25f-4c6c-9a44-649c994004c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:36:16 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 0f4fa79b-345a-4e58-a77c-fdfed675e6e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:36:16 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 24fb8ee5-4eee-4976-bcab-24242ef70d39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:36:16 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 2b150aa0-612b-4ccd-87d3-3b38c1af96d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:36:16 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 16:36:16 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 16:36:16 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Refreshing inventories for resource provider dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 16:36:16 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Updating ProviderTree inventory for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 16:36:16 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Updating inventory in ProviderTree for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 16:36:16 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Refreshing aggregate associations for resource provider dcc0ed27-167e-4f3a-a0de-183bb144a50c, aggregates: None {{(pid=75245) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 16:36:16 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Refreshing trait associations for resource provider dcc0ed27-167e-4f3a-a0de-183bb144a50c, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG {{(pid=75245) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 16:36:16 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:36:16 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:36:16 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Compute_service record updated for user:user {{(pid=75245) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 16:36:16 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.681s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:36:17 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:36:18 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:36:18 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:36:18 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:36:19 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:36:19 user nova-compute[75245]: DEBUG nova.compute.manager [req-1e2ce230-88ae-4ac4-8b13-82b95e4b1c06 req-9c5df84b-c29b-4df1-8237-7c0a472f4a21 service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Received event network-changed-62440fbd-97a8-49eb-8509-a7be044b764a {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:36:19 user nova-compute[75245]: DEBUG nova.compute.manager [req-1e2ce230-88ae-4ac4-8b13-82b95e4b1c06 req-9c5df84b-c29b-4df1-8237-7c0a472f4a21 service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Refreshing instance network info cache due to event network-changed-62440fbd-97a8-49eb-8509-a7be044b764a. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:36:19 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-1e2ce230-88ae-4ac4-8b13-82b95e4b1c06 req-9c5df84b-c29b-4df1-8237-7c0a472f4a21 service nova] Acquiring lock "refresh_cache-24fb8ee5-4eee-4976-bcab-24242ef70d39" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:36:19 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-1e2ce230-88ae-4ac4-8b13-82b95e4b1c06 req-9c5df84b-c29b-4df1-8237-7c0a472f4a21 service nova] Acquired lock "refresh_cache-24fb8ee5-4eee-4976-bcab-24242ef70d39" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:36:19 user nova-compute[75245]: DEBUG nova.network.neutron [req-1e2ce230-88ae-4ac4-8b13-82b95e4b1c06 req-9c5df84b-c29b-4df1-8237-7c0a472f4a21 service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Refreshing network info cache for port 62440fbd-97a8-49eb-8509-a7be044b764a {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:36:20 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-952d8cf0-2c9f-49d5-8eb5-146a65edae2d tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Acquiring lock "24fb8ee5-4eee-4976-bcab-24242ef70d39" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:36:20 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-952d8cf0-2c9f-49d5-8eb5-146a65edae2d tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lock "24fb8ee5-4eee-4976-bcab-24242ef70d39" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:36:20 user nova-compute[75245]: INFO nova.compute.manager [None req-952d8cf0-2c9f-49d5-8eb5-146a65edae2d tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Detaching volume 298a22d2-7a11-4639-bfae-04f0e4a0716e
Nov 29 16:36:20 user nova-compute[75245]: DEBUG nova.network.neutron [req-1e2ce230-88ae-4ac4-8b13-82b95e4b1c06 req-9c5df84b-c29b-4df1-8237-7c0a472f4a21 service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Updated VIF entry in instance network info cache for port 62440fbd-97a8-49eb-8509-a7be044b764a. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:36:20 user nova-compute[75245]: DEBUG nova.network.neutron [req-1e2ce230-88ae-4ac4-8b13-82b95e4b1c06 req-9c5df84b-c29b-4df1-8237-7c0a472f4a21 service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Updating instance_info_cache with network_info: [{"id": "62440fbd-97a8-49eb-8509-a7be044b764a", "address": "fa:16:3e:b2:63:34", "network": {"id": "02098e86-68f8-464e-84ee-bf2fb09b881b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085418471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e12002e1a11f4caf8953371e66e6652e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62440fbd-97", "ovs_interfaceid": "62440fbd-97a8-49eb-8509-a7be044b764a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:36:20 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-1e2ce230-88ae-4ac4-8b13-82b95e4b1c06 req-9c5df84b-c29b-4df1-8237-7c0a472f4a21 service nova] Releasing lock "refresh_cache-24fb8ee5-4eee-4976-bcab-24242ef70d39" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:36:20 user nova-compute[75245]: INFO nova.virt.block_device [None req-952d8cf0-2c9f-49d5-8eb5-146a65edae2d tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Attempting to driver detach volume 298a22d2-7a11-4639-bfae-04f0e4a0716e from mountpoint /dev/vdb
Nov 29 16:36:20 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-952d8cf0-2c9f-49d5-8eb5-146a65edae2d tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Attempting to detach device vdb from instance 24fb8ee5-4eee-4976-bcab-24242ef70d39 from the persistent domain config. {{(pid=75245) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 16:36:20 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-952d8cf0-2c9f-49d5-8eb5-146a65edae2d tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 16:36:20 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:36:20 user nova-compute[75245]:   <source dev="/dev/sdc"/>
Nov 29 16:36:20 user nova-compute[75245]:   <target dev="vdb" bus="virtio"/>
Nov 29 16:36:20 user nova-compute[75245]:   <serial>298a22d2-7a11-4639-bfae-04f0e4a0716e</serial>
Nov 29 16:36:20 user nova-compute[75245]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 16:36:20 user nova-compute[75245]: </disk>
Nov 29 16:36:20 user nova-compute[75245]:  {{(pid=75245) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 16:36:20 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-952d8cf0-2c9f-49d5-8eb5-146a65edae2d tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Successfully detached device vdb from instance 24fb8ee5-4eee-4976-bcab-24242ef70d39 from the persistent domain config.
Nov 29 16:36:20 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-952d8cf0-2c9f-49d5-8eb5-146a65edae2d tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 24fb8ee5-4eee-4976-bcab-24242ef70d39 from the live domain config. {{(pid=75245) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 16:36:20 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-952d8cf0-2c9f-49d5-8eb5-146a65edae2d tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 16:36:20 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:36:20 user nova-compute[75245]:   <source dev="/dev/sdc"/>
Nov 29 16:36:20 user nova-compute[75245]:   <target dev="vdb" bus="virtio"/>
Nov 29 16:36:20 user nova-compute[75245]:   <serial>298a22d2-7a11-4639-bfae-04f0e4a0716e</serial>
Nov 29 16:36:20 user nova-compute[75245]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 16:36:20 user nova-compute[75245]: </disk>
Nov 29 16:36:20 user nova-compute[75245]:  {{(pid=75245) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 16:36:20 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-952d8cf0-2c9f-49d5-8eb5-146a65edae2d tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 24fb8ee5-4eee-4976-bcab-24242ef70d39 {{(pid=75245) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 16:36:21 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:36:21 user nova-compute[75245]: DEBUG nova.compute.manager [req-3d2c4715-4662-4486-aaaf-9727266452ff req-3507aecb-a2d2-4f04-a18d-dc97b0fec7f2 service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Received event network-changed-62440fbd-97a8-49eb-8509-a7be044b764a {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:36:21 user nova-compute[75245]: DEBUG nova.compute.manager [req-3d2c4715-4662-4486-aaaf-9727266452ff req-3507aecb-a2d2-4f04-a18d-dc97b0fec7f2 service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Refreshing instance network info cache due to event network-changed-62440fbd-97a8-49eb-8509-a7be044b764a. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:36:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-3d2c4715-4662-4486-aaaf-9727266452ff req-3507aecb-a2d2-4f04-a18d-dc97b0fec7f2 service nova] Acquiring lock "refresh_cache-24fb8ee5-4eee-4976-bcab-24242ef70d39" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:36:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-3d2c4715-4662-4486-aaaf-9727266452ff req-3507aecb-a2d2-4f04-a18d-dc97b0fec7f2 service nova] Acquired lock "refresh_cache-24fb8ee5-4eee-4976-bcab-24242ef70d39" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:36:21 user nova-compute[75245]: DEBUG nova.network.neutron [req-3d2c4715-4662-4486-aaaf-9727266452ff req-3507aecb-a2d2-4f04-a18d-dc97b0fec7f2 service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Refreshing network info cache for port 62440fbd-97a8-49eb-8509-a7be044b764a {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:36:22 user nova-compute[75245]: DEBUG nova.network.neutron [req-3d2c4715-4662-4486-aaaf-9727266452ff req-3507aecb-a2d2-4f04-a18d-dc97b0fec7f2 service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Updated VIF entry in instance network info cache for port 62440fbd-97a8-49eb-8509-a7be044b764a. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:36:22 user nova-compute[75245]: DEBUG nova.network.neutron [req-3d2c4715-4662-4486-aaaf-9727266452ff req-3507aecb-a2d2-4f04-a18d-dc97b0fec7f2 service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Updating instance_info_cache with network_info: [{"id": "62440fbd-97a8-49eb-8509-a7be044b764a", "address": "fa:16:3e:b2:63:34", "network": {"id": "02098e86-68f8-464e-84ee-bf2fb09b881b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085418471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e12002e1a11f4caf8953371e66e6652e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62440fbd-97", "ovs_interfaceid": "62440fbd-97a8-49eb-8509-a7be044b764a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:36:22 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-3d2c4715-4662-4486-aaaf-9727266452ff req-3507aecb-a2d2-4f04-a18d-dc97b0fec7f2 service nova] Releasing lock "refresh_cache-24fb8ee5-4eee-4976-bcab-24242ef70d39" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:36:22 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:36:22 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75245) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 16:36:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:36:23 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:36:23 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75245) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 16:36:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:36:25 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-583adb2f-4a96-49e6-b97a-2d1100972fa3 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Acquiring lock "0f4fa79b-345a-4e58-a77c-fdfed675e6e7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:36:25 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-583adb2f-4a96-49e6-b97a-2d1100972fa3 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Lock "0f4fa79b-345a-4e58-a77c-fdfed675e6e7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:36:25 user nova-compute[75245]: INFO nova.compute.manager [None req-583adb2f-4a96-49e6-b97a-2d1100972fa3 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Detaching volume 5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf
Nov 29 16:36:25 user nova-compute[75245]: INFO nova.virt.block_device [None req-583adb2f-4a96-49e6-b97a-2d1100972fa3 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Attempting to driver detach volume 5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf from mountpoint /dev/vdb
Nov 29 16:36:25 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-583adb2f-4a96-49e6-b97a-2d1100972fa3 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Attempting to detach device vdb from instance 0f4fa79b-345a-4e58-a77c-fdfed675e6e7 from the persistent domain config. {{(pid=75245) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 16:36:25 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-583adb2f-4a96-49e6-b97a-2d1100972fa3 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 16:36:25 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:36:25 user nova-compute[75245]:   <source dev="/dev/sdd"/>
Nov 29 16:36:25 user nova-compute[75245]:   <target dev="vdb" bus="virtio"/>
Nov 29 16:36:25 user nova-compute[75245]:   <serial>5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf</serial>
Nov 29 16:36:25 user nova-compute[75245]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 16:36:25 user nova-compute[75245]: </disk>
Nov 29 16:36:25 user nova-compute[75245]:  {{(pid=75245) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 16:36:25 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-583adb2f-4a96-49e6-b97a-2d1100972fa3 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Successfully detached device vdb from instance 0f4fa79b-345a-4e58-a77c-fdfed675e6e7 from the persistent domain config.
Nov 29 16:36:25 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-583adb2f-4a96-49e6-b97a-2d1100972fa3 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0f4fa79b-345a-4e58-a77c-fdfed675e6e7 from the live domain config. {{(pid=75245) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 16:36:25 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-583adb2f-4a96-49e6-b97a-2d1100972fa3 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 16:36:25 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:36:25 user nova-compute[75245]:   <source dev="/dev/sdd"/>
Nov 29 16:36:25 user nova-compute[75245]:   <target dev="vdb" bus="virtio"/>
Nov 29 16:36:25 user nova-compute[75245]:   <serial>5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf</serial>
Nov 29 16:36:25 user nova-compute[75245]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 16:36:25 user nova-compute[75245]: </disk>
Nov 29 16:36:25 user nova-compute[75245]:  {{(pid=75245) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 16:36:25 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-583adb2f-4a96-49e6-b97a-2d1100972fa3 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0f4fa79b-345a-4e58-a77c-fdfed675e6e7 {{(pid=75245) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 16:36:27 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:36:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:36:29 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:36:29 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:36:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:36:37 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:36:40 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-952d8cf0-2c9f-49d5-8eb5-146a65edae2d tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 24fb8ee5-4eee-4976-bcab-24242ef70d39 is timed out.
Nov 29 16:36:40 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-952d8cf0-2c9f-49d5-8eb5-146a65edae2d tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Successfully detached device vdb from instance 24fb8ee5-4eee-4976-bcab-24242ef70d39 from the live domain config.
Nov 29 16:36:40 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-952d8cf0-2c9f-49d5-8eb5-146a65edae2d tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] calling os-brick to detach iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 16:36:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-952d8cf0-2c9f-49d5-8eb5-146a65edae2d tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, {'target_iqn': 'iqn.2010-10.org.openstack:298a22d2-7a11-4639-bfae-04f0e4a0716e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XQeBzoDW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:36:40 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-952d8cf0-2c9f-49d5-8eb5-146a65edae2d tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:36:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-952d8cf0-2c9f-49d5-8eb5-146a65edae2d tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:36:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-952d8cf0-2c9f-49d5-8eb5-146a65edae2d tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:36:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:36:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:36:40 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac38614-6160-4e67-bd13-cf972f80dde1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:298a22d2-7a11-4639-bfae-04f0e4a0716e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:36:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-952d8cf0-2c9f-49d5-8eb5-146a65edae2d tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 16:36:40 user nova-compute[75245]: No targets found.
Nov 29 16:36:40 user nova-compute[75245]: iSNS:
Nov 29 16:36:40 user nova-compute[75245]: No targets found.
Nov 29 16:36:40 user nova-compute[75245]: STATIC:
Nov 29 16:36:40 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:298a22d2-7a11-4639-bfae-04f0e4a0716e
Nov 29 16:36:40 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:36:40 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:36:40 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf
Nov 29 16:36:40 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:36:40 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:36:40 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed
Nov 29 16:36:40 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:36:40 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:36:40 user nova-compute[75245]: FIRMWARE:
Nov 29 16:36:40 user nova-compute[75245]: No targets found.
Nov 29 16:36:40 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:36:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-952d8cf0-2c9f-49d5-8eb5-146a65edae2d tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 16:36:40 user nova-compute[75245]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 16:36:40 user nova-compute[75245]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75245) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 16:36:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-952d8cf0-2c9f-49d5-8eb5-146a65edae2d tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:298a22d2-7a11-4639-bfae-04f0e4a0716e', 0)] {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 16:36:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:36:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:36:40 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[749491b9-23a9-44b5-9033-e0030c63adb0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:298a22d2-7a11-4639-bfae-04f0e4a0716e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:36:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:36:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:36:40 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f137fa2-9ef1-41f1-998e-fa25f1856532]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298a22d2-7a11-4639-bfae-04f0e4a0716e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:36:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-952d8cf0-2c9f-49d5-8eb5-146a65edae2d tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)
Nov 29 16:36:40 user nova-compute[75245]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298a22d2-7a11-4639-bfae-04f0e4a0716e (non-flash)
Nov 29 16:36:40 user nova-compute[75245]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf (non-flash)
Nov 29 16:36:40 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:36:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-952d8cf0-2c9f-49d5-8eb5-146a65edae2d tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)
Nov 29 16:36:40 user nova-compute[75245]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298a22d2-7a11-4639-bfae-04f0e4a0716e (non-flash)
Nov 29 16:36:40 user nova-compute[75245]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf (non-flash)
Nov 29 16:36:40 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:36:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-952d8cf0-2c9f-49d5-8eb5-146a65edae2d tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0d444725f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:298a22d2-7a11-4639-bfae-04f0e4a0716e'): ({'sdc'}, set())}) {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 16:36:40 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-952d8cf0-2c9f-49d5-8eb5-146a65edae2d tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Removing single pathed devices sdc {{(pid=75245) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 16:36:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:36:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:36:40 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[867bff73-31df-47c4-aa5d-1352ee6e614e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:36:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:36:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:36:40 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[f646be62-4d2d-4b67-93f7-ed9c637c95d6]: (4, ('ok\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:36:40 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-952d8cf0-2c9f-49d5-8eb5-146a65edae2d tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Flushing IO for device /dev/sdc {{(pid=75245) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 16:36:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:36:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:36:40 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c99c47a-c20d-4f3c-ab3a-df678a252e80]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:36:40 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-952d8cf0-2c9f-49d5-8eb5-146a65edae2d tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75245) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 16:36:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:36:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:36:40 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ffa677-ac3c-455f-9281-2758901bf370]: (4, ('1', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:36:40 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-952d8cf0-2c9f-49d5-8eb5-146a65edae2d tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 16:36:40 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-952d8cf0-2c9f-49d5-8eb5-146a65edae2d tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] SCSI volumes sdc have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 16:36:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-952d8cf0-2c9f-49d5-8eb5-146a65edae2d tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:298a22d2-7a11-4639-bfae-04f0e4a0716e')] {{(pid=75245) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 16:36:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:298a22d2-7a11-4639-bfae-04f0e4a0716e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:36:41 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:298a22d2-7a11-4639-bfae-04f0e4a0716e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:36:41 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[edfabd84-946a-4efe-a32a-2d71be662af9]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:36:41 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-952d8cf0-2c9f-49d5-8eb5-146a65edae2d tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:36:41 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:298a22d2-7a11-4639-bfae-04f0e4a0716e -p 172.16.0.220:3260 --logout {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:36:41 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:298a22d2-7a11-4639-bfae-04f0e4a0716e -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:36:41 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[0300b40c-2c28-4853-9f8d-1853a89e2075]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:298a22d2-7a11-4639-bfae-04f0e4a0716e, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:298a22d2-7a11-4639-bfae-04f0e4a0716e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:36:41 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-952d8cf0-2c9f-49d5-8eb5-146a65edae2d tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:298a22d2-7a11-4639-bfae-04f0e4a0716e, portal: 172.16.0.220,3260]
Nov 29 16:36:41 user nova-compute[75245]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:298a22d2-7a11-4639-bfae-04f0e4a0716e, portal: 172.16.0.220,3260] successful.
Nov 29 16:36:41 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:36:41 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:298a22d2-7a11-4639-bfae-04f0e4a0716e -p 172.16.0.220:3260 --op delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:36:41 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:298a22d2-7a11-4639-bfae-04f0e4a0716e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:36:41 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb48cf24-03ed-4603-a438-4a5102b7df0e]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:36:41 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-952d8cf0-2c9f-49d5-8eb5-146a65edae2d tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:36:41 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-952d8cf0-2c9f-49d5-8eb5-146a65edae2d tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:36:41 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-952d8cf0-2c9f-49d5-8eb5-146a65edae2d tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] <== disconnect_volume: return (317ms) None {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:36:41 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-952d8cf0-2c9f-49d5-8eb5-146a65edae2d tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Disconnected iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 16:36:41 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:36:41 user nova-compute[75245]: DEBUG nova.objects.instance [None req-952d8cf0-2c9f-49d5-8eb5-146a65edae2d tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lazy-loading 'flavor' on Instance uuid 24fb8ee5-4eee-4976-bcab-24242ef70d39 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:36:42 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-952d8cf0-2c9f-49d5-8eb5-146a65edae2d tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lock "24fb8ee5-4eee-4976-bcab-24242ef70d39" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.809s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:36:42 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d38d8a35-d745-4a57-888c-d41aeb36cfc1 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Acquiring lock "78784fb7-a25f-4c6c-9a44-649c994004c7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:36:42 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d38d8a35-d745-4a57-888c-d41aeb36cfc1 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "78784fb7-a25f-4c6c-9a44-649c994004c7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:36:42 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d38d8a35-d745-4a57-888c-d41aeb36cfc1 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Acquiring lock "78784fb7-a25f-4c6c-9a44-649c994004c7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:36:42 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d38d8a35-d745-4a57-888c-d41aeb36cfc1 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "78784fb7-a25f-4c6c-9a44-649c994004c7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:36:42 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d38d8a35-d745-4a57-888c-d41aeb36cfc1 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "78784fb7-a25f-4c6c-9a44-649c994004c7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:36:42 user nova-compute[75245]: INFO nova.compute.manager [None req-d38d8a35-d745-4a57-888c-d41aeb36cfc1 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 78784fb7-a25f-4c6c-9a44-649c994004c7] Terminating instance
Nov 29 16:36:42 user nova-compute[75245]: DEBUG nova.compute.manager [None req-d38d8a35-d745-4a57-888c-d41aeb36cfc1 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 78784fb7-a25f-4c6c-9a44-649c994004c7] Start destroying the instance on the hypervisor. {{(pid=75245) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 16:36:42 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:36:42 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:36:42 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:36:43 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:36:43 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:36:43 user nova-compute[75245]: DEBUG nova.compute.manager [req-3d3df1f8-2af8-44a3-b0c8-1733af3b91dd req-2f222953-8e78-40c8-8c4e-b3032dec238e service nova] [instance: 78784fb7-a25f-4c6c-9a44-649c994004c7] Received event network-vif-unplugged-be7f7c96-525a-4895-933d-a680c6bbf4f2 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:36:43 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-3d3df1f8-2af8-44a3-b0c8-1733af3b91dd req-2f222953-8e78-40c8-8c4e-b3032dec238e service nova] Acquiring lock "78784fb7-a25f-4c6c-9a44-649c994004c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:36:43 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-3d3df1f8-2af8-44a3-b0c8-1733af3b91dd req-2f222953-8e78-40c8-8c4e-b3032dec238e service nova] Lock "78784fb7-a25f-4c6c-9a44-649c994004c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:36:43 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-3d3df1f8-2af8-44a3-b0c8-1733af3b91dd req-2f222953-8e78-40c8-8c4e-b3032dec238e service nova] Lock "78784fb7-a25f-4c6c-9a44-649c994004c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:36:43 user nova-compute[75245]: DEBUG nova.compute.manager [req-3d3df1f8-2af8-44a3-b0c8-1733af3b91dd req-2f222953-8e78-40c8-8c4e-b3032dec238e service nova] [instance: 78784fb7-a25f-4c6c-9a44-649c994004c7] No waiting events found dispatching network-vif-unplugged-be7f7c96-525a-4895-933d-a680c6bbf4f2 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:36:43 user nova-compute[75245]: DEBUG nova.compute.manager [req-3d3df1f8-2af8-44a3-b0c8-1733af3b91dd req-2f222953-8e78-40c8-8c4e-b3032dec238e service nova] [instance: 78784fb7-a25f-4c6c-9a44-649c994004c7] Received event network-vif-unplugged-be7f7c96-525a-4895-933d-a680c6bbf4f2 for instance with task_state deleting. {{(pid=75245) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 16:36:43 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:36:43 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 78784fb7-a25f-4c6c-9a44-649c994004c7] Instance destroyed successfully.
Nov 29 16:36:43 user nova-compute[75245]: DEBUG nova.objects.instance [None req-d38d8a35-d745-4a57-888c-d41aeb36cfc1 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lazy-loading 'resources' on Instance uuid 78784fb7-a25f-4c6c-9a44-649c994004c7 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:36:43 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-d38d8a35-d745-4a57-888c-d41aeb36cfc1 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:27:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1566046722',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1566046722',id=28,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:27:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1d52776451e947f5a9ef3fa44ac8acbb',ramdisk_id='',reservation_id='r-ztv0bcou',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1780163218',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:29:17Z,user_data=None,user_id='4f20e7c9ae22462ea6bc623c93697fce',uuid=78784fb7-a25f-4c6c-9a44-649c994004c7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "be7f7c96-525a-4895-933d-a680c6bbf4f2", "address": "fa:16:3e:f3:a2:bb", "network": {"id": "6a7f7426-b595-4aa3-bf80-cc92ba7ce15e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-917300903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d52776451e947f5a9ef3fa44ac8acbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe7f7c96-52", "ovs_interfaceid": "be7f7c96-525a-4895-933d-a680c6bbf4f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 16:36:43 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-d38d8a35-d745-4a57-888c-d41aeb36cfc1 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Converting VIF {"id": "be7f7c96-525a-4895-933d-a680c6bbf4f2", "address": "fa:16:3e:f3:a2:bb", "network": {"id": "6a7f7426-b595-4aa3-bf80-cc92ba7ce15e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-917300903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d52776451e947f5a9ef3fa44ac8acbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe7f7c96-52", "ovs_interfaceid": "be7f7c96-525a-4895-933d-a680c6bbf4f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:36:43 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-d38d8a35-d745-4a57-888c-d41aeb36cfc1 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f3:a2:bb,bridge_name='br-int',has_traffic_filtering=True,id=be7f7c96-525a-4895-933d-a680c6bbf4f2,network=Network(6a7f7426-b595-4aa3-bf80-cc92ba7ce15e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe7f7c96-52') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:36:43 user nova-compute[75245]: DEBUG os_vif [None req-d38d8a35-d745-4a57-888c-d41aeb36cfc1 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:a2:bb,bridge_name='br-int',has_traffic_filtering=True,id=be7f7c96-525a-4895-933d-a680c6bbf4f2,network=Network(6a7f7426-b595-4aa3-bf80-cc92ba7ce15e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe7f7c96-52') {{(pid=75245) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 16:36:43 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:36:43 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbe7f7c96-52, bridge=br-int, if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:36:43 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:36:43 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:36:43 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:36:43 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bb8e20a6-7c03-443f-9dd4-93047a96dbf4) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:36:43 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:36:43 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:36:43 user nova-compute[75245]: INFO os_vif [None req-d38d8a35-d745-4a57-888c-d41aeb36cfc1 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:a2:bb,bridge_name='br-int',has_traffic_filtering=True,id=be7f7c96-525a-4895-933d-a680c6bbf4f2,network=Network(6a7f7426-b595-4aa3-bf80-cc92ba7ce15e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe7f7c96-52')
Nov 29 16:36:43 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-d38d8a35-d745-4a57-888c-d41aeb36cfc1 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 78784fb7-a25f-4c6c-9a44-649c994004c7] Deleting instance files /opt/stack/data/nova/instances/78784fb7-a25f-4c6c-9a44-649c994004c7_del
Nov 29 16:36:43 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-d38d8a35-d745-4a57-888c-d41aeb36cfc1 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 78784fb7-a25f-4c6c-9a44-649c994004c7] Deletion of /opt/stack/data/nova/instances/78784fb7-a25f-4c6c-9a44-649c994004c7_del complete
Nov 29 16:36:43 user nova-compute[75245]: INFO nova.compute.manager [None req-d38d8a35-d745-4a57-888c-d41aeb36cfc1 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 78784fb7-a25f-4c6c-9a44-649c994004c7] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 29 16:36:43 user nova-compute[75245]: DEBUG oslo.service.loopingcall [None req-d38d8a35-d745-4a57-888c-d41aeb36cfc1 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75245) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 16:36:43 user nova-compute[75245]: DEBUG nova.compute.manager [-] [instance: 78784fb7-a25f-4c6c-9a44-649c994004c7] Deallocating network for instance {{(pid=75245) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 16:36:43 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: 78784fb7-a25f-4c6c-9a44-649c994004c7] deallocate_for_instance() {{(pid=75245) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 16:36:44 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: 78784fb7-a25f-4c6c-9a44-649c994004c7] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:36:44 user nova-compute[75245]: INFO nova.compute.manager [-] [instance: 78784fb7-a25f-4c6c-9a44-649c994004c7] Took 0.71 seconds to deallocate network for instance.
Nov 29 16:36:44 user nova-compute[75245]: DEBUG nova.compute.manager [req-63c1100e-94ab-4544-8426-62f5d21c712d req-87b3ee97-8bac-4b34-820c-f8f129285b55 service nova] [instance: 78784fb7-a25f-4c6c-9a44-649c994004c7] Received event network-vif-deleted-be7f7c96-525a-4895-933d-a680c6bbf4f2 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:36:44 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d38d8a35-d745-4a57-888c-d41aeb36cfc1 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:36:44 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d38d8a35-d745-4a57-888c-d41aeb36cfc1 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:36:44 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-d38d8a35-d745-4a57-888c-d41aeb36cfc1 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:36:44 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-d38d8a35-d745-4a57-888c-d41aeb36cfc1 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:36:44 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d38d8a35-d745-4a57-888c-d41aeb36cfc1 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.284s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:36:44 user nova-compute[75245]: INFO nova.scheduler.client.report [None req-d38d8a35-d745-4a57-888c-d41aeb36cfc1 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Deleted allocations for instance 78784fb7-a25f-4c6c-9a44-649c994004c7
Nov 29 16:36:44 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d38d8a35-d745-4a57-888c-d41aeb36cfc1 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "78784fb7-a25f-4c6c-9a44-649c994004c7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.095s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:36:45 user nova-compute[75245]: DEBUG nova.compute.manager [req-03f2fa68-0fd5-48e4-b644-a3f22b71cf4e req-cba5dbe5-2c35-4738-a2b2-8e38a329ca55 service nova] [instance: 78784fb7-a25f-4c6c-9a44-649c994004c7] Received event network-vif-plugged-be7f7c96-525a-4895-933d-a680c6bbf4f2 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:36:45 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-03f2fa68-0fd5-48e4-b644-a3f22b71cf4e req-cba5dbe5-2c35-4738-a2b2-8e38a329ca55 service nova] Acquiring lock "78784fb7-a25f-4c6c-9a44-649c994004c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:36:45 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-03f2fa68-0fd5-48e4-b644-a3f22b71cf4e req-cba5dbe5-2c35-4738-a2b2-8e38a329ca55 service nova] Lock "78784fb7-a25f-4c6c-9a44-649c994004c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:36:45 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-03f2fa68-0fd5-48e4-b644-a3f22b71cf4e req-cba5dbe5-2c35-4738-a2b2-8e38a329ca55 service nova] Lock "78784fb7-a25f-4c6c-9a44-649c994004c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:36:45 user nova-compute[75245]: DEBUG nova.compute.manager [req-03f2fa68-0fd5-48e4-b644-a3f22b71cf4e req-cba5dbe5-2c35-4738-a2b2-8e38a329ca55 service nova] [instance: 78784fb7-a25f-4c6c-9a44-649c994004c7] No waiting events found dispatching network-vif-plugged-be7f7c96-525a-4895-933d-a680c6bbf4f2 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:36:45 user nova-compute[75245]: WARNING nova.compute.manager [req-03f2fa68-0fd5-48e4-b644-a3f22b71cf4e req-cba5dbe5-2c35-4738-a2b2-8e38a329ca55 service nova] [instance: 78784fb7-a25f-4c6c-9a44-649c994004c7] Received unexpected event network-vif-plugged-be7f7c96-525a-4895-933d-a680c6bbf4f2 for instance with vm_state deleted and task_state None.
Nov 29 16:36:45 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-583adb2f-4a96-49e6-b97a-2d1100972fa3 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0f4fa79b-345a-4e58-a77c-fdfed675e6e7 is timed out.
Nov 29 16:36:45 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-583adb2f-4a96-49e6-b97a-2d1100972fa3 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Successfully detached device vdb from instance 0f4fa79b-345a-4e58-a77c-fdfed675e6e7 from the live domain config.
Nov 29 16:36:45 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-583adb2f-4a96-49e6-b97a-2d1100972fa3 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] calling os-brick to detach iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 16:36:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-583adb2f-4a96-49e6-b97a-2d1100972fa3 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, {'target_iqn': 'iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lDgMFYAT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:36:45 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-583adb2f-4a96-49e6-b97a-2d1100972fa3 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:36:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-583adb2f-4a96-49e6-b97a-2d1100972fa3 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:36:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-583adb2f-4a96-49e6-b97a-2d1100972fa3 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:36:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:36:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:36:45 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[18bb14d4-36a3-4381-ba45-0dec4ef01e43]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:36:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-583adb2f-4a96-49e6-b97a-2d1100972fa3 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 16:36:45 user nova-compute[75245]: No targets found.
Nov 29 16:36:45 user nova-compute[75245]: iSNS:
Nov 29 16:36:45 user nova-compute[75245]: No targets found.
Nov 29 16:36:45 user nova-compute[75245]: STATIC:
Nov 29 16:36:45 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf
Nov 29 16:36:45 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:36:45 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:36:45 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed
Nov 29 16:36:45 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:36:45 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:36:45 user nova-compute[75245]: FIRMWARE:
Nov 29 16:36:45 user nova-compute[75245]: No targets found.
Nov 29 16:36:45 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:36:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-583adb2f-4a96-49e6-b97a-2d1100972fa3 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 16:36:45 user nova-compute[75245]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 16:36:45 user nova-compute[75245]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75245) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 16:36:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-583adb2f-4a96-49e6-b97a-2d1100972fa3 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf', 0)] {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 16:36:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:36:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:36:45 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[0673f009-ed58-4121-97a3-9f5690727603]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:36:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:36:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:36:45 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[bebcbd7c-5df5-4292-9221-c7356d4cdce6]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:36:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-583adb2f-4a96-49e6-b97a-2d1100972fa3 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)
Nov 29 16:36:45 user nova-compute[75245]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf (non-flash)
Nov 29 16:36:45 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:36:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-583adb2f-4a96-49e6-b97a-2d1100972fa3 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)
Nov 29 16:36:45 user nova-compute[75245]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf (non-flash)
Nov 29 16:36:45 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:36:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-583adb2f-4a96-49e6-b97a-2d1100972fa3 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0d444312d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf'): ({'sdd'}, set())}) {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 16:36:45 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-583adb2f-4a96-49e6-b97a-2d1100972fa3 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Removing single pathed devices sdd {{(pid=75245) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 16:36:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:36:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:36:45 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ead1a30-d3ab-4ec2-a607-1d3e7265c90c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:36:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:36:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:36:45 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c21683-fa32-4e7a-84c1-b2aa2ed6113a]: (4, ('ok\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:36:45 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-583adb2f-4a96-49e6-b97a-2d1100972fa3 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Flushing IO for device /dev/sdd {{(pid=75245) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 16:36:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:36:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:36:45 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[f42f9a09-1e77-482e-9927-82ba9f9ea14d]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:36:45 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-583adb2f-4a96-49e6-b97a-2d1100972fa3 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75245) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 16:36:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:36:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:36:45 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[35592a3e-8f86-4807-b53b-1d33ae419882]: (4, ('1', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:36:45 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-583adb2f-4a96-49e6-b97a-2d1100972fa3 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 16:36:45 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-583adb2f-4a96-49e6-b97a-2d1100972fa3 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] SCSI volumes sdd have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 16:36:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-583adb2f-4a96-49e6-b97a-2d1100972fa3 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf')] {{(pid=75245) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 16:36:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:36:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:36:45 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[82011e3d-0c63-450d-9364-880a07098bb4]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:36:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-583adb2f-4a96-49e6-b97a-2d1100972fa3 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:36:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf -p 172.16.0.220:3260 --logout {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:36:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:36:45 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef4669f5-e824-4ca1-86de-9a054ac976ce]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:36:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-583adb2f-4a96-49e6-b97a-2d1100972fa3 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf, portal: 172.16.0.220,3260]
Nov 29 16:36:45 user nova-compute[75245]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf, portal: 172.16.0.220,3260] successful.
Nov 29 16:36:45 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:36:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf -p 172.16.0.220:3260 --op delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:36:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f1612a7-3ae1-4ac8-bb1c-bc1eb4d426cf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:36:45 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d8350ba-7591-4bde-b08d-7d26b687b472]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:36:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-583adb2f-4a96-49e6-b97a-2d1100972fa3 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:36:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-583adb2f-4a96-49e6-b97a-2d1100972fa3 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:36:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-583adb2f-4a96-49e6-b97a-2d1100972fa3 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] <== disconnect_volume: return (278ms) None {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:36:45 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-583adb2f-4a96-49e6-b97a-2d1100972fa3 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Disconnected iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 16:36:46 user nova-compute[75245]: DEBUG nova.objects.instance [None req-583adb2f-4a96-49e6-b97a-2d1100972fa3 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Lazy-loading 'flavor' on Instance uuid 0f4fa79b-345a-4e58-a77c-fdfed675e6e7 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:36:46 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-583adb2f-4a96-49e6-b97a-2d1100972fa3 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Lock "0f4fa79b-345a-4e58-a77c-fdfed675e6e7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.624s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:36:48 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:36:53 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:36:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:36:59 user nova-compute[75245]: DEBUG nova.compute.manager [req-51c01c4d-4e12-49a7-a67e-145a5b03467b req-57ec81f4-24db-4bea-ba2c-643e947e9edd service nova] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] Received event network-changed-bb7dda5f-1f48-4d4f-bd7c-3e983aab8a26 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:36:59 user nova-compute[75245]: DEBUG nova.compute.manager [req-51c01c4d-4e12-49a7-a67e-145a5b03467b req-57ec81f4-24db-4bea-ba2c-643e947e9edd service nova] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] Refreshing instance network info cache due to event network-changed-bb7dda5f-1f48-4d4f-bd7c-3e983aab8a26. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:36:59 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-51c01c4d-4e12-49a7-a67e-145a5b03467b req-57ec81f4-24db-4bea-ba2c-643e947e9edd service nova] Acquiring lock "refresh_cache-2b150aa0-612b-4ccd-87d3-3b38c1af96d7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:36:59 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-51c01c4d-4e12-49a7-a67e-145a5b03467b req-57ec81f4-24db-4bea-ba2c-643e947e9edd service nova] Acquired lock "refresh_cache-2b150aa0-612b-4ccd-87d3-3b38c1af96d7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:36:59 user nova-compute[75245]: DEBUG nova.network.neutron [req-51c01c4d-4e12-49a7-a67e-145a5b03467b req-57ec81f4-24db-4bea-ba2c-643e947e9edd service nova] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] Refreshing network info cache for port bb7dda5f-1f48-4d4f-bd7c-3e983aab8a26 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:36:59 user nova-compute[75245]: DEBUG nova.network.neutron [req-51c01c4d-4e12-49a7-a67e-145a5b03467b req-57ec81f4-24db-4bea-ba2c-643e947e9edd service nova] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] Updated VIF entry in instance network info cache for port bb7dda5f-1f48-4d4f-bd7c-3e983aab8a26. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:36:59 user nova-compute[75245]: DEBUG nova.network.neutron [req-51c01c4d-4e12-49a7-a67e-145a5b03467b req-57ec81f4-24db-4bea-ba2c-643e947e9edd service nova] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] Updating instance_info_cache with network_info: [{"id": "bb7dda5f-1f48-4d4f-bd7c-3e983aab8a26", "address": "fa:16:3e:41:c6:08", "network": {"id": "2110162d-c25f-4c3d-9a67-18e52f6caf43", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1854809203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba4d99c1c6c4472be06502d8b0e75a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb7dda5f-1f", "ovs_interfaceid": "bb7dda5f-1f48-4d4f-bd7c-3e983aab8a26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:36:59 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-51c01c4d-4e12-49a7-a67e-145a5b03467b req-57ec81f4-24db-4bea-ba2c-643e947e9edd service nova] Releasing lock "refresh_cache-2b150aa0-612b-4ccd-87d3-3b38c1af96d7" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:37:01 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3c5eee16-01a2-4ae9-99d2-213613706194 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Acquiring lock "2b150aa0-612b-4ccd-87d3-3b38c1af96d7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:37:01 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3c5eee16-01a2-4ae9-99d2-213613706194 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lock "2b150aa0-612b-4ccd-87d3-3b38c1af96d7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:37:01 user nova-compute[75245]: DEBUG nova.objects.instance [None req-3c5eee16-01a2-4ae9-99d2-213613706194 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lazy-loading 'flavor' on Instance uuid 2b150aa0-612b-4ccd-87d3-3b38c1af96d7 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:37:01 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3c5eee16-01a2-4ae9-99d2-213613706194 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lock "2b150aa0-612b-4ccd-87d3-3b38c1af96d7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:37:02 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3c5eee16-01a2-4ae9-99d2-213613706194 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Acquiring lock "2b150aa0-612b-4ccd-87d3-3b38c1af96d7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:37:02 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3c5eee16-01a2-4ae9-99d2-213613706194 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lock "2b150aa0-612b-4ccd-87d3-3b38c1af96d7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:37:02 user nova-compute[75245]: INFO nova.compute.manager [None req-3c5eee16-01a2-4ae9-99d2-213613706194 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] Attaching volume 3d0f48b5-9ba4-49df-851f-c996ad05e2c4 to /dev/vdb
Nov 29 16:37:02 user nova-compute[75245]: DEBUG os_brick.utils [None req-3c5eee16-01a2-4ae9-99d2-213613706194 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:37:02 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:37:02 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:37:02 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[4316400b-4ce8-4785-93c5-658339990cf1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:69ed8ed87091\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:37:02 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:37:02 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:37:02 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1fae7f4-2526-44af-b9c8-308f3c0d0136]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:37:02 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:37:02 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:37:02 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[d99708a1-6370-4a97-854c-44cfd48f9b47]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:37:02 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b40b38-94ad-43aa-82e3-8ad42839a42c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:37:02 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-3c5eee16-01a2-4ae9-99d2-213613706194 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Running cmd (subprocess): nvme version {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:37:02 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-3c5eee16-01a2-4ae9-99d2-213613706194 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] 'nvme version' failed. Not Retrying. {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:37:02 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3c5eee16-01a2-4ae9-99d2-213613706194 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] nvme not present on system {{(pid=75245) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 16:37:02 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:37:02 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:37:02 user nova-compute[75245]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 16:37:02 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[be2b27f8-4291-4e77-bd38-5e62a225b2c6]: (4, '') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:37:02 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-3c5eee16-01a2-4ae9-99d2-213613706194 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75245) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 16:37:02 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-3c5eee16-01a2-4ae9-99d2-213613706194 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 16:37:02 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-3c5eee16-01a2-4ae9-99d2-213613706194 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] LIGHTOS: no hostnqn found. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 16:37:02 user nova-compute[75245]: DEBUG os_brick.utils [None req-3c5eee16-01a2-4ae9-99d2-213613706194 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:69ed8ed87091', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:37:02 user nova-compute[75245]: DEBUG nova.virt.block_device [None req-3c5eee16-01a2-4ae9-99d2-213613706194 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] Updating existing volume attachment record: e3a70ee6-f08d-4258-897c-aa0ff0bf83b8 {{(pid=75245) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 16:37:03 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:37:03 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:37:08 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:37:08 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Starting heal instance info cache {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 16:37:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:37:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "refresh_cache-24fb8ee5-4eee-4976-bcab-24242ef70d39" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:37:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquired lock "refresh_cache-24fb8ee5-4eee-4976-bcab-24242ef70d39" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:37:08 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Forcefully refreshing network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 16:37:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:37:09 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Updating instance_info_cache with network_info: [{"id": "62440fbd-97a8-49eb-8509-a7be044b764a", "address": "fa:16:3e:b2:63:34", "network": {"id": "02098e86-68f8-464e-84ee-bf2fb09b881b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085418471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e12002e1a11f4caf8953371e66e6652e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62440fbd-97", "ovs_interfaceid": "62440fbd-97a8-49eb-8509-a7be044b764a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:37:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Releasing lock "refresh_cache-24fb8ee5-4eee-4976-bcab-24242ef70d39" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:37:09 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Updated the network info_cache for instance {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 16:37:09 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c5eee16-01a2-4ae9-99d2-213613706194 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] Calling os-brick to attach iSCSI Volume {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 16:37:09 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5eee16-01a2-4ae9-99d2-213613706194 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3d0f48b5-9ba4-49df-851f-c996ad05e2c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gzGAYEwv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:37:09 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-3c5eee16-01a2-4ae9-99d2-213613706194 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:37:09 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-3c5eee16-01a2-4ae9-99d2-213613706194 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:37:09 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-3c5eee16-01a2-4ae9-99d2-213613706194 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:37:09 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-3c5eee16-01a2-4ae9-99d2-213613706194 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:37:09 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-3c5eee16-01a2-4ae9-99d2-213613706194 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d0f48b5-9ba4-49df-851f-c996ad05e2c4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:37:09 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-3c5eee16-01a2-4ae9-99d2-213613706194 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d0f48b5-9ba4-49df-851f-c996ad05e2c4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:37:09 user nova-compute[75245]: INFO os_brick.initiator.connectors.iscsi [None req-3c5eee16-01a2-4ae9-99d2-213613706194 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 16:37:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d0f48b5-9ba4-49df-851f-c996ad05e2c4 -p 172.16.0.220:3260 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:37:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d0f48b5-9ba4-49df-851f-c996ad05e2c4 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:37:09 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[989de9e2-b60b-4c62-8a0d-8ed4d9107a98]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:37:09 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5eee16-01a2-4ae9-99d2-213613706194 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 16:37:09 user nova-compute[75245]:  {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:37:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d0f48b5-9ba4-49df-851f-c996ad05e2c4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:37:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d0f48b5-9ba4-49df-851f-c996ad05e2c4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:37:09 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[353fd969-fc8f-4ca2-b1bd-79fcad49f796]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d0f48b5-9ba4-49df-851f-c996ad05e2c4] added\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:37:09 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5eee16-01a2-4ae9-99d2-213613706194 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d0f48b5-9ba4-49df-851f-c996ad05e2c4] added
Nov 29 16:37:09 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:37:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d0f48b5-9ba4-49df-851f-c996ad05e2c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:37:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d0f48b5-9ba4-49df-851f-c996ad05e2c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:37:09 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f834661-dbae-46e4-94b5-0101a5e9cf97]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:37:09 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5eee16-01a2-4ae9-99d2-213613706194 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:37:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d0f48b5-9ba4-49df-851f-c996ad05e2c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:37:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d0f48b5-9ba4-49df-851f-c996ad05e2c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:37:09 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d0bc80-cb0d-48e7-9b0c-b1c860313d4d]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:37:09 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5eee16-01a2-4ae9-99d2-213613706194 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:37:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d0f48b5-9ba4-49df-851f-c996ad05e2c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gzGAYEwv {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:37:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d0f48b5-9ba4-49df-851f-c996ad05e2c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gzGAYEwv" returned: 0 in 0.024s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:37:09 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e34552-e025-479d-b5fe-49befcba1885]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:37:09 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5eee16-01a2-4ae9-99d2-213613706194 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gzGAYEwv'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:37:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d0f48b5-9ba4-49df-851f-c996ad05e2c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:37:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d0f48b5-9ba4-49df-851f-c996ad05e2c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:37:09 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d9acb8-0ba0-4dff-941b-e928aa530085]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:37:09 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5eee16-01a2-4ae9-99d2-213613706194 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:37:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:37:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:37:09 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb01354-bbf2-47fa-9632-aa0256cc28c2]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:37:09 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5eee16-01a2-4ae9-99d2-213613706194 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)
Nov 29 16:37:09 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:37:09 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5eee16-01a2-4ae9-99d2-213613706194 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)
Nov 29 16:37:09 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:37:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d0f48b5-9ba4-49df-851f-c996ad05e2c4 -p 172.16.0.220:3260 --login {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:37:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d0f48b5-9ba4-49df-851f-c996ad05e2c4 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:37:09 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ef25b6-d52c-4b6c-a404-8c2ecb81fb9d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d0f48b5-9ba4-49df-851f-c996ad05e2c4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3d0f48b5-9ba4-49df-851f-c996ad05e2c4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:37:09 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5eee16-01a2-4ae9-99d2-213613706194 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d0f48b5-9ba4-49df-851f-c996ad05e2c4, portal: 172.16.0.220,3260]
Nov 29 16:37:09 user nova-compute[75245]: Login to [iface: default, target: iqn.2010-10.org.openstack:3d0f48b5-9ba4-49df-851f-c996ad05e2c4, portal: 172.16.0.220,3260] successful.
Nov 29 16:37:09 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:37:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d0f48b5-9ba4-49df-851f-c996ad05e2c4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:37:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d0f48b5-9ba4-49df-851f-c996ad05e2c4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:37:09 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b196178-dcef-4d91-857f-b96349dd9c09]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:37:09 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5eee16-01a2-4ae9-99d2-213613706194 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:37:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:37:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:37:09 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b8bff2-1ed1-45a5-bdd1-1acbcccae2b7]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d0f48b5-9ba4-49df-851f-c996ad05e2c4 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:37:09 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5eee16-01a2-4ae9-99d2-213613706194 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)
Nov 29 16:37:09 user nova-compute[75245]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d0f48b5-9ba4-49df-851f-c996ad05e2c4 (non-flash)
Nov 29 16:37:09 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:37:09 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5eee16-01a2-4ae9-99d2-213613706194 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)
Nov 29 16:37:09 user nova-compute[75245]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d0f48b5-9ba4-49df-851f-c996ad05e2c4 (non-flash)
Nov 29 16:37:09 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:37:09 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-3c5eee16-01a2-4ae9-99d2-213613706194 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d0f48b5-9ba4-49df-851f-c996ad05e2c4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:37:09 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5eee16-01a2-4ae9-99d2-213613706194 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Connected to 172.16.0.220:3260 {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 16:37:09 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-3c5eee16-01a2-4ae9-99d2-213613706194 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] HCTL ('33', '-', '-', 0) found on session 39 with lun 0 {{(pid=75245) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 16:37:09 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-3c5eee16-01a2-4ae9-99d2-213613706194 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75245) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 16:37:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:37:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:37:09 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c930055-3894-48cc-b132-e43ac7de8f87]: (4, ('- - 0', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:37:09 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-3c5eee16-01a2-4ae9-99d2-213613706194 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: None {{(pid=75245) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 16:37:10 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:37:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-055b3dec-a9d2-4df5-8357-21928311ae55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Acquiring lock "24fb8ee5-4eee-4976-bcab-24242ef70d39" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:37:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-055b3dec-a9d2-4df5-8357-21928311ae55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lock "24fb8ee5-4eee-4976-bcab-24242ef70d39" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:37:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-055b3dec-a9d2-4df5-8357-21928311ae55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Acquiring lock "24fb8ee5-4eee-4976-bcab-24242ef70d39-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:37:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-055b3dec-a9d2-4df5-8357-21928311ae55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lock "24fb8ee5-4eee-4976-bcab-24242ef70d39-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:37:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-055b3dec-a9d2-4df5-8357-21928311ae55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lock "24fb8ee5-4eee-4976-bcab-24242ef70d39-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:37:10 user nova-compute[75245]: INFO nova.compute.manager [None req-055b3dec-a9d2-4df5-8357-21928311ae55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Terminating instance
Nov 29 16:37:10 user nova-compute[75245]: DEBUG nova.compute.manager [None req-055b3dec-a9d2-4df5-8357-21928311ae55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Start destroying the instance on the hypervisor. {{(pid=75245) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 16:37:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:37:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:37:10 user nova-compute[75245]: DEBUG nova.compute.manager [req-74314819-1fa4-4cfe-a3e9-bca00c6b0248 req-3f8af2f5-8749-49f9-9bcc-a705565a4a96 service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Received event network-vif-unplugged-62440fbd-97a8-49eb-8509-a7be044b764a {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:37:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-74314819-1fa4-4cfe-a3e9-bca00c6b0248 req-3f8af2f5-8749-49f9-9bcc-a705565a4a96 service nova] Acquiring lock "24fb8ee5-4eee-4976-bcab-24242ef70d39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:37:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-74314819-1fa4-4cfe-a3e9-bca00c6b0248 req-3f8af2f5-8749-49f9-9bcc-a705565a4a96 service nova] Lock "24fb8ee5-4eee-4976-bcab-24242ef70d39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:37:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-74314819-1fa4-4cfe-a3e9-bca00c6b0248 req-3f8af2f5-8749-49f9-9bcc-a705565a4a96 service nova] Lock "24fb8ee5-4eee-4976-bcab-24242ef70d39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:37:10 user nova-compute[75245]: DEBUG nova.compute.manager [req-74314819-1fa4-4cfe-a3e9-bca00c6b0248 req-3f8af2f5-8749-49f9-9bcc-a705565a4a96 service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] No waiting events found dispatching network-vif-unplugged-62440fbd-97a8-49eb-8509-a7be044b764a {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:37:10 user nova-compute[75245]: DEBUG nova.compute.manager [req-74314819-1fa4-4cfe-a3e9-bca00c6b0248 req-3f8af2f5-8749-49f9-9bcc-a705565a4a96 service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Received event network-vif-unplugged-62440fbd-97a8-49eb-8509-a7be044b764a for instance with task_state deleting. {{(pid=75245) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 16:37:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:37:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:37:10 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-3c5eee16-01a2-4ae9-99d2-213613706194 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75245) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 16:37:10 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5eee16-01a2-4ae9-99d2-213613706194 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3d0f48b5-9ba4-49df-851f-c996ad05e2c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gzGAYEwv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 16:37:10 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-3c5eee16-01a2-4ae9-99d2-213613706194 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:37:10 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5eee16-01a2-4ae9-99d2-213613706194 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] <== connect_volume: return (1283ms) {'type': 'block', 'scsi_wwn': '23261333062303736', 'path': '/dev/sdb'} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:37:10 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c5eee16-01a2-4ae9-99d2-213613706194 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23261333062303736', 'path': '/dev/sdb'} {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 16:37:10 user nova-compute[75245]: DEBUG nova.objects.instance [None req-3c5eee16-01a2-4ae9-99d2-213613706194 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lazy-loading 'flavor' on Instance uuid 2b150aa0-612b-4ccd-87d3-3b38c1af96d7 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:37:10 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-3c5eee16-01a2-4ae9-99d2-213613706194 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 16:37:10 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:37:10 user nova-compute[75245]:   <source dev="/dev/sdb"/>
Nov 29 16:37:10 user nova-compute[75245]:   <target dev="vdb" bus="virtio"/>
Nov 29 16:37:10 user nova-compute[75245]:   <serial>3d0f48b5-9ba4-49df-851f-c996ad05e2c4</serial>
Nov 29 16:37:10 user nova-compute[75245]: </disk>
Nov 29 16:37:10 user nova-compute[75245]:  {{(pid=75245) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 16:37:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:37:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:37:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:37:11 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Instance destroyed successfully.
Nov 29 16:37:11 user nova-compute[75245]: DEBUG nova.objects.instance [None req-055b3dec-a9d2-4df5-8357-21928311ae55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lazy-loading 'resources' on Instance uuid 24fb8ee5-4eee-4976-bcab-24242ef70d39 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:37:11 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-055b3dec-a9d2-4df5-8357-21928311ae55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:30:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-640260040',display_name='tempest-ServerRescueNegativeTestJSON-server-640260040',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-640260040',id=31,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBACvKEgq8kStkZ1z3ReTmb3c/dp4mRi1EUgpKQXKqWZlYREEZfw+OWLoIIjh5f+XOK1abUAZHhSpf9SDmRSDBWvCgIJoBwK9h9YoQr9SBb5REV1zRe7b4QTPMqNd5zaDNw==',key_name='tempest-keypair-2048224560',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:32:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e12002e1a11f4caf8953371e66e6652e',ramdisk_id='',reservation_id='r-8gg62wg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1013090395',owner_user_name='tempest-ServerRescueNegativeTestJSON-1013090395-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:34:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d876b1e244b14a29ad5b4b422135336b',uuid=24fb8ee5-4eee-4976-bcab-24242ef70d39,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "62440fbd-97a8-49eb-8509-a7be044b764a", "address": "fa:16:3e:b2:63:34", "network": {"id": "02098e86-68f8-464e-84ee-bf2fb09b881b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085418471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e12002e1a11f4caf8953371e66e6652e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62440fbd-97", "ovs_interfaceid": "62440fbd-97a8-49eb-8509-a7be044b764a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 16:37:11 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-055b3dec-a9d2-4df5-8357-21928311ae55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Converting VIF {"id": "62440fbd-97a8-49eb-8509-a7be044b764a", "address": "fa:16:3e:b2:63:34", "network": {"id": "02098e86-68f8-464e-84ee-bf2fb09b881b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085418471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e12002e1a11f4caf8953371e66e6652e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62440fbd-97", "ovs_interfaceid": "62440fbd-97a8-49eb-8509-a7be044b764a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:37:11 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-055b3dec-a9d2-4df5-8357-21928311ae55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b2:63:34,bridge_name='br-int',has_traffic_filtering=True,id=62440fbd-97a8-49eb-8509-a7be044b764a,network=Network(02098e86-68f8-464e-84ee-bf2fb09b881b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62440fbd-97') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:37:11 user nova-compute[75245]: DEBUG os_vif [None req-055b3dec-a9d2-4df5-8357-21928311ae55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:63:34,bridge_name='br-int',has_traffic_filtering=True,id=62440fbd-97a8-49eb-8509-a7be044b764a,network=Network(02098e86-68f8-464e-84ee-bf2fb09b881b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62440fbd-97') {{(pid=75245) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 16:37:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:37:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap62440fbd-97, bridge=br-int, if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:37:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:37:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:37:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:37:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:37:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:37:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0505550a-0331-46b3-b78b-2062ef8bd3fc) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:37:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:37:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:37:11 user nova-compute[75245]: INFO os_vif [None req-055b3dec-a9d2-4df5-8357-21928311ae55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:63:34,bridge_name='br-int',has_traffic_filtering=True,id=62440fbd-97a8-49eb-8509-a7be044b764a,network=Network(02098e86-68f8-464e-84ee-bf2fb09b881b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62440fbd-97')
Nov 29 16:37:11 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-055b3dec-a9d2-4df5-8357-21928311ae55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Deleting instance files /opt/stack/data/nova/instances/24fb8ee5-4eee-4976-bcab-24242ef70d39_del
Nov 29 16:37:11 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-055b3dec-a9d2-4df5-8357-21928311ae55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Deletion of /opt/stack/data/nova/instances/24fb8ee5-4eee-4976-bcab-24242ef70d39_del complete
Nov 29 16:37:11 user nova-compute[75245]: INFO nova.compute.manager [None req-055b3dec-a9d2-4df5-8357-21928311ae55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Took 0.69 seconds to destroy the instance on the hypervisor.
Nov 29 16:37:11 user nova-compute[75245]: DEBUG oslo.service.loopingcall [None req-055b3dec-a9d2-4df5-8357-21928311ae55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75245) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 16:37:11 user nova-compute[75245]: DEBUG nova.compute.manager [-] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Deallocating network for instance {{(pid=75245) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 16:37:11 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] deallocate_for_instance() {{(pid=75245) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 16:37:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:37:11 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-3c5eee16-01a2-4ae9-99d2-213613706194 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:37:11 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-3c5eee16-01a2-4ae9-99d2-213613706194 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:37:11 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-3c5eee16-01a2-4ae9-99d2-213613706194 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] No VIF found with MAC fa:16:3e:41:c6:08, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:37:11 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:37:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:37:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:37:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3c5eee16-01a2-4ae9-99d2-213613706194 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lock "2b150aa0-612b-4ccd-87d3-3b38c1af96d7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.472s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:37:12 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:37:12 user nova-compute[75245]: INFO nova.compute.manager [-] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Took 1.51 seconds to deallocate network for instance.
Nov 29 16:37:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-055b3dec-a9d2-4df5-8357-21928311ae55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:37:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-055b3dec-a9d2-4df5-8357-21928311ae55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:37:12 user nova-compute[75245]: DEBUG nova.compute.manager [req-96c65c65-5316-4267-aa4b-169ea02229dd req-a93f053f-49c1-4e05-9b26-9d043556445e service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Received event network-vif-plugged-62440fbd-97a8-49eb-8509-a7be044b764a {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:37:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-96c65c65-5316-4267-aa4b-169ea02229dd req-a93f053f-49c1-4e05-9b26-9d043556445e service nova] Acquiring lock "24fb8ee5-4eee-4976-bcab-24242ef70d39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:37:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-96c65c65-5316-4267-aa4b-169ea02229dd req-a93f053f-49c1-4e05-9b26-9d043556445e service nova] Lock "24fb8ee5-4eee-4976-bcab-24242ef70d39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:37:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-96c65c65-5316-4267-aa4b-169ea02229dd req-a93f053f-49c1-4e05-9b26-9d043556445e service nova] Lock "24fb8ee5-4eee-4976-bcab-24242ef70d39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:37:12 user nova-compute[75245]: DEBUG nova.compute.manager [req-96c65c65-5316-4267-aa4b-169ea02229dd req-a93f053f-49c1-4e05-9b26-9d043556445e service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] No waiting events found dispatching network-vif-plugged-62440fbd-97a8-49eb-8509-a7be044b764a {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:37:12 user nova-compute[75245]: WARNING nova.compute.manager [req-96c65c65-5316-4267-aa4b-169ea02229dd req-a93f053f-49c1-4e05-9b26-9d043556445e service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Received unexpected event network-vif-plugged-62440fbd-97a8-49eb-8509-a7be044b764a for instance with vm_state deleted and task_state None.
Nov 29 16:37:12 user nova-compute[75245]: DEBUG nova.compute.manager [req-96c65c65-5316-4267-aa4b-169ea02229dd req-a93f053f-49c1-4e05-9b26-9d043556445e service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Received event network-vif-plugged-62440fbd-97a8-49eb-8509-a7be044b764a {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:37:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-96c65c65-5316-4267-aa4b-169ea02229dd req-a93f053f-49c1-4e05-9b26-9d043556445e service nova] Acquiring lock "24fb8ee5-4eee-4976-bcab-24242ef70d39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:37:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-96c65c65-5316-4267-aa4b-169ea02229dd req-a93f053f-49c1-4e05-9b26-9d043556445e service nova] Lock "24fb8ee5-4eee-4976-bcab-24242ef70d39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:37:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-96c65c65-5316-4267-aa4b-169ea02229dd req-a93f053f-49c1-4e05-9b26-9d043556445e service nova] Lock "24fb8ee5-4eee-4976-bcab-24242ef70d39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:37:12 user nova-compute[75245]: DEBUG nova.compute.manager [req-96c65c65-5316-4267-aa4b-169ea02229dd req-a93f053f-49c1-4e05-9b26-9d043556445e service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] No waiting events found dispatching network-vif-plugged-62440fbd-97a8-49eb-8509-a7be044b764a {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:37:12 user nova-compute[75245]: WARNING nova.compute.manager [req-96c65c65-5316-4267-aa4b-169ea02229dd req-a93f053f-49c1-4e05-9b26-9d043556445e service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Received unexpected event network-vif-plugged-62440fbd-97a8-49eb-8509-a7be044b764a for instance with vm_state deleted and task_state None.
Nov 29 16:37:12 user nova-compute[75245]: DEBUG nova.compute.manager [req-96c65c65-5316-4267-aa4b-169ea02229dd req-a93f053f-49c1-4e05-9b26-9d043556445e service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Received event network-vif-plugged-62440fbd-97a8-49eb-8509-a7be044b764a {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:37:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-96c65c65-5316-4267-aa4b-169ea02229dd req-a93f053f-49c1-4e05-9b26-9d043556445e service nova] Acquiring lock "24fb8ee5-4eee-4976-bcab-24242ef70d39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:37:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-96c65c65-5316-4267-aa4b-169ea02229dd req-a93f053f-49c1-4e05-9b26-9d043556445e service nova] Lock "24fb8ee5-4eee-4976-bcab-24242ef70d39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:37:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-96c65c65-5316-4267-aa4b-169ea02229dd req-a93f053f-49c1-4e05-9b26-9d043556445e service nova] Lock "24fb8ee5-4eee-4976-bcab-24242ef70d39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:37:12 user nova-compute[75245]: DEBUG nova.compute.manager [req-96c65c65-5316-4267-aa4b-169ea02229dd req-a93f053f-49c1-4e05-9b26-9d043556445e service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] No waiting events found dispatching network-vif-plugged-62440fbd-97a8-49eb-8509-a7be044b764a {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:37:12 user nova-compute[75245]: WARNING nova.compute.manager [req-96c65c65-5316-4267-aa4b-169ea02229dd req-a93f053f-49c1-4e05-9b26-9d043556445e service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Received unexpected event network-vif-plugged-62440fbd-97a8-49eb-8509-a7be044b764a for instance with vm_state deleted and task_state None.
Nov 29 16:37:12 user nova-compute[75245]: DEBUG nova.compute.manager [req-96c65c65-5316-4267-aa4b-169ea02229dd req-a93f053f-49c1-4e05-9b26-9d043556445e service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Received event network-vif-unplugged-62440fbd-97a8-49eb-8509-a7be044b764a {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:37:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-96c65c65-5316-4267-aa4b-169ea02229dd req-a93f053f-49c1-4e05-9b26-9d043556445e service nova] Acquiring lock "24fb8ee5-4eee-4976-bcab-24242ef70d39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:37:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-96c65c65-5316-4267-aa4b-169ea02229dd req-a93f053f-49c1-4e05-9b26-9d043556445e service nova] Lock "24fb8ee5-4eee-4976-bcab-24242ef70d39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:37:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-96c65c65-5316-4267-aa4b-169ea02229dd req-a93f053f-49c1-4e05-9b26-9d043556445e service nova] Lock "24fb8ee5-4eee-4976-bcab-24242ef70d39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:37:12 user nova-compute[75245]: DEBUG nova.compute.manager [req-96c65c65-5316-4267-aa4b-169ea02229dd req-a93f053f-49c1-4e05-9b26-9d043556445e service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] No waiting events found dispatching network-vif-unplugged-62440fbd-97a8-49eb-8509-a7be044b764a {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:37:12 user nova-compute[75245]: WARNING nova.compute.manager [req-96c65c65-5316-4267-aa4b-169ea02229dd req-a93f053f-49c1-4e05-9b26-9d043556445e service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Received unexpected event network-vif-unplugged-62440fbd-97a8-49eb-8509-a7be044b764a for instance with vm_state deleted and task_state None.
Nov 29 16:37:12 user nova-compute[75245]: DEBUG nova.compute.manager [req-96c65c65-5316-4267-aa4b-169ea02229dd req-a93f053f-49c1-4e05-9b26-9d043556445e service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Received event network-vif-plugged-62440fbd-97a8-49eb-8509-a7be044b764a {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:37:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-96c65c65-5316-4267-aa4b-169ea02229dd req-a93f053f-49c1-4e05-9b26-9d043556445e service nova] Acquiring lock "24fb8ee5-4eee-4976-bcab-24242ef70d39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:37:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-96c65c65-5316-4267-aa4b-169ea02229dd req-a93f053f-49c1-4e05-9b26-9d043556445e service nova] Lock "24fb8ee5-4eee-4976-bcab-24242ef70d39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:37:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-96c65c65-5316-4267-aa4b-169ea02229dd req-a93f053f-49c1-4e05-9b26-9d043556445e service nova] Lock "24fb8ee5-4eee-4976-bcab-24242ef70d39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:37:12 user nova-compute[75245]: DEBUG nova.compute.manager [req-96c65c65-5316-4267-aa4b-169ea02229dd req-a93f053f-49c1-4e05-9b26-9d043556445e service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] No waiting events found dispatching network-vif-plugged-62440fbd-97a8-49eb-8509-a7be044b764a {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:37:12 user nova-compute[75245]: WARNING nova.compute.manager [req-96c65c65-5316-4267-aa4b-169ea02229dd req-a93f053f-49c1-4e05-9b26-9d043556445e service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Received unexpected event network-vif-plugged-62440fbd-97a8-49eb-8509-a7be044b764a for instance with vm_state deleted and task_state None.
Nov 29 16:37:12 user nova-compute[75245]: DEBUG nova.compute.manager [req-96c65c65-5316-4267-aa4b-169ea02229dd req-a93f053f-49c1-4e05-9b26-9d043556445e service nova] [instance: 24fb8ee5-4eee-4976-bcab-24242ef70d39] Received event network-vif-deleted-62440fbd-97a8-49eb-8509-a7be044b764a {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:37:13 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-055b3dec-a9d2-4df5-8357-21928311ae55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:37:13 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-055b3dec-a9d2-4df5-8357-21928311ae55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:37:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-055b3dec-a9d2-4df5-8357-21928311ae55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.256s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:37:13 user nova-compute[75245]: INFO nova.scheduler.client.report [None req-055b3dec-a9d2-4df5-8357-21928311ae55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Deleted allocations for instance 24fb8ee5-4eee-4976-bcab-24242ef70d39
Nov 29 16:37:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-055b3dec-a9d2-4df5-8357-21928311ae55 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lock "24fb8ee5-4eee-4976-bcab-24242ef70d39" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.635s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:37:13 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:37:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:37:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:37:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:37:13 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75245) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 16:37:13 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b150aa0-612b-4ccd-87d3-3b38c1af96d7/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:37:13 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b150aa0-612b-4ccd-87d3-3b38c1af96d7/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:37:13 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b150aa0-612b-4ccd-87d3-3b38c1af96d7/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:37:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b150aa0-612b-4ccd-87d3-3b38c1af96d7/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:37:14 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:37:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:37:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:37:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:37:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:37:14 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:37:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:37:14 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d9a39eeb-ea3b-4533-b775-e173428cd310 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Acquiring lock "2b150aa0-612b-4ccd-87d3-3b38c1af96d7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:37:14 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d9a39eeb-ea3b-4533-b775-e173428cd310 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lock "2b150aa0-612b-4ccd-87d3-3b38c1af96d7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:37:14 user nova-compute[75245]: DEBUG nova.objects.instance [None req-d9a39eeb-ea3b-4533-b775-e173428cd310 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lazy-loading 'flavor' on Instance uuid 2b150aa0-612b-4ccd-87d3-3b38c1af96d7 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:37:14 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d9a39eeb-ea3b-4533-b775-e173428cd310 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lock "2b150aa0-612b-4ccd-87d3-3b38c1af96d7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:37:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:37:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:37:14 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d9a39eeb-ea3b-4533-b775-e173428cd310 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Acquiring lock "2b150aa0-612b-4ccd-87d3-3b38c1af96d7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:37:14 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d9a39eeb-ea3b-4533-b775-e173428cd310 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lock "2b150aa0-612b-4ccd-87d3-3b38c1af96d7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:37:14 user nova-compute[75245]: INFO nova.compute.manager [None req-d9a39eeb-ea3b-4533-b775-e173428cd310 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] Attaching volume 8caba35c-664c-42fb-a596-4f42be5ae739 to /dev/vdc
Nov 29 16:37:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:37:14 user nova-compute[75245]: DEBUG os_brick.utils [None req-d9a39eeb-ea3b-4533-b775-e173428cd310 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:37:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:37:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f4fa79b-345a-4e58-a77c-fdfed675e6e7/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:37:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:37:14 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9ed40b-1987-42aa-a228-96bb12eb5a86]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:69ed8ed87091\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:37:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:37:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:37:14 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[6adc2bde-8c33-4c6d-a939-74faad23d802]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:37:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:37:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:37:14 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[f94e33ea-5582-43d6-809a-bf096ee4ea3c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:37:14 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[84151ef1-eca0-4ca3-8a04-2cb6d77f8643]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:37:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-d9a39eeb-ea3b-4533-b775-e173428cd310 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Running cmd (subprocess): nvme version {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:37:15 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-d9a39eeb-ea3b-4533-b775-e173428cd310 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] 'nvme version' failed. Not Retrying. {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:37:15 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d9a39eeb-ea3b-4533-b775-e173428cd310 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] nvme not present on system {{(pid=75245) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 16:37:15 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:37:15 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:37:15 user nova-compute[75245]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 16:37:15 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19a297b-287c-44eb-8f8c-1145e9d9f7bc]: (4, '') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:37:15 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-d9a39eeb-ea3b-4533-b775-e173428cd310 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75245) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 16:37:15 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-d9a39eeb-ea3b-4533-b775-e173428cd310 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 16:37:15 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-d9a39eeb-ea3b-4533-b775-e173428cd310 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] LIGHTOS: no hostnqn found. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 16:37:15 user nova-compute[75245]: DEBUG os_brick.utils [None req-d9a39eeb-ea3b-4533-b775-e173428cd310 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:69ed8ed87091', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:37:15 user nova-compute[75245]: DEBUG nova.virt.block_device [None req-d9a39eeb-ea3b-4533-b775-e173428cd310 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] Updating existing volume attachment record: 2e1f0b05-6d64-4195-af2b-c738dabfacb7 {{(pid=75245) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 16:37:15 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f4fa79b-345a-4e58-a77c-fdfed675e6e7/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:37:15 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f4fa79b-345a-4e58-a77c-fdfed675e6e7/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:37:15 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f4fa79b-345a-4e58-a77c-fdfed675e6e7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:37:15 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk.rescue --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:37:15 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:37:15 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk.rescue --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:37:15 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:37:15 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:37:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-ec6ed7f3-c10c-4b10-8ab5-54f8f52c4714 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Acquiring lock "0f4fa79b-345a-4e58-a77c-fdfed675e6e7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:37:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-ec6ed7f3-c10c-4b10-8ab5-54f8f52c4714 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Lock "0f4fa79b-345a-4e58-a77c-fdfed675e6e7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:37:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-ec6ed7f3-c10c-4b10-8ab5-54f8f52c4714 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Acquiring lock "0f4fa79b-345a-4e58-a77c-fdfed675e6e7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:37:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-ec6ed7f3-c10c-4b10-8ab5-54f8f52c4714 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Lock "0f4fa79b-345a-4e58-a77c-fdfed675e6e7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:37:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-ec6ed7f3-c10c-4b10-8ab5-54f8f52c4714 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Lock "0f4fa79b-345a-4e58-a77c-fdfed675e6e7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:37:15 user nova-compute[75245]: INFO nova.compute.manager [None req-ec6ed7f3-c10c-4b10-8ab5-54f8f52c4714 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Terminating instance
Nov 29 16:37:15 user nova-compute[75245]: DEBUG nova.compute.manager [None req-ec6ed7f3-c10c-4b10-8ab5-54f8f52c4714 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Start destroying the instance on the hypervisor. {{(pid=75245) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 16:37:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:37:15 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:37:15 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:37:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:37:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:37:16 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:37:16 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:37:16 user nova-compute[75245]: DEBUG nova.compute.manager [req-552c085b-4b00-4559-a6fe-817daa4cff61 req-e7027d4b-0dad-4865-99ae-5298cfe8bcc4 service nova] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Received event network-vif-unplugged-0b59ddaf-c343-420d-9cf5-93d5fa48bc23 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:37:16 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-552c085b-4b00-4559-a6fe-817daa4cff61 req-e7027d4b-0dad-4865-99ae-5298cfe8bcc4 service nova] Acquiring lock "0f4fa79b-345a-4e58-a77c-fdfed675e6e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:37:16 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-552c085b-4b00-4559-a6fe-817daa4cff61 req-e7027d4b-0dad-4865-99ae-5298cfe8bcc4 service nova] Lock "0f4fa79b-345a-4e58-a77c-fdfed675e6e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:37:16 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-552c085b-4b00-4559-a6fe-817daa4cff61 req-e7027d4b-0dad-4865-99ae-5298cfe8bcc4 service nova] Lock "0f4fa79b-345a-4e58-a77c-fdfed675e6e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:37:16 user nova-compute[75245]: DEBUG nova.compute.manager [req-552c085b-4b00-4559-a6fe-817daa4cff61 req-e7027d4b-0dad-4865-99ae-5298cfe8bcc4 service nova] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] No waiting events found dispatching network-vif-unplugged-0b59ddaf-c343-420d-9cf5-93d5fa48bc23 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:37:16 user nova-compute[75245]: DEBUG nova.compute.manager [req-552c085b-4b00-4559-a6fe-817daa4cff61 req-e7027d4b-0dad-4865-99ae-5298cfe8bcc4 service nova] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Received event network-vif-unplugged-0b59ddaf-c343-420d-9cf5-93d5fa48bc23 for instance with task_state deleting. {{(pid=75245) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 16:37:16 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:37:16 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:37:16 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Hypervisor/Node resource view: name=user free_ram=8439MB free_disk=24.98261260986328GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75245) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 16:37:16 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:37:16 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:37:16 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Instance destroyed successfully.
Nov 29 16:37:16 user nova-compute[75245]: DEBUG nova.objects.instance [None req-ec6ed7f3-c10c-4b10-8ab5-54f8f52c4714 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Lazy-loading 'resources' on Instance uuid 0f4fa79b-345a-4e58-a77c-fdfed675e6e7 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:37:16 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-ec6ed7f3-c10c-4b10-8ab5-54f8f52c4714 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:30:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-513385249',display_name='tempest-ServerStableDeviceRescueTest-server-513385249',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-513385249',id=29,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL1Z68o0lP6Hi7Hps1ExPAu//BM0Y3yUpeo20GOYYPdy96iUaa/DNByIByWzZ26Oh5Df0t6c9Eobojc//k6HPkTz9N7Nd3BYUDK2hhL44idE2i+iJ7tKl8lnWLgL/rJ52g==',key_name='tempest-keypair-502202166',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:34:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='12ae03075ca94c57af11198359d26514',ramdisk_id='',reservation_id='r-xnixzkar',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-101632514',owner_user_name='tempest-ServerStableDeviceRescueTest-101632514-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:35:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4222ccbed0bd4fa084e80d5c72cd9f58',uuid=0f4fa79b-345a-4e58-a77c-fdfed675e6e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0b59ddaf-c343-420d-9cf5-93d5fa48bc23", "address": "fa:16:3e:12:d2:ca", "network": {"id": "74420114-8c7f-4f7b-9589-8605e1a2b922", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1124145478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12ae03075ca94c57af11198359d26514", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b59ddaf-c3", "ovs_interfaceid": "0b59ddaf-c343-420d-9cf5-93d5fa48bc23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 16:37:16 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-ec6ed7f3-c10c-4b10-8ab5-54f8f52c4714 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Converting VIF {"id": "0b59ddaf-c343-420d-9cf5-93d5fa48bc23", "address": "fa:16:3e:12:d2:ca", "network": {"id": "74420114-8c7f-4f7b-9589-8605e1a2b922", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1124145478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12ae03075ca94c57af11198359d26514", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b59ddaf-c3", "ovs_interfaceid": "0b59ddaf-c343-420d-9cf5-93d5fa48bc23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:37:16 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-ec6ed7f3-c10c-4b10-8ab5-54f8f52c4714 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:12:d2:ca,bridge_name='br-int',has_traffic_filtering=True,id=0b59ddaf-c343-420d-9cf5-93d5fa48bc23,network=Network(74420114-8c7f-4f7b-9589-8605e1a2b922),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b59ddaf-c3') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:37:16 user nova-compute[75245]: DEBUG os_vif [None req-ec6ed7f3-c10c-4b10-8ab5-54f8f52c4714 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:d2:ca,bridge_name='br-int',has_traffic_filtering=True,id=0b59ddaf-c343-420d-9cf5-93d5fa48bc23,network=Network(74420114-8c7f-4f7b-9589-8605e1a2b922),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b59ddaf-c3') {{(pid=75245) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 16:37:16 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:37:16 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0b59ddaf-c3, bridge=br-int, if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:37:16 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:37:16 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:37:16 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:37:16 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=39e9645a-bd67-4f51-ba3f-bbcfd3a5cf82) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:37:16 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:37:16 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:37:16 user nova-compute[75245]: INFO os_vif [None req-ec6ed7f3-c10c-4b10-8ab5-54f8f52c4714 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:d2:ca,bridge_name='br-int',has_traffic_filtering=True,id=0b59ddaf-c343-420d-9cf5-93d5fa48bc23,network=Network(74420114-8c7f-4f7b-9589-8605e1a2b922),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b59ddaf-c3')
Nov 29 16:37:16 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-ec6ed7f3-c10c-4b10-8ab5-54f8f52c4714 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Deleting instance files /opt/stack/data/nova/instances/0f4fa79b-345a-4e58-a77c-fdfed675e6e7_del
Nov 29 16:37:16 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-ec6ed7f3-c10c-4b10-8ab5-54f8f52c4714 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Deletion of /opt/stack/data/nova/instances/0f4fa79b-345a-4e58-a77c-fdfed675e6e7_del complete
Nov 29 16:37:16 user nova-compute[75245]: INFO nova.compute.manager [None req-ec6ed7f3-c10c-4b10-8ab5-54f8f52c4714 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 29 16:37:16 user nova-compute[75245]: DEBUG oslo.service.loopingcall [None req-ec6ed7f3-c10c-4b10-8ab5-54f8f52c4714 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75245) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 16:37:16 user nova-compute[75245]: DEBUG nova.compute.manager [-] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Deallocating network for instance {{(pid=75245) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 16:37:16 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] deallocate_for_instance() {{(pid=75245) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 16:37:16 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 8785a3c2-5b7a-4382-b50d-cecd8743329c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:37:16 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 5de7e10c-f216-46b3-8f74-57bac6ab7e56 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:37:16 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:37:16 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance ed9d1ad5-f5d0-4a68-a073-e7a83be772ea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:37:16 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 0f4fa79b-345a-4e58-a77c-fdfed675e6e7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:37:16 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 2b150aa0-612b-4ccd-87d3-3b38c1af96d7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:37:16 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 16:37:16 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 16:37:17 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:37:17 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:37:17 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Compute_service record updated for user:user {{(pid=75245) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 16:37:17 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.372s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:37:17 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:37:17 user nova-compute[75245]: INFO nova.compute.manager [-] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Took 1.03 seconds to deallocate network for instance.
Nov 29 16:37:17 user nova-compute[75245]: DEBUG nova.compute.manager [req-7f9b6f00-430f-41fb-9396-1a8893f25520 req-2555869b-586a-4a58-976d-b639979483ec service nova] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Received event network-vif-deleted-0b59ddaf-c343-420d-9cf5-93d5fa48bc23 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:37:18 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-ec6ed7f3-c10c-4b10-8ab5-54f8f52c4714 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:37:18 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-ec6ed7f3-c10c-4b10-8ab5-54f8f52c4714 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:37:18 user nova-compute[75245]: DEBUG nova.compute.manager [req-d2990a36-d7ae-42a6-a617-d98439cbc902 req-f92363d5-4b15-4546-9300-bd9249ebd021 service nova] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Received event network-vif-plugged-0b59ddaf-c343-420d-9cf5-93d5fa48bc23 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:37:18 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d2990a36-d7ae-42a6-a617-d98439cbc902 req-f92363d5-4b15-4546-9300-bd9249ebd021 service nova] Acquiring lock "0f4fa79b-345a-4e58-a77c-fdfed675e6e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:37:18 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d2990a36-d7ae-42a6-a617-d98439cbc902 req-f92363d5-4b15-4546-9300-bd9249ebd021 service nova] Lock "0f4fa79b-345a-4e58-a77c-fdfed675e6e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:37:18 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d2990a36-d7ae-42a6-a617-d98439cbc902 req-f92363d5-4b15-4546-9300-bd9249ebd021 service nova] Lock "0f4fa79b-345a-4e58-a77c-fdfed675e6e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:37:18 user nova-compute[75245]: DEBUG nova.compute.manager [req-d2990a36-d7ae-42a6-a617-d98439cbc902 req-f92363d5-4b15-4546-9300-bd9249ebd021 service nova] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] No waiting events found dispatching network-vif-plugged-0b59ddaf-c343-420d-9cf5-93d5fa48bc23 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:37:18 user nova-compute[75245]: WARNING nova.compute.manager [req-d2990a36-d7ae-42a6-a617-d98439cbc902 req-f92363d5-4b15-4546-9300-bd9249ebd021 service nova] [instance: 0f4fa79b-345a-4e58-a77c-fdfed675e6e7] Received unexpected event network-vif-plugged-0b59ddaf-c343-420d-9cf5-93d5fa48bc23 for instance with vm_state deleted and task_state None.
Nov 29 16:37:18 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-ec6ed7f3-c10c-4b10-8ab5-54f8f52c4714 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:37:18 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-ec6ed7f3-c10c-4b10-8ab5-54f8f52c4714 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:37:18 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-ec6ed7f3-c10c-4b10-8ab5-54f8f52c4714 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.249s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:37:18 user nova-compute[75245]: INFO nova.scheduler.client.report [None req-ec6ed7f3-c10c-4b10-8ab5-54f8f52c4714 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Deleted allocations for instance 0f4fa79b-345a-4e58-a77c-fdfed675e6e7
Nov 29 16:37:18 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-ec6ed7f3-c10c-4b10-8ab5-54f8f52c4714 tempest-ServerStableDeviceRescueTest-101632514 tempest-ServerStableDeviceRescueTest-101632514-project-member] Lock "0f4fa79b-345a-4e58-a77c-fdfed675e6e7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.647s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:37:18 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:37:19 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:37:19 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:37:21 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:37:21 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:37:22 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:37:22 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:37:22 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75245) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 16:37:22 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9a39eeb-ea3b-4533-b775-e173428cd310 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] Calling os-brick to attach iSCSI Volume {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 16:37:22 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9a39eeb-ea3b-4533-b775-e173428cd310 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8caba35c-664c-42fb-a596-4f42be5ae739', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VQoduMJg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:37:22 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-d9a39eeb-ea3b-4533-b775-e173428cd310 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:37:22 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-d9a39eeb-ea3b-4533-b775-e173428cd310 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:37:22 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-d9a39eeb-ea3b-4533-b775-e173428cd310 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:37:22 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-d9a39eeb-ea3b-4533-b775-e173428cd310 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:37:22 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-d9a39eeb-ea3b-4533-b775-e173428cd310 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8caba35c-664c-42fb-a596-4f42be5ae739" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:37:22 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-d9a39eeb-ea3b-4533-b775-e173428cd310 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8caba35c-664c-42fb-a596-4f42be5ae739" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:37:22 user nova-compute[75245]: INFO os_brick.initiator.connectors.iscsi [None req-d9a39eeb-ea3b-4533-b775-e173428cd310 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 16:37:22 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8caba35c-664c-42fb-a596-4f42be5ae739 -p 172.16.0.220:3260 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:37:22 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8caba35c-664c-42fb-a596-4f42be5ae739 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:37:22 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[804ac42c-3384-440f-bf43-a1d1ec1dbe33]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:37:22 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9a39eeb-ea3b-4533-b775-e173428cd310 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 16:37:22 user nova-compute[75245]:  {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:37:22 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8caba35c-664c-42fb-a596-4f42be5ae739 -p 172.16.0.220:3260 --interface default --op new {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:37:22 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8caba35c-664c-42fb-a596-4f42be5ae739 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:37:22 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0c4012-facc-40bc-8ad1-52d6c59cb186]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8caba35c-664c-42fb-a596-4f42be5ae739] added\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:37:22 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9a39eeb-ea3b-4533-b775-e173428cd310 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8caba35c-664c-42fb-a596-4f42be5ae739] added
Nov 29 16:37:22 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:37:22 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8caba35c-664c-42fb-a596-4f42be5ae739 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:37:22 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8caba35c-664c-42fb-a596-4f42be5ae739 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:37:22 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a2d5be-502f-4b2e-8a13-bed6f5c70d6b]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:37:22 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9a39eeb-ea3b-4533-b775-e173428cd310 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:37:22 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8caba35c-664c-42fb-a596-4f42be5ae739 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:37:22 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8caba35c-664c-42fb-a596-4f42be5ae739 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:37:22 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c5f54f-3f89-4830-b88c-93e010473ef6]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:37:22 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9a39eeb-ea3b-4533-b775-e173428cd310 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:37:22 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8caba35c-664c-42fb-a596-4f42be5ae739 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VQoduMJg {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:37:22 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8caba35c-664c-42fb-a596-4f42be5ae739 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VQoduMJg" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:37:22 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce9b000-b2d6-4ae1-95d6-c62b1d976401]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:37:22 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9a39eeb-ea3b-4533-b775-e173428cd310 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VQoduMJg'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:37:22 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8caba35c-664c-42fb-a596-4f42be5ae739 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:37:22 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8caba35c-664c-42fb-a596-4f42be5ae739 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:37:22 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[b17940ba-5096-4074-968a-aac0c284b466]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:37:22 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9a39eeb-ea3b-4533-b775-e173428cd310 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:37:22 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:37:22 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:37:22 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ccf62b-11e5-426d-84fe-fb9e6730e138]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d0f48b5-9ba4-49df-851f-c996ad05e2c4 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:37:22 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9a39eeb-ea3b-4533-b775-e173428cd310 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)
Nov 29 16:37:22 user nova-compute[75245]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d0f48b5-9ba4-49df-851f-c996ad05e2c4 (non-flash)
Nov 29 16:37:22 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:37:22 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9a39eeb-ea3b-4533-b775-e173428cd310 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)
Nov 29 16:37:22 user nova-compute[75245]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d0f48b5-9ba4-49df-851f-c996ad05e2c4 (non-flash)
Nov 29 16:37:22 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:37:22 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8caba35c-664c-42fb-a596-4f42be5ae739 -p 172.16.0.220:3260 --login {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:37:22 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8caba35c-664c-42fb-a596-4f42be5ae739 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:37:22 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[8129d515-f7f2-416e-b1d8-909b3d263e1f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8caba35c-664c-42fb-a596-4f42be5ae739, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8caba35c-664c-42fb-a596-4f42be5ae739, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:37:22 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9a39eeb-ea3b-4533-b775-e173428cd310 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8caba35c-664c-42fb-a596-4f42be5ae739, portal: 172.16.0.220,3260]
Nov 29 16:37:22 user nova-compute[75245]: Login to [iface: default, target: iqn.2010-10.org.openstack:8caba35c-664c-42fb-a596-4f42be5ae739, portal: 172.16.0.220,3260] successful.
Nov 29 16:37:22 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:37:22 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8caba35c-664c-42fb-a596-4f42be5ae739 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:37:22 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8caba35c-664c-42fb-a596-4f42be5ae739 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:37:22 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a777a67-01fd-465c-9c44-f3cebb7942b7]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:37:22 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9a39eeb-ea3b-4533-b775-e173428cd310 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:37:22 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:37:22 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:37:22 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd29cc5-cdb2-4332-9b0f-715ae738bdde]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d0f48b5-9ba4-49df-851f-c996ad05e2c4 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8caba35c-664c-42fb-a596-4f42be5ae739 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:37:22 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9a39eeb-ea3b-4533-b775-e173428cd310 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)
Nov 29 16:37:22 user nova-compute[75245]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d0f48b5-9ba4-49df-851f-c996ad05e2c4 (non-flash)
Nov 29 16:37:22 user nova-compute[75245]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8caba35c-664c-42fb-a596-4f42be5ae739 (non-flash)
Nov 29 16:37:22 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:37:22 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9a39eeb-ea3b-4533-b775-e173428cd310 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)
Nov 29 16:37:22 user nova-compute[75245]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d0f48b5-9ba4-49df-851f-c996ad05e2c4 (non-flash)
Nov 29 16:37:22 user nova-compute[75245]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8caba35c-664c-42fb-a596-4f42be5ae739 (non-flash)
Nov 29 16:37:22 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:37:22 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-d9a39eeb-ea3b-4533-b775-e173428cd310 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8caba35c-664c-42fb-a596-4f42be5ae739" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:37:22 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9a39eeb-ea3b-4533-b775-e173428cd310 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Connected to 172.16.0.220:3260 {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 16:37:22 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-d9a39eeb-ea3b-4533-b775-e173428cd310 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] HCTL ('34', '-', '-', 0) found on session 40 with lun 0 {{(pid=75245) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 16:37:22 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-d9a39eeb-ea3b-4533-b775-e173428cd310 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75245) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 16:37:22 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:37:22 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:37:22 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[992ec621-7fd7-4faa-91ad-811d71e24bc8]: (4, ('- - 0', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:37:22 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-d9a39eeb-ea3b-4533-b775-e173428cd310 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Searching for a device in session 40 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75245) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 16:37:22 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9a39eeb-ea3b-4533-b775-e173428cd310 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8caba35c-664c-42fb-a596-4f42be5ae739', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VQoduMJg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 16:37:23 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-d9a39eeb-ea3b-4533-b775-e173428cd310 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:37:23 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9a39eeb-ea3b-4533-b775-e173428cd310 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '23435316230393835', 'path': '/dev/sdc'} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:37:23 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9a39eeb-ea3b-4533-b775-e173428cd310 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23435316230393835', 'path': '/dev/sdc'} {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 16:37:23 user nova-compute[75245]: DEBUG nova.objects.instance [None req-d9a39eeb-ea3b-4533-b775-e173428cd310 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lazy-loading 'flavor' on Instance uuid 2b150aa0-612b-4ccd-87d3-3b38c1af96d7 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:37:23 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-d9a39eeb-ea3b-4533-b775-e173428cd310 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 16:37:23 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:37:23 user nova-compute[75245]:   <source dev="/dev/sdc"/>
Nov 29 16:37:23 user nova-compute[75245]:   <target dev="vdc" bus="virtio"/>
Nov 29 16:37:23 user nova-compute[75245]:   <serial>8caba35c-664c-42fb-a596-4f42be5ae739</serial>
Nov 29 16:37:23 user nova-compute[75245]: </disk>
Nov 29 16:37:23 user nova-compute[75245]:  {{(pid=75245) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 16:37:24 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-d9a39eeb-ea3b-4533-b775-e173428cd310 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:37:24 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-d9a39eeb-ea3b-4533-b775-e173428cd310 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:37:24 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-d9a39eeb-ea3b-4533-b775-e173428cd310 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:37:24 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-d9a39eeb-ea3b-4533-b775-e173428cd310 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] No VIF found with MAC fa:16:3e:41:c6:08, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:37:24 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d9a39eeb-ea3b-4533-b775-e173428cd310 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lock "2b150aa0-612b-4ccd-87d3-3b38c1af96d7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.642s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:37:24 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-e7bf5123-27ac-4424-9dc1-f0796a30ccc5 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Acquiring lock "2b150aa0-612b-4ccd-87d3-3b38c1af96d7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:37:24 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-e7bf5123-27ac-4424-9dc1-f0796a30ccc5 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lock "2b150aa0-612b-4ccd-87d3-3b38c1af96d7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:37:24 user nova-compute[75245]: INFO nova.compute.manager [None req-e7bf5123-27ac-4424-9dc1-f0796a30ccc5 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] Detaching volume 3d0f48b5-9ba4-49df-851f-c996ad05e2c4
Nov 29 16:37:25 user nova-compute[75245]: INFO nova.virt.block_device [None req-e7bf5123-27ac-4424-9dc1-f0796a30ccc5 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] Attempting to driver detach volume 3d0f48b5-9ba4-49df-851f-c996ad05e2c4 from mountpoint /dev/vdb
Nov 29 16:37:25 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-e7bf5123-27ac-4424-9dc1-f0796a30ccc5 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Attempting to detach device vdb from instance 2b150aa0-612b-4ccd-87d3-3b38c1af96d7 from the persistent domain config. {{(pid=75245) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 16:37:25 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-e7bf5123-27ac-4424-9dc1-f0796a30ccc5 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 16:37:25 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:37:25 user nova-compute[75245]:   <source dev="/dev/sdb"/>
Nov 29 16:37:25 user nova-compute[75245]:   <target dev="vdb" bus="virtio"/>
Nov 29 16:37:25 user nova-compute[75245]:   <serial>3d0f48b5-9ba4-49df-851f-c996ad05e2c4</serial>
Nov 29 16:37:25 user nova-compute[75245]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 16:37:25 user nova-compute[75245]: </disk>
Nov 29 16:37:25 user nova-compute[75245]:  {{(pid=75245) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 16:37:25 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-e7bf5123-27ac-4424-9dc1-f0796a30ccc5 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Successfully detached device vdb from instance 2b150aa0-612b-4ccd-87d3-3b38c1af96d7 from the persistent domain config.
Nov 29 16:37:25 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-e7bf5123-27ac-4424-9dc1-f0796a30ccc5 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2b150aa0-612b-4ccd-87d3-3b38c1af96d7 from the live domain config. {{(pid=75245) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 16:37:25 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-e7bf5123-27ac-4424-9dc1-f0796a30ccc5 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 16:37:25 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:37:25 user nova-compute[75245]:   <source dev="/dev/sdb"/>
Nov 29 16:37:25 user nova-compute[75245]:   <target dev="vdb" bus="virtio"/>
Nov 29 16:37:25 user nova-compute[75245]:   <serial>3d0f48b5-9ba4-49df-851f-c996ad05e2c4</serial>
Nov 29 16:37:25 user nova-compute[75245]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 16:37:25 user nova-compute[75245]: </disk>
Nov 29 16:37:25 user nova-compute[75245]:  {{(pid=75245) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 16:37:25 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-e7bf5123-27ac-4424-9dc1-f0796a30ccc5 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2b150aa0-612b-4ccd-87d3-3b38c1af96d7 {{(pid=75245) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 16:37:26 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:37:26 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:37:26 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75245) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 16:37:26 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:37:26 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:37:26 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:37:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:37:29 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:37:29 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Triggering sync for uuid 8785a3c2-5b7a-4382-b50d-cecd8743329c {{(pid=75245) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 16:37:29 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Triggering sync for uuid 5de7e10c-f216-46b3-8f74-57bac6ab7e56 {{(pid=75245) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 16:37:29 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Triggering sync for uuid 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8 {{(pid=75245) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 16:37:29 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Triggering sync for uuid ed9d1ad5-f5d0-4a68-a073-e7a83be772ea {{(pid=75245) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 16:37:29 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Triggering sync for uuid 2b150aa0-612b-4ccd-87d3-3b38c1af96d7 {{(pid=75245) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 16:37:29 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "8785a3c2-5b7a-4382-b50d-cecd8743329c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:37:29 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "8785a3c2-5b7a-4382-b50d-cecd8743329c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:37:29 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "5de7e10c-f216-46b3-8f74-57bac6ab7e56" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:37:29 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "5de7e10c-f216-46b3-8f74-57bac6ab7e56" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:37:29 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:37:29 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:37:29 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "ed9d1ad5-f5d0-4a68-a073-e7a83be772ea" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:37:29 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "ed9d1ad5-f5d0-4a68-a073-e7a83be772ea" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:37:29 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "2b150aa0-612b-4ccd-87d3-3b38c1af96d7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:37:29 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "5de7e10c-f216-46b3-8f74-57bac6ab7e56" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:37:29 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "8785a3c2-5b7a-4382-b50d-cecd8743329c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:37:29 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:37:29 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "ed9d1ad5-f5d0-4a68-a073-e7a83be772ea" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:37:31 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:37:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2a722e93-c5d8-4bf4-8257-160636cc3149 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Acquiring lock "5de7e10c-f216-46b3-8f74-57bac6ab7e56" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:37:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2a722e93-c5d8-4bf4-8257-160636cc3149 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "5de7e10c-f216-46b3-8f74-57bac6ab7e56" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:37:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2a722e93-c5d8-4bf4-8257-160636cc3149 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Acquiring lock "5de7e10c-f216-46b3-8f74-57bac6ab7e56-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:37:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2a722e93-c5d8-4bf4-8257-160636cc3149 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "5de7e10c-f216-46b3-8f74-57bac6ab7e56-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:37:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2a722e93-c5d8-4bf4-8257-160636cc3149 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "5de7e10c-f216-46b3-8f74-57bac6ab7e56-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:37:33 user nova-compute[75245]: INFO nova.compute.manager [None req-2a722e93-c5d8-4bf4-8257-160636cc3149 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Terminating instance
Nov 29 16:37:33 user nova-compute[75245]: DEBUG nova.compute.manager [None req-2a722e93-c5d8-4bf4-8257-160636cc3149 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Start destroying the instance on the hypervisor. {{(pid=75245) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 16:37:33 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:37:33 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:37:33 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:37:33 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:37:33 user nova-compute[75245]: DEBUG nova.compute.manager [req-fefc0cd2-ef53-45ca-85cf-493ed5f97407 req-5517704d-c3ee-474d-8c63-c9f93086c122 service nova] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Received event network-vif-unplugged-116d08d0-5549-4438-b689-0bbda3a5934f {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:37:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-fefc0cd2-ef53-45ca-85cf-493ed5f97407 req-5517704d-c3ee-474d-8c63-c9f93086c122 service nova] Acquiring lock "5de7e10c-f216-46b3-8f74-57bac6ab7e56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:37:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-fefc0cd2-ef53-45ca-85cf-493ed5f97407 req-5517704d-c3ee-474d-8c63-c9f93086c122 service nova] Lock "5de7e10c-f216-46b3-8f74-57bac6ab7e56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:37:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-fefc0cd2-ef53-45ca-85cf-493ed5f97407 req-5517704d-c3ee-474d-8c63-c9f93086c122 service nova] Lock "5de7e10c-f216-46b3-8f74-57bac6ab7e56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:37:33 user nova-compute[75245]: DEBUG nova.compute.manager [req-fefc0cd2-ef53-45ca-85cf-493ed5f97407 req-5517704d-c3ee-474d-8c63-c9f93086c122 service nova] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] No waiting events found dispatching network-vif-unplugged-116d08d0-5549-4438-b689-0bbda3a5934f {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:37:33 user nova-compute[75245]: DEBUG nova.compute.manager [req-fefc0cd2-ef53-45ca-85cf-493ed5f97407 req-5517704d-c3ee-474d-8c63-c9f93086c122 service nova] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Received event network-vif-unplugged-116d08d0-5549-4438-b689-0bbda3a5934f for instance with task_state deleting. {{(pid=75245) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 16:37:33 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:37:34 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Instance destroyed successfully.
Nov 29 16:37:34 user nova-compute[75245]: DEBUG nova.objects.instance [None req-2a722e93-c5d8-4bf4-8257-160636cc3149 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lazy-loading 'resources' on Instance uuid 5de7e10c-f216-46b3-8f74-57bac6ab7e56 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:37:34 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-2a722e93-c5d8-4bf4-8257-160636cc3149 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:21:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1389384608',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1389384608',id=24,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:23:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1d52776451e947f5a9ef3fa44ac8acbb',ramdisk_id='',reservation_id='r-l3dmntgm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1780163218',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:25:34Z,user_data=None,user_id='4f20e7c9ae22462ea6bc623c93697fce',uuid=5de7e10c-f216-46b3-8f74-57bac6ab7e56,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "116d08d0-5549-4438-b689-0bbda3a5934f", "address": "fa:16:3e:97:fb:c7", "network": {"id": "6a7f7426-b595-4aa3-bf80-cc92ba7ce15e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-917300903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d52776451e947f5a9ef3fa44ac8acbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap116d08d0-55", "ovs_interfaceid": "116d08d0-5549-4438-b689-0bbda3a5934f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 16:37:34 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-2a722e93-c5d8-4bf4-8257-160636cc3149 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Converting VIF {"id": "116d08d0-5549-4438-b689-0bbda3a5934f", "address": "fa:16:3e:97:fb:c7", "network": {"id": "6a7f7426-b595-4aa3-bf80-cc92ba7ce15e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-917300903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d52776451e947f5a9ef3fa44ac8acbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap116d08d0-55", "ovs_interfaceid": "116d08d0-5549-4438-b689-0bbda3a5934f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:37:34 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-2a722e93-c5d8-4bf4-8257-160636cc3149 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:97:fb:c7,bridge_name='br-int',has_traffic_filtering=True,id=116d08d0-5549-4438-b689-0bbda3a5934f,network=Network(6a7f7426-b595-4aa3-bf80-cc92ba7ce15e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap116d08d0-55') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:37:34 user nova-compute[75245]: DEBUG os_vif [None req-2a722e93-c5d8-4bf4-8257-160636cc3149 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:fb:c7,bridge_name='br-int',has_traffic_filtering=True,id=116d08d0-5549-4438-b689-0bbda3a5934f,network=Network(6a7f7426-b595-4aa3-bf80-cc92ba7ce15e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap116d08d0-55') {{(pid=75245) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 16:37:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:37:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap116d08d0-55, bridge=br-int, if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:37:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:37:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:37:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:37:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fea86118-525e-469c-bf2f-45edeb853a1d) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:37:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:37:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:37:34 user nova-compute[75245]: INFO os_vif [None req-2a722e93-c5d8-4bf4-8257-160636cc3149 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:fb:c7,bridge_name='br-int',has_traffic_filtering=True,id=116d08d0-5549-4438-b689-0bbda3a5934f,network=Network(6a7f7426-b595-4aa3-bf80-cc92ba7ce15e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap116d08d0-55')
Nov 29 16:37:34 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a722e93-c5d8-4bf4-8257-160636cc3149 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] calling os-brick to detach iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 16:37:34 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a722e93-c5d8-4bf4-8257-160636cc3149 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, {'target_iqn': 'iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TlHrZFpQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:37:34 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-2a722e93-c5d8-4bf4-8257-160636cc3149 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:37:34 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-2a722e93-c5d8-4bf4-8257-160636cc3149 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:37:34 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-2a722e93-c5d8-4bf4-8257-160636cc3149 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:37:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:37:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:37:34 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[77dbd02c-7b5e-4050-b13f-86c262c1c0c1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8caba35c-664c-42fb-a596-4f42be5ae739\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d0f48b5-9ba4-49df-851f-c996ad05e2c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:37:34 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a722e93-c5d8-4bf4-8257-160636cc3149 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 16:37:34 user nova-compute[75245]: No targets found.
Nov 29 16:37:34 user nova-compute[75245]: iSNS:
Nov 29 16:37:34 user nova-compute[75245]: No targets found.
Nov 29 16:37:34 user nova-compute[75245]: STATIC:
Nov 29 16:37:34 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:8caba35c-664c-42fb-a596-4f42be5ae739
Nov 29 16:37:34 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:37:34 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:37:34 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:3d0f48b5-9ba4-49df-851f-c996ad05e2c4
Nov 29 16:37:34 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:37:34 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:37:34 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed
Nov 29 16:37:34 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:37:34 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:37:34 user nova-compute[75245]: FIRMWARE:
Nov 29 16:37:34 user nova-compute[75245]: No targets found.
Nov 29 16:37:34 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:37:34 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a722e93-c5d8-4bf4-8257-160636cc3149 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 16:37:34 user nova-compute[75245]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 16:37:34 user nova-compute[75245]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75245) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 16:37:34 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a722e93-c5d8-4bf4-8257-160636cc3149 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed', 0)] {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 16:37:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:37:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:37:34 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd506c9b-33d0-41f5-9b50-e58fe4518314]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d0f48b5-9ba4-49df-851f-c996ad05e2c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8caba35c-664c-42fb-a596-4f42be5ae739\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:37:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:37:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:37:34 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[a577fce2-ad94-4b54-81e1-4a21ffc97248]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d0f48b5-9ba4-49df-851f-c996ad05e2c4 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8caba35c-664c-42fb-a596-4f42be5ae739 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:37:34 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a722e93-c5d8-4bf4-8257-160636cc3149 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)
Nov 29 16:37:34 user nova-compute[75245]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d0f48b5-9ba4-49df-851f-c996ad05e2c4 (non-flash)
Nov 29 16:37:34 user nova-compute[75245]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8caba35c-664c-42fb-a596-4f42be5ae739 (non-flash)
Nov 29 16:37:34 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:37:34 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a722e93-c5d8-4bf4-8257-160636cc3149 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed (non-flash)
Nov 29 16:37:34 user nova-compute[75245]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d0f48b5-9ba4-49df-851f-c996ad05e2c4 (non-flash)
Nov 29 16:37:34 user nova-compute[75245]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8caba35c-664c-42fb-a596-4f42be5ae739 (non-flash)
Nov 29 16:37:34 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:37:34 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a722e93-c5d8-4bf4-8257-160636cc3149 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0d442e3eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed'): ({'sde'}, set())}) {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 16:37:34 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-2a722e93-c5d8-4bf4-8257-160636cc3149 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Removing single pathed devices sde {{(pid=75245) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 16:37:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:37:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:37:34 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[263fae30-db1b-49bd-b58f-02c14686288d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:37:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:37:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:37:34 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4813f6-164e-448f-9455-2b5a5f44b239]: (4, ('ok\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:37:34 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-2a722e93-c5d8-4bf4-8257-160636cc3149 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Flushing IO for device /dev/sde {{(pid=75245) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 16:37:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:37:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:37:34 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[b701bb4b-756d-4d0f-90f9-2886773f89fd]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:37:34 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-2a722e93-c5d8-4bf4-8257-160636cc3149 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75245) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 16:37:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:37:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.034s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:37:34 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[68079d39-f423-414e-9519-0282fd556fdb]: (4, ('1', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:37:34 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-2a722e93-c5d8-4bf4-8257-160636cc3149 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 16:37:34 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-2a722e93-c5d8-4bf4-8257-160636cc3149 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] SCSI volumes sde have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 16:37:34 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a722e93-c5d8-4bf4-8257-160636cc3149 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed')] {{(pid=75245) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 16:37:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:37:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:37:34 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd419a22-bb7a-4632-9e57-4df6f7f70971]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:37:34 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a722e93-c5d8-4bf4-8257-160636cc3149 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:37:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed -p 172.16.0.220:3260 --logout {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:37:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed -p 172.16.0.220:3260 --logout" returned: 0 in 0.039s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:37:34 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[21028e01-8caa-47a7-9ad1-65ebaf433739]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:37:34 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a722e93-c5d8-4bf4-8257-160636cc3149 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed, portal: 172.16.0.220,3260]
Nov 29 16:37:34 user nova-compute[75245]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed, portal: 172.16.0.220,3260] successful.
Nov 29 16:37:34 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:37:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed -p 172.16.0.220:3260 --op delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:37:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02359d7f-e8f6-408e-961c-64d566ea0eed -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:37:34 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[7281ed4c-6772-40aa-9f36-591627cdb153]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:37:34 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a722e93-c5d8-4bf4-8257-160636cc3149 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:37:34 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-2a722e93-c5d8-4bf4-8257-160636cc3149 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.257s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:37:34 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a722e93-c5d8-4bf4-8257-160636cc3149 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] <== disconnect_volume: return (257ms) None {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:37:34 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a722e93-c5d8-4bf4-8257-160636cc3149 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Disconnected iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 16:37:34 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-2a722e93-c5d8-4bf4-8257-160636cc3149 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Deleting instance files /opt/stack/data/nova/instances/5de7e10c-f216-46b3-8f74-57bac6ab7e56_del
Nov 29 16:37:34 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-2a722e93-c5d8-4bf4-8257-160636cc3149 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Deletion of /opt/stack/data/nova/instances/5de7e10c-f216-46b3-8f74-57bac6ab7e56_del complete
Nov 29 16:37:34 user nova-compute[75245]: INFO nova.compute.manager [None req-2a722e93-c5d8-4bf4-8257-160636cc3149 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Took 1.10 seconds to destroy the instance on the hypervisor.
Nov 29 16:37:34 user nova-compute[75245]: DEBUG oslo.service.loopingcall [None req-2a722e93-c5d8-4bf4-8257-160636cc3149 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75245) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 16:37:34 user nova-compute[75245]: DEBUG nova.compute.manager [-] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Deallocating network for instance {{(pid=75245) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 16:37:34 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] deallocate_for_instance() {{(pid=75245) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 16:37:34 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:37:34 user nova-compute[75245]: INFO nova.compute.manager [-] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Took 0.44 seconds to deallocate network for instance.
Nov 29 16:37:34 user nova-compute[75245]: DEBUG nova.compute.manager [req-3ac8bade-6e36-4f39-ba50-5b764a234dde req-f70ff1f6-6ce0-4aaa-971c-e75157a82cb5 service nova] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Received event network-vif-deleted-116d08d0-5549-4438-b689-0bbda3a5934f {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:37:34 user nova-compute[75245]: INFO nova.compute.manager [req-3ac8bade-6e36-4f39-ba50-5b764a234dde req-f70ff1f6-6ce0-4aaa-971c-e75157a82cb5 service nova] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Neutron deleted interface 116d08d0-5549-4438-b689-0bbda3a5934f; detaching it from the instance and deleting it from the info cache
Nov 29 16:37:34 user nova-compute[75245]: DEBUG nova.network.neutron [req-3ac8bade-6e36-4f39-ba50-5b764a234dde req-f70ff1f6-6ce0-4aaa-971c-e75157a82cb5 service nova] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:37:34 user nova-compute[75245]: DEBUG nova.compute.manager [req-3ac8bade-6e36-4f39-ba50-5b764a234dde req-f70ff1f6-6ce0-4aaa-971c-e75157a82cb5 service nova] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Detach interface failed, port_id=116d08d0-5549-4438-b689-0bbda3a5934f, reason: Instance 5de7e10c-f216-46b3-8f74-57bac6ab7e56 could not be found. {{(pid=75245) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 16:37:35 user nova-compute[75245]: DEBUG nova.compute.manager [req-2c891144-85f6-47a3-b12c-056eeb9602ed req-5f5393a9-3396-4796-b986-78007463c038 service nova] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Received event network-vif-plugged-116d08d0-5549-4438-b689-0bbda3a5934f {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:37:35 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-2c891144-85f6-47a3-b12c-056eeb9602ed req-5f5393a9-3396-4796-b986-78007463c038 service nova] Acquiring lock "5de7e10c-f216-46b3-8f74-57bac6ab7e56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:37:35 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-2c891144-85f6-47a3-b12c-056eeb9602ed req-5f5393a9-3396-4796-b986-78007463c038 service nova] Lock "5de7e10c-f216-46b3-8f74-57bac6ab7e56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:37:35 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-2c891144-85f6-47a3-b12c-056eeb9602ed req-5f5393a9-3396-4796-b986-78007463c038 service nova] Lock "5de7e10c-f216-46b3-8f74-57bac6ab7e56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:37:35 user nova-compute[75245]: DEBUG nova.compute.manager [req-2c891144-85f6-47a3-b12c-056eeb9602ed req-5f5393a9-3396-4796-b986-78007463c038 service nova] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] No waiting events found dispatching network-vif-plugged-116d08d0-5549-4438-b689-0bbda3a5934f {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:37:35 user nova-compute[75245]: WARNING nova.compute.manager [req-2c891144-85f6-47a3-b12c-056eeb9602ed req-5f5393a9-3396-4796-b986-78007463c038 service nova] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Received unexpected event network-vif-plugged-116d08d0-5549-4438-b689-0bbda3a5934f for instance with vm_state active and task_state deleting.
Nov 29 16:37:35 user nova-compute[75245]: INFO nova.compute.manager [None req-2a722e93-c5d8-4bf4-8257-160636cc3149 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 5de7e10c-f216-46b3-8f74-57bac6ab7e56] Took 0.90 seconds to detach 1 volumes for instance.
Nov 29 16:37:35 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2a722e93-c5d8-4bf4-8257-160636cc3149 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:37:35 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2a722e93-c5d8-4bf4-8257-160636cc3149 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:37:36 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-2a722e93-c5d8-4bf4-8257-160636cc3149 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:37:36 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-2a722e93-c5d8-4bf4-8257-160636cc3149 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:37:36 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2a722e93-c5d8-4bf4-8257-160636cc3149 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.248s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:37:36 user nova-compute[75245]: INFO nova.scheduler.client.report [None req-2a722e93-c5d8-4bf4-8257-160636cc3149 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Deleted allocations for instance 5de7e10c-f216-46b3-8f74-57bac6ab7e56
Nov 29 16:37:36 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2a722e93-c5d8-4bf4-8257-160636cc3149 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "5de7e10c-f216-46b3-8f74-57bac6ab7e56" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.916s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:37:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:37:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:37:45 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-e7bf5123-27ac-4424-9dc1-f0796a30ccc5 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2b150aa0-612b-4ccd-87d3-3b38c1af96d7 is timed out.
Nov 29 16:37:45 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-e7bf5123-27ac-4424-9dc1-f0796a30ccc5 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Successfully detached device vdb from instance 2b150aa0-612b-4ccd-87d3-3b38c1af96d7 from the live domain config.
Nov 29 16:37:45 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7bf5123-27ac-4424-9dc1-f0796a30ccc5 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] calling os-brick to detach iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 16:37:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7bf5123-27ac-4424-9dc1-f0796a30ccc5 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, {'target_iqn': 'iqn.2010-10.org.openstack:3d0f48b5-9ba4-49df-851f-c996ad05e2c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gzGAYEwv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:37:45 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-e7bf5123-27ac-4424-9dc1-f0796a30ccc5 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:37:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-e7bf5123-27ac-4424-9dc1-f0796a30ccc5 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:37:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-e7bf5123-27ac-4424-9dc1-f0796a30ccc5 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:37:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:37:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:37:45 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[641ea06d-4a27-43a4-8904-8a5cae339aee]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8caba35c-664c-42fb-a596-4f42be5ae739\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d0f48b5-9ba4-49df-851f-c996ad05e2c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:37:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7bf5123-27ac-4424-9dc1-f0796a30ccc5 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 16:37:45 user nova-compute[75245]: No targets found.
Nov 29 16:37:45 user nova-compute[75245]: iSNS:
Nov 29 16:37:45 user nova-compute[75245]: No targets found.
Nov 29 16:37:45 user nova-compute[75245]: STATIC:
Nov 29 16:37:45 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:8caba35c-664c-42fb-a596-4f42be5ae739
Nov 29 16:37:45 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:37:45 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:37:45 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:3d0f48b5-9ba4-49df-851f-c996ad05e2c4
Nov 29 16:37:45 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:37:45 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:37:45 user nova-compute[75245]: FIRMWARE:
Nov 29 16:37:45 user nova-compute[75245]: No targets found.
Nov 29 16:37:45 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:37:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7bf5123-27ac-4424-9dc1-f0796a30ccc5 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 16:37:45 user nova-compute[75245]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 16:37:45 user nova-compute[75245]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75245) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 16:37:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7bf5123-27ac-4424-9dc1-f0796a30ccc5 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d0f48b5-9ba4-49df-851f-c996ad05e2c4', 0)] {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 16:37:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:37:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:37:45 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b554ec-fe4c-4af9-a69d-f64357c84778]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d0f48b5-9ba4-49df-851f-c996ad05e2c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8caba35c-664c-42fb-a596-4f42be5ae739\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:37:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:37:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:37:45 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[1052515e-68a6-4ad6-b330-ade505fd7e9c]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d0f48b5-9ba4-49df-851f-c996ad05e2c4 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8caba35c-664c-42fb-a596-4f42be5ae739 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:37:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7bf5123-27ac-4424-9dc1-f0796a30ccc5 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d0f48b5-9ba4-49df-851f-c996ad05e2c4 (non-flash)
Nov 29 16:37:45 user nova-compute[75245]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8caba35c-664c-42fb-a596-4f42be5ae739 (non-flash)
Nov 29 16:37:45 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:37:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7bf5123-27ac-4424-9dc1-f0796a30ccc5 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d0f48b5-9ba4-49df-851f-c996ad05e2c4 (non-flash)
Nov 29 16:37:45 user nova-compute[75245]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8caba35c-664c-42fb-a596-4f42be5ae739 (non-flash)
Nov 29 16:37:45 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:37:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7bf5123-27ac-4424-9dc1-f0796a30ccc5 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0d20744160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d0f48b5-9ba4-49df-851f-c996ad05e2c4'): ({'sdb'}, set())}) {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 16:37:45 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-e7bf5123-27ac-4424-9dc1-f0796a30ccc5 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Removing single pathed devices sdb {{(pid=75245) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 16:37:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:37:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:37:45 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[afba0230-1393-4415-8883-8115b817f0ff]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:37:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:37:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:37:45 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6aae3e-ecf4-4ff3-b07d-da75752ee1a5]: (4, ('ok\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:37:45 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-e7bf5123-27ac-4424-9dc1-f0796a30ccc5 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Flushing IO for device /dev/sdb {{(pid=75245) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 16:37:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:37:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:37:45 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[64128340-1914-4bf1-b26f-8975804d47a1]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:37:45 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-e7bf5123-27ac-4424-9dc1-f0796a30ccc5 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75245) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 16:37:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:37:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.065s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:37:45 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c6c7da-4379-4f3c-b479-e96b13014450]: (4, ('1', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:37:45 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-e7bf5123-27ac-4424-9dc1-f0796a30ccc5 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 16:37:45 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-e7bf5123-27ac-4424-9dc1-f0796a30ccc5 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] SCSI volumes sdb have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 16:37:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7bf5123-27ac-4424-9dc1-f0796a30ccc5 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d0f48b5-9ba4-49df-851f-c996ad05e2c4')] {{(pid=75245) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 16:37:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d0f48b5-9ba4-49df-851f-c996ad05e2c4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:37:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d0f48b5-9ba4-49df-851f-c996ad05e2c4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:37:45 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdcfd6f1-5be2-4e29-a9e9-7d95983cedb0]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:37:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7bf5123-27ac-4424-9dc1-f0796a30ccc5 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:37:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d0f48b5-9ba4-49df-851f-c996ad05e2c4 -p 172.16.0.220:3260 --logout {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:37:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d0f48b5-9ba4-49df-851f-c996ad05e2c4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:37:45 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5d2400-661f-4ce5-b69c-48bc07f03d84]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:3d0f48b5-9ba4-49df-851f-c996ad05e2c4, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:3d0f48b5-9ba4-49df-851f-c996ad05e2c4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:37:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7bf5123-27ac-4424-9dc1-f0796a30ccc5 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:3d0f48b5-9ba4-49df-851f-c996ad05e2c4, portal: 172.16.0.220,3260]
Nov 29 16:37:45 user nova-compute[75245]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:3d0f48b5-9ba4-49df-851f-c996ad05e2c4, portal: 172.16.0.220,3260] successful.
Nov 29 16:37:45 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:37:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d0f48b5-9ba4-49df-851f-c996ad05e2c4 -p 172.16.0.220:3260 --op delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:37:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d0f48b5-9ba4-49df-851f-c996ad05e2c4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:37:45 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb45b66-e22e-4693-ae22-2dfac16dd012]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:37:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7bf5123-27ac-4424-9dc1-f0796a30ccc5 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:37:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-e7bf5123-27ac-4424-9dc1-f0796a30ccc5 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:37:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7bf5123-27ac-4424-9dc1-f0796a30ccc5 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] <== disconnect_volume: return (331ms) None {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:37:45 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7bf5123-27ac-4424-9dc1-f0796a30ccc5 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] Disconnected iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 16:37:46 user nova-compute[75245]: DEBUG nova.objects.instance [None req-e7bf5123-27ac-4424-9dc1-f0796a30ccc5 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lazy-loading 'flavor' on Instance uuid 2b150aa0-612b-4ccd-87d3-3b38c1af96d7 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:37:46 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-e7bf5123-27ac-4424-9dc1-f0796a30ccc5 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lock "2b150aa0-612b-4ccd-87d3-3b38c1af96d7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.735s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:37:46 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "2b150aa0-612b-4ccd-87d3-3b38c1af96d7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 16.984s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:37:46 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "2b150aa0-612b-4ccd-87d3-3b38c1af96d7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:37:47 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-9bcd64f2-f313-4819-a5fe-b68df193782a tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Acquiring lock "2b150aa0-612b-4ccd-87d3-3b38c1af96d7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:37:47 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-9bcd64f2-f313-4819-a5fe-b68df193782a tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lock "2b150aa0-612b-4ccd-87d3-3b38c1af96d7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:37:47 user nova-compute[75245]: INFO nova.compute.manager [None req-9bcd64f2-f313-4819-a5fe-b68df193782a tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] Detaching volume 8caba35c-664c-42fb-a596-4f42be5ae739
Nov 29 16:37:47 user nova-compute[75245]: INFO nova.virt.block_device [None req-9bcd64f2-f313-4819-a5fe-b68df193782a tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] Attempting to driver detach volume 8caba35c-664c-42fb-a596-4f42be5ae739 from mountpoint /dev/vdc
Nov 29 16:37:47 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-9bcd64f2-f313-4819-a5fe-b68df193782a tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Attempting to detach device vdc from instance 2b150aa0-612b-4ccd-87d3-3b38c1af96d7 from the persistent domain config. {{(pid=75245) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 16:37:47 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-9bcd64f2-f313-4819-a5fe-b68df193782a tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 16:37:47 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:37:47 user nova-compute[75245]:   <source dev="/dev/sdc"/>
Nov 29 16:37:47 user nova-compute[75245]:   <target dev="vdc" bus="virtio"/>
Nov 29 16:37:47 user nova-compute[75245]:   <serial>8caba35c-664c-42fb-a596-4f42be5ae739</serial>
Nov 29 16:37:47 user nova-compute[75245]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 29 16:37:47 user nova-compute[75245]: </disk>
Nov 29 16:37:47 user nova-compute[75245]:  {{(pid=75245) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 16:37:47 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-9bcd64f2-f313-4819-a5fe-b68df193782a tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Successfully detached device vdc from instance 2b150aa0-612b-4ccd-87d3-3b38c1af96d7 from the persistent domain config.
Nov 29 16:37:47 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-9bcd64f2-f313-4819-a5fe-b68df193782a tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 2b150aa0-612b-4ccd-87d3-3b38c1af96d7 from the live domain config. {{(pid=75245) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 16:37:47 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-9bcd64f2-f313-4819-a5fe-b68df193782a tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 16:37:47 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:37:47 user nova-compute[75245]:   <source dev="/dev/sdc"/>
Nov 29 16:37:47 user nova-compute[75245]:   <target dev="vdc" bus="virtio"/>
Nov 29 16:37:47 user nova-compute[75245]:   <serial>8caba35c-664c-42fb-a596-4f42be5ae739</serial>
Nov 29 16:37:47 user nova-compute[75245]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 29 16:37:47 user nova-compute[75245]: </disk>
Nov 29 16:37:47 user nova-compute[75245]:  {{(pid=75245) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 16:37:48 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-9bcd64f2-f313-4819-a5fe-b68df193782a tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 2b150aa0-612b-4ccd-87d3-3b38c1af96d7 {{(pid=75245) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 16:37:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:37:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:37:59 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:38:01 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:38:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:38:08 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-9bcd64f2-f313-4819-a5fe-b68df193782a tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 2b150aa0-612b-4ccd-87d3-3b38c1af96d7 is timed out.
Nov 29 16:38:08 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-9bcd64f2-f313-4819-a5fe-b68df193782a tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Successfully detached device vdc from instance 2b150aa0-612b-4ccd-87d3-3b38c1af96d7 from the live domain config.
Nov 29 16:38:08 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9bcd64f2-f313-4819-a5fe-b68df193782a tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] calling os-brick to detach iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 16:38:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bcd64f2-f313-4819-a5fe-b68df193782a tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, {'target_iqn': 'iqn.2010-10.org.openstack:8caba35c-664c-42fb-a596-4f42be5ae739', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VQoduMJg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:38:08 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-9bcd64f2-f313-4819-a5fe-b68df193782a tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:38:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-9bcd64f2-f313-4819-a5fe-b68df193782a tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:38:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-9bcd64f2-f313-4819-a5fe-b68df193782a tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:38:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:38:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:38:08 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[00679adc-bdb1-4edf-9e0b-5120ac61b39b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8caba35c-664c-42fb-a596-4f42be5ae739\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:38:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bcd64f2-f313-4819-a5fe-b68df193782a tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 16:38:08 user nova-compute[75245]: No targets found.
Nov 29 16:38:08 user nova-compute[75245]: iSNS:
Nov 29 16:38:08 user nova-compute[75245]: No targets found.
Nov 29 16:38:08 user nova-compute[75245]: STATIC:
Nov 29 16:38:08 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:8caba35c-664c-42fb-a596-4f42be5ae739
Nov 29 16:38:08 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:38:08 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:38:08 user nova-compute[75245]: FIRMWARE:
Nov 29 16:38:08 user nova-compute[75245]: No targets found.
Nov 29 16:38:08 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:38:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bcd64f2-f313-4819-a5fe-b68df193782a tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 16:38:08 user nova-compute[75245]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 16:38:08 user nova-compute[75245]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75245) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 16:38:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bcd64f2-f313-4819-a5fe-b68df193782a tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8caba35c-664c-42fb-a596-4f42be5ae739', 0)] {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 16:38:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:38:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:38:08 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dbdf43b-cb49-4300-98bc-8aab1fbe3db9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8caba35c-664c-42fb-a596-4f42be5ae739\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:38:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:38:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:38:08 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e09932-caf0-4789-a206-b0315214638c]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8caba35c-664c-42fb-a596-4f42be5ae739 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:38:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bcd64f2-f313-4819-a5fe-b68df193782a tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8caba35c-664c-42fb-a596-4f42be5ae739 (non-flash)
Nov 29 16:38:08 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:38:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bcd64f2-f313-4819-a5fe-b68df193782a tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8caba35c-664c-42fb-a596-4f42be5ae739 (non-flash)
Nov 29 16:38:08 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:38:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bcd64f2-f313-4819-a5fe-b68df193782a tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0d442e3250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8caba35c-664c-42fb-a596-4f42be5ae739'): ({'sdc'}, set())}) {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 16:38:08 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-9bcd64f2-f313-4819-a5fe-b68df193782a tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Removing single pathed devices sdc {{(pid=75245) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 16:38:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:38:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:38:08 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dff797d-d9f2-462b-894d-ea91b0fd7e16]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:38:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:38:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:38:08 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[a26b4027-c669-4af9-b7a4-9dcc498e186f]: (4, ('ok\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:38:08 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-9bcd64f2-f313-4819-a5fe-b68df193782a tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Flushing IO for device /dev/sdc {{(pid=75245) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 16:38:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:38:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:38:08 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c67616d-b2aa-4581-a4d3-6e081e5b9951]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:38:08 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-9bcd64f2-f313-4819-a5fe-b68df193782a tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75245) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 16:38:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:38:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:38:08 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b0c91a-d798-4534-8307-be2d946557c2]: (4, ('1', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:38:08 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-9bcd64f2-f313-4819-a5fe-b68df193782a tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 16:38:08 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-9bcd64f2-f313-4819-a5fe-b68df193782a tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] SCSI volumes sdc have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 16:38:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bcd64f2-f313-4819-a5fe-b68df193782a tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8caba35c-664c-42fb-a596-4f42be5ae739')] {{(pid=75245) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 16:38:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8caba35c-664c-42fb-a596-4f42be5ae739 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:38:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8caba35c-664c-42fb-a596-4f42be5ae739 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.089s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:38:08 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[820f7ba2-ae6b-4571-96b3-14d18e70bcca]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:38:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bcd64f2-f313-4819-a5fe-b68df193782a tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:38:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8caba35c-664c-42fb-a596-4f42be5ae739 -p 172.16.0.220:3260 --logout {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:38:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8caba35c-664c-42fb-a596-4f42be5ae739 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:38:08 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[05cc3e3a-7b0f-4bc3-8527-9f20c14cadfe]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:8caba35c-664c-42fb-a596-4f42be5ae739, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:8caba35c-664c-42fb-a596-4f42be5ae739, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:38:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bcd64f2-f313-4819-a5fe-b68df193782a tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:8caba35c-664c-42fb-a596-4f42be5ae739, portal: 172.16.0.220,3260]
Nov 29 16:38:08 user nova-compute[75245]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:8caba35c-664c-42fb-a596-4f42be5ae739, portal: 172.16.0.220,3260] successful.
Nov 29 16:38:08 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:38:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8caba35c-664c-42fb-a596-4f42be5ae739 -p 172.16.0.220:3260 --op delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:38:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8caba35c-664c-42fb-a596-4f42be5ae739 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:38:08 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee49af28-6e27-4feb-9cce-cb2c22db2086]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:38:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bcd64f2-f313-4819-a5fe-b68df193782a tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:38:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-9bcd64f2-f313-4819-a5fe-b68df193782a tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:38:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bcd64f2-f313-4819-a5fe-b68df193782a tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] <== disconnect_volume: return (360ms) None {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:38:08 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9bcd64f2-f313-4819-a5fe-b68df193782a tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] Disconnected iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 16:38:08 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:38:08 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Starting heal instance info cache {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 16:38:08 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Rebuilding the list of instances to heal {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 16:38:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "refresh_cache-8785a3c2-5b7a-4382-b50d-cecd8743329c" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:38:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquired lock "refresh_cache-8785a3c2-5b7a-4382-b50d-cecd8743329c" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:38:08 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Forcefully refreshing network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 16:38:08 user nova-compute[75245]: DEBUG nova.objects.instance [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lazy-loading 'info_cache' on Instance uuid 8785a3c2-5b7a-4382-b50d-cecd8743329c {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:38:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:38:09 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Updating instance_info_cache with network_info: [{"id": "8c7418c2-2459-4bc3-acfb-16df97c78f67", "address": "fa:16:3e:82:d0:d8", "network": {"id": "6a7f7426-b595-4aa3-bf80-cc92ba7ce15e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-917300903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d52776451e947f5a9ef3fa44ac8acbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7418c2-24", "ovs_interfaceid": "8c7418c2-2459-4bc3-acfb-16df97c78f67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:38:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Releasing lock "refresh_cache-8785a3c2-5b7a-4382-b50d-cecd8743329c" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:38:09 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Updated the network info_cache for instance {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 16:38:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-ec28128b-dfee-4123-bfab-a9300c2eeca9 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Acquiring lock "ed9d1ad5-f5d0-4a68-a073-e7a83be772ea" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:38:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-ec28128b-dfee-4123-bfab-a9300c2eeca9 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lock "ed9d1ad5-f5d0-4a68-a073-e7a83be772ea" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:38:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-ec28128b-dfee-4123-bfab-a9300c2eeca9 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Acquiring lock "ed9d1ad5-f5d0-4a68-a073-e7a83be772ea-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:38:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-ec28128b-dfee-4123-bfab-a9300c2eeca9 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lock "ed9d1ad5-f5d0-4a68-a073-e7a83be772ea-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:38:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-ec28128b-dfee-4123-bfab-a9300c2eeca9 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lock "ed9d1ad5-f5d0-4a68-a073-e7a83be772ea-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:38:09 user nova-compute[75245]: INFO nova.compute.manager [None req-ec28128b-dfee-4123-bfab-a9300c2eeca9 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Terminating instance
Nov 29 16:38:09 user nova-compute[75245]: DEBUG nova.compute.manager [None req-ec28128b-dfee-4123-bfab-a9300c2eeca9 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Start destroying the instance on the hypervisor. {{(pid=75245) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 16:38:09 user nova-compute[75245]: DEBUG nova.objects.instance [None req-9bcd64f2-f313-4819-a5fe-b68df193782a tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lazy-loading 'flavor' on Instance uuid 2b150aa0-612b-4ccd-87d3-3b38c1af96d7 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:38:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:38:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-9bcd64f2-f313-4819-a5fe-b68df193782a tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lock "2b150aa0-612b-4ccd-87d3-3b38c1af96d7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.789s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:38:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:38:09 user nova-compute[75245]: DEBUG nova.compute.manager [req-cba7161a-e200-462e-8146-a328ed6e723d req-5e1f13e6-82ea-4a89-878e-5ca24a857400 service nova] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Received event network-vif-unplugged-592b836b-e112-414f-b9a9-60e5f65b8f98 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:38:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-cba7161a-e200-462e-8146-a328ed6e723d req-5e1f13e6-82ea-4a89-878e-5ca24a857400 service nova] Acquiring lock "ed9d1ad5-f5d0-4a68-a073-e7a83be772ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:38:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-cba7161a-e200-462e-8146-a328ed6e723d req-5e1f13e6-82ea-4a89-878e-5ca24a857400 service nova] Lock "ed9d1ad5-f5d0-4a68-a073-e7a83be772ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:38:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-cba7161a-e200-462e-8146-a328ed6e723d req-5e1f13e6-82ea-4a89-878e-5ca24a857400 service nova] Lock "ed9d1ad5-f5d0-4a68-a073-e7a83be772ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:38:09 user nova-compute[75245]: DEBUG nova.compute.manager [req-cba7161a-e200-462e-8146-a328ed6e723d req-5e1f13e6-82ea-4a89-878e-5ca24a857400 service nova] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] No waiting events found dispatching network-vif-unplugged-592b836b-e112-414f-b9a9-60e5f65b8f98 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:38:09 user nova-compute[75245]: DEBUG nova.compute.manager [req-cba7161a-e200-462e-8146-a328ed6e723d req-5e1f13e6-82ea-4a89-878e-5ca24a857400 service nova] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Received event network-vif-unplugged-592b836b-e112-414f-b9a9-60e5f65b8f98 for instance with task_state deleting. {{(pid=75245) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 16:38:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:38:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:38:09 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Instance destroyed successfully.
Nov 29 16:38:09 user nova-compute[75245]: DEBUG nova.objects.instance [None req-ec28128b-dfee-4123-bfab-a9300c2eeca9 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lazy-loading 'resources' on Instance uuid ed9d1ad5-f5d0-4a68-a073-e7a83be772ea {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:38:10 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-ec28128b-dfee-4123-bfab-a9300c2eeca9 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:22:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1973964224',display_name='tempest-ServerRescueNegativeTestJSON-server-1973964224',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1973964224',id=26,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:24:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e12002e1a11f4caf8953371e66e6652e',ramdisk_id='',reservation_id='r-z1a05ozn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1013090395',owner_user_name='tempest-ServerRescueNegativeTestJSON-1013090395-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:24:01Z,user_data=None,user_id='d876b1e244b14a29ad5b4b422135336b',uuid=ed9d1ad5-f5d0-4a68-a073-e7a83be772ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "592b836b-e112-414f-b9a9-60e5f65b8f98", "address": "fa:16:3e:90:86:e1", "network": {"id": "02098e86-68f8-464e-84ee-bf2fb09b881b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085418471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e12002e1a11f4caf8953371e66e6652e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592b836b-e1", "ovs_interfaceid": "592b836b-e112-414f-b9a9-60e5f65b8f98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 16:38:10 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-ec28128b-dfee-4123-bfab-a9300c2eeca9 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Converting VIF {"id": "592b836b-e112-414f-b9a9-60e5f65b8f98", "address": "fa:16:3e:90:86:e1", "network": {"id": "02098e86-68f8-464e-84ee-bf2fb09b881b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085418471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e12002e1a11f4caf8953371e66e6652e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592b836b-e1", "ovs_interfaceid": "592b836b-e112-414f-b9a9-60e5f65b8f98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:38:10 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-ec28128b-dfee-4123-bfab-a9300c2eeca9 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:90:86:e1,bridge_name='br-int',has_traffic_filtering=True,id=592b836b-e112-414f-b9a9-60e5f65b8f98,network=Network(02098e86-68f8-464e-84ee-bf2fb09b881b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap592b836b-e1') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:38:10 user nova-compute[75245]: DEBUG os_vif [None req-ec28128b-dfee-4123-bfab-a9300c2eeca9 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:86:e1,bridge_name='br-int',has_traffic_filtering=True,id=592b836b-e112-414f-b9a9-60e5f65b8f98,network=Network(02098e86-68f8-464e-84ee-bf2fb09b881b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap592b836b-e1') {{(pid=75245) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 16:38:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:38:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap592b836b-e1, bridge=br-int, if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:38:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:38:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:38:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:38:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7cd241ce-b35b-4e50-bfce-5540a27e3ddf) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:38:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:38:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:38:10 user nova-compute[75245]: INFO os_vif [None req-ec28128b-dfee-4123-bfab-a9300c2eeca9 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:86:e1,bridge_name='br-int',has_traffic_filtering=True,id=592b836b-e112-414f-b9a9-60e5f65b8f98,network=Network(02098e86-68f8-464e-84ee-bf2fb09b881b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap592b836b-e1')
Nov 29 16:38:10 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-ec28128b-dfee-4123-bfab-a9300c2eeca9 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Deleting instance files /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea_del
Nov 29 16:38:10 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-ec28128b-dfee-4123-bfab-a9300c2eeca9 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Deletion of /opt/stack/data/nova/instances/ed9d1ad5-f5d0-4a68-a073-e7a83be772ea_del complete
Nov 29 16:38:10 user nova-compute[75245]: INFO nova.compute.manager [None req-ec28128b-dfee-4123-bfab-a9300c2eeca9 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 29 16:38:10 user nova-compute[75245]: DEBUG oslo.service.loopingcall [None req-ec28128b-dfee-4123-bfab-a9300c2eeca9 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75245) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 16:38:10 user nova-compute[75245]: DEBUG nova.compute.manager [-] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Deallocating network for instance {{(pid=75245) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 16:38:10 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] deallocate_for_instance() {{(pid=75245) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 16:38:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-89a45fce-3ad6-47c9-af76-6ac769c8fd41 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Acquiring lock "2b150aa0-612b-4ccd-87d3-3b38c1af96d7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:38:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-89a45fce-3ad6-47c9-af76-6ac769c8fd41 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lock "2b150aa0-612b-4ccd-87d3-3b38c1af96d7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:38:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-89a45fce-3ad6-47c9-af76-6ac769c8fd41 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Acquiring lock "2b150aa0-612b-4ccd-87d3-3b38c1af96d7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:38:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-89a45fce-3ad6-47c9-af76-6ac769c8fd41 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lock "2b150aa0-612b-4ccd-87d3-3b38c1af96d7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:38:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-89a45fce-3ad6-47c9-af76-6ac769c8fd41 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lock "2b150aa0-612b-4ccd-87d3-3b38c1af96d7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:38:10 user nova-compute[75245]: INFO nova.compute.manager [None req-89a45fce-3ad6-47c9-af76-6ac769c8fd41 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] Terminating instance
Nov 29 16:38:10 user nova-compute[75245]: DEBUG nova.compute.manager [None req-89a45fce-3ad6-47c9-af76-6ac769c8fd41 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] Start destroying the instance on the hypervisor. {{(pid=75245) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 16:38:10 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:38:10 user nova-compute[75245]: INFO nova.compute.manager [-] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Took 0.48 seconds to deallocate network for instance.
Nov 29 16:38:10 user nova-compute[75245]: DEBUG nova.compute.manager [req-6ed3c99b-aab7-4143-aeb2-9d2b4b511042 req-9b9f242e-4b10-455a-a984-cb1309b6eaf0 service nova] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Received event network-vif-deleted-592b836b-e112-414f-b9a9-60e5f65b8f98 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:38:10 user nova-compute[75245]: INFO nova.compute.manager [req-6ed3c99b-aab7-4143-aeb2-9d2b4b511042 req-9b9f242e-4b10-455a-a984-cb1309b6eaf0 service nova] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Neutron deleted interface 592b836b-e112-414f-b9a9-60e5f65b8f98; detaching it from the instance and deleting it from the info cache
Nov 29 16:38:10 user nova-compute[75245]: DEBUG nova.network.neutron [req-6ed3c99b-aab7-4143-aeb2-9d2b4b511042 req-9b9f242e-4b10-455a-a984-cb1309b6eaf0 service nova] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:38:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:38:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:38:10 user nova-compute[75245]: DEBUG nova.compute.manager [req-6ed3c99b-aab7-4143-aeb2-9d2b4b511042 req-9b9f242e-4b10-455a-a984-cb1309b6eaf0 service nova] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Detach interface failed, port_id=592b836b-e112-414f-b9a9-60e5f65b8f98, reason: Instance ed9d1ad5-f5d0-4a68-a073-e7a83be772ea could not be found. {{(pid=75245) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 16:38:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:38:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:38:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-ec28128b-dfee-4123-bfab-a9300c2eeca9 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:38:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-ec28128b-dfee-4123-bfab-a9300c2eeca9 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:38:10 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-ec28128b-dfee-4123-bfab-a9300c2eeca9 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:38:10 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-ec28128b-dfee-4123-bfab-a9300c2eeca9 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:38:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-ec28128b-dfee-4123-bfab-a9300c2eeca9 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.270s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:38:10 user nova-compute[75245]: INFO nova.scheduler.client.report [None req-ec28128b-dfee-4123-bfab-a9300c2eeca9 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Deleted allocations for instance ed9d1ad5-f5d0-4a68-a073-e7a83be772ea
Nov 29 16:38:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-ec28128b-dfee-4123-bfab-a9300c2eeca9 tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lock "ed9d1ad5-f5d0-4a68-a073-e7a83be772ea" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.851s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:38:11 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] Instance destroyed successfully.
Nov 29 16:38:11 user nova-compute[75245]: DEBUG nova.objects.instance [None req-89a45fce-3ad6-47c9-af76-6ac769c8fd41 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lazy-loading 'resources' on Instance uuid 2b150aa0-612b-4ccd-87d3-3b38c1af96d7 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:38:11 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-89a45fce-3ad6-47c9-af76-6ac769c8fd41 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:35:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-577505168',display_name='tempest-AttachVolumeTestJSON-server-577505168',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-577505168',id=32,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDl5KUNKB25OXpQsfrKezppTSS89KIYC595W9NtQqLaMbPEUNL/dKatCma44RpD5RD/0pGyrN3YrnfRHyENZSoWd3wLxJynvyWYKeunc0iJG6sSXUl3TttmuEOuv7+1Slg==',key_name='tempest-keypair-1236278888',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:35:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ba4d99c1c6c4472be06502d8b0e75a4',ramdisk_id='',reservation_id='r-lttd3tvq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-280497743',owner_user_name='tempest-AttachVolumeTestJSON-280497743-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:35:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d5d3377c73648b8ba9044cfddbfc759',uuid=2b150aa0-612b-4ccd-87d3-3b38c1af96d7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bb7dda5f-1f48-4d4f-bd7c-3e983aab8a26", "address": "fa:16:3e:41:c6:08", "network": {"id": "2110162d-c25f-4c3d-9a67-18e52f6caf43", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1854809203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba4d99c1c6c4472be06502d8b0e75a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb7dda5f-1f", "ovs_interfaceid": "bb7dda5f-1f48-4d4f-bd7c-3e983aab8a26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 16:38:11 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-89a45fce-3ad6-47c9-af76-6ac769c8fd41 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Converting VIF {"id": "bb7dda5f-1f48-4d4f-bd7c-3e983aab8a26", "address": "fa:16:3e:41:c6:08", "network": {"id": "2110162d-c25f-4c3d-9a67-18e52f6caf43", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1854809203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba4d99c1c6c4472be06502d8b0e75a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb7dda5f-1f", "ovs_interfaceid": "bb7dda5f-1f48-4d4f-bd7c-3e983aab8a26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:38:11 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-89a45fce-3ad6-47c9-af76-6ac769c8fd41 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:41:c6:08,bridge_name='br-int',has_traffic_filtering=True,id=bb7dda5f-1f48-4d4f-bd7c-3e983aab8a26,network=Network(2110162d-c25f-4c3d-9a67-18e52f6caf43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb7dda5f-1f') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:38:11 user nova-compute[75245]: DEBUG os_vif [None req-89a45fce-3ad6-47c9-af76-6ac769c8fd41 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:c6:08,bridge_name='br-int',has_traffic_filtering=True,id=bb7dda5f-1f48-4d4f-bd7c-3e983aab8a26,network=Network(2110162d-c25f-4c3d-9a67-18e52f6caf43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb7dda5f-1f') {{(pid=75245) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 16:38:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:38:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbb7dda5f-1f, bridge=br-int, if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:38:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:38:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:38:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:38:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b2366426-abcc-4d09-b273-f021b4bc2cb2) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:38:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:38:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:38:11 user nova-compute[75245]: INFO os_vif [None req-89a45fce-3ad6-47c9-af76-6ac769c8fd41 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:c6:08,bridge_name='br-int',has_traffic_filtering=True,id=bb7dda5f-1f48-4d4f-bd7c-3e983aab8a26,network=Network(2110162d-c25f-4c3d-9a67-18e52f6caf43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb7dda5f-1f')
Nov 29 16:38:11 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-89a45fce-3ad6-47c9-af76-6ac769c8fd41 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] Deleting instance files /opt/stack/data/nova/instances/2b150aa0-612b-4ccd-87d3-3b38c1af96d7_del
Nov 29 16:38:11 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-89a45fce-3ad6-47c9-af76-6ac769c8fd41 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] Deletion of /opt/stack/data/nova/instances/2b150aa0-612b-4ccd-87d3-3b38c1af96d7_del complete
Nov 29 16:38:11 user nova-compute[75245]: INFO nova.compute.manager [None req-89a45fce-3ad6-47c9-af76-6ac769c8fd41 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 29 16:38:11 user nova-compute[75245]: DEBUG oslo.service.loopingcall [None req-89a45fce-3ad6-47c9-af76-6ac769c8fd41 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75245) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 16:38:11 user nova-compute[75245]: DEBUG nova.compute.manager [-] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] Deallocating network for instance {{(pid=75245) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 16:38:11 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] deallocate_for_instance() {{(pid=75245) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 16:38:11 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:38:11 user nova-compute[75245]: DEBUG nova.compute.manager [req-120c5eb5-683b-4476-99aa-6ab9578ecccc req-70a1f144-3816-45bc-a9e7-e15b9c7ed05d service nova] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Received event network-vif-plugged-592b836b-e112-414f-b9a9-60e5f65b8f98 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:38:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-120c5eb5-683b-4476-99aa-6ab9578ecccc req-70a1f144-3816-45bc-a9e7-e15b9c7ed05d service nova] Acquiring lock "ed9d1ad5-f5d0-4a68-a073-e7a83be772ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:38:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-120c5eb5-683b-4476-99aa-6ab9578ecccc req-70a1f144-3816-45bc-a9e7-e15b9c7ed05d service nova] Lock "ed9d1ad5-f5d0-4a68-a073-e7a83be772ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:38:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-120c5eb5-683b-4476-99aa-6ab9578ecccc req-70a1f144-3816-45bc-a9e7-e15b9c7ed05d service nova] Lock "ed9d1ad5-f5d0-4a68-a073-e7a83be772ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:38:11 user nova-compute[75245]: DEBUG nova.compute.manager [req-120c5eb5-683b-4476-99aa-6ab9578ecccc req-70a1f144-3816-45bc-a9e7-e15b9c7ed05d service nova] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] No waiting events found dispatching network-vif-plugged-592b836b-e112-414f-b9a9-60e5f65b8f98 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:38:11 user nova-compute[75245]: WARNING nova.compute.manager [req-120c5eb5-683b-4476-99aa-6ab9578ecccc req-70a1f144-3816-45bc-a9e7-e15b9c7ed05d service nova] [instance: ed9d1ad5-f5d0-4a68-a073-e7a83be772ea] Received unexpected event network-vif-plugged-592b836b-e112-414f-b9a9-60e5f65b8f98 for instance with vm_state deleted and task_state None.
Nov 29 16:38:11 user nova-compute[75245]: DEBUG nova.compute.manager [req-120c5eb5-683b-4476-99aa-6ab9578ecccc req-70a1f144-3816-45bc-a9e7-e15b9c7ed05d service nova] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] Received event network-vif-unplugged-bb7dda5f-1f48-4d4f-bd7c-3e983aab8a26 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:38:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-120c5eb5-683b-4476-99aa-6ab9578ecccc req-70a1f144-3816-45bc-a9e7-e15b9c7ed05d service nova] Acquiring lock "2b150aa0-612b-4ccd-87d3-3b38c1af96d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:38:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-120c5eb5-683b-4476-99aa-6ab9578ecccc req-70a1f144-3816-45bc-a9e7-e15b9c7ed05d service nova] Lock "2b150aa0-612b-4ccd-87d3-3b38c1af96d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:38:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-120c5eb5-683b-4476-99aa-6ab9578ecccc req-70a1f144-3816-45bc-a9e7-e15b9c7ed05d service nova] Lock "2b150aa0-612b-4ccd-87d3-3b38c1af96d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:38:11 user nova-compute[75245]: DEBUG nova.compute.manager [req-120c5eb5-683b-4476-99aa-6ab9578ecccc req-70a1f144-3816-45bc-a9e7-e15b9c7ed05d service nova] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] No waiting events found dispatching network-vif-unplugged-bb7dda5f-1f48-4d4f-bd7c-3e983aab8a26 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:38:11 user nova-compute[75245]: DEBUG nova.compute.manager [req-120c5eb5-683b-4476-99aa-6ab9578ecccc req-70a1f144-3816-45bc-a9e7-e15b9c7ed05d service nova] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] Received event network-vif-unplugged-bb7dda5f-1f48-4d4f-bd7c-3e983aab8a26 for instance with task_state deleting. {{(pid=75245) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 16:38:11 user nova-compute[75245]: DEBUG nova.compute.manager [req-120c5eb5-683b-4476-99aa-6ab9578ecccc req-70a1f144-3816-45bc-a9e7-e15b9c7ed05d service nova] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] Received event network-vif-plugged-bb7dda5f-1f48-4d4f-bd7c-3e983aab8a26 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:38:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-120c5eb5-683b-4476-99aa-6ab9578ecccc req-70a1f144-3816-45bc-a9e7-e15b9c7ed05d service nova] Acquiring lock "2b150aa0-612b-4ccd-87d3-3b38c1af96d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:38:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-120c5eb5-683b-4476-99aa-6ab9578ecccc req-70a1f144-3816-45bc-a9e7-e15b9c7ed05d service nova] Lock "2b150aa0-612b-4ccd-87d3-3b38c1af96d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:38:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-120c5eb5-683b-4476-99aa-6ab9578ecccc req-70a1f144-3816-45bc-a9e7-e15b9c7ed05d service nova] Lock "2b150aa0-612b-4ccd-87d3-3b38c1af96d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:38:11 user nova-compute[75245]: DEBUG nova.compute.manager [req-120c5eb5-683b-4476-99aa-6ab9578ecccc req-70a1f144-3816-45bc-a9e7-e15b9c7ed05d service nova] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] No waiting events found dispatching network-vif-plugged-bb7dda5f-1f48-4d4f-bd7c-3e983aab8a26 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:38:11 user nova-compute[75245]: WARNING nova.compute.manager [req-120c5eb5-683b-4476-99aa-6ab9578ecccc req-70a1f144-3816-45bc-a9e7-e15b9c7ed05d service nova] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] Received unexpected event network-vif-plugged-bb7dda5f-1f48-4d4f-bd7c-3e983aab8a26 for instance with vm_state active and task_state deleting.
Nov 29 16:38:12 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:38:12 user nova-compute[75245]: INFO nova.compute.manager [-] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] Took 1.44 seconds to deallocate network for instance.
Nov 29 16:38:12 user nova-compute[75245]: DEBUG nova.compute.manager [req-7ef92316-0576-4558-b3cb-2d201a65d295 req-7f038c0a-6e6a-4a5a-912e-d73887f28074 service nova] [instance: 2b150aa0-612b-4ccd-87d3-3b38c1af96d7] Received event network-vif-deleted-bb7dda5f-1f48-4d4f-bd7c-3e983aab8a26 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:38:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-89a45fce-3ad6-47c9-af76-6ac769c8fd41 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:38:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-89a45fce-3ad6-47c9-af76-6ac769c8fd41 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:38:13 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-89a45fce-3ad6-47c9-af76-6ac769c8fd41 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:38:13 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-89a45fce-3ad6-47c9-af76-6ac769c8fd41 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:38:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-89a45fce-3ad6-47c9-af76-6ac769c8fd41 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.158s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:38:13 user nova-compute[75245]: INFO nova.scheduler.client.report [None req-89a45fce-3ad6-47c9-af76-6ac769c8fd41 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Deleted allocations for instance 2b150aa0-612b-4ccd-87d3-3b38c1af96d7
Nov 29 16:38:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-89a45fce-3ad6-47c9-af76-6ac769c8fd41 tempest-AttachVolumeTestJSON-280497743 tempest-AttachVolumeTestJSON-280497743-project-member] Lock "2b150aa0-612b-4ccd-87d3-3b38c1af96d7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.653s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:38:13 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:38:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:38:14 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:38:14 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:38:14 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:38:14 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:38:14 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75245) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 16:38:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:38:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:38:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:38:15 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:38:15 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:38:15 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:38:15 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:38:15 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:38:15 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:38:15 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:38:15 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Hypervisor/Node resource view: name=user free_ram=8782MB free_disk=25.161846160888672GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75245) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 16:38:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:38:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:38:15 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 8785a3c2-5b7a-4382-b50d-cecd8743329c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:38:15 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:38:15 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 16:38:15 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 16:38:15 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:38:15 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:38:15 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Compute_service record updated for user:user {{(pid=75245) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 16:38:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.215s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:38:16 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:38:17 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:38:20 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:38:21 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:38:21 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:38:22 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:38:22 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75245) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 16:38:23 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:38:24 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-29a87fa4-4a2a-4f7e-ab61-62aa3945e611 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Acquiring lock "8785a3c2-5b7a-4382-b50d-cecd8743329c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:38:24 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-29a87fa4-4a2a-4f7e-ab61-62aa3945e611 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "8785a3c2-5b7a-4382-b50d-cecd8743329c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:38:24 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-29a87fa4-4a2a-4f7e-ab61-62aa3945e611 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Acquiring lock "8785a3c2-5b7a-4382-b50d-cecd8743329c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:38:24 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-29a87fa4-4a2a-4f7e-ab61-62aa3945e611 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "8785a3c2-5b7a-4382-b50d-cecd8743329c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:38:24 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-29a87fa4-4a2a-4f7e-ab61-62aa3945e611 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "8785a3c2-5b7a-4382-b50d-cecd8743329c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:38:24 user nova-compute[75245]: INFO nova.compute.manager [None req-29a87fa4-4a2a-4f7e-ab61-62aa3945e611 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Terminating instance
Nov 29 16:38:24 user nova-compute[75245]: DEBUG nova.compute.manager [None req-29a87fa4-4a2a-4f7e-ab61-62aa3945e611 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Start destroying the instance on the hypervisor. {{(pid=75245) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 16:38:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:38:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:38:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:38:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:38:24 user nova-compute[75245]: DEBUG nova.compute.manager [req-c0889b45-7229-4c92-9e08-8e9e6603daf6 req-64fd0d14-a142-4711-aaf5-1296560d24e9 service nova] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Received event network-vif-unplugged-8c7418c2-2459-4bc3-acfb-16df97c78f67 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:38:24 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-c0889b45-7229-4c92-9e08-8e9e6603daf6 req-64fd0d14-a142-4711-aaf5-1296560d24e9 service nova] Acquiring lock "8785a3c2-5b7a-4382-b50d-cecd8743329c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:38:24 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-c0889b45-7229-4c92-9e08-8e9e6603daf6 req-64fd0d14-a142-4711-aaf5-1296560d24e9 service nova] Lock "8785a3c2-5b7a-4382-b50d-cecd8743329c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:38:24 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-c0889b45-7229-4c92-9e08-8e9e6603daf6 req-64fd0d14-a142-4711-aaf5-1296560d24e9 service nova] Lock "8785a3c2-5b7a-4382-b50d-cecd8743329c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:38:24 user nova-compute[75245]: DEBUG nova.compute.manager [req-c0889b45-7229-4c92-9e08-8e9e6603daf6 req-64fd0d14-a142-4711-aaf5-1296560d24e9 service nova] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] No waiting events found dispatching network-vif-unplugged-8c7418c2-2459-4bc3-acfb-16df97c78f67 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:38:24 user nova-compute[75245]: DEBUG nova.compute.manager [req-c0889b45-7229-4c92-9e08-8e9e6603daf6 req-64fd0d14-a142-4711-aaf5-1296560d24e9 service nova] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Received event network-vif-unplugged-8c7418c2-2459-4bc3-acfb-16df97c78f67 for instance with task_state deleting. {{(pid=75245) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 16:38:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:38:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:38:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:38:24 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Instance destroyed successfully.
Nov 29 16:38:24 user nova-compute[75245]: DEBUG nova.objects.instance [None req-29a87fa4-4a2a-4f7e-ab61-62aa3945e611 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lazy-loading 'resources' on Instance uuid 8785a3c2-5b7a-4382-b50d-cecd8743329c {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:38:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:38:24 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-29a87fa4-4a2a-4f7e-ab61-62aa3945e611 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:18:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-908755378',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-908755378',id=21,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:18:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1d52776451e947f5a9ef3fa44ac8acbb',ramdisk_id='',reservation_id='r-ehafhgpq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1780163218',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:20:45Z,user_data=None,user_id='4f20e7c9ae22462ea6bc623c93697fce',uuid=8785a3c2-5b7a-4382-b50d-cecd8743329c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c7418c2-2459-4bc3-acfb-16df97c78f67", "address": "fa:16:3e:82:d0:d8", "network": {"id": "6a7f7426-b595-4aa3-bf80-cc92ba7ce15e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-917300903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d52776451e947f5a9ef3fa44ac8acbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7418c2-24", "ovs_interfaceid": "8c7418c2-2459-4bc3-acfb-16df97c78f67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 16:38:24 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-29a87fa4-4a2a-4f7e-ab61-62aa3945e611 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Converting VIF {"id": "8c7418c2-2459-4bc3-acfb-16df97c78f67", "address": "fa:16:3e:82:d0:d8", "network": {"id": "6a7f7426-b595-4aa3-bf80-cc92ba7ce15e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-917300903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d52776451e947f5a9ef3fa44ac8acbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7418c2-24", "ovs_interfaceid": "8c7418c2-2459-4bc3-acfb-16df97c78f67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:38:24 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-29a87fa4-4a2a-4f7e-ab61-62aa3945e611 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:82:d0:d8,bridge_name='br-int',has_traffic_filtering=True,id=8c7418c2-2459-4bc3-acfb-16df97c78f67,network=Network(6a7f7426-b595-4aa3-bf80-cc92ba7ce15e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c7418c2-24') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:38:24 user nova-compute[75245]: DEBUG os_vif [None req-29a87fa4-4a2a-4f7e-ab61-62aa3945e611 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:82:d0:d8,bridge_name='br-int',has_traffic_filtering=True,id=8c7418c2-2459-4bc3-acfb-16df97c78f67,network=Network(6a7f7426-b595-4aa3-bf80-cc92ba7ce15e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c7418c2-24') {{(pid=75245) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 16:38:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:38:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8c7418c2-24, bridge=br-int, if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:38:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:38:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:38:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:38:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=edfb0820-f4bd-46f3-aa92-1bc3e132cd8f) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:38:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:38:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:38:24 user nova-compute[75245]: INFO os_vif [None req-29a87fa4-4a2a-4f7e-ab61-62aa3945e611 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:82:d0:d8,bridge_name='br-int',has_traffic_filtering=True,id=8c7418c2-2459-4bc3-acfb-16df97c78f67,network=Network(6a7f7426-b595-4aa3-bf80-cc92ba7ce15e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c7418c2-24')
Nov 29 16:38:24 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-29a87fa4-4a2a-4f7e-ab61-62aa3945e611 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Deleting instance files /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c_del
Nov 29 16:38:24 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-29a87fa4-4a2a-4f7e-ab61-62aa3945e611 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Deletion of /opt/stack/data/nova/instances/8785a3c2-5b7a-4382-b50d-cecd8743329c_del complete
Nov 29 16:38:24 user nova-compute[75245]: INFO nova.compute.manager [None req-29a87fa4-4a2a-4f7e-ab61-62aa3945e611 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Took 0.70 seconds to destroy the instance on the hypervisor.
Nov 29 16:38:24 user nova-compute[75245]: DEBUG oslo.service.loopingcall [None req-29a87fa4-4a2a-4f7e-ab61-62aa3945e611 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75245) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 16:38:24 user nova-compute[75245]: DEBUG nova.compute.manager [-] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Deallocating network for instance {{(pid=75245) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 16:38:24 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] deallocate_for_instance() {{(pid=75245) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 16:38:25 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:38:25 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:38:25 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:38:25 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:38:25 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:38:25 user nova-compute[75245]: INFO nova.compute.manager [-] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Took 0.55 seconds to deallocate network for instance.
Nov 29 16:38:25 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:38:25 user nova-compute[75245]: DEBUG nova.compute.manager [req-0ddfeb02-90dd-473a-be62-3b72e6b9830b req-593fcabc-33a2-4158-b5bc-89611e90680f service nova] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Received event network-vif-deleted-8c7418c2-2459-4bc3-acfb-16df97c78f67 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:38:25 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-29a87fa4-4a2a-4f7e-ab61-62aa3945e611 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:38:25 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-29a87fa4-4a2a-4f7e-ab61-62aa3945e611 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:38:25 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-29a87fa4-4a2a-4f7e-ab61-62aa3945e611 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:38:25 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-29a87fa4-4a2a-4f7e-ab61-62aa3945e611 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:38:25 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-29a87fa4-4a2a-4f7e-ab61-62aa3945e611 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.149s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:38:25 user nova-compute[75245]: INFO nova.scheduler.client.report [None req-29a87fa4-4a2a-4f7e-ab61-62aa3945e611 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Deleted allocations for instance 8785a3c2-5b7a-4382-b50d-cecd8743329c
Nov 29 16:38:25 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-29a87fa4-4a2a-4f7e-ab61-62aa3945e611 tempest-ServerBootFromVolumeStableRescueTest-1780163218 tempest-ServerBootFromVolumeStableRescueTest-1780163218-project-member] Lock "8785a3c2-5b7a-4382-b50d-cecd8743329c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.619s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:38:26 user nova-compute[75245]: DEBUG nova.compute.manager [req-d0e6dab7-9d90-4fc1-8881-4df759db325f req-de422efa-f68d-4624-adb0-59b4e9bf3cd6 service nova] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Received event network-vif-plugged-8c7418c2-2459-4bc3-acfb-16df97c78f67 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:38:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d0e6dab7-9d90-4fc1-8881-4df759db325f req-de422efa-f68d-4624-adb0-59b4e9bf3cd6 service nova] Acquiring lock "8785a3c2-5b7a-4382-b50d-cecd8743329c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:38:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d0e6dab7-9d90-4fc1-8881-4df759db325f req-de422efa-f68d-4624-adb0-59b4e9bf3cd6 service nova] Lock "8785a3c2-5b7a-4382-b50d-cecd8743329c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:38:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d0e6dab7-9d90-4fc1-8881-4df759db325f req-de422efa-f68d-4624-adb0-59b4e9bf3cd6 service nova] Lock "8785a3c2-5b7a-4382-b50d-cecd8743329c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:38:26 user nova-compute[75245]: DEBUG nova.compute.manager [req-d0e6dab7-9d90-4fc1-8881-4df759db325f req-de422efa-f68d-4624-adb0-59b4e9bf3cd6 service nova] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] No waiting events found dispatching network-vif-plugged-8c7418c2-2459-4bc3-acfb-16df97c78f67 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:38:26 user nova-compute[75245]: WARNING nova.compute.manager [req-d0e6dab7-9d90-4fc1-8881-4df759db325f req-de422efa-f68d-4624-adb0-59b4e9bf3cd6 service nova] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Received unexpected event network-vif-plugged-8c7418c2-2459-4bc3-acfb-16df97c78f67 for instance with vm_state deleted and task_state None.
Nov 29 16:38:26 user nova-compute[75245]: DEBUG nova.compute.manager [req-d0e6dab7-9d90-4fc1-8881-4df759db325f req-de422efa-f68d-4624-adb0-59b4e9bf3cd6 service nova] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Received event network-vif-plugged-8c7418c2-2459-4bc3-acfb-16df97c78f67 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:38:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d0e6dab7-9d90-4fc1-8881-4df759db325f req-de422efa-f68d-4624-adb0-59b4e9bf3cd6 service nova] Acquiring lock "8785a3c2-5b7a-4382-b50d-cecd8743329c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:38:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d0e6dab7-9d90-4fc1-8881-4df759db325f req-de422efa-f68d-4624-adb0-59b4e9bf3cd6 service nova] Lock "8785a3c2-5b7a-4382-b50d-cecd8743329c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:38:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d0e6dab7-9d90-4fc1-8881-4df759db325f req-de422efa-f68d-4624-adb0-59b4e9bf3cd6 service nova] Lock "8785a3c2-5b7a-4382-b50d-cecd8743329c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:38:26 user nova-compute[75245]: DEBUG nova.compute.manager [req-d0e6dab7-9d90-4fc1-8881-4df759db325f req-de422efa-f68d-4624-adb0-59b4e9bf3cd6 service nova] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] No waiting events found dispatching network-vif-plugged-8c7418c2-2459-4bc3-acfb-16df97c78f67 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:38:26 user nova-compute[75245]: WARNING nova.compute.manager [req-d0e6dab7-9d90-4fc1-8881-4df759db325f req-de422efa-f68d-4624-adb0-59b4e9bf3cd6 service nova] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Received unexpected event network-vif-plugged-8c7418c2-2459-4bc3-acfb-16df97c78f67 for instance with vm_state deleted and task_state None.
Nov 29 16:38:26 user nova-compute[75245]: DEBUG nova.compute.manager [req-d0e6dab7-9d90-4fc1-8881-4df759db325f req-de422efa-f68d-4624-adb0-59b4e9bf3cd6 service nova] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Received event network-vif-plugged-8c7418c2-2459-4bc3-acfb-16df97c78f67 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:38:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d0e6dab7-9d90-4fc1-8881-4df759db325f req-de422efa-f68d-4624-adb0-59b4e9bf3cd6 service nova] Acquiring lock "8785a3c2-5b7a-4382-b50d-cecd8743329c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:38:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d0e6dab7-9d90-4fc1-8881-4df759db325f req-de422efa-f68d-4624-adb0-59b4e9bf3cd6 service nova] Lock "8785a3c2-5b7a-4382-b50d-cecd8743329c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:38:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d0e6dab7-9d90-4fc1-8881-4df759db325f req-de422efa-f68d-4624-adb0-59b4e9bf3cd6 service nova] Lock "8785a3c2-5b7a-4382-b50d-cecd8743329c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:38:26 user nova-compute[75245]: DEBUG nova.compute.manager [req-d0e6dab7-9d90-4fc1-8881-4df759db325f req-de422efa-f68d-4624-adb0-59b4e9bf3cd6 service nova] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] No waiting events found dispatching network-vif-plugged-8c7418c2-2459-4bc3-acfb-16df97c78f67 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:38:26 user nova-compute[75245]: WARNING nova.compute.manager [req-d0e6dab7-9d90-4fc1-8881-4df759db325f req-de422efa-f68d-4624-adb0-59b4e9bf3cd6 service nova] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Received unexpected event network-vif-plugged-8c7418c2-2459-4bc3-acfb-16df97c78f67 for instance with vm_state deleted and task_state None.
Nov 29 16:38:26 user nova-compute[75245]: DEBUG nova.compute.manager [req-d0e6dab7-9d90-4fc1-8881-4df759db325f req-de422efa-f68d-4624-adb0-59b4e9bf3cd6 service nova] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Received event network-vif-unplugged-8c7418c2-2459-4bc3-acfb-16df97c78f67 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:38:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d0e6dab7-9d90-4fc1-8881-4df759db325f req-de422efa-f68d-4624-adb0-59b4e9bf3cd6 service nova] Acquiring lock "8785a3c2-5b7a-4382-b50d-cecd8743329c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:38:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d0e6dab7-9d90-4fc1-8881-4df759db325f req-de422efa-f68d-4624-adb0-59b4e9bf3cd6 service nova] Lock "8785a3c2-5b7a-4382-b50d-cecd8743329c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:38:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d0e6dab7-9d90-4fc1-8881-4df759db325f req-de422efa-f68d-4624-adb0-59b4e9bf3cd6 service nova] Lock "8785a3c2-5b7a-4382-b50d-cecd8743329c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:38:26 user nova-compute[75245]: DEBUG nova.compute.manager [req-d0e6dab7-9d90-4fc1-8881-4df759db325f req-de422efa-f68d-4624-adb0-59b4e9bf3cd6 service nova] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] No waiting events found dispatching network-vif-unplugged-8c7418c2-2459-4bc3-acfb-16df97c78f67 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:38:26 user nova-compute[75245]: WARNING nova.compute.manager [req-d0e6dab7-9d90-4fc1-8881-4df759db325f req-de422efa-f68d-4624-adb0-59b4e9bf3cd6 service nova] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Received unexpected event network-vif-unplugged-8c7418c2-2459-4bc3-acfb-16df97c78f67 for instance with vm_state deleted and task_state None.
Nov 29 16:38:26 user nova-compute[75245]: DEBUG nova.compute.manager [req-d0e6dab7-9d90-4fc1-8881-4df759db325f req-de422efa-f68d-4624-adb0-59b4e9bf3cd6 service nova] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Received event network-vif-plugged-8c7418c2-2459-4bc3-acfb-16df97c78f67 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:38:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d0e6dab7-9d90-4fc1-8881-4df759db325f req-de422efa-f68d-4624-adb0-59b4e9bf3cd6 service nova] Acquiring lock "8785a3c2-5b7a-4382-b50d-cecd8743329c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:38:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d0e6dab7-9d90-4fc1-8881-4df759db325f req-de422efa-f68d-4624-adb0-59b4e9bf3cd6 service nova] Lock "8785a3c2-5b7a-4382-b50d-cecd8743329c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:38:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d0e6dab7-9d90-4fc1-8881-4df759db325f req-de422efa-f68d-4624-adb0-59b4e9bf3cd6 service nova] Lock "8785a3c2-5b7a-4382-b50d-cecd8743329c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:38:26 user nova-compute[75245]: DEBUG nova.compute.manager [req-d0e6dab7-9d90-4fc1-8881-4df759db325f req-de422efa-f68d-4624-adb0-59b4e9bf3cd6 service nova] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] No waiting events found dispatching network-vif-plugged-8c7418c2-2459-4bc3-acfb-16df97c78f67 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:38:26 user nova-compute[75245]: WARNING nova.compute.manager [req-d0e6dab7-9d90-4fc1-8881-4df759db325f req-de422efa-f68d-4624-adb0-59b4e9bf3cd6 service nova] [instance: 8785a3c2-5b7a-4382-b50d-cecd8743329c] Received unexpected event network-vif-plugged-8c7418c2-2459-4bc3-acfb-16df97c78f67 for instance with vm_state deleted and task_state None.
Nov 29 16:38:29 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:38:33 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:38:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:38:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:38:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75245) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 16:38:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:38:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:38:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:38:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:38:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:38:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75245) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 16:38:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:38:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:38:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:38:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:38:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:38:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75245) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 16:38:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:38:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:38:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:38:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:38:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:38:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:38:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75245) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 16:38:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:38:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:38:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:38:55 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:38:57 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:38:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:38:59 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:39:00 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-506b8a02-1e41-4554-8f83-12a1d2122f0b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Acquiring lock "35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:39:00 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-506b8a02-1e41-4554-8f83-12a1d2122f0b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lock "35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:39:00 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-506b8a02-1e41-4554-8f83-12a1d2122f0b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Acquiring lock "35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:39:00 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-506b8a02-1e41-4554-8f83-12a1d2122f0b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lock "35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.003s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:39:00 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-506b8a02-1e41-4554-8f83-12a1d2122f0b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lock "35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:39:00 user nova-compute[75245]: INFO nova.compute.manager [None req-506b8a02-1e41-4554-8f83-12a1d2122f0b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Terminating instance
Nov 29 16:39:00 user nova-compute[75245]: DEBUG nova.compute.manager [None req-506b8a02-1e41-4554-8f83-12a1d2122f0b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Start destroying the instance on the hypervisor. {{(pid=75245) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 16:39:00 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:39:00 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:39:00 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:39:00 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:39:00 user nova-compute[75245]: DEBUG nova.compute.manager [req-7eed0675-4c07-4cc7-a474-74177dbb0f1c req-5c841f34-8739-40cb-86ba-3bb0872e15e2 service nova] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Received event network-vif-unplugged-545bae30-b03e-41ac-8dd9-f86e85b590d1 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:39:00 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-7eed0675-4c07-4cc7-a474-74177dbb0f1c req-5c841f34-8739-40cb-86ba-3bb0872e15e2 service nova] Acquiring lock "35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:39:00 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-7eed0675-4c07-4cc7-a474-74177dbb0f1c req-5c841f34-8739-40cb-86ba-3bb0872e15e2 service nova] Lock "35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:39:00 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-7eed0675-4c07-4cc7-a474-74177dbb0f1c req-5c841f34-8739-40cb-86ba-3bb0872e15e2 service nova] Lock "35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:39:00 user nova-compute[75245]: DEBUG nova.compute.manager [req-7eed0675-4c07-4cc7-a474-74177dbb0f1c req-5c841f34-8739-40cb-86ba-3bb0872e15e2 service nova] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] No waiting events found dispatching network-vif-unplugged-545bae30-b03e-41ac-8dd9-f86e85b590d1 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:39:00 user nova-compute[75245]: DEBUG nova.compute.manager [req-7eed0675-4c07-4cc7-a474-74177dbb0f1c req-5c841f34-8739-40cb-86ba-3bb0872e15e2 service nova] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Received event network-vif-unplugged-545bae30-b03e-41ac-8dd9-f86e85b590d1 for instance with task_state deleting. {{(pid=75245) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 16:39:00 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:39:00 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:39:00 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Instance destroyed successfully.
Nov 29 16:39:00 user nova-compute[75245]: DEBUG nova.objects.instance [None req-506b8a02-1e41-4554-8f83-12a1d2122f0b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lazy-loading 'resources' on Instance uuid 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:39:00 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-506b8a02-1e41-4554-8f83-12a1d2122f0b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:22:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1012702765',display_name='tempest-ServerRescueNegativeTestJSON-server-1012702765',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1012702765',id=25,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:26:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e12002e1a11f4caf8953371e66e6652e',ramdisk_id='',reservation_id='r-vzx9ywrd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1013090395',owner_user_name='tempest-ServerRescueNegativeTestJSON-1013090395-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:28:44Z,user_data=None,user_id='d876b1e244b14a29ad5b4b422135336b',uuid=35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "545bae30-b03e-41ac-8dd9-f86e85b590d1", "address": "fa:16:3e:26:46:35", "network": {"id": "02098e86-68f8-464e-84ee-bf2fb09b881b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085418471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e12002e1a11f4caf8953371e66e6652e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap545bae30-b0", "ovs_interfaceid": "545bae30-b03e-41ac-8dd9-f86e85b590d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 16:39:00 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-506b8a02-1e41-4554-8f83-12a1d2122f0b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Converting VIF {"id": "545bae30-b03e-41ac-8dd9-f86e85b590d1", "address": "fa:16:3e:26:46:35", "network": {"id": "02098e86-68f8-464e-84ee-bf2fb09b881b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085418471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e12002e1a11f4caf8953371e66e6652e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap545bae30-b0", "ovs_interfaceid": "545bae30-b03e-41ac-8dd9-f86e85b590d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:39:00 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-506b8a02-1e41-4554-8f83-12a1d2122f0b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:46:35,bridge_name='br-int',has_traffic_filtering=True,id=545bae30-b03e-41ac-8dd9-f86e85b590d1,network=Network(02098e86-68f8-464e-84ee-bf2fb09b881b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap545bae30-b0') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:39:00 user nova-compute[75245]: DEBUG os_vif [None req-506b8a02-1e41-4554-8f83-12a1d2122f0b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:46:35,bridge_name='br-int',has_traffic_filtering=True,id=545bae30-b03e-41ac-8dd9-f86e85b590d1,network=Network(02098e86-68f8-464e-84ee-bf2fb09b881b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap545bae30-b0') {{(pid=75245) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 16:39:00 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:39:00 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap545bae30-b0, bridge=br-int, if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:39:00 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:39:00 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:39:00 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:39:00 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e5e81aef-a5db-4a5e-8ae2-f21ef512e3b6) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:39:00 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:39:00 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:39:01 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:39:01 user nova-compute[75245]: INFO os_vif [None req-506b8a02-1e41-4554-8f83-12a1d2122f0b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:46:35,bridge_name='br-int',has_traffic_filtering=True,id=545bae30-b03e-41ac-8dd9-f86e85b590d1,network=Network(02098e86-68f8-464e-84ee-bf2fb09b881b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap545bae30-b0')
Nov 29 16:39:01 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-506b8a02-1e41-4554-8f83-12a1d2122f0b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Deleting instance files /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8_del
Nov 29 16:39:01 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-506b8a02-1e41-4554-8f83-12a1d2122f0b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Deletion of /opt/stack/data/nova/instances/35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8_del complete
Nov 29 16:39:01 user nova-compute[75245]: INFO nova.compute.manager [None req-506b8a02-1e41-4554-8f83-12a1d2122f0b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Took 0.74 seconds to destroy the instance on the hypervisor.
Nov 29 16:39:01 user nova-compute[75245]: DEBUG oslo.service.loopingcall [None req-506b8a02-1e41-4554-8f83-12a1d2122f0b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75245) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 16:39:01 user nova-compute[75245]: DEBUG nova.compute.manager [-] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Deallocating network for instance {{(pid=75245) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 16:39:01 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] deallocate_for_instance() {{(pid=75245) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 16:39:01 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:39:02 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:39:02 user nova-compute[75245]: INFO nova.compute.manager [-] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Took 0.95 seconds to deallocate network for instance.
Nov 29 16:39:02 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-506b8a02-1e41-4554-8f83-12a1d2122f0b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:39:02 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-506b8a02-1e41-4554-8f83-12a1d2122f0b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:39:02 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-506b8a02-1e41-4554-8f83-12a1d2122f0b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:39:02 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-506b8a02-1e41-4554-8f83-12a1d2122f0b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:39:02 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-506b8a02-1e41-4554-8f83-12a1d2122f0b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.144s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:39:02 user nova-compute[75245]: INFO nova.scheduler.client.report [None req-506b8a02-1e41-4554-8f83-12a1d2122f0b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Deleted allocations for instance 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8
Nov 29 16:39:02 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-506b8a02-1e41-4554-8f83-12a1d2122f0b tempest-ServerRescueNegativeTestJSON-1013090395 tempest-ServerRescueNegativeTestJSON-1013090395-project-member] Lock "35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.045s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:39:02 user nova-compute[75245]: DEBUG nova.compute.manager [req-bd556924-75eb-49b3-8664-75ec226ba627 req-041e6d88-42f9-4e6b-8fce-a6f4c4cc83ca service nova] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Received event network-vif-plugged-545bae30-b03e-41ac-8dd9-f86e85b590d1 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:39:02 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-bd556924-75eb-49b3-8664-75ec226ba627 req-041e6d88-42f9-4e6b-8fce-a6f4c4cc83ca service nova] Acquiring lock "35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:39:02 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-bd556924-75eb-49b3-8664-75ec226ba627 req-041e6d88-42f9-4e6b-8fce-a6f4c4cc83ca service nova] Lock "35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:39:02 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-bd556924-75eb-49b3-8664-75ec226ba627 req-041e6d88-42f9-4e6b-8fce-a6f4c4cc83ca service nova] Lock "35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:39:02 user nova-compute[75245]: DEBUG nova.compute.manager [req-bd556924-75eb-49b3-8664-75ec226ba627 req-041e6d88-42f9-4e6b-8fce-a6f4c4cc83ca service nova] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] No waiting events found dispatching network-vif-plugged-545bae30-b03e-41ac-8dd9-f86e85b590d1 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:39:02 user nova-compute[75245]: WARNING nova.compute.manager [req-bd556924-75eb-49b3-8664-75ec226ba627 req-041e6d88-42f9-4e6b-8fce-a6f4c4cc83ca service nova] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Received unexpected event network-vif-plugged-545bae30-b03e-41ac-8dd9-f86e85b590d1 for instance with vm_state deleted and task_state None.
Nov 29 16:39:02 user nova-compute[75245]: DEBUG nova.compute.manager [req-bd556924-75eb-49b3-8664-75ec226ba627 req-041e6d88-42f9-4e6b-8fce-a6f4c4cc83ca service nova] [instance: 35a5e8a8-a1cd-45d2-85cf-26fa93e27ec8] Received event network-vif-deleted-545bae30-b03e-41ac-8dd9-f86e85b590d1 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:39:03 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:39:03 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:39:05 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:39:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Acquiring lock "c9ad13aa-7c21-4701-88e6-6265c7d19d7b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:39:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lock "c9ad13aa-7c21-4701-88e6-6265c7d19d7b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:39:07 user nova-compute[75245]: DEBUG nova.compute.manager [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Starting instance... {{(pid=75245) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 16:39:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:39:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:39:07 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75245) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 16:39:07 user nova-compute[75245]: INFO nova.compute.claims [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Claim successful on node user
Nov 29 16:39:07 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:39:07 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:39:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.242s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:39:07 user nova-compute[75245]: DEBUG nova.compute.manager [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Start building networks asynchronously for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 16:39:07 user nova-compute[75245]: DEBUG nova.compute.manager [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Allocating IP information in the background. {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 16:39:07 user nova-compute[75245]: DEBUG nova.network.neutron [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] allocate_for_instance() {{(pid=75245) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 16:39:07 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 16:39:07 user nova-compute[75245]: DEBUG nova.compute.manager [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Start building block device mappings for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 16:39:07 user nova-compute[75245]: DEBUG nova.policy [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a219fd71b6cc40d88b161ba5ba82f4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd1ea36980641739f2bdd856a65d68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75245) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 16:39:07 user nova-compute[75245]: DEBUG nova.compute.manager [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Start spawning the instance on the hypervisor. {{(pid=75245) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 16:39:07 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Creating instance directory {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 16:39:07 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Creating image(s)
Nov 29 16:39:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Acquiring lock "/opt/stack/data/nova/instances/c9ad13aa-7c21-4701-88e6-6265c7d19d7b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:39:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lock "/opt/stack/data/nova/instances/c9ad13aa-7c21-4701-88e6-6265c7d19d7b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:39:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lock "/opt/stack/data/nova/instances/c9ad13aa-7c21-4701-88e6-6265c7d19d7b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:39:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Acquiring lock "42a3184f5fc6a39f11cded1b67adfb5500d7aeb5" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:39:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lock "42a3184f5fc6a39f11cded1b67adfb5500d7aeb5" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:39:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/42a3184f5fc6a39f11cded1b67adfb5500d7aeb5.part --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:39:08 user nova-compute[75245]: DEBUG nova.network.neutron [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Successfully created port: 2844f77d-297d-4177-974c-22a1cab3590c {{(pid=75245) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 16:39:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/42a3184f5fc6a39f11cded1b67adfb5500d7aeb5.part --force-share --output=json" returned: 0 in 0.181s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:39:08 user nova-compute[75245]: DEBUG nova.virt.images [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] 0fe99299-5682-40ee-b061-9396244f4f30 was qcow2, converting to raw {{(pid=75245) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 16:39:08 user nova-compute[75245]: DEBUG nova.privsep.utils [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75245) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 16:39:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/42a3184f5fc6a39f11cded1b67adfb5500d7aeb5.part /opt/stack/data/nova/instances/_base/42a3184f5fc6a39f11cded1b67adfb5500d7aeb5.converted {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:39:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/42a3184f5fc6a39f11cded1b67adfb5500d7aeb5.part /opt/stack/data/nova/instances/_base/42a3184f5fc6a39f11cded1b67adfb5500d7aeb5.converted" returned: 0 in 0.338s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:39:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/42a3184f5fc6a39f11cded1b67adfb5500d7aeb5.converted --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:39:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:39:09 user nova-compute[75245]: DEBUG nova.network.neutron [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Successfully updated port: 2844f77d-297d-4177-974c-22a1cab3590c {{(pid=75245) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 16:39:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Acquiring lock "refresh_cache-c9ad13aa-7c21-4701-88e6-6265c7d19d7b" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:39:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Acquired lock "refresh_cache-c9ad13aa-7c21-4701-88e6-6265c7d19d7b" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:39:09 user nova-compute[75245]: DEBUG nova.network.neutron [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 16:39:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/42a3184f5fc6a39f11cded1b67adfb5500d7aeb5.converted --force-share --output=json" returned: 0 in 0.184s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:39:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lock "42a3184f5fc6a39f11cded1b67adfb5500d7aeb5" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.230s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:39:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/42a3184f5fc6a39f11cded1b67adfb5500d7aeb5 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:39:09 user nova-compute[75245]: DEBUG nova.compute.manager [req-6dddd0c3-f1bc-4a83-97bb-d5d2900e21d7 req-15c5239f-a053-4c7c-ac04-157b3747794c service nova] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Received event network-changed-2844f77d-297d-4177-974c-22a1cab3590c {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:39:09 user nova-compute[75245]: DEBUG nova.compute.manager [req-6dddd0c3-f1bc-4a83-97bb-d5d2900e21d7 req-15c5239f-a053-4c7c-ac04-157b3747794c service nova] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Refreshing instance network info cache due to event network-changed-2844f77d-297d-4177-974c-22a1cab3590c. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:39:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-6dddd0c3-f1bc-4a83-97bb-d5d2900e21d7 req-15c5239f-a053-4c7c-ac04-157b3747794c service nova] Acquiring lock "refresh_cache-c9ad13aa-7c21-4701-88e6-6265c7d19d7b" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:39:09 user nova-compute[75245]: DEBUG nova.network.neutron [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Instance cache missing network info. {{(pid=75245) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 16:39:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/42a3184f5fc6a39f11cded1b67adfb5500d7aeb5 --force-share --output=json" returned: 0 in 0.192s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:39:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Acquiring lock "42a3184f5fc6a39f11cded1b67adfb5500d7aeb5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:39:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lock "42a3184f5fc6a39f11cded1b67adfb5500d7aeb5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:39:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/42a3184f5fc6a39f11cded1b67adfb5500d7aeb5 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:39:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/42a3184f5fc6a39f11cded1b67adfb5500d7aeb5 --force-share --output=json" returned: 0 in 0.177s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:39:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/42a3184f5fc6a39f11cded1b67adfb5500d7aeb5,backing_fmt=raw /opt/stack/data/nova/instances/c9ad13aa-7c21-4701-88e6-6265c7d19d7b/disk 1073741824 {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:39:09 user nova-compute[75245]: DEBUG nova.network.neutron [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Updating instance_info_cache with network_info: [{"id": "2844f77d-297d-4177-974c-22a1cab3590c", "address": "fa:16:3e:f4:3a:98", "network": {"id": "b0e81786-47f3-4a13-90c7-788cb53a4df5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1382922826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebd1ea36980641739f2bdd856a65d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2844f77d-29", "ovs_interfaceid": "2844f77d-297d-4177-974c-22a1cab3590c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:39:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/42a3184f5fc6a39f11cded1b67adfb5500d7aeb5,backing_fmt=raw /opt/stack/data/nova/instances/c9ad13aa-7c21-4701-88e6-6265c7d19d7b/disk 1073741824" returned: 0 in 0.050s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:39:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lock "42a3184f5fc6a39f11cded1b67adfb5500d7aeb5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:39:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/42a3184f5fc6a39f11cded1b67adfb5500d7aeb5 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:39:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Releasing lock "refresh_cache-c9ad13aa-7c21-4701-88e6-6265c7d19d7b" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:39:09 user nova-compute[75245]: DEBUG nova.compute.manager [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Instance network_info: |[{"id": "2844f77d-297d-4177-974c-22a1cab3590c", "address": "fa:16:3e:f4:3a:98", "network": {"id": "b0e81786-47f3-4a13-90c7-788cb53a4df5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1382922826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebd1ea36980641739f2bdd856a65d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2844f77d-29", "ovs_interfaceid": "2844f77d-297d-4177-974c-22a1cab3590c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 16:39:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-6dddd0c3-f1bc-4a83-97bb-d5d2900e21d7 req-15c5239f-a053-4c7c-ac04-157b3747794c service nova] Acquired lock "refresh_cache-c9ad13aa-7c21-4701-88e6-6265c7d19d7b" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:39:09 user nova-compute[75245]: DEBUG nova.network.neutron [req-6dddd0c3-f1bc-4a83-97bb-d5d2900e21d7 req-15c5239f-a053-4c7c-ac04-157b3747794c service nova] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Refreshing network info cache for port 2844f77d-297d-4177-974c-22a1cab3590c {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:39:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/42a3184f5fc6a39f11cded1b67adfb5500d7aeb5 --force-share --output=json" returned: 0 in 0.176s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:39:09 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c9ad13aa-7c21-4701-88e6-6265c7d19d7b/disk. size=1073741824 {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 16:39:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ad13aa-7c21-4701-88e6-6265c7d19d7b/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:39:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ad13aa-7c21-4701-88e6-6265c7d19d7b/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:39:09 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Cannot resize image /opt/stack/data/nova/instances/c9ad13aa-7c21-4701-88e6-6265c7d19d7b/disk to a smaller size. {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 16:39:09 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Created local disks {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 16:39:09 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Ensure instance console log exists: /opt/stack/data/nova/instances/c9ad13aa-7c21-4701-88e6-6265c7d19d7b/console.log {{(pid=75245) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 16:39:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:39:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:39:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:39:09 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Start _get_guest_xml network_info=[{"id": "2844f77d-297d-4177-974c-22a1cab3590c", "address": "fa:16:3e:f4:3a:98", "network": {"id": "b0e81786-47f3-4a13-90c7-788cb53a4df5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1382922826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebd1ea36980641739f2bdd856a65d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2844f77d-29", "ovs_interfaceid": "2844f77d-297d-4177-974c-22a1cab3590c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:39:04Z,direct_url=<?>,disk_format='qcow2',id=0fe99299-5682-40ee-b061-9396244f4f30,min_disk=0,min_ram=0,name='tempest-scenario-img--692374843',owner='ebd1ea36980641739f2bdd856a65d68a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:39:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '0fe99299-5682-40ee-b061-9396244f4f30'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 16:39:09 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:39:09 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:39:09 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 16:39:09 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] CPU controller missing on host. {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 16:39:09 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 16:39:09 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] CPU controller found on host. {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 16:39:09 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75245) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 16:39:09 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T16:06:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:39:04Z,direct_url=<?>,disk_format='qcow2',id=0fe99299-5682-40ee-b061-9396244f4f30,min_disk=0,min_ram=0,name='tempest-scenario-img--692374843',owner='ebd1ea36980641739f2bdd856a65d68a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:39:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 16:39:09 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Flavor limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 16:39:09 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Image limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 16:39:09 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Flavor pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 16:39:09 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Image pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 16:39:09 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 16:39:09 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 16:39:09 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 16:39:09 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Got 1 possible topologies {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 16:39:09 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 16:39:09 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 16:39:09 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:39:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1892014678',display_name='tempest-TestMinimumBasicScenario-server-1892014678',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1892014678',id=33,image_ref='0fe99299-5682-40ee-b061-9396244f4f30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/fn3VZnaXRp52GgsG0rY0i3RksU9OcRdAeWoRVNMPmpdzBDa1b7iLg4ZNEWFhggmujXFSjcNRV3ybIUYpdHxIBtavYnjhjPvvDSYwscCv4nOgu/eQT6tBitfqYb6Z97A==',key_name='tempest-TestMinimumBasicScenario-1472502262',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ebd1ea36980641739f2bdd856a65d68a',ramdisk_id='',reservation_id='r-8fk12xb9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0fe99299-5682-40ee-b061-9396244f4f30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1366540792',owner_user_name='tempest-TestMinimumBasicScenario-1366540792-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:39:08Z,user_data=None,user_id='a219fd71b6cc40d88b161ba5ba82f4a7',uuid=c9ad13aa-7c21-4701-88e6-6265c7d19d7b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2844f77d-297d-4177-974c-22a1cab3590c", "address": "fa:16:3e:f4:3a:98", "network": {"id": "b0e81786-47f3-4a13-90c7-788cb53a4df5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1382922826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebd1ea36980641739f2bdd856a65d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2844f77d-29", "ovs_interfaceid": "2844f77d-297d-4177-974c-22a1cab3590c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:39:09 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Converting VIF {"id": "2844f77d-297d-4177-974c-22a1cab3590c", "address": "fa:16:3e:f4:3a:98", "network": {"id": "b0e81786-47f3-4a13-90c7-788cb53a4df5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1382922826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebd1ea36980641739f2bdd856a65d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2844f77d-29", "ovs_interfaceid": "2844f77d-297d-4177-974c-22a1cab3590c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:39:09 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:3a:98,bridge_name='br-int',has_traffic_filtering=True,id=2844f77d-297d-4177-974c-22a1cab3590c,network=Network(b0e81786-47f3-4a13-90c7-788cb53a4df5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2844f77d-29') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:39:09 user nova-compute[75245]: DEBUG nova.objects.instance [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lazy-loading 'pci_devices' on Instance uuid c9ad13aa-7c21-4701-88e6-6265c7d19d7b {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:39:09 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] End _get_guest_xml xml=<domain type="kvm">
Nov 29 16:39:09 user nova-compute[75245]:   <uuid>c9ad13aa-7c21-4701-88e6-6265c7d19d7b</uuid>
Nov 29 16:39:09 user nova-compute[75245]:   <name>instance-00000021</name>
Nov 29 16:39:09 user nova-compute[75245]:   <memory>524288</memory>
Nov 29 16:39:09 user nova-compute[75245]:   <vcpu>1</vcpu>
Nov 29 16:39:09 user nova-compute[75245]:   <metadata>
Nov 29 16:39:09 user nova-compute[75245]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 16:39:09 user nova-compute[75245]:       <nova:package version="0.0.0"/>
Nov 29 16:39:09 user nova-compute[75245]:       <nova:name>tempest-TestMinimumBasicScenario-server-1892014678</nova:name>
Nov 29 16:39:09 user nova-compute[75245]:       <nova:creationTime>2023-11-29 16:39:09</nova:creationTime>
Nov 29 16:39:09 user nova-compute[75245]:       <nova:flavor name="m1.tiny">
Nov 29 16:39:09 user nova-compute[75245]:         <nova:memory>512</nova:memory>
Nov 29 16:39:09 user nova-compute[75245]:         <nova:disk>1</nova:disk>
Nov 29 16:39:09 user nova-compute[75245]:         <nova:swap>0</nova:swap>
Nov 29 16:39:09 user nova-compute[75245]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 16:39:09 user nova-compute[75245]:         <nova:vcpus>1</nova:vcpus>
Nov 29 16:39:09 user nova-compute[75245]:       </nova:flavor>
Nov 29 16:39:09 user nova-compute[75245]:       <nova:owner>
Nov 29 16:39:09 user nova-compute[75245]:         <nova:user uuid="a219fd71b6cc40d88b161ba5ba82f4a7">tempest-TestMinimumBasicScenario-1366540792-project-member</nova:user>
Nov 29 16:39:09 user nova-compute[75245]:         <nova:project uuid="ebd1ea36980641739f2bdd856a65d68a">tempest-TestMinimumBasicScenario-1366540792</nova:project>
Nov 29 16:39:09 user nova-compute[75245]:       </nova:owner>
Nov 29 16:39:09 user nova-compute[75245]:       <nova:root type="image" uuid="0fe99299-5682-40ee-b061-9396244f4f30"/>
Nov 29 16:39:09 user nova-compute[75245]:       <nova:ports>
Nov 29 16:39:09 user nova-compute[75245]:         <nova:port uuid="2844f77d-297d-4177-974c-22a1cab3590c">
Nov 29 16:39:09 user nova-compute[75245]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 29 16:39:09 user nova-compute[75245]:         </nova:port>
Nov 29 16:39:09 user nova-compute[75245]:       </nova:ports>
Nov 29 16:39:09 user nova-compute[75245]:     </nova:instance>
Nov 29 16:39:09 user nova-compute[75245]:   </metadata>
Nov 29 16:39:09 user nova-compute[75245]:   <sysinfo type="smbios">
Nov 29 16:39:09 user nova-compute[75245]:     <system>
Nov 29 16:39:09 user nova-compute[75245]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 16:39:09 user nova-compute[75245]:       <entry name="product">OpenStack Nova</entry>
Nov 29 16:39:09 user nova-compute[75245]:       <entry name="version">0.0.0</entry>
Nov 29 16:39:09 user nova-compute[75245]:       <entry name="serial">c9ad13aa-7c21-4701-88e6-6265c7d19d7b</entry>
Nov 29 16:39:09 user nova-compute[75245]:       <entry name="uuid">c9ad13aa-7c21-4701-88e6-6265c7d19d7b</entry>
Nov 29 16:39:09 user nova-compute[75245]:       <entry name="family">Virtual Machine</entry>
Nov 29 16:39:09 user nova-compute[75245]:     </system>
Nov 29 16:39:09 user nova-compute[75245]:   </sysinfo>
Nov 29 16:39:09 user nova-compute[75245]:   <os>
Nov 29 16:39:09 user nova-compute[75245]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 16:39:09 user nova-compute[75245]:     <boot dev="hd"/>
Nov 29 16:39:09 user nova-compute[75245]:     <smbios mode="sysinfo"/>
Nov 29 16:39:09 user nova-compute[75245]:   </os>
Nov 29 16:39:09 user nova-compute[75245]:   <features>
Nov 29 16:39:09 user nova-compute[75245]:     <acpi/>
Nov 29 16:39:09 user nova-compute[75245]:     <apic/>
Nov 29 16:39:09 user nova-compute[75245]:     <vmcoreinfo/>
Nov 29 16:39:09 user nova-compute[75245]:   </features>
Nov 29 16:39:09 user nova-compute[75245]:   <clock offset="utc">
Nov 29 16:39:09 user nova-compute[75245]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 16:39:09 user nova-compute[75245]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 16:39:09 user nova-compute[75245]:     <timer name="hpet" present="no"/>
Nov 29 16:39:09 user nova-compute[75245]:   </clock>
Nov 29 16:39:09 user nova-compute[75245]:   <cpu mode="custom" match="exact">
Nov 29 16:39:09 user nova-compute[75245]:     <model>Nehalem</model>
Nov 29 16:39:09 user nova-compute[75245]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 16:39:09 user nova-compute[75245]:   </cpu>
Nov 29 16:39:09 user nova-compute[75245]:   <devices>
Nov 29 16:39:09 user nova-compute[75245]:     <disk type="file" device="disk">
Nov 29 16:39:09 user nova-compute[75245]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 16:39:09 user nova-compute[75245]:       <source file="/opt/stack/data/nova/instances/c9ad13aa-7c21-4701-88e6-6265c7d19d7b/disk"/>
Nov 29 16:39:09 user nova-compute[75245]:       <target dev="vda" bus="virtio"/>
Nov 29 16:39:09 user nova-compute[75245]:     </disk>
Nov 29 16:39:09 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 16:39:09 user nova-compute[75245]:       <mac address="fa:16:3e:f4:3a:98"/>
Nov 29 16:39:09 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:39:09 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 16:39:09 user nova-compute[75245]:       <target dev="tap2844f77d-29"/>
Nov 29 16:39:09 user nova-compute[75245]:     </interface>
Nov 29 16:39:09 user nova-compute[75245]:     <serial type="pty">
Nov 29 16:39:09 user nova-compute[75245]:       <log file="/opt/stack/data/nova/instances/c9ad13aa-7c21-4701-88e6-6265c7d19d7b/console.log" append="off"/>
Nov 29 16:39:09 user nova-compute[75245]:     </serial>
Nov 29 16:39:09 user nova-compute[75245]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 16:39:09 user nova-compute[75245]:     <video>
Nov 29 16:39:09 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:39:09 user nova-compute[75245]:     </video>
Nov 29 16:39:09 user nova-compute[75245]:     <rng model="virtio">
Nov 29 16:39:09 user nova-compute[75245]:       <backend model="random">/dev/urandom</backend>
Nov 29 16:39:09 user nova-compute[75245]:     </rng>
Nov 29 16:39:09 user nova-compute[75245]:     <controller type="usb" index="0" model="none"/>
Nov 29 16:39:09 user nova-compute[75245]:     <memballoon model="virtio">
Nov 29 16:39:09 user nova-compute[75245]:       <stats period="10"/>
Nov 29 16:39:09 user nova-compute[75245]:     </memballoon>
Nov 29 16:39:09 user nova-compute[75245]:   </devices>
Nov 29 16:39:09 user nova-compute[75245]: </domain>
Nov 29 16:39:09 user nova-compute[75245]:  {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 16:39:09 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:39:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1892014678',display_name='tempest-TestMinimumBasicScenario-server-1892014678',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1892014678',id=33,image_ref='0fe99299-5682-40ee-b061-9396244f4f30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/fn3VZnaXRp52GgsG0rY0i3RksU9OcRdAeWoRVNMPmpdzBDa1b7iLg4ZNEWFhggmujXFSjcNRV3ybIUYpdHxIBtavYnjhjPvvDSYwscCv4nOgu/eQT6tBitfqYb6Z97A==',key_name='tempest-TestMinimumBasicScenario-1472502262',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ebd1ea36980641739f2bdd856a65d68a',ramdisk_id='',reservation_id='r-8fk12xb9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0fe99299-5682-40ee-b061-9396244f4f30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1366540792',owner_user_name='tempest-TestMinimumBasicScenario-1366540792-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:39:08Z,user_data=None,user_id='a219fd71b6cc40d88b161ba5ba82f4a7',uuid=c9ad13aa-7c21-4701-88e6-6265c7d19d7b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2844f77d-297d-4177-974c-22a1cab3590c", "address": "fa:16:3e:f4:3a:98", "network": {"id": "b0e81786-47f3-4a13-90c7-788cb53a4df5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1382922826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebd1ea36980641739f2bdd856a65d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2844f77d-29", "ovs_interfaceid": "2844f77d-297d-4177-974c-22a1cab3590c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 16:39:09 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Converting VIF {"id": "2844f77d-297d-4177-974c-22a1cab3590c", "address": "fa:16:3e:f4:3a:98", "network": {"id": "b0e81786-47f3-4a13-90c7-788cb53a4df5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1382922826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebd1ea36980641739f2bdd856a65d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2844f77d-29", "ovs_interfaceid": "2844f77d-297d-4177-974c-22a1cab3590c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:39:09 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:3a:98,bridge_name='br-int',has_traffic_filtering=True,id=2844f77d-297d-4177-974c-22a1cab3590c,network=Network(b0e81786-47f3-4a13-90c7-788cb53a4df5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2844f77d-29') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:39:09 user nova-compute[75245]: DEBUG os_vif [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:3a:98,bridge_name='br-int',has_traffic_filtering=True,id=2844f77d-297d-4177-974c-22a1cab3590c,network=Network(b0e81786-47f3-4a13-90c7-788cb53a4df5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2844f77d-29') {{(pid=75245) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 16:39:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:39:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:39:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 16:39:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:39:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0fb5b399-542a-5bdd-a10e-a0e2dd3753a8', '_type': 'linux-noop'}}, row=False) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:39:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:39:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:39:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:39:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2844f77d-29, may_exist=True, interface_attrs={}) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:39:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2844f77d-29, col_values=(('qos', UUID('4641e079-4550-4078-a996-f46da6ebabbd')),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:39:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2844f77d-29, col_values=(('external_ids', {'iface-id': '2844f77d-297d-4177-974c-22a1cab3590c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:3a:98', 'vm-uuid': 'c9ad13aa-7c21-4701-88e6-6265c7d19d7b'}),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:39:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:39:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:39:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:39:10 user nova-compute[75245]: INFO os_vif [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:3a:98,bridge_name='br-int',has_traffic_filtering=True,id=2844f77d-297d-4177-974c-22a1cab3590c,network=Network(b0e81786-47f3-4a13-90c7-788cb53a4df5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2844f77d-29')
Nov 29 16:39:10 user nova-compute[75245]: DEBUG nova.network.neutron [req-6dddd0c3-f1bc-4a83-97bb-d5d2900e21d7 req-15c5239f-a053-4c7c-ac04-157b3747794c service nova] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Updated VIF entry in instance network info cache for port 2844f77d-297d-4177-974c-22a1cab3590c. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:39:10 user nova-compute[75245]: DEBUG nova.network.neutron [req-6dddd0c3-f1bc-4a83-97bb-d5d2900e21d7 req-15c5239f-a053-4c7c-ac04-157b3747794c service nova] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Updating instance_info_cache with network_info: [{"id": "2844f77d-297d-4177-974c-22a1cab3590c", "address": "fa:16:3e:f4:3a:98", "network": {"id": "b0e81786-47f3-4a13-90c7-788cb53a4df5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1382922826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebd1ea36980641739f2bdd856a65d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2844f77d-29", "ovs_interfaceid": "2844f77d-297d-4177-974c-22a1cab3590c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:39:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-6dddd0c3-f1bc-4a83-97bb-d5d2900e21d7 req-15c5239f-a053-4c7c-ac04-157b3747794c service nova] Releasing lock "refresh_cache-c9ad13aa-7c21-4701-88e6-6265c7d19d7b" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:39:10 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:39:10 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] No VIF found with MAC fa:16:3e:f4:3a:98, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:39:10 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:39:10 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Starting heal instance info cache {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 16:39:10 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Didn't find any instances for network info cache update. {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 16:39:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:39:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:39:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:39:11 user nova-compute[75245]: DEBUG nova.compute.manager [req-50448030-e820-4c58-ab88-d34d7e9890ad req-748ed938-8a43-4793-8373-de698267342a service nova] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Received event network-vif-plugged-2844f77d-297d-4177-974c-22a1cab3590c {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:39:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-50448030-e820-4c58-ab88-d34d7e9890ad req-748ed938-8a43-4793-8373-de698267342a service nova] Acquiring lock "c9ad13aa-7c21-4701-88e6-6265c7d19d7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:39:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-50448030-e820-4c58-ab88-d34d7e9890ad req-748ed938-8a43-4793-8373-de698267342a service nova] Lock "c9ad13aa-7c21-4701-88e6-6265c7d19d7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:39:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-50448030-e820-4c58-ab88-d34d7e9890ad req-748ed938-8a43-4793-8373-de698267342a service nova] Lock "c9ad13aa-7c21-4701-88e6-6265c7d19d7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:39:11 user nova-compute[75245]: DEBUG nova.compute.manager [req-50448030-e820-4c58-ab88-d34d7e9890ad req-748ed938-8a43-4793-8373-de698267342a service nova] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] No waiting events found dispatching network-vif-plugged-2844f77d-297d-4177-974c-22a1cab3590c {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:39:11 user nova-compute[75245]: WARNING nova.compute.manager [req-50448030-e820-4c58-ab88-d34d7e9890ad req-748ed938-8a43-4793-8373-de698267342a service nova] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Received unexpected event network-vif-plugged-2844f77d-297d-4177-974c-22a1cab3590c for instance with vm_state building and task_state spawning.
Nov 29 16:39:12 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:39:12 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:39:12 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:39:12 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:39:12 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:39:13 user nova-compute[75245]: DEBUG nova.compute.manager [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Instance event wait completed in 0 seconds for  {{(pid=75245) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 16:39:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Guest created on hypervisor {{(pid=75245) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 16:39:13 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Instance spawned successfully.
Nov 29 16:39:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 16:39:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Found default for hw_cdrom_bus of ide {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:39:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Found default for hw_disk_bus of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:39:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Found default for hw_input_bus of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:39:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Found default for hw_pointer_model of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:39:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Found default for hw_video_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:39:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Found default for hw_vif_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:39:13 user nova-compute[75245]: DEBUG nova.compute.manager [req-4bcb7dba-4814-415f-a877-061a1fa91050 req-df7bb9a7-8e43-4e1e-9d25-6edcd5185212 service nova] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Received event network-vif-plugged-2844f77d-297d-4177-974c-22a1cab3590c {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:39:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-4bcb7dba-4814-415f-a877-061a1fa91050 req-df7bb9a7-8e43-4e1e-9d25-6edcd5185212 service nova] Acquiring lock "c9ad13aa-7c21-4701-88e6-6265c7d19d7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:39:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-4bcb7dba-4814-415f-a877-061a1fa91050 req-df7bb9a7-8e43-4e1e-9d25-6edcd5185212 service nova] Lock "c9ad13aa-7c21-4701-88e6-6265c7d19d7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:39:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-4bcb7dba-4814-415f-a877-061a1fa91050 req-df7bb9a7-8e43-4e1e-9d25-6edcd5185212 service nova] Lock "c9ad13aa-7c21-4701-88e6-6265c7d19d7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:39:13 user nova-compute[75245]: DEBUG nova.compute.manager [req-4bcb7dba-4814-415f-a877-061a1fa91050 req-df7bb9a7-8e43-4e1e-9d25-6edcd5185212 service nova] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] No waiting events found dispatching network-vif-plugged-2844f77d-297d-4177-974c-22a1cab3590c {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:39:13 user nova-compute[75245]: WARNING nova.compute.manager [req-4bcb7dba-4814-415f-a877-061a1fa91050 req-df7bb9a7-8e43-4e1e-9d25-6edcd5185212 service nova] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Received unexpected event network-vif-plugged-2844f77d-297d-4177-974c-22a1cab3590c for instance with vm_state building and task_state spawning.
Nov 29 16:39:13 user nova-compute[75245]: INFO nova.compute.manager [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Took 5.87 seconds to spawn the instance on the hypervisor.
Nov 29 16:39:13 user nova-compute[75245]: DEBUG nova.compute.manager [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:39:13 user nova-compute[75245]: INFO nova.compute.manager [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Took 6.48 seconds to build instance.
Nov 29 16:39:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3c3e4658-bfa0-4561-b8ac-8f69edf0d6d4 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lock "c9ad13aa-7c21-4701-88e6-6265c7d19d7b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.582s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:39:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:39:14 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:39:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:39:15 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:39:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:39:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:39:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:39:15 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75245) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 16:39:15 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ad13aa-7c21-4701-88e6-6265c7d19d7b/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:39:15 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ad13aa-7c21-4701-88e6-6265c7d19d7b/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:39:15 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ad13aa-7c21-4701-88e6-6265c7d19d7b/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:39:16 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ad13aa-7c21-4701-88e6-6265c7d19d7b/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:39:16 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:39:16 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:39:16 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Hypervisor/Node resource view: name=user free_ram=8950MB free_disk=25.242000579833984GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75245) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 16:39:16 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:39:16 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:39:16 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance c9ad13aa-7c21-4701-88e6-6265c7d19d7b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:39:16 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 16:39:16 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 16:39:16 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:39:16 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:39:16 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Compute_service record updated for user:user {{(pid=75245) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 16:39:16 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.264s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:39:16 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:39:17 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:39:18 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:39:18 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:39:19 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:39:21 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:39:22 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:39:22 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:39:22 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75245) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 16:39:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:39:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:39:25 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:39:25 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:39:28 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Acquiring lock "ba3662d8-598b-4296-a1e8-4dd57b5c7f3d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:39:28 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "ba3662d8-598b-4296-a1e8-4dd57b5c7f3d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:39:28 user nova-compute[75245]: DEBUG nova.compute.manager [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] Starting instance... {{(pid=75245) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 16:39:28 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:39:28 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:39:28 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75245) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 16:39:28 user nova-compute[75245]: INFO nova.compute.claims [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] Claim successful on node user
Nov 29 16:39:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:39:29 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:39:29 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:39:29 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.216s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:39:29 user nova-compute[75245]: DEBUG nova.compute.manager [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] Start building networks asynchronously for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 16:39:29 user nova-compute[75245]: DEBUG nova.compute.manager [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] Allocating IP information in the background. {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 16:39:29 user nova-compute[75245]: DEBUG nova.network.neutron [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] allocate_for_instance() {{(pid=75245) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 16:39:29 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 16:39:29 user nova-compute[75245]: DEBUG nova.compute.manager [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] Start building block device mappings for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 16:39:29 user nova-compute[75245]: DEBUG nova.policy [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fb4c94298bf14753bb9530633e766dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e269dbe30d46ccb81d58e2590004db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75245) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 16:39:29 user nova-compute[75245]: DEBUG nova.compute.manager [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] Start spawning the instance on the hypervisor. {{(pid=75245) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 16:39:29 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] Creating instance directory {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 16:39:29 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] Creating image(s)
Nov 29 16:39:29 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Acquiring lock "/opt/stack/data/nova/instances/ba3662d8-598b-4296-a1e8-4dd57b5c7f3d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:39:29 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "/opt/stack/data/nova/instances/ba3662d8-598b-4296-a1e8-4dd57b5c7f3d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:39:29 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "/opt/stack/data/nova/instances/ba3662d8-598b-4296-a1e8-4dd57b5c7f3d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:39:29 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:39:29 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.178s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:39:29 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Acquiring lock "d654f7206043e05d3525550b0fc885556eb999f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:39:29 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:39:29 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:39:29 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.186s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:39:29 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/ba3662d8-598b-4296-a1e8-4dd57b5c7f3d/disk 1073741824 {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:39:29 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/ba3662d8-598b-4296-a1e8-4dd57b5c7f3d/disk 1073741824" returned: 0 in 0.080s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:39:29 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:39:29 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:39:29 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.176s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:39:29 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ba3662d8-598b-4296-a1e8-4dd57b5c7f3d/disk. size=1073741824 {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 16:39:29 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba3662d8-598b-4296-a1e8-4dd57b5c7f3d/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:39:29 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:39:30 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba3662d8-598b-4296-a1e8-4dd57b5c7f3d/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:39:30 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Cannot resize image /opt/stack/data/nova/instances/ba3662d8-598b-4296-a1e8-4dd57b5c7f3d/disk to a smaller size. {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 16:39:30 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] Created local disks {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 16:39:30 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] Ensure instance console log exists: /opt/stack/data/nova/instances/ba3662d8-598b-4296-a1e8-4dd57b5c7f3d/console.log {{(pid=75245) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 16:39:30 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:39:30 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:39:30 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:39:30 user nova-compute[75245]: DEBUG nova.network.neutron [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] Successfully created port: e8484c13-9f26-42b4-8790-028d183a911a {{(pid=75245) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 16:39:30 user nova-compute[75245]: DEBUG nova.network.neutron [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] Successfully updated port: e8484c13-9f26-42b4-8790-028d183a911a {{(pid=75245) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 16:39:30 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Acquiring lock "refresh_cache-ba3662d8-598b-4296-a1e8-4dd57b5c7f3d" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:39:30 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Acquired lock "refresh_cache-ba3662d8-598b-4296-a1e8-4dd57b5c7f3d" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:39:30 user nova-compute[75245]: DEBUG nova.network.neutron [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 16:39:30 user nova-compute[75245]: DEBUG nova.compute.manager [req-7d864885-1541-4b80-a734-f3ad29b1a7ff req-d075a057-8920-4960-a941-fbfd3cf97e05 service nova] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] Received event network-changed-e8484c13-9f26-42b4-8790-028d183a911a {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:39:30 user nova-compute[75245]: DEBUG nova.compute.manager [req-7d864885-1541-4b80-a734-f3ad29b1a7ff req-d075a057-8920-4960-a941-fbfd3cf97e05 service nova] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] Refreshing instance network info cache due to event network-changed-e8484c13-9f26-42b4-8790-028d183a911a. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:39:30 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-7d864885-1541-4b80-a734-f3ad29b1a7ff req-d075a057-8920-4960-a941-fbfd3cf97e05 service nova] Acquiring lock "refresh_cache-ba3662d8-598b-4296-a1e8-4dd57b5c7f3d" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:39:30 user nova-compute[75245]: DEBUG nova.network.neutron [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] Instance cache missing network info. {{(pid=75245) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 16:39:31 user nova-compute[75245]: DEBUG nova.network.neutron [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] Updating instance_info_cache with network_info: [{"id": "e8484c13-9f26-42b4-8790-028d183a911a", "address": "fa:16:3e:6b:bd:c8", "network": {"id": "55744af1-3291-4de1-9bf4-554f9ee4f057", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1570836437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01e269dbe30d46ccb81d58e2590004db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8484c13-9f", "ovs_interfaceid": "e8484c13-9f26-42b4-8790-028d183a911a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:39:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Releasing lock "refresh_cache-ba3662d8-598b-4296-a1e8-4dd57b5c7f3d" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:39:31 user nova-compute[75245]: DEBUG nova.compute.manager [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] Instance network_info: |[{"id": "e8484c13-9f26-42b4-8790-028d183a911a", "address": "fa:16:3e:6b:bd:c8", "network": {"id": "55744af1-3291-4de1-9bf4-554f9ee4f057", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1570836437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01e269dbe30d46ccb81d58e2590004db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8484c13-9f", "ovs_interfaceid": "e8484c13-9f26-42b4-8790-028d183a911a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 16:39:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-7d864885-1541-4b80-a734-f3ad29b1a7ff req-d075a057-8920-4960-a941-fbfd3cf97e05 service nova] Acquired lock "refresh_cache-ba3662d8-598b-4296-a1e8-4dd57b5c7f3d" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:39:31 user nova-compute[75245]: DEBUG nova.network.neutron [req-7d864885-1541-4b80-a734-f3ad29b1a7ff req-d075a057-8920-4960-a941-fbfd3cf97e05 service nova] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] Refreshing network info cache for port e8484c13-9f26-42b4-8790-028d183a911a {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:39:31 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] Start _get_guest_xml network_info=[{"id": "e8484c13-9f26-42b4-8790-028d183a911a", "address": "fa:16:3e:6b:bd:c8", "network": {"id": "55744af1-3291-4de1-9bf4-554f9ee4f057", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1570836437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01e269dbe30d46ccb81d58e2590004db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8484c13-9f", "ovs_interfaceid": "e8484c13-9f26-42b4-8790-028d183a911a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'a291d9c3-be02-4c6c-9649-4b45c5b7f487'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 16:39:31 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:39:31 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:39:31 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 16:39:31 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] CPU controller missing on host. {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 16:39:31 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 16:39:31 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] CPU controller found on host. {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 16:39:31 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75245) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 16:39:31 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T16:06:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 16:39:31 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Flavor limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 16:39:31 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Image limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 16:39:31 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Flavor pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 16:39:31 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Image pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 16:39:31 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 16:39:31 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 16:39:31 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 16:39:31 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Got 1 possible topologies {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 16:39:31 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 16:39:31 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 16:39:31 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:39:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-368707389',display_name='tempest-AttachVolumeNegativeTest-server-368707389',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-368707389',id=34,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL0XbW+77+5IttR4DxQwPCY4hhMFWKhFR+XJp0lFoitlFyoxe3lxDdIOwf9MUD+bloTjHJZFssgDEl27H9m8DnQ7OVg0KiJD/eouTn859qnkNTxBMnZybn/iAKPLsfQN1w==',key_name='tempest-keypair-1307614818',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='01e269dbe30d46ccb81d58e2590004db',ramdisk_id='',reservation_id='r-6lm85bep',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-44169219',owner_user_name='tempest-AttachVolumeNegativeTest-44169219-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:39:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb4c94298bf14753bb9530633e766dee',uuid=ba3662d8-598b-4296-a1e8-4dd57b5c7f3d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8484c13-9f26-42b4-8790-028d183a911a", "address": "fa:16:3e:6b:bd:c8", "network": {"id": "55744af1-3291-4de1-9bf4-554f9ee4f057", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1570836437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01e269dbe30d46ccb81d58e2590004db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8484c13-9f", "ovs_interfaceid": "e8484c13-9f26-42b4-8790-028d183a911a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:39:31 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Converting VIF {"id": "e8484c13-9f26-42b4-8790-028d183a911a", "address": "fa:16:3e:6b:bd:c8", "network": {"id": "55744af1-3291-4de1-9bf4-554f9ee4f057", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1570836437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01e269dbe30d46ccb81d58e2590004db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8484c13-9f", "ovs_interfaceid": "e8484c13-9f26-42b4-8790-028d183a911a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:39:31 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:bd:c8,bridge_name='br-int',has_traffic_filtering=True,id=e8484c13-9f26-42b4-8790-028d183a911a,network=Network(55744af1-3291-4de1-9bf4-554f9ee4f057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8484c13-9f') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:39:31 user nova-compute[75245]: DEBUG nova.objects.instance [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lazy-loading 'pci_devices' on Instance uuid ba3662d8-598b-4296-a1e8-4dd57b5c7f3d {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:39:31 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] End _get_guest_xml xml=<domain type="kvm">
Nov 29 16:39:31 user nova-compute[75245]:   <uuid>ba3662d8-598b-4296-a1e8-4dd57b5c7f3d</uuid>
Nov 29 16:39:31 user nova-compute[75245]:   <name>instance-00000022</name>
Nov 29 16:39:31 user nova-compute[75245]:   <memory>524288</memory>
Nov 29 16:39:31 user nova-compute[75245]:   <vcpu>1</vcpu>
Nov 29 16:39:31 user nova-compute[75245]:   <metadata>
Nov 29 16:39:31 user nova-compute[75245]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 16:39:31 user nova-compute[75245]:       <nova:package version="0.0.0"/>
Nov 29 16:39:31 user nova-compute[75245]:       <nova:name>tempest-AttachVolumeNegativeTest-server-368707389</nova:name>
Nov 29 16:39:31 user nova-compute[75245]:       <nova:creationTime>2023-11-29 16:39:31</nova:creationTime>
Nov 29 16:39:31 user nova-compute[75245]:       <nova:flavor name="m1.tiny">
Nov 29 16:39:31 user nova-compute[75245]:         <nova:memory>512</nova:memory>
Nov 29 16:39:31 user nova-compute[75245]:         <nova:disk>1</nova:disk>
Nov 29 16:39:31 user nova-compute[75245]:         <nova:swap>0</nova:swap>
Nov 29 16:39:31 user nova-compute[75245]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 16:39:31 user nova-compute[75245]:         <nova:vcpus>1</nova:vcpus>
Nov 29 16:39:31 user nova-compute[75245]:       </nova:flavor>
Nov 29 16:39:31 user nova-compute[75245]:       <nova:owner>
Nov 29 16:39:31 user nova-compute[75245]:         <nova:user uuid="fb4c94298bf14753bb9530633e766dee">tempest-AttachVolumeNegativeTest-44169219-project-member</nova:user>
Nov 29 16:39:31 user nova-compute[75245]:         <nova:project uuid="01e269dbe30d46ccb81d58e2590004db">tempest-AttachVolumeNegativeTest-44169219</nova:project>
Nov 29 16:39:31 user nova-compute[75245]:       </nova:owner>
Nov 29 16:39:31 user nova-compute[75245]:       <nova:root type="image" uuid="a291d9c3-be02-4c6c-9649-4b45c5b7f487"/>
Nov 29 16:39:31 user nova-compute[75245]:       <nova:ports>
Nov 29 16:39:31 user nova-compute[75245]:         <nova:port uuid="e8484c13-9f26-42b4-8790-028d183a911a">
Nov 29 16:39:31 user nova-compute[75245]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 29 16:39:31 user nova-compute[75245]:         </nova:port>
Nov 29 16:39:31 user nova-compute[75245]:       </nova:ports>
Nov 29 16:39:31 user nova-compute[75245]:     </nova:instance>
Nov 29 16:39:31 user nova-compute[75245]:   </metadata>
Nov 29 16:39:31 user nova-compute[75245]:   <sysinfo type="smbios">
Nov 29 16:39:31 user nova-compute[75245]:     <system>
Nov 29 16:39:31 user nova-compute[75245]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 16:39:31 user nova-compute[75245]:       <entry name="product">OpenStack Nova</entry>
Nov 29 16:39:31 user nova-compute[75245]:       <entry name="version">0.0.0</entry>
Nov 29 16:39:31 user nova-compute[75245]:       <entry name="serial">ba3662d8-598b-4296-a1e8-4dd57b5c7f3d</entry>
Nov 29 16:39:31 user nova-compute[75245]:       <entry name="uuid">ba3662d8-598b-4296-a1e8-4dd57b5c7f3d</entry>
Nov 29 16:39:31 user nova-compute[75245]:       <entry name="family">Virtual Machine</entry>
Nov 29 16:39:31 user nova-compute[75245]:     </system>
Nov 29 16:39:31 user nova-compute[75245]:   </sysinfo>
Nov 29 16:39:31 user nova-compute[75245]:   <os>
Nov 29 16:39:31 user nova-compute[75245]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 16:39:31 user nova-compute[75245]:     <boot dev="hd"/>
Nov 29 16:39:31 user nova-compute[75245]:     <smbios mode="sysinfo"/>
Nov 29 16:39:31 user nova-compute[75245]:   </os>
Nov 29 16:39:31 user nova-compute[75245]:   <features>
Nov 29 16:39:31 user nova-compute[75245]:     <acpi/>
Nov 29 16:39:31 user nova-compute[75245]:     <apic/>
Nov 29 16:39:31 user nova-compute[75245]:     <vmcoreinfo/>
Nov 29 16:39:31 user nova-compute[75245]:   </features>
Nov 29 16:39:31 user nova-compute[75245]:   <clock offset="utc">
Nov 29 16:39:31 user nova-compute[75245]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 16:39:31 user nova-compute[75245]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 16:39:31 user nova-compute[75245]:     <timer name="hpet" present="no"/>
Nov 29 16:39:31 user nova-compute[75245]:   </clock>
Nov 29 16:39:31 user nova-compute[75245]:   <cpu mode="custom" match="exact">
Nov 29 16:39:31 user nova-compute[75245]:     <model>Nehalem</model>
Nov 29 16:39:31 user nova-compute[75245]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 16:39:31 user nova-compute[75245]:   </cpu>
Nov 29 16:39:31 user nova-compute[75245]:   <devices>
Nov 29 16:39:31 user nova-compute[75245]:     <disk type="file" device="disk">
Nov 29 16:39:31 user nova-compute[75245]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 16:39:31 user nova-compute[75245]:       <source file="/opt/stack/data/nova/instances/ba3662d8-598b-4296-a1e8-4dd57b5c7f3d/disk"/>
Nov 29 16:39:31 user nova-compute[75245]:       <target dev="vda" bus="virtio"/>
Nov 29 16:39:31 user nova-compute[75245]:     </disk>
Nov 29 16:39:31 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 16:39:31 user nova-compute[75245]:       <mac address="fa:16:3e:6b:bd:c8"/>
Nov 29 16:39:31 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:39:31 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 16:39:31 user nova-compute[75245]:       <target dev="tape8484c13-9f"/>
Nov 29 16:39:31 user nova-compute[75245]:     </interface>
Nov 29 16:39:31 user nova-compute[75245]:     <serial type="pty">
Nov 29 16:39:31 user nova-compute[75245]:       <log file="/opt/stack/data/nova/instances/ba3662d8-598b-4296-a1e8-4dd57b5c7f3d/console.log" append="off"/>
Nov 29 16:39:31 user nova-compute[75245]:     </serial>
Nov 29 16:39:31 user nova-compute[75245]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 16:39:31 user nova-compute[75245]:     <video>
Nov 29 16:39:31 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:39:31 user nova-compute[75245]:     </video>
Nov 29 16:39:31 user nova-compute[75245]:     <rng model="virtio">
Nov 29 16:39:31 user nova-compute[75245]:       <backend model="random">/dev/urandom</backend>
Nov 29 16:39:31 user nova-compute[75245]:     </rng>
Nov 29 16:39:31 user nova-compute[75245]:     <controller type="usb" index="0" model="none"/>
Nov 29 16:39:31 user nova-compute[75245]:     <memballoon model="virtio">
Nov 29 16:39:31 user nova-compute[75245]:       <stats period="10"/>
Nov 29 16:39:31 user nova-compute[75245]:     </memballoon>
Nov 29 16:39:31 user nova-compute[75245]:   </devices>
Nov 29 16:39:31 user nova-compute[75245]: </domain>
Nov 29 16:39:31 user nova-compute[75245]:  {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 16:39:31 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:39:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-368707389',display_name='tempest-AttachVolumeNegativeTest-server-368707389',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-368707389',id=34,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL0XbW+77+5IttR4DxQwPCY4hhMFWKhFR+XJp0lFoitlFyoxe3lxDdIOwf9MUD+bloTjHJZFssgDEl27H9m8DnQ7OVg0KiJD/eouTn859qnkNTxBMnZybn/iAKPLsfQN1w==',key_name='tempest-keypair-1307614818',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='01e269dbe30d46ccb81d58e2590004db',ramdisk_id='',reservation_id='r-6lm85bep',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-44169219',owner_user_name='tempest-AttachVolumeNegativeTest-44169219-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:39:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb4c94298bf14753bb9530633e766dee',uuid=ba3662d8-598b-4296-a1e8-4dd57b5c7f3d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8484c13-9f26-42b4-8790-028d183a911a", "address": "fa:16:3e:6b:bd:c8", "network": {"id": "55744af1-3291-4de1-9bf4-554f9ee4f057", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1570836437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01e269dbe30d46ccb81d58e2590004db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8484c13-9f", "ovs_interfaceid": "e8484c13-9f26-42b4-8790-028d183a911a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 16:39:31 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Converting VIF {"id": "e8484c13-9f26-42b4-8790-028d183a911a", "address": "fa:16:3e:6b:bd:c8", "network": {"id": "55744af1-3291-4de1-9bf4-554f9ee4f057", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1570836437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01e269dbe30d46ccb81d58e2590004db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8484c13-9f", "ovs_interfaceid": "e8484c13-9f26-42b4-8790-028d183a911a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:39:31 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:bd:c8,bridge_name='br-int',has_traffic_filtering=True,id=e8484c13-9f26-42b4-8790-028d183a911a,network=Network(55744af1-3291-4de1-9bf4-554f9ee4f057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8484c13-9f') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:39:31 user nova-compute[75245]: DEBUG os_vif [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:bd:c8,bridge_name='br-int',has_traffic_filtering=True,id=e8484c13-9f26-42b4-8790-028d183a911a,network=Network(55744af1-3291-4de1-9bf4-554f9ee4f057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8484c13-9f') {{(pid=75245) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 16:39:31 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:39:31 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:39:31 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 16:39:31 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:39:31 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b35361a1-b662-59ec-844d-b85a3cc79745', '_type': 'linux-noop'}}, row=False) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:39:31 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:39:31 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:39:31 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:39:31 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape8484c13-9f, may_exist=True, interface_attrs={}) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:39:31 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape8484c13-9f, col_values=(('qos', UUID('c2b4962b-964b-4f72-9e36-8dacd98a7804')),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:39:31 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape8484c13-9f, col_values=(('external_ids', {'iface-id': 'e8484c13-9f26-42b4-8790-028d183a911a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:bd:c8', 'vm-uuid': 'ba3662d8-598b-4296-a1e8-4dd57b5c7f3d'}),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:39:31 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:39:31 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:39:31 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:39:31 user nova-compute[75245]: INFO os_vif [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:bd:c8,bridge_name='br-int',has_traffic_filtering=True,id=e8484c13-9f26-42b4-8790-028d183a911a,network=Network(55744af1-3291-4de1-9bf4-554f9ee4f057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8484c13-9f')
Nov 29 16:39:31 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:39:31 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] No VIF found with MAC fa:16:3e:6b:bd:c8, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:39:31 user nova-compute[75245]: DEBUG nova.network.neutron [req-7d864885-1541-4b80-a734-f3ad29b1a7ff req-d075a057-8920-4960-a941-fbfd3cf97e05 service nova] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] Updated VIF entry in instance network info cache for port e8484c13-9f26-42b4-8790-028d183a911a. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:39:31 user nova-compute[75245]: DEBUG nova.network.neutron [req-7d864885-1541-4b80-a734-f3ad29b1a7ff req-d075a057-8920-4960-a941-fbfd3cf97e05 service nova] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] Updating instance_info_cache with network_info: [{"id": "e8484c13-9f26-42b4-8790-028d183a911a", "address": "fa:16:3e:6b:bd:c8", "network": {"id": "55744af1-3291-4de1-9bf4-554f9ee4f057", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1570836437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01e269dbe30d46ccb81d58e2590004db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8484c13-9f", "ovs_interfaceid": "e8484c13-9f26-42b4-8790-028d183a911a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:39:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-7d864885-1541-4b80-a734-f3ad29b1a7ff req-d075a057-8920-4960-a941-fbfd3cf97e05 service nova] Releasing lock "refresh_cache-ba3662d8-598b-4296-a1e8-4dd57b5c7f3d" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:39:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:39:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:39:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:39:32 user nova-compute[75245]: DEBUG nova.compute.manager [req-f5356bf5-2579-4fe2-a3f6-8ce673b4e18b req-1679f197-6442-4f47-8224-68317a58ea62 service nova] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] Received event network-vif-plugged-e8484c13-9f26-42b4-8790-028d183a911a {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:39:32 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-f5356bf5-2579-4fe2-a3f6-8ce673b4e18b req-1679f197-6442-4f47-8224-68317a58ea62 service nova] Acquiring lock "ba3662d8-598b-4296-a1e8-4dd57b5c7f3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:39:32 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-f5356bf5-2579-4fe2-a3f6-8ce673b4e18b req-1679f197-6442-4f47-8224-68317a58ea62 service nova] Lock "ba3662d8-598b-4296-a1e8-4dd57b5c7f3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:39:32 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-f5356bf5-2579-4fe2-a3f6-8ce673b4e18b req-1679f197-6442-4f47-8224-68317a58ea62 service nova] Lock "ba3662d8-598b-4296-a1e8-4dd57b5c7f3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:39:32 user nova-compute[75245]: DEBUG nova.compute.manager [req-f5356bf5-2579-4fe2-a3f6-8ce673b4e18b req-1679f197-6442-4f47-8224-68317a58ea62 service nova] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] No waiting events found dispatching network-vif-plugged-e8484c13-9f26-42b4-8790-028d183a911a {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:39:32 user nova-compute[75245]: WARNING nova.compute.manager [req-f5356bf5-2579-4fe2-a3f6-8ce673b4e18b req-1679f197-6442-4f47-8224-68317a58ea62 service nova] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] Received unexpected event network-vif-plugged-e8484c13-9f26-42b4-8790-028d183a911a for instance with vm_state building and task_state spawning.
Nov 29 16:39:33 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:39:33 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:39:33 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:39:33 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:39:33 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:39:34 user nova-compute[75245]: DEBUG nova.compute.manager [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] Instance event wait completed in 0 seconds for  {{(pid=75245) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 16:39:34 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] Guest created on hypervisor {{(pid=75245) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 16:39:35 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] Instance spawned successfully.
Nov 29 16:39:35 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 16:39:35 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] Found default for hw_cdrom_bus of ide {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:39:35 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] Found default for hw_disk_bus of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:39:35 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] Found default for hw_input_bus of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:39:35 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] Found default for hw_pointer_model of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:39:35 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] Found default for hw_video_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:39:35 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] Found default for hw_vif_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:39:35 user nova-compute[75245]: INFO nova.compute.manager [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] Took 5.82 seconds to spawn the instance on the hypervisor.
Nov 29 16:39:35 user nova-compute[75245]: DEBUG nova.compute.manager [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:39:35 user nova-compute[75245]: INFO nova.compute.manager [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] Took 6.34 seconds to build instance.
Nov 29 16:39:35 user nova-compute[75245]: DEBUG nova.compute.manager [req-f5704e2f-b4d2-4a42-91d6-9879c339af35 req-dff3f332-39a5-40a1-90a0-4fd060ec40a6 service nova] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] Received event network-vif-plugged-e8484c13-9f26-42b4-8790-028d183a911a {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:39:35 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-f5704e2f-b4d2-4a42-91d6-9879c339af35 req-dff3f332-39a5-40a1-90a0-4fd060ec40a6 service nova] Acquiring lock "ba3662d8-598b-4296-a1e8-4dd57b5c7f3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:39:35 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-f5704e2f-b4d2-4a42-91d6-9879c339af35 req-dff3f332-39a5-40a1-90a0-4fd060ec40a6 service nova] Lock "ba3662d8-598b-4296-a1e8-4dd57b5c7f3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:39:35 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-f5704e2f-b4d2-4a42-91d6-9879c339af35 req-dff3f332-39a5-40a1-90a0-4fd060ec40a6 service nova] Lock "ba3662d8-598b-4296-a1e8-4dd57b5c7f3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:39:35 user nova-compute[75245]: DEBUG nova.compute.manager [req-f5704e2f-b4d2-4a42-91d6-9879c339af35 req-dff3f332-39a5-40a1-90a0-4fd060ec40a6 service nova] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] No waiting events found dispatching network-vif-plugged-e8484c13-9f26-42b4-8790-028d183a911a {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:39:35 user nova-compute[75245]: WARNING nova.compute.manager [req-f5704e2f-b4d2-4a42-91d6-9879c339af35 req-dff3f332-39a5-40a1-90a0-4fd060ec40a6 service nova] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] Received unexpected event network-vif-plugged-e8484c13-9f26-42b4-8790-028d183a911a for instance with vm_state active and task_state None.
Nov 29 16:39:35 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-00330a65-5219-4f51-8678-257da96302c2 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "ba3662d8-598b-4296-a1e8-4dd57b5c7f3d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.447s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:39:36 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:39:38 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:39:41 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:39:43 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:39:46 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:39:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:39:53 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:39:53 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:39:56 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:39:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:39:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:39:59 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:40:01 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:40:03 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:40:03 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:40:05 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:40:06 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:40:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Acquiring lock "3d913349-8ede-4dbc-96bf-27e33881dee0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:40:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Lock "3d913349-8ede-4dbc-96bf-27e33881dee0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:40:08 user nova-compute[75245]: DEBUG nova.compute.manager [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] Starting instance... {{(pid=75245) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 16:40:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:40:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:40:08 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75245) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 16:40:08 user nova-compute[75245]: INFO nova.compute.claims [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] Claim successful on node user
Nov 29 16:40:08 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:40:08 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:40:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.240s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:40:08 user nova-compute[75245]: DEBUG nova.compute.manager [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] Start building networks asynchronously for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 16:40:08 user nova-compute[75245]: DEBUG nova.compute.manager [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] Allocating IP information in the background. {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 16:40:08 user nova-compute[75245]: DEBUG nova.network.neutron [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] allocate_for_instance() {{(pid=75245) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 16:40:08 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 16:40:08 user nova-compute[75245]: DEBUG nova.compute.manager [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] Start building block device mappings for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 16:40:08 user nova-compute[75245]: DEBUG nova.policy [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8c6bb5bcfd11494a975a40e8fcc29765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15d626475ac4e3686fcbbeeb391d650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75245) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 16:40:08 user nova-compute[75245]: DEBUG nova.compute.manager [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] Start spawning the instance on the hypervisor. {{(pid=75245) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 16:40:08 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] Creating instance directory {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 16:40:08 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] Creating image(s)
Nov 29 16:40:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Acquiring lock "/opt/stack/data/nova/instances/3d913349-8ede-4dbc-96bf-27e33881dee0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:40:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Lock "/opt/stack/data/nova/instances/3d913349-8ede-4dbc-96bf-27e33881dee0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:40:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Lock "/opt/stack/data/nova/instances/3d913349-8ede-4dbc-96bf-27e33881dee0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:40:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:40:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:40:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.186s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:40:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Acquiring lock "d654f7206043e05d3525550b0fc885556eb999f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:40:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:40:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:40:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.180s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:40:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/3d913349-8ede-4dbc-96bf-27e33881dee0/disk 1073741824 {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:40:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/3d913349-8ede-4dbc-96bf-27e33881dee0/disk 1073741824" returned: 0 in 0.056s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:40:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:40:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:40:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.194s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:40:09 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3d913349-8ede-4dbc-96bf-27e33881dee0/disk. size=1073741824 {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 16:40:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d913349-8ede-4dbc-96bf-27e33881dee0/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:40:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d913349-8ede-4dbc-96bf-27e33881dee0/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:40:09 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Cannot resize image /opt/stack/data/nova/instances/3d913349-8ede-4dbc-96bf-27e33881dee0/disk to a smaller size. {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 16:40:09 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] Created local disks {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 16:40:09 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] Ensure instance console log exists: /opt/stack/data/nova/instances/3d913349-8ede-4dbc-96bf-27e33881dee0/console.log {{(pid=75245) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 16:40:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:40:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:40:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:40:09 user nova-compute[75245]: DEBUG nova.network.neutron [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] Successfully created port: ad62def3-239d-492d-845a-6753c82f6250 {{(pid=75245) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 16:40:10 user nova-compute[75245]: DEBUG nova.network.neutron [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] Successfully updated port: ad62def3-239d-492d-845a-6753c82f6250 {{(pid=75245) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 16:40:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Acquiring lock "refresh_cache-3d913349-8ede-4dbc-96bf-27e33881dee0" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:40:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Acquired lock "refresh_cache-3d913349-8ede-4dbc-96bf-27e33881dee0" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:40:10 user nova-compute[75245]: DEBUG nova.network.neutron [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 16:40:10 user nova-compute[75245]: DEBUG nova.compute.manager [req-24880756-bcdc-4aa9-8f7f-3095a9b705b7 req-289a75e3-b3c2-4c5c-b87d-a88a55447161 service nova] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] Received event network-changed-ad62def3-239d-492d-845a-6753c82f6250 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:40:10 user nova-compute[75245]: DEBUG nova.compute.manager [req-24880756-bcdc-4aa9-8f7f-3095a9b705b7 req-289a75e3-b3c2-4c5c-b87d-a88a55447161 service nova] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] Refreshing instance network info cache due to event network-changed-ad62def3-239d-492d-845a-6753c82f6250. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:40:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-24880756-bcdc-4aa9-8f7f-3095a9b705b7 req-289a75e3-b3c2-4c5c-b87d-a88a55447161 service nova] Acquiring lock "refresh_cache-3d913349-8ede-4dbc-96bf-27e33881dee0" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:40:10 user nova-compute[75245]: DEBUG nova.network.neutron [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] Instance cache missing network info. {{(pid=75245) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 16:40:10 user nova-compute[75245]: DEBUG nova.network.neutron [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] Updating instance_info_cache with network_info: [{"id": "ad62def3-239d-492d-845a-6753c82f6250", "address": "fa:16:3e:d9:c7:6f", "network": {"id": "3f83d273-14b6-4405-8725-9d76b79aa767", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1314414874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c15d626475ac4e3686fcbbeeb391d650", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad62def3-23", "ovs_interfaceid": "ad62def3-239d-492d-845a-6753c82f6250", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:40:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Releasing lock "refresh_cache-3d913349-8ede-4dbc-96bf-27e33881dee0" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:40:10 user nova-compute[75245]: DEBUG nova.compute.manager [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] Instance network_info: |[{"id": "ad62def3-239d-492d-845a-6753c82f6250", "address": "fa:16:3e:d9:c7:6f", "network": {"id": "3f83d273-14b6-4405-8725-9d76b79aa767", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1314414874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c15d626475ac4e3686fcbbeeb391d650", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad62def3-23", "ovs_interfaceid": "ad62def3-239d-492d-845a-6753c82f6250", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 16:40:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-24880756-bcdc-4aa9-8f7f-3095a9b705b7 req-289a75e3-b3c2-4c5c-b87d-a88a55447161 service nova] Acquired lock "refresh_cache-3d913349-8ede-4dbc-96bf-27e33881dee0" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:40:10 user nova-compute[75245]: DEBUG nova.network.neutron [req-24880756-bcdc-4aa9-8f7f-3095a9b705b7 req-289a75e3-b3c2-4c5c-b87d-a88a55447161 service nova] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] Refreshing network info cache for port ad62def3-239d-492d-845a-6753c82f6250 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:40:10 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] Start _get_guest_xml network_info=[{"id": "ad62def3-239d-492d-845a-6753c82f6250", "address": "fa:16:3e:d9:c7:6f", "network": {"id": "3f83d273-14b6-4405-8725-9d76b79aa767", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1314414874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c15d626475ac4e3686fcbbeeb391d650", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad62def3-23", "ovs_interfaceid": "ad62def3-239d-492d-845a-6753c82f6250", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'a291d9c3-be02-4c6c-9649-4b45c5b7f487'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 16:40:10 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:40:10 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:40:10 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 16:40:10 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] CPU controller missing on host. {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 16:40:10 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 16:40:10 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] CPU controller found on host. {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 16:40:10 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75245) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 16:40:10 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T16:06:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 16:40:10 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Flavor limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 16:40:10 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Image limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 16:40:10 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Flavor pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 16:40:10 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Image pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 16:40:10 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 16:40:10 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 16:40:10 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 16:40:10 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Got 1 possible topologies {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 16:40:10 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 16:40:10 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 16:40:10 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:40:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-598348180',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-598348180',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-5983481',id=35,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVOzyqwN6Rm1tscolBevHqSmaN50xcLetfSVmazmhcgzqOJkAu9kIFnFNsT7Z7Kw4OMD+We2MinhjYDLA6MdK8YuaiNuXMnYVimhwd8zg0x1m8MD7dCQ6YyxnB3yXP/ZQ==',key_name='tempest-keypair-1209648044',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c15d626475ac4e3686fcbbeeb391d650',ramdisk_id='',reservation_id='r-vvbkqz5o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1811877478',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:40:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c6bb5bcfd11494a975a40e8fcc29765',uuid=3d913349-8ede-4dbc-96bf-27e33881dee0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad62def3-239d-492d-845a-6753c82f6250", "address": "fa:16:3e:d9:c7:6f", "network": {"id": "3f83d273-14b6-4405-8725-9d76b79aa767", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1314414874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c15d626475ac4e3686fcbbeeb391d650", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad62def3-23", "ovs_interfaceid": "ad62def3-239d-492d-845a-6753c82f6250", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:40:10 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Converting VIF {"id": "ad62def3-239d-492d-845a-6753c82f6250", "address": "fa:16:3e:d9:c7:6f", "network": {"id": "3f83d273-14b6-4405-8725-9d76b79aa767", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1314414874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c15d626475ac4e3686fcbbeeb391d650", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad62def3-23", "ovs_interfaceid": "ad62def3-239d-492d-845a-6753c82f6250", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:40:10 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:c7:6f,bridge_name='br-int',has_traffic_filtering=True,id=ad62def3-239d-492d-845a-6753c82f6250,network=Network(3f83d273-14b6-4405-8725-9d76b79aa767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad62def3-23') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:40:10 user nova-compute[75245]: DEBUG nova.objects.instance [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Lazy-loading 'pci_devices' on Instance uuid 3d913349-8ede-4dbc-96bf-27e33881dee0 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:40:10 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] End _get_guest_xml xml=<domain type="kvm">
Nov 29 16:40:10 user nova-compute[75245]:   <uuid>3d913349-8ede-4dbc-96bf-27e33881dee0</uuid>
Nov 29 16:40:10 user nova-compute[75245]:   <name>instance-00000023</name>
Nov 29 16:40:10 user nova-compute[75245]:   <memory>524288</memory>
Nov 29 16:40:10 user nova-compute[75245]:   <vcpu>1</vcpu>
Nov 29 16:40:10 user nova-compute[75245]:   <metadata>
Nov 29 16:40:10 user nova-compute[75245]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 16:40:10 user nova-compute[75245]:       <nova:package version="0.0.0"/>
Nov 29 16:40:10 user nova-compute[75245]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-598348180</nova:name>
Nov 29 16:40:10 user nova-compute[75245]:       <nova:creationTime>2023-11-29 16:40:10</nova:creationTime>
Nov 29 16:40:10 user nova-compute[75245]:       <nova:flavor name="m1.tiny">
Nov 29 16:40:10 user nova-compute[75245]:         <nova:memory>512</nova:memory>
Nov 29 16:40:10 user nova-compute[75245]:         <nova:disk>1</nova:disk>
Nov 29 16:40:10 user nova-compute[75245]:         <nova:swap>0</nova:swap>
Nov 29 16:40:10 user nova-compute[75245]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 16:40:10 user nova-compute[75245]:         <nova:vcpus>1</nova:vcpus>
Nov 29 16:40:10 user nova-compute[75245]:       </nova:flavor>
Nov 29 16:40:10 user nova-compute[75245]:       <nova:owner>
Nov 29 16:40:10 user nova-compute[75245]:         <nova:user uuid="8c6bb5bcfd11494a975a40e8fcc29765">tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member</nova:user>
Nov 29 16:40:10 user nova-compute[75245]:         <nova:project uuid="c15d626475ac4e3686fcbbeeb391d650">tempest-TestServerVolumeAttachScenarioOldVersion-1811877478</nova:project>
Nov 29 16:40:10 user nova-compute[75245]:       </nova:owner>
Nov 29 16:40:10 user nova-compute[75245]:       <nova:root type="image" uuid="a291d9c3-be02-4c6c-9649-4b45c5b7f487"/>
Nov 29 16:40:10 user nova-compute[75245]:       <nova:ports>
Nov 29 16:40:10 user nova-compute[75245]:         <nova:port uuid="ad62def3-239d-492d-845a-6753c82f6250">
Nov 29 16:40:10 user nova-compute[75245]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 29 16:40:10 user nova-compute[75245]:         </nova:port>
Nov 29 16:40:10 user nova-compute[75245]:       </nova:ports>
Nov 29 16:40:10 user nova-compute[75245]:     </nova:instance>
Nov 29 16:40:10 user nova-compute[75245]:   </metadata>
Nov 29 16:40:10 user nova-compute[75245]:   <sysinfo type="smbios">
Nov 29 16:40:10 user nova-compute[75245]:     <system>
Nov 29 16:40:10 user nova-compute[75245]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 16:40:10 user nova-compute[75245]:       <entry name="product">OpenStack Nova</entry>
Nov 29 16:40:10 user nova-compute[75245]:       <entry name="version">0.0.0</entry>
Nov 29 16:40:10 user nova-compute[75245]:       <entry name="serial">3d913349-8ede-4dbc-96bf-27e33881dee0</entry>
Nov 29 16:40:10 user nova-compute[75245]:       <entry name="uuid">3d913349-8ede-4dbc-96bf-27e33881dee0</entry>
Nov 29 16:40:10 user nova-compute[75245]:       <entry name="family">Virtual Machine</entry>
Nov 29 16:40:10 user nova-compute[75245]:     </system>
Nov 29 16:40:10 user nova-compute[75245]:   </sysinfo>
Nov 29 16:40:10 user nova-compute[75245]:   <os>
Nov 29 16:40:10 user nova-compute[75245]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 16:40:10 user nova-compute[75245]:     <boot dev="hd"/>
Nov 29 16:40:10 user nova-compute[75245]:     <smbios mode="sysinfo"/>
Nov 29 16:40:10 user nova-compute[75245]:   </os>
Nov 29 16:40:10 user nova-compute[75245]:   <features>
Nov 29 16:40:10 user nova-compute[75245]:     <acpi/>
Nov 29 16:40:10 user nova-compute[75245]:     <apic/>
Nov 29 16:40:10 user nova-compute[75245]:     <vmcoreinfo/>
Nov 29 16:40:10 user nova-compute[75245]:   </features>
Nov 29 16:40:10 user nova-compute[75245]:   <clock offset="utc">
Nov 29 16:40:10 user nova-compute[75245]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 16:40:10 user nova-compute[75245]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 16:40:10 user nova-compute[75245]:     <timer name="hpet" present="no"/>
Nov 29 16:40:10 user nova-compute[75245]:   </clock>
Nov 29 16:40:10 user nova-compute[75245]:   <cpu mode="custom" match="exact">
Nov 29 16:40:10 user nova-compute[75245]:     <model>Nehalem</model>
Nov 29 16:40:10 user nova-compute[75245]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 16:40:10 user nova-compute[75245]:   </cpu>
Nov 29 16:40:10 user nova-compute[75245]:   <devices>
Nov 29 16:40:10 user nova-compute[75245]:     <disk type="file" device="disk">
Nov 29 16:40:10 user nova-compute[75245]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 16:40:10 user nova-compute[75245]:       <source file="/opt/stack/data/nova/instances/3d913349-8ede-4dbc-96bf-27e33881dee0/disk"/>
Nov 29 16:40:10 user nova-compute[75245]:       <target dev="vda" bus="virtio"/>
Nov 29 16:40:10 user nova-compute[75245]:     </disk>
Nov 29 16:40:10 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 16:40:10 user nova-compute[75245]:       <mac address="fa:16:3e:d9:c7:6f"/>
Nov 29 16:40:10 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:40:10 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 16:40:10 user nova-compute[75245]:       <target dev="tapad62def3-23"/>
Nov 29 16:40:10 user nova-compute[75245]:     </interface>
Nov 29 16:40:10 user nova-compute[75245]:     <serial type="pty">
Nov 29 16:40:10 user nova-compute[75245]:       <log file="/opt/stack/data/nova/instances/3d913349-8ede-4dbc-96bf-27e33881dee0/console.log" append="off"/>
Nov 29 16:40:10 user nova-compute[75245]:     </serial>
Nov 29 16:40:10 user nova-compute[75245]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 16:40:10 user nova-compute[75245]:     <video>
Nov 29 16:40:10 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:40:10 user nova-compute[75245]:     </video>
Nov 29 16:40:10 user nova-compute[75245]:     <rng model="virtio">
Nov 29 16:40:10 user nova-compute[75245]:       <backend model="random">/dev/urandom</backend>
Nov 29 16:40:10 user nova-compute[75245]:     </rng>
Nov 29 16:40:10 user nova-compute[75245]:     <controller type="usb" index="0" model="none"/>
Nov 29 16:40:10 user nova-compute[75245]:     <memballoon model="virtio">
Nov 29 16:40:10 user nova-compute[75245]:       <stats period="10"/>
Nov 29 16:40:10 user nova-compute[75245]:     </memballoon>
Nov 29 16:40:10 user nova-compute[75245]:   </devices>
Nov 29 16:40:10 user nova-compute[75245]: </domain>
Nov 29 16:40:10 user nova-compute[75245]:  {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 16:40:10 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:40:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-598348180',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-598348180',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-5983481',id=35,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVOzyqwN6Rm1tscolBevHqSmaN50xcLetfSVmazmhcgzqOJkAu9kIFnFNsT7Z7Kw4OMD+We2MinhjYDLA6MdK8YuaiNuXMnYVimhwd8zg0x1m8MD7dCQ6YyxnB3yXP/ZQ==',key_name='tempest-keypair-1209648044',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c15d626475ac4e3686fcbbeeb391d650',ramdisk_id='',reservation_id='r-vvbkqz5o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1811877478',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:40:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c6bb5bcfd11494a975a40e8fcc29765',uuid=3d913349-8ede-4dbc-96bf-27e33881dee0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad62def3-239d-492d-845a-6753c82f6250", "address": "fa:16:3e:d9:c7:6f", "network": {"id": "3f83d273-14b6-4405-8725-9d76b79aa767", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1314414874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c15d626475ac4e3686fcbbeeb391d650", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad62def3-23", "ovs_interfaceid": "ad62def3-239d-492d-845a-6753c82f6250", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 16:40:10 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Converting VIF {"id": "ad62def3-239d-492d-845a-6753c82f6250", "address": "fa:16:3e:d9:c7:6f", "network": {"id": "3f83d273-14b6-4405-8725-9d76b79aa767", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1314414874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c15d626475ac4e3686fcbbeeb391d650", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad62def3-23", "ovs_interfaceid": "ad62def3-239d-492d-845a-6753c82f6250", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:40:10 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:c7:6f,bridge_name='br-int',has_traffic_filtering=True,id=ad62def3-239d-492d-845a-6753c82f6250,network=Network(3f83d273-14b6-4405-8725-9d76b79aa767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad62def3-23') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:40:10 user nova-compute[75245]: DEBUG os_vif [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:c7:6f,bridge_name='br-int',has_traffic_filtering=True,id=ad62def3-239d-492d-845a-6753c82f6250,network=Network(3f83d273-14b6-4405-8725-9d76b79aa767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad62def3-23') {{(pid=75245) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 16:40:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:40:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:40:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 16:40:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:40:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f4217d52-a55c-54fc-8ef4-03fed7015ea5', '_type': 'linux-noop'}}, row=False) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:40:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:40:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:40:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:40:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapad62def3-23, may_exist=True, interface_attrs={}) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:40:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapad62def3-23, col_values=(('qos', UUID('fd3fa8ba-f131-4189-b7ed-1c462f060bab')),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:40:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapad62def3-23, col_values=(('external_ids', {'iface-id': 'ad62def3-239d-492d-845a-6753c82f6250', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:c7:6f', 'vm-uuid': '3d913349-8ede-4dbc-96bf-27e33881dee0'}),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:40:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:40:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:40:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:40:10 user nova-compute[75245]: INFO os_vif [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:c7:6f,bridge_name='br-int',has_traffic_filtering=True,id=ad62def3-239d-492d-845a-6753c82f6250,network=Network(3f83d273-14b6-4405-8725-9d76b79aa767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad62def3-23')
Nov 29 16:40:10 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:40:10 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] No VIF found with MAC fa:16:3e:d9:c7:6f, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:40:11 user nova-compute[75245]: DEBUG nova.network.neutron [req-24880756-bcdc-4aa9-8f7f-3095a9b705b7 req-289a75e3-b3c2-4c5c-b87d-a88a55447161 service nova] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] Updated VIF entry in instance network info cache for port ad62def3-239d-492d-845a-6753c82f6250. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:40:11 user nova-compute[75245]: DEBUG nova.network.neutron [req-24880756-bcdc-4aa9-8f7f-3095a9b705b7 req-289a75e3-b3c2-4c5c-b87d-a88a55447161 service nova] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] Updating instance_info_cache with network_info: [{"id": "ad62def3-239d-492d-845a-6753c82f6250", "address": "fa:16:3e:d9:c7:6f", "network": {"id": "3f83d273-14b6-4405-8725-9d76b79aa767", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1314414874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c15d626475ac4e3686fcbbeeb391d650", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad62def3-23", "ovs_interfaceid": "ad62def3-239d-492d-845a-6753c82f6250", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:40:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-24880756-bcdc-4aa9-8f7f-3095a9b705b7 req-289a75e3-b3c2-4c5c-b87d-a88a55447161 service nova] Releasing lock "refresh_cache-3d913349-8ede-4dbc-96bf-27e33881dee0" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:40:11 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:40:11 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Starting heal instance info cache {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 16:40:11 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Rebuilding the list of instances to heal {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 16:40:11 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] Skipping network cache update for instance because it is Building. {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 29 16:40:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "refresh_cache-c9ad13aa-7c21-4701-88e6-6265c7d19d7b" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:40:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquired lock "refresh_cache-c9ad13aa-7c21-4701-88e6-6265c7d19d7b" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:40:11 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Forcefully refreshing network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 16:40:11 user nova-compute[75245]: DEBUG nova.objects.instance [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lazy-loading 'info_cache' on Instance uuid c9ad13aa-7c21-4701-88e6-6265c7d19d7b {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:40:11 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Updating instance_info_cache with network_info: [{"id": "2844f77d-297d-4177-974c-22a1cab3590c", "address": "fa:16:3e:f4:3a:98", "network": {"id": "b0e81786-47f3-4a13-90c7-788cb53a4df5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1382922826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebd1ea36980641739f2bdd856a65d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2844f77d-29", "ovs_interfaceid": "2844f77d-297d-4177-974c-22a1cab3590c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:40:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Releasing lock "refresh_cache-c9ad13aa-7c21-4701-88e6-6265c7d19d7b" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:40:11 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Updated the network info_cache for instance {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 16:40:12 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:40:12 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:40:12 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:40:12 user nova-compute[75245]: DEBUG nova.compute.manager [req-c26e8495-957f-4466-b892-ee5d31c7fd07 req-1a2b956e-356e-4ebd-8377-87b805acb2b9 service nova] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] Received event network-vif-plugged-ad62def3-239d-492d-845a-6753c82f6250 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:40:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-c26e8495-957f-4466-b892-ee5d31c7fd07 req-1a2b956e-356e-4ebd-8377-87b805acb2b9 service nova] Acquiring lock "3d913349-8ede-4dbc-96bf-27e33881dee0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:40:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-c26e8495-957f-4466-b892-ee5d31c7fd07 req-1a2b956e-356e-4ebd-8377-87b805acb2b9 service nova] Lock "3d913349-8ede-4dbc-96bf-27e33881dee0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:40:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-c26e8495-957f-4466-b892-ee5d31c7fd07 req-1a2b956e-356e-4ebd-8377-87b805acb2b9 service nova] Lock "3d913349-8ede-4dbc-96bf-27e33881dee0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:40:12 user nova-compute[75245]: DEBUG nova.compute.manager [req-c26e8495-957f-4466-b892-ee5d31c7fd07 req-1a2b956e-356e-4ebd-8377-87b805acb2b9 service nova] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] No waiting events found dispatching network-vif-plugged-ad62def3-239d-492d-845a-6753c82f6250 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:40:12 user nova-compute[75245]: WARNING nova.compute.manager [req-c26e8495-957f-4466-b892-ee5d31c7fd07 req-1a2b956e-356e-4ebd-8377-87b805acb2b9 service nova] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] Received unexpected event network-vif-plugged-ad62def3-239d-492d-845a-6753c82f6250 for instance with vm_state building and task_state spawning.
Nov 29 16:40:12 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:40:12 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:40:12 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:40:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:40:14 user nova-compute[75245]: DEBUG nova.compute.manager [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] Instance event wait completed in 0 seconds for  {{(pid=75245) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 16:40:14 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] Guest created on hypervisor {{(pid=75245) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 16:40:14 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] Instance spawned successfully.
Nov 29 16:40:14 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:40:14 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 16:40:14 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] Found default for hw_cdrom_bus of ide {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:40:14 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] Found default for hw_disk_bus of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:40:14 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] Found default for hw_input_bus of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:40:14 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] Found default for hw_pointer_model of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:40:14 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] Found default for hw_video_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:40:14 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] Found default for hw_vif_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:40:14 user nova-compute[75245]: DEBUG nova.compute.manager [req-4eac029b-6771-4e35-a8f8-bcc4a31d3d01 req-c23235b2-24e0-4f7e-8ffd-3dec1a6bfa4b service nova] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] Received event network-vif-plugged-ad62def3-239d-492d-845a-6753c82f6250 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:40:14 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-4eac029b-6771-4e35-a8f8-bcc4a31d3d01 req-c23235b2-24e0-4f7e-8ffd-3dec1a6bfa4b service nova] Acquiring lock "3d913349-8ede-4dbc-96bf-27e33881dee0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:40:14 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-4eac029b-6771-4e35-a8f8-bcc4a31d3d01 req-c23235b2-24e0-4f7e-8ffd-3dec1a6bfa4b service nova] Lock "3d913349-8ede-4dbc-96bf-27e33881dee0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:40:14 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-4eac029b-6771-4e35-a8f8-bcc4a31d3d01 req-c23235b2-24e0-4f7e-8ffd-3dec1a6bfa4b service nova] Lock "3d913349-8ede-4dbc-96bf-27e33881dee0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:40:14 user nova-compute[75245]: DEBUG nova.compute.manager [req-4eac029b-6771-4e35-a8f8-bcc4a31d3d01 req-c23235b2-24e0-4f7e-8ffd-3dec1a6bfa4b service nova] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] No waiting events found dispatching network-vif-plugged-ad62def3-239d-492d-845a-6753c82f6250 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:40:14 user nova-compute[75245]: WARNING nova.compute.manager [req-4eac029b-6771-4e35-a8f8-bcc4a31d3d01 req-c23235b2-24e0-4f7e-8ffd-3dec1a6bfa4b service nova] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] Received unexpected event network-vif-plugged-ad62def3-239d-492d-845a-6753c82f6250 for instance with vm_state building and task_state spawning.
Nov 29 16:40:14 user nova-compute[75245]: INFO nova.compute.manager [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] Took 5.68 seconds to spawn the instance on the hypervisor.
Nov 29 16:40:14 user nova-compute[75245]: DEBUG nova.compute.manager [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:40:14 user nova-compute[75245]: INFO nova.compute.manager [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] Took 6.23 seconds to build instance.
Nov 29 16:40:14 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2013c3d2-7807-44ca-b26a-94ff4428237d tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Lock "3d913349-8ede-4dbc-96bf-27e33881dee0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.339s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:40:15 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:40:15 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:40:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:40:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:40:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:40:15 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75245) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 16:40:15 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d913349-8ede-4dbc-96bf-27e33881dee0/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:40:15 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d913349-8ede-4dbc-96bf-27e33881dee0/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:40:15 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d913349-8ede-4dbc-96bf-27e33881dee0/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:40:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:40:15 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d913349-8ede-4dbc-96bf-27e33881dee0/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:40:16 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba3662d8-598b-4296-a1e8-4dd57b5c7f3d/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:40:16 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba3662d8-598b-4296-a1e8-4dd57b5c7f3d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:40:16 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba3662d8-598b-4296-a1e8-4dd57b5c7f3d/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:40:16 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba3662d8-598b-4296-a1e8-4dd57b5c7f3d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:40:16 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ad13aa-7c21-4701-88e6-6265c7d19d7b/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:40:16 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ad13aa-7c21-4701-88e6-6265c7d19d7b/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:40:16 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ad13aa-7c21-4701-88e6-6265c7d19d7b/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:40:16 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ad13aa-7c21-4701-88e6-6265c7d19d7b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:40:17 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:40:17 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:40:17 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Hypervisor/Node resource view: name=user free_ram=8649MB free_disk=25.171756744384766GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75245) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 16:40:17 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:40:17 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:40:17 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance c9ad13aa-7c21-4701-88e6-6265c7d19d7b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:40:17 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance ba3662d8-598b-4296-a1e8-4dd57b5c7f3d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:40:17 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 3d913349-8ede-4dbc-96bf-27e33881dee0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:40:17 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 16:40:17 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 16:40:17 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:40:17 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:40:17 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Compute_service record updated for user:user {{(pid=75245) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 16:40:17 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.266s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:40:18 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:40:19 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:40:20 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:40:22 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:40:22 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75245) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 16:40:23 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:40:23 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:40:25 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:40:26 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:40:29 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:40:30 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:40:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:40:35 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:40:36 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:40:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:40:40 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:40:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:40:45 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:40:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:40:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:40:55 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:41:00 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-0c7bc461-129f-482b-b5a6-834af944df93 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Acquiring lock "c9ad13aa-7c21-4701-88e6-6265c7d19d7b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:41:00 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-0c7bc461-129f-482b-b5a6-834af944df93 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lock "c9ad13aa-7c21-4701-88e6-6265c7d19d7b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:41:00 user nova-compute[75245]: DEBUG nova.objects.instance [None req-0c7bc461-129f-482b-b5a6-834af944df93 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lazy-loading 'flavor' on Instance uuid c9ad13aa-7c21-4701-88e6-6265c7d19d7b {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:41:00 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-0c7bc461-129f-482b-b5a6-834af944df93 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lock "c9ad13aa-7c21-4701-88e6-6265c7d19d7b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:41:00 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-0c7bc461-129f-482b-b5a6-834af944df93 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Acquiring lock "c9ad13aa-7c21-4701-88e6-6265c7d19d7b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:41:00 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-0c7bc461-129f-482b-b5a6-834af944df93 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lock "c9ad13aa-7c21-4701-88e6-6265c7d19d7b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:41:00 user nova-compute[75245]: INFO nova.compute.manager [None req-0c7bc461-129f-482b-b5a6-834af944df93 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Attaching volume 3e40860c-63ee-4df7-87e1-d9e8219f694d to /dev/vdb
Nov 29 16:41:00 user nova-compute[75245]: DEBUG os_brick.utils [None req-0c7bc461-129f-482b-b5a6-834af944df93 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:41:00 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:41:00 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:41:00 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:41:00 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75245) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 16:41:00 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:41:00 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:41:00 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:41:00 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa1324b9-93dd-4aa3-9ae1-c530a254db68]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:69ed8ed87091\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:41:00 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:41:00 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:41:00 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:41:00 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd268a5f-b49f-4fd9-a564-dbf1c1210d8b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:41:00 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:41:00 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:41:00 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0bbce8-8eeb-443a-9ddf-382b9cdde6e2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:41:00 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f86fa0-8f70-4596-8fd3-e505e3b97fba]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:41:00 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-0c7bc461-129f-482b-b5a6-834af944df93 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Running cmd (subprocess): nvme version {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:41:01 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-0c7bc461-129f-482b-b5a6-834af944df93 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] 'nvme version' failed. Not Retrying. {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:41:01 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0c7bc461-129f-482b-b5a6-834af944df93 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] nvme not present on system {{(pid=75245) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 16:41:01 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:41:01 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:41:01 user nova-compute[75245]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 16:41:01 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[8802cb6c-11b2-4016-9fe7-dd2318480086]: (4, '') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:41:01 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-0c7bc461-129f-482b-b5a6-834af944df93 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75245) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 16:41:01 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-0c7bc461-129f-482b-b5a6-834af944df93 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 16:41:01 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-0c7bc461-129f-482b-b5a6-834af944df93 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] LIGHTOS: no hostnqn found. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 16:41:01 user nova-compute[75245]: DEBUG os_brick.utils [None req-0c7bc461-129f-482b-b5a6-834af944df93 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:69ed8ed87091', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:41:01 user nova-compute[75245]: DEBUG nova.virt.block_device [None req-0c7bc461-129f-482b-b5a6-834af944df93 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Updating existing volume attachment record: eaaadc4b-b037-4b4e-8fda-f97633b5bc73 {{(pid=75245) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 16:41:05 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:41:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:41:08 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c7bc461-129f-482b-b5a6-834af944df93 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Calling os-brick to attach iSCSI Volume {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 16:41:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c7bc461-129f-482b-b5a6-834af944df93 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yHixFYrN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:41:08 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-0c7bc461-129f-482b-b5a6-834af944df93 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:41:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-0c7bc461-129f-482b-b5a6-834af944df93 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:41:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-0c7bc461-129f-482b-b5a6-834af944df93 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:41:08 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-0c7bc461-129f-482b-b5a6-834af944df93 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:41:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-0c7bc461-129f-482b-b5a6-834af944df93 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:41:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-0c7bc461-129f-482b-b5a6-834af944df93 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:41:08 user nova-compute[75245]: INFO os_brick.initiator.connectors.iscsi [None req-0c7bc461-129f-482b-b5a6-834af944df93 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 16:41:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d -p 172.16.0.220:3260 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:41:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:41:08 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[995fd01e-70fb-4ebd-9540-f34af523f20d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:41:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c7bc461-129f-482b-b5a6-834af944df93 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 16:41:08 user nova-compute[75245]:  {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:41:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d -p 172.16.0.220:3260 --interface default --op new {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:41:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:41:08 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[283a1a8c-66ce-47e5-8f66-42a3f9369d00]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d] added\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:41:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c7bc461-129f-482b-b5a6-834af944df93 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d] added
Nov 29 16:41:08 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:41:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:41:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:41:08 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb7e1319-e46d-4b13-b7ee-569c45f59466]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:41:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c7bc461-129f-482b-b5a6-834af944df93 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:41:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:41:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:41:08 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3beb20c-9ced-4485-a7af-794c1ba127e0]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:41:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c7bc461-129f-482b-b5a6-834af944df93 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:41:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yHixFYrN {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:41:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yHixFYrN" returned: 0 in 0.025s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:41:08 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[020edf4f-c409-482c-93a4-5b1d58b6aab2]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:41:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c7bc461-129f-482b-b5a6-834af944df93 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yHixFYrN'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:41:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:41:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:41:08 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddcb7c16-585f-43bc-ab0f-7145752c913e]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:41:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c7bc461-129f-482b-b5a6-834af944df93 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:41:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:41:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:41:08 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8aac9f5-e68c-4737-afaa-109770b3af2a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:41:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c7bc461-129f-482b-b5a6-834af944df93 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 16:41:08 user nova-compute[75245]:  {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:41:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c7bc461-129f-482b-b5a6-834af944df93 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 16:41:08 user nova-compute[75245]:  {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:41:08 user nova-compute[75245]: WARNING os_brick.initiator.connectors.iscsi [None req-0c7bc461-129f-482b-b5a6-834af944df93 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 16:41:08 user nova-compute[75245]: 
Nov 29 16:41:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d -p 172.16.0.220:3260 --login {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:41:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:41:08 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac3d839-e03d-42d5-a4cb-3a08bb036b07]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:41:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c7bc461-129f-482b-b5a6-834af944df93 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d, portal: 172.16.0.220,3260]
Nov 29 16:41:08 user nova-compute[75245]: Login to [iface: default, target: iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d, portal: 172.16.0.220,3260] successful.
Nov 29 16:41:08 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:41:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:41:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:41:08 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f07a511-8b20-4ac6-acd2-41443cc28bbc]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:41:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c7bc461-129f-482b-b5a6-834af944df93 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:41:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:41:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:41:08 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[0481884b-8007-4782-a192-e9d393f208ac]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:41:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c7bc461-129f-482b-b5a6-834af944df93 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d (non-flash)
Nov 29 16:41:08 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:41:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c7bc461-129f-482b-b5a6-834af944df93 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d (non-flash)
Nov 29 16:41:08 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:41:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-0c7bc461-129f-482b-b5a6-834af944df93 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:41:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c7bc461-129f-482b-b5a6-834af944df93 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Connected to 172.16.0.220:3260 {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 16:41:08 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-0c7bc461-129f-482b-b5a6-834af944df93 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] HCTL ('33', '-', '-', 0) found on session 41 with lun 0 {{(pid=75245) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 16:41:08 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-0c7bc461-129f-482b-b5a6-834af944df93 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75245) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 16:41:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:41:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:41:08 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[30bc3d72-b42b-4cde-989d-dca02b869ca2]: (4, ('- - 0', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:41:08 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-0c7bc461-129f-482b-b5a6-834af944df93 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75245) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 16:41:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c7bc461-129f-482b-b5a6-834af944df93 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yHixFYrN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 16:41:09 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-0c7bc461-129f-482b-b5a6-834af944df93 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:41:09 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c7bc461-129f-482b-b5a6-834af944df93 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '23134373333323634', 'path': '/dev/sdb'} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:41:09 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c7bc461-129f-482b-b5a6-834af944df93 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23134373333323634', 'path': '/dev/sdb'} {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 16:41:09 user nova-compute[75245]: DEBUG nova.objects.instance [None req-0c7bc461-129f-482b-b5a6-834af944df93 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lazy-loading 'flavor' on Instance uuid c9ad13aa-7c21-4701-88e6-6265c7d19d7b {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:41:09 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-0c7bc461-129f-482b-b5a6-834af944df93 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 16:41:09 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:41:09 user nova-compute[75245]:   <source dev="/dev/sdb"/>
Nov 29 16:41:09 user nova-compute[75245]:   <target dev="vdb" bus="virtio"/>
Nov 29 16:41:09 user nova-compute[75245]:   <serial>3e40860c-63ee-4df7-87e1-d9e8219f694d</serial>
Nov 29 16:41:09 user nova-compute[75245]: </disk>
Nov 29 16:41:09 user nova-compute[75245]:  {{(pid=75245) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 16:41:10 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-0c7bc461-129f-482b-b5a6-834af944df93 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:41:10 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-0c7bc461-129f-482b-b5a6-834af944df93 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:41:10 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-0c7bc461-129f-482b-b5a6-834af944df93 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] No VIF found with MAC fa:16:3e:f4:3a:98, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:41:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-0c7bc461-129f-482b-b5a6-834af944df93 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lock "c9ad13aa-7c21-4701-88e6-6265c7d19d7b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.636s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:41:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:41:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:41:13 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:41:13 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Starting heal instance info cache {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 16:41:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "refresh_cache-ba3662d8-598b-4296-a1e8-4dd57b5c7f3d" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:41:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquired lock "refresh_cache-ba3662d8-598b-4296-a1e8-4dd57b5c7f3d" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:41:13 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] Forcefully refreshing network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 16:41:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:41:14 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] Updating instance_info_cache with network_info: [{"id": "e8484c13-9f26-42b4-8790-028d183a911a", "address": "fa:16:3e:6b:bd:c8", "network": {"id": "55744af1-3291-4de1-9bf4-554f9ee4f057", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1570836437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01e269dbe30d46ccb81d58e2590004db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8484c13-9f", "ovs_interfaceid": "e8484c13-9f26-42b4-8790-028d183a911a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:41:14 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Releasing lock "refresh_cache-ba3662d8-598b-4296-a1e8-4dd57b5c7f3d" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:41:14 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] Updated the network info_cache for instance {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 16:41:14 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Acquiring lock "23d4db24-cd37-4fb3-8ab3-ad8721e3714a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:41:14 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Lock "23d4db24-cd37-4fb3-8ab3-ad8721e3714a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:41:14 user nova-compute[75245]: DEBUG nova.compute.manager [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] [instance: 23d4db24-cd37-4fb3-8ab3-ad8721e3714a] Starting instance... {{(pid=75245) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 16:41:14 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:41:14 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:41:14 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75245) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 16:41:14 user nova-compute[75245]: INFO nova.compute.claims [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] [instance: 23d4db24-cd37-4fb3-8ab3-ad8721e3714a] Claim successful on node user
Nov 29 16:41:14 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:41:14 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:41:14 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.251s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:41:14 user nova-compute[75245]: DEBUG nova.compute.manager [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] [instance: 23d4db24-cd37-4fb3-8ab3-ad8721e3714a] Start building networks asynchronously for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 16:41:14 user nova-compute[75245]: DEBUG nova.compute.manager [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] [instance: 23d4db24-cd37-4fb3-8ab3-ad8721e3714a] Allocating IP information in the background. {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 16:41:14 user nova-compute[75245]: DEBUG nova.network.neutron [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] [instance: 23d4db24-cd37-4fb3-8ab3-ad8721e3714a] allocate_for_instance() {{(pid=75245) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 16:41:14 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] [instance: 23d4db24-cd37-4fb3-8ab3-ad8721e3714a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 16:41:14 user nova-compute[75245]: DEBUG nova.compute.manager [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] [instance: 23d4db24-cd37-4fb3-8ab3-ad8721e3714a] Start building block device mappings for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 16:41:14 user nova-compute[75245]: DEBUG nova.policy [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ad0b7d0571224f208814582c802fe0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa8698b2fbe4e45a02a50397fdc15c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75245) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 16:41:14 user nova-compute[75245]: DEBUG nova.compute.manager [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] [instance: 23d4db24-cd37-4fb3-8ab3-ad8721e3714a] Start spawning the instance on the hypervisor. {{(pid=75245) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 16:41:14 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] [instance: 23d4db24-cd37-4fb3-8ab3-ad8721e3714a] Creating instance directory {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 16:41:14 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] [instance: 23d4db24-cd37-4fb3-8ab3-ad8721e3714a] Creating image(s)
Nov 29 16:41:14 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Acquiring lock "/opt/stack/data/nova/instances/23d4db24-cd37-4fb3-8ab3-ad8721e3714a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:41:14 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Lock "/opt/stack/data/nova/instances/23d4db24-cd37-4fb3-8ab3-ad8721e3714a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:41:14 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Lock "/opt/stack/data/nova/instances/23d4db24-cd37-4fb3-8ab3-ad8721e3714a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:41:15 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:41:15 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.189s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:41:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Acquiring lock "d654f7206043e05d3525550b0fc885556eb999f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:41:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:41:15 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:41:15 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.169s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:41:15 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/23d4db24-cd37-4fb3-8ab3-ad8721e3714a/disk 1073741824 {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:41:15 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/23d4db24-cd37-4fb3-8ab3-ad8721e3714a/disk 1073741824" returned: 0 in 0.054s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:41:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:41:15 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:41:15 user nova-compute[75245]: DEBUG nova.network.neutron [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] [instance: 23d4db24-cd37-4fb3-8ab3-ad8721e3714a] Successfully created port: d1f96728-4585-4399-8490-7d55437b21bb {{(pid=75245) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 16:41:15 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.174s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:41:15 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Checking if we can resize image /opt/stack/data/nova/instances/23d4db24-cd37-4fb3-8ab3-ad8721e3714a/disk. size=1073741824 {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 16:41:15 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23d4db24-cd37-4fb3-8ab3-ad8721e3714a/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:41:15 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23d4db24-cd37-4fb3-8ab3-ad8721e3714a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:41:15 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Cannot resize image /opt/stack/data/nova/instances/23d4db24-cd37-4fb3-8ab3-ad8721e3714a/disk to a smaller size. {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 16:41:15 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] [instance: 23d4db24-cd37-4fb3-8ab3-ad8721e3714a] Created local disks {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 16:41:15 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] [instance: 23d4db24-cd37-4fb3-8ab3-ad8721e3714a] Ensure instance console log exists: /opt/stack/data/nova/instances/23d4db24-cd37-4fb3-8ab3-ad8721e3714a/console.log {{(pid=75245) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 16:41:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:41:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:41:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:41:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:41:16 user nova-compute[75245]: DEBUG nova.network.neutron [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] [instance: 23d4db24-cd37-4fb3-8ab3-ad8721e3714a] Successfully updated port: d1f96728-4585-4399-8490-7d55437b21bb {{(pid=75245) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 16:41:16 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Acquiring lock "refresh_cache-23d4db24-cd37-4fb3-8ab3-ad8721e3714a" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:41:16 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Acquired lock "refresh_cache-23d4db24-cd37-4fb3-8ab3-ad8721e3714a" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:41:16 user nova-compute[75245]: DEBUG nova.network.neutron [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] [instance: 23d4db24-cd37-4fb3-8ab3-ad8721e3714a] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 16:41:16 user nova-compute[75245]: DEBUG nova.compute.manager [req-e4a7d1bb-7acf-4671-8e13-561193d7336d req-09d3101c-a030-48fc-bd90-ac74be43ff57 service nova] [instance: 23d4db24-cd37-4fb3-8ab3-ad8721e3714a] Received event network-changed-d1f96728-4585-4399-8490-7d55437b21bb {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:41:16 user nova-compute[75245]: DEBUG nova.compute.manager [req-e4a7d1bb-7acf-4671-8e13-561193d7336d req-09d3101c-a030-48fc-bd90-ac74be43ff57 service nova] [instance: 23d4db24-cd37-4fb3-8ab3-ad8721e3714a] Refreshing instance network info cache due to event network-changed-d1f96728-4585-4399-8490-7d55437b21bb. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:41:16 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-e4a7d1bb-7acf-4671-8e13-561193d7336d req-09d3101c-a030-48fc-bd90-ac74be43ff57 service nova] Acquiring lock "refresh_cache-23d4db24-cd37-4fb3-8ab3-ad8721e3714a" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:41:16 user nova-compute[75245]: DEBUG nova.network.neutron [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] [instance: 23d4db24-cd37-4fb3-8ab3-ad8721e3714a] Instance cache missing network info. {{(pid=75245) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 16:41:16 user nova-compute[75245]: DEBUG nova.network.neutron [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] [instance: 23d4db24-cd37-4fb3-8ab3-ad8721e3714a] Updating instance_info_cache with network_info: [{"id": "d1f96728-4585-4399-8490-7d55437b21bb", "address": "fa:16:3e:2d:3e:dc", "network": {"id": "02425e20-f9ba-4d18-a4ae-3805376f9ffc", "bridge": "br-int", "label": "tempest-VolumesActionsTest-437049831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fa8698b2fbe4e45a02a50397fdc15c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1f96728-45", "ovs_interfaceid": "d1f96728-4585-4399-8490-7d55437b21bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:41:16 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Releasing lock "refresh_cache-23d4db24-cd37-4fb3-8ab3-ad8721e3714a" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:41:16 user nova-compute[75245]: DEBUG nova.compute.manager [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] [instance: 23d4db24-cd37-4fb3-8ab3-ad8721e3714a] Instance network_info: |[{"id": "d1f96728-4585-4399-8490-7d55437b21bb", "address": "fa:16:3e:2d:3e:dc", "network": {"id": "02425e20-f9ba-4d18-a4ae-3805376f9ffc", "bridge": "br-int", "label": "tempest-VolumesActionsTest-437049831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fa8698b2fbe4e45a02a50397fdc15c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1f96728-45", "ovs_interfaceid": "d1f96728-4585-4399-8490-7d55437b21bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 16:41:16 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-e4a7d1bb-7acf-4671-8e13-561193d7336d req-09d3101c-a030-48fc-bd90-ac74be43ff57 service nova] Acquired lock "refresh_cache-23d4db24-cd37-4fb3-8ab3-ad8721e3714a" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:41:16 user nova-compute[75245]: DEBUG nova.network.neutron [req-e4a7d1bb-7acf-4671-8e13-561193d7336d req-09d3101c-a030-48fc-bd90-ac74be43ff57 service nova] [instance: 23d4db24-cd37-4fb3-8ab3-ad8721e3714a] Refreshing network info cache for port d1f96728-4585-4399-8490-7d55437b21bb {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:41:16 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] [instance: 23d4db24-cd37-4fb3-8ab3-ad8721e3714a] Start _get_guest_xml network_info=[{"id": "d1f96728-4585-4399-8490-7d55437b21bb", "address": "fa:16:3e:2d:3e:dc", "network": {"id": "02425e20-f9ba-4d18-a4ae-3805376f9ffc", "bridge": "br-int", "label": "tempest-VolumesActionsTest-437049831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fa8698b2fbe4e45a02a50397fdc15c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1f96728-45", "ovs_interfaceid": "d1f96728-4585-4399-8490-7d55437b21bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'a291d9c3-be02-4c6c-9649-4b45c5b7f487'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 16:41:16 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:41:16 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:41:16 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 16:41:16 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] CPU controller missing on host. {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 16:41:16 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 16:41:16 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] CPU controller found on host. {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 16:41:16 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75245) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 16:41:16 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T16:06:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 16:41:16 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Flavor limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 16:41:16 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Image limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 16:41:16 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Flavor pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 16:41:16 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Image pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 16:41:16 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 16:41:16 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 16:41:16 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 16:41:16 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Got 1 possible topologies {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 16:41:16 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 16:41:16 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 16:41:16 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:41:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1794048252',display_name='tempest-VolumesActionsTest-instance-1794048252',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1794048252',id=36,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7fa8698b2fbe4e45a02a50397fdc15c0',ramdisk_id='',reservation_id='r-000xqpq6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1420605510',owner_user_name='tempest-VolumesActionsTest-1420605510-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:41:15Z,user_data=None,user_id='ad0b7d0571224f208814582c802fe0c7',uuid=23d4db24-cd37-4fb3-8ab3-ad8721e3714a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1f96728-4585-4399-8490-7d55437b21bb", "address": "fa:16:3e:2d:3e:dc", "network": {"id": "02425e20-f9ba-4d18-a4ae-3805376f9ffc", "bridge": "br-int", "label": "tempest-VolumesActionsTest-437049831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fa8698b2fbe4e45a02a50397fdc15c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1f96728-45", "ovs_interfaceid": "d1f96728-4585-4399-8490-7d55437b21bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:41:16 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Converting VIF {"id": "d1f96728-4585-4399-8490-7d55437b21bb", "address": "fa:16:3e:2d:3e:dc", "network": {"id": "02425e20-f9ba-4d18-a4ae-3805376f9ffc", "bridge": "br-int", "label": "tempest-VolumesActionsTest-437049831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fa8698b2fbe4e45a02a50397fdc15c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1f96728-45", "ovs_interfaceid": "d1f96728-4585-4399-8490-7d55437b21bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:41:16 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:3e:dc,bridge_name='br-int',has_traffic_filtering=True,id=d1f96728-4585-4399-8490-7d55437b21bb,network=Network(02425e20-f9ba-4d18-a4ae-3805376f9ffc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1f96728-45') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:41:16 user nova-compute[75245]: DEBUG nova.objects.instance [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Lazy-loading 'pci_devices' on Instance uuid 23d4db24-cd37-4fb3-8ab3-ad8721e3714a {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:41:16 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] [instance: 23d4db24-cd37-4fb3-8ab3-ad8721e3714a] End _get_guest_xml xml=<domain type="kvm">
Nov 29 16:41:16 user nova-compute[75245]:   <uuid>23d4db24-cd37-4fb3-8ab3-ad8721e3714a</uuid>
Nov 29 16:41:16 user nova-compute[75245]:   <name>instance-00000024</name>
Nov 29 16:41:16 user nova-compute[75245]:   <memory>524288</memory>
Nov 29 16:41:16 user nova-compute[75245]:   <vcpu>1</vcpu>
Nov 29 16:41:16 user nova-compute[75245]:   <metadata>
Nov 29 16:41:16 user nova-compute[75245]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 16:41:16 user nova-compute[75245]:       <nova:package version="0.0.0"/>
Nov 29 16:41:16 user nova-compute[75245]:       <nova:name>tempest-VolumesActionsTest-instance-1794048252</nova:name>
Nov 29 16:41:16 user nova-compute[75245]:       <nova:creationTime>2023-11-29 16:41:16</nova:creationTime>
Nov 29 16:41:16 user nova-compute[75245]:       <nova:flavor name="m1.tiny">
Nov 29 16:41:16 user nova-compute[75245]:         <nova:memory>512</nova:memory>
Nov 29 16:41:16 user nova-compute[75245]:         <nova:disk>1</nova:disk>
Nov 29 16:41:16 user nova-compute[75245]:         <nova:swap>0</nova:swap>
Nov 29 16:41:16 user nova-compute[75245]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 16:41:16 user nova-compute[75245]:         <nova:vcpus>1</nova:vcpus>
Nov 29 16:41:16 user nova-compute[75245]:       </nova:flavor>
Nov 29 16:41:16 user nova-compute[75245]:       <nova:owner>
Nov 29 16:41:16 user nova-compute[75245]:         <nova:user uuid="ad0b7d0571224f208814582c802fe0c7">tempest-VolumesActionsTest-1420605510-project-member</nova:user>
Nov 29 16:41:16 user nova-compute[75245]:         <nova:project uuid="7fa8698b2fbe4e45a02a50397fdc15c0">tempest-VolumesActionsTest-1420605510</nova:project>
Nov 29 16:41:16 user nova-compute[75245]:       </nova:owner>
Nov 29 16:41:16 user nova-compute[75245]:       <nova:root type="image" uuid="a291d9c3-be02-4c6c-9649-4b45c5b7f487"/>
Nov 29 16:41:16 user nova-compute[75245]:       <nova:ports>
Nov 29 16:41:16 user nova-compute[75245]:         <nova:port uuid="d1f96728-4585-4399-8490-7d55437b21bb">
Nov 29 16:41:16 user nova-compute[75245]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 29 16:41:16 user nova-compute[75245]:         </nova:port>
Nov 29 16:41:16 user nova-compute[75245]:       </nova:ports>
Nov 29 16:41:16 user nova-compute[75245]:     </nova:instance>
Nov 29 16:41:16 user nova-compute[75245]:   </metadata>
Nov 29 16:41:16 user nova-compute[75245]:   <sysinfo type="smbios">
Nov 29 16:41:16 user nova-compute[75245]:     <system>
Nov 29 16:41:16 user nova-compute[75245]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 16:41:16 user nova-compute[75245]:       <entry name="product">OpenStack Nova</entry>
Nov 29 16:41:16 user nova-compute[75245]:       <entry name="version">0.0.0</entry>
Nov 29 16:41:16 user nova-compute[75245]:       <entry name="serial">23d4db24-cd37-4fb3-8ab3-ad8721e3714a</entry>
Nov 29 16:41:16 user nova-compute[75245]:       <entry name="uuid">23d4db24-cd37-4fb3-8ab3-ad8721e3714a</entry>
Nov 29 16:41:16 user nova-compute[75245]:       <entry name="family">Virtual Machine</entry>
Nov 29 16:41:16 user nova-compute[75245]:     </system>
Nov 29 16:41:16 user nova-compute[75245]:   </sysinfo>
Nov 29 16:41:16 user nova-compute[75245]:   <os>
Nov 29 16:41:16 user nova-compute[75245]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 16:41:16 user nova-compute[75245]:     <boot dev="hd"/>
Nov 29 16:41:16 user nova-compute[75245]:     <smbios mode="sysinfo"/>
Nov 29 16:41:16 user nova-compute[75245]:   </os>
Nov 29 16:41:16 user nova-compute[75245]:   <features>
Nov 29 16:41:16 user nova-compute[75245]:     <acpi/>
Nov 29 16:41:16 user nova-compute[75245]:     <apic/>
Nov 29 16:41:16 user nova-compute[75245]:     <vmcoreinfo/>
Nov 29 16:41:16 user nova-compute[75245]:   </features>
Nov 29 16:41:16 user nova-compute[75245]:   <clock offset="utc">
Nov 29 16:41:16 user nova-compute[75245]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 16:41:16 user nova-compute[75245]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 16:41:16 user nova-compute[75245]:     <timer name="hpet" present="no"/>
Nov 29 16:41:16 user nova-compute[75245]:   </clock>
Nov 29 16:41:16 user nova-compute[75245]:   <cpu mode="custom" match="exact">
Nov 29 16:41:16 user nova-compute[75245]:     <model>Nehalem</model>
Nov 29 16:41:16 user nova-compute[75245]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 16:41:16 user nova-compute[75245]:   </cpu>
Nov 29 16:41:16 user nova-compute[75245]:   <devices>
Nov 29 16:41:16 user nova-compute[75245]:     <disk type="file" device="disk">
Nov 29 16:41:16 user nova-compute[75245]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 16:41:16 user nova-compute[75245]:       <source file="/opt/stack/data/nova/instances/23d4db24-cd37-4fb3-8ab3-ad8721e3714a/disk"/>
Nov 29 16:41:16 user nova-compute[75245]:       <target dev="vda" bus="virtio"/>
Nov 29 16:41:16 user nova-compute[75245]:     </disk>
Nov 29 16:41:16 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 16:41:16 user nova-compute[75245]:       <mac address="fa:16:3e:2d:3e:dc"/>
Nov 29 16:41:16 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:41:16 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 16:41:16 user nova-compute[75245]:       <target dev="tapd1f96728-45"/>
Nov 29 16:41:16 user nova-compute[75245]:     </interface>
Nov 29 16:41:16 user nova-compute[75245]:     <serial type="pty">
Nov 29 16:41:16 user nova-compute[75245]:       <log file="/opt/stack/data/nova/instances/23d4db24-cd37-4fb3-8ab3-ad8721e3714a/console.log" append="off"/>
Nov 29 16:41:16 user nova-compute[75245]:     </serial>
Nov 29 16:41:16 user nova-compute[75245]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 16:41:16 user nova-compute[75245]:     <video>
Nov 29 16:41:16 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:41:16 user nova-compute[75245]:     </video>
Nov 29 16:41:16 user nova-compute[75245]:     <rng model="virtio">
Nov 29 16:41:16 user nova-compute[75245]:       <backend model="random">/dev/urandom</backend>
Nov 29 16:41:16 user nova-compute[75245]:     </rng>
Nov 29 16:41:16 user nova-compute[75245]:     <controller type="usb" index="0" model="none"/>
Nov 29 16:41:16 user nova-compute[75245]:     <memballoon model="virtio">
Nov 29 16:41:16 user nova-compute[75245]:       <stats period="10"/>
Nov 29 16:41:16 user nova-compute[75245]:     </memballoon>
Nov 29 16:41:16 user nova-compute[75245]:   </devices>
Nov 29 16:41:16 user nova-compute[75245]: </domain>
Nov 29 16:41:16 user nova-compute[75245]:  {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 16:41:16 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:41:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1794048252',display_name='tempest-VolumesActionsTest-instance-1794048252',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1794048252',id=36,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7fa8698b2fbe4e45a02a50397fdc15c0',ramdisk_id='',reservation_id='r-000xqpq6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1420605510',owner_user_name='tempest-VolumesActionsTest-1420605510-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:41:15Z,user_data=None,user_id='ad0b7d0571224f208814582c802fe0c7',uuid=23d4db24-cd37-4fb3-8ab3-ad8721e3714a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1f96728-4585-4399-8490-7d55437b21bb", "address": "fa:16:3e:2d:3e:dc", "network": {"id": "02425e20-f9ba-4d18-a4ae-3805376f9ffc", "bridge": "br-int", "label": "tempest-VolumesActionsTest-437049831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fa8698b2fbe4e45a02a50397fdc15c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1f96728-45", "ovs_interfaceid": "d1f96728-4585-4399-8490-7d55437b21bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 16:41:16 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Converting VIF {"id": "d1f96728-4585-4399-8490-7d55437b21bb", "address": "fa:16:3e:2d:3e:dc", "network": {"id": "02425e20-f9ba-4d18-a4ae-3805376f9ffc", "bridge": "br-int", "label": "tempest-VolumesActionsTest-437049831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fa8698b2fbe4e45a02a50397fdc15c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1f96728-45", "ovs_interfaceid": "d1f96728-4585-4399-8490-7d55437b21bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:41:16 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:3e:dc,bridge_name='br-int',has_traffic_filtering=True,id=d1f96728-4585-4399-8490-7d55437b21bb,network=Network(02425e20-f9ba-4d18-a4ae-3805376f9ffc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1f96728-45') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:41:16 user nova-compute[75245]: DEBUG os_vif [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:3e:dc,bridge_name='br-int',has_traffic_filtering=True,id=d1f96728-4585-4399-8490-7d55437b21bb,network=Network(02425e20-f9ba-4d18-a4ae-3805376f9ffc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1f96728-45') {{(pid=75245) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 16:41:16 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:41:16 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:41:16 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 16:41:16 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:41:16 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd107be04-f21d-591d-a62c-73c82c090d63', '_type': 'linux-noop'}}, row=False) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:41:16 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:41:16 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:41:16 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:41:16 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd1f96728-45, may_exist=True, interface_attrs={}) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:41:16 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd1f96728-45, col_values=(('qos', UUID('3ea608ad-58f9-43f7-b344-dfc52491a528')),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:41:16 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd1f96728-45, col_values=(('external_ids', {'iface-id': 'd1f96728-4585-4399-8490-7d55437b21bb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:3e:dc', 'vm-uuid': '23d4db24-cd37-4fb3-8ab3-ad8721e3714a'}),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:41:16 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:41:16 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:41:16 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:41:16 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:41:16 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:41:16 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:41:16 user nova-compute[75245]: INFO os_vif [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:3e:dc,bridge_name='br-int',has_traffic_filtering=True,id=d1f96728-4585-4399-8490-7d55437b21bb,network=Network(02425e20-f9ba-4d18-a4ae-3805376f9ffc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1f96728-45')
Nov 29 16:41:16 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:41:16 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:41:16 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:41:16 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75245) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 16:41:16 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:41:16 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] No VIF found with MAC fa:16:3e:2d:3e:dc, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:41:16 user nova-compute[75245]: DEBUG nova.network.neutron [req-e4a7d1bb-7acf-4671-8e13-561193d7336d req-09d3101c-a030-48fc-bd90-ac74be43ff57 service nova] [instance: 23d4db24-cd37-4fb3-8ab3-ad8721e3714a] Updated VIF entry in instance network info cache for port d1f96728-4585-4399-8490-7d55437b21bb. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:41:16 user nova-compute[75245]: DEBUG nova.network.neutron [req-e4a7d1bb-7acf-4671-8e13-561193d7336d req-09d3101c-a030-48fc-bd90-ac74be43ff57 service nova] [instance: 23d4db24-cd37-4fb3-8ab3-ad8721e3714a] Updating instance_info_cache with network_info: [{"id": "d1f96728-4585-4399-8490-7d55437b21bb", "address": "fa:16:3e:2d:3e:dc", "network": {"id": "02425e20-f9ba-4d18-a4ae-3805376f9ffc", "bridge": "br-int", "label": "tempest-VolumesActionsTest-437049831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fa8698b2fbe4e45a02a50397fdc15c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1f96728-45", "ovs_interfaceid": "d1f96728-4585-4399-8490-7d55437b21bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:41:16 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-e4a7d1bb-7acf-4671-8e13-561193d7336d req-09d3101c-a030-48fc-bd90-ac74be43ff57 service nova] Releasing lock "refresh_cache-23d4db24-cd37-4fb3-8ab3-ad8721e3714a" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:41:17 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:41:17 user nova-compute[75245]: DEBUG nova.compute.manager [req-22957c8e-c979-40ff-8dc1-a978e9e71bf9 req-feca8fb2-1ef2-437d-960a-2ab95fa11fae service nova] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Received event network-changed-2844f77d-297d-4177-974c-22a1cab3590c {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:41:17 user nova-compute[75245]: DEBUG nova.compute.manager [req-22957c8e-c979-40ff-8dc1-a978e9e71bf9 req-feca8fb2-1ef2-437d-960a-2ab95fa11fae service nova] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Refreshing instance network info cache due to event network-changed-2844f77d-297d-4177-974c-22a1cab3590c. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:41:17 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-22957c8e-c979-40ff-8dc1-a978e9e71bf9 req-feca8fb2-1ef2-437d-960a-2ab95fa11fae service nova] Acquiring lock "refresh_cache-c9ad13aa-7c21-4701-88e6-6265c7d19d7b" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:41:17 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-22957c8e-c979-40ff-8dc1-a978e9e71bf9 req-feca8fb2-1ef2-437d-960a-2ab95fa11fae service nova] Acquired lock "refresh_cache-c9ad13aa-7c21-4701-88e6-6265c7d19d7b" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:41:17 user nova-compute[75245]: DEBUG nova.network.neutron [req-22957c8e-c979-40ff-8dc1-a978e9e71bf9 req-feca8fb2-1ef2-437d-960a-2ab95fa11fae service nova] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Refreshing network info cache for port 2844f77d-297d-4177-974c-22a1cab3590c {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:41:17 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:41:17 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:41:18 user nova-compute[75245]: DEBUG nova.compute.manager [req-7a77b06d-6e2f-45b8-b52a-2e07958d550f req-270ebca7-ffff-4b5b-86e9-3b40656d3ce7 service nova] [instance: 23d4db24-cd37-4fb3-8ab3-ad8721e3714a] Received event network-vif-plugged-d1f96728-4585-4399-8490-7d55437b21bb {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:41:18 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-7a77b06d-6e2f-45b8-b52a-2e07958d550f req-270ebca7-ffff-4b5b-86e9-3b40656d3ce7 service nova] Acquiring lock "23d4db24-cd37-4fb3-8ab3-ad8721e3714a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:41:18 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-7a77b06d-6e2f-45b8-b52a-2e07958d550f req-270ebca7-ffff-4b5b-86e9-3b40656d3ce7 service nova] Lock "23d4db24-cd37-4fb3-8ab3-ad8721e3714a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:41:18 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-7a77b06d-6e2f-45b8-b52a-2e07958d550f req-270ebca7-ffff-4b5b-86e9-3b40656d3ce7 service nova] Lock "23d4db24-cd37-4fb3-8ab3-ad8721e3714a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:41:18 user nova-compute[75245]: DEBUG nova.compute.manager [req-7a77b06d-6e2f-45b8-b52a-2e07958d550f req-270ebca7-ffff-4b5b-86e9-3b40656d3ce7 service nova] [instance: 23d4db24-cd37-4fb3-8ab3-ad8721e3714a] No waiting events found dispatching network-vif-plugged-d1f96728-4585-4399-8490-7d55437b21bb {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:41:18 user nova-compute[75245]: WARNING nova.compute.manager [req-7a77b06d-6e2f-45b8-b52a-2e07958d550f req-270ebca7-ffff-4b5b-86e9-3b40656d3ce7 service nova] [instance: 23d4db24-cd37-4fb3-8ab3-ad8721e3714a] Received unexpected event network-vif-plugged-d1f96728-4585-4399-8490-7d55437b21bb for instance with vm_state building and task_state spawning.
Nov 29 16:41:18 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d913349-8ede-4dbc-96bf-27e33881dee0/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:41:18 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:41:18 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:41:18 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:41:18 user nova-compute[75245]: DEBUG nova.network.neutron [req-22957c8e-c979-40ff-8dc1-a978e9e71bf9 req-feca8fb2-1ef2-437d-960a-2ab95fa11fae service nova] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Updated VIF entry in instance network info cache for port 2844f77d-297d-4177-974c-22a1cab3590c. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:41:18 user nova-compute[75245]: DEBUG nova.network.neutron [req-22957c8e-c979-40ff-8dc1-a978e9e71bf9 req-feca8fb2-1ef2-437d-960a-2ab95fa11fae service nova] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Updating instance_info_cache with network_info: [{"id": "2844f77d-297d-4177-974c-22a1cab3590c", "address": "fa:16:3e:f4:3a:98", "network": {"id": "b0e81786-47f3-4a13-90c7-788cb53a4df5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1382922826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebd1ea36980641739f2bdd856a65d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2844f77d-29", "ovs_interfaceid": "2844f77d-297d-4177-974c-22a1cab3590c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:41:18 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-22957c8e-c979-40ff-8dc1-a978e9e71bf9 req-feca8fb2-1ef2-437d-960a-2ab95fa11fae service nova] Releasing lock "refresh_cache-c9ad13aa-7c21-4701-88e6-6265c7d19d7b" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:41:18 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d913349-8ede-4dbc-96bf-27e33881dee0/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:41:18 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d913349-8ede-4dbc-96bf-27e33881dee0/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:41:18 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d913349-8ede-4dbc-96bf-27e33881dee0/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:41:18 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba3662d8-598b-4296-a1e8-4dd57b5c7f3d/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:41:18 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba3662d8-598b-4296-a1e8-4dd57b5c7f3d/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:41:18 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba3662d8-598b-4296-a1e8-4dd57b5c7f3d/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:41:19 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:41:19 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba3662d8-598b-4296-a1e8-4dd57b5c7f3d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:41:19 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ad13aa-7c21-4701-88e6-6265c7d19d7b/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:41:19 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ad13aa-7c21-4701-88e6-6265c7d19d7b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:41:19 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ad13aa-7c21-4701-88e6-6265c7d19d7b/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:41:19 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ad13aa-7c21-4701-88e6-6265c7d19d7b/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:41:19 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:41:19 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23d4db24-cd37-4fb3-8ab3-ad8721e3714a/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:41:19 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23d4db24-cd37-4fb3-8ab3-ad8721e3714a/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:41:19 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23d4db24-cd37-4fb3-8ab3-ad8721e3714a/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:41:19 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23d4db24-cd37-4fb3-8ab3-ad8721e3714a/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:41:20 user nova-compute[75245]: DEBUG nova.compute.manager [req-08b3fe4b-3473-4e13-8124-53ce6f570961 req-5fc57fa5-f389-426e-ba7e-e7cd7cbc6881 service nova] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Received event network-changed-2844f77d-297d-4177-974c-22a1cab3590c {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:41:20 user nova-compute[75245]: DEBUG nova.compute.manager [req-08b3fe4b-3473-4e13-8124-53ce6f570961 req-5fc57fa5-f389-426e-ba7e-e7cd7cbc6881 service nova] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Refreshing instance network info cache due to event network-changed-2844f77d-297d-4177-974c-22a1cab3590c. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:41:20 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-08b3fe4b-3473-4e13-8124-53ce6f570961 req-5fc57fa5-f389-426e-ba7e-e7cd7cbc6881 service nova] Acquiring lock "refresh_cache-c9ad13aa-7c21-4701-88e6-6265c7d19d7b" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:41:20 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-08b3fe4b-3473-4e13-8124-53ce6f570961 req-5fc57fa5-f389-426e-ba7e-e7cd7cbc6881 service nova] Acquired lock "refresh_cache-c9ad13aa-7c21-4701-88e6-6265c7d19d7b" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:41:20 user nova-compute[75245]: DEBUG nova.network.neutron [req-08b3fe4b-3473-4e13-8124-53ce6f570961 req-5fc57fa5-f389-426e-ba7e-e7cd7cbc6881 service nova] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Refreshing network info cache for port 2844f77d-297d-4177-974c-22a1cab3590c {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:41:20 user nova-compute[75245]: DEBUG nova.compute.manager [req-1959ad8f-fc40-48d4-b2d0-45208b3a5298 req-66e67091-94ee-4157-ab2b-8eb687575c86 service nova] [instance: 23d4db24-cd37-4fb3-8ab3-ad8721e3714a] Received event network-vif-plugged-d1f96728-4585-4399-8490-7d55437b21bb {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:41:20 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-1959ad8f-fc40-48d4-b2d0-45208b3a5298 req-66e67091-94ee-4157-ab2b-8eb687575c86 service nova] Acquiring lock "23d4db24-cd37-4fb3-8ab3-ad8721e3714a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:41:20 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-1959ad8f-fc40-48d4-b2d0-45208b3a5298 req-66e67091-94ee-4157-ab2b-8eb687575c86 service nova] Lock "23d4db24-cd37-4fb3-8ab3-ad8721e3714a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:41:20 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-1959ad8f-fc40-48d4-b2d0-45208b3a5298 req-66e67091-94ee-4157-ab2b-8eb687575c86 service nova] Lock "23d4db24-cd37-4fb3-8ab3-ad8721e3714a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:41:20 user nova-compute[75245]: DEBUG nova.compute.manager [req-1959ad8f-fc40-48d4-b2d0-45208b3a5298 req-66e67091-94ee-4157-ab2b-8eb687575c86 service nova] [instance: 23d4db24-cd37-4fb3-8ab3-ad8721e3714a] No waiting events found dispatching network-vif-plugged-d1f96728-4585-4399-8490-7d55437b21bb {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:41:20 user nova-compute[75245]: WARNING nova.compute.manager [req-1959ad8f-fc40-48d4-b2d0-45208b3a5298 req-66e67091-94ee-4157-ab2b-8eb687575c86 service nova] [instance: 23d4db24-cd37-4fb3-8ab3-ad8721e3714a] Received unexpected event network-vif-plugged-d1f96728-4585-4399-8490-7d55437b21bb for instance with vm_state building and task_state spawning.
Nov 29 16:41:20 user nova-compute[75245]: DEBUG nova.compute.manager [req-1959ad8f-fc40-48d4-b2d0-45208b3a5298 req-66e67091-94ee-4157-ab2b-8eb687575c86 service nova] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] Received event network-changed-e8484c13-9f26-42b4-8790-028d183a911a {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:41:20 user nova-compute[75245]: DEBUG nova.compute.manager [req-1959ad8f-fc40-48d4-b2d0-45208b3a5298 req-66e67091-94ee-4157-ab2b-8eb687575c86 service nova] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] Refreshing instance network info cache due to event network-changed-e8484c13-9f26-42b4-8790-028d183a911a. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:41:20 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-1959ad8f-fc40-48d4-b2d0-45208b3a5298 req-66e67091-94ee-4157-ab2b-8eb687575c86 service nova] Acquiring lock "refresh_cache-ba3662d8-598b-4296-a1e8-4dd57b5c7f3d" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:41:20 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-1959ad8f-fc40-48d4-b2d0-45208b3a5298 req-66e67091-94ee-4157-ab2b-8eb687575c86 service nova] Acquired lock "refresh_cache-ba3662d8-598b-4296-a1e8-4dd57b5c7f3d" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:41:20 user nova-compute[75245]: DEBUG nova.network.neutron [req-1959ad8f-fc40-48d4-b2d0-45208b3a5298 req-66e67091-94ee-4157-ab2b-8eb687575c86 service nova] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] Refreshing network info cache for port e8484c13-9f26-42b4-8790-028d183a911a {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:41:20 user nova-compute[75245]: DEBUG nova.compute.manager [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] [instance: 23d4db24-cd37-4fb3-8ab3-ad8721e3714a] Instance event wait completed in 0 seconds for  {{(pid=75245) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 16:41:20 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] [instance: 23d4db24-cd37-4fb3-8ab3-ad8721e3714a] Guest created on hypervisor {{(pid=75245) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 16:41:20 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 23d4db24-cd37-4fb3-8ab3-ad8721e3714a] Instance spawned successfully.
Nov 29 16:41:20 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:41:20 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:41:20 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Hypervisor/Node resource view: name=user free_ram=8665MB free_disk=25.140583038330078GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75245) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 16:41:20 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:41:20 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:41:20 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] [instance: 23d4db24-cd37-4fb3-8ab3-ad8721e3714a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 16:41:20 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] [instance: 23d4db24-cd37-4fb3-8ab3-ad8721e3714a] Found default for hw_cdrom_bus of ide {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:41:20 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] [instance: 23d4db24-cd37-4fb3-8ab3-ad8721e3714a] Found default for hw_disk_bus of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:41:20 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] [instance: 23d4db24-cd37-4fb3-8ab3-ad8721e3714a] Found default for hw_input_bus of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:41:20 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] [instance: 23d4db24-cd37-4fb3-8ab3-ad8721e3714a] Found default for hw_pointer_model of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:41:20 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] [instance: 23d4db24-cd37-4fb3-8ab3-ad8721e3714a] Found default for hw_video_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:41:20 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] [instance: 23d4db24-cd37-4fb3-8ab3-ad8721e3714a] Found default for hw_vif_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:41:20 user nova-compute[75245]: INFO nova.compute.manager [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] [instance: 23d4db24-cd37-4fb3-8ab3-ad8721e3714a] Took 5.54 seconds to spawn the instance on the hypervisor.
Nov 29 16:41:20 user nova-compute[75245]: DEBUG nova.compute.manager [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] [instance: 23d4db24-cd37-4fb3-8ab3-ad8721e3714a] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:41:20 user nova-compute[75245]: INFO nova.compute.manager [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] [instance: 23d4db24-cd37-4fb3-8ab3-ad8721e3714a] Took 6.27 seconds to build instance.
Nov 29 16:41:20 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-c0861a31-c27c-4961-9239-5f7d4c5b13ac tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Lock "23d4db24-cd37-4fb3-8ab3-ad8721e3714a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.362s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:41:20 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance c9ad13aa-7c21-4701-88e6-6265c7d19d7b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:41:20 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance ba3662d8-598b-4296-a1e8-4dd57b5c7f3d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:41:20 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 3d913349-8ede-4dbc-96bf-27e33881dee0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:41:20 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 23d4db24-cd37-4fb3-8ab3-ad8721e3714a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:41:20 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 16:41:20 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 16:41:20 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Refreshing inventories for resource provider dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 16:41:20 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Updating ProviderTree inventory for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 16:41:20 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Updating inventory in ProviderTree for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 16:41:20 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Refreshing aggregate associations for resource provider dcc0ed27-167e-4f3a-a0de-183bb144a50c, aggregates: None {{(pid=75245) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 16:41:20 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Refreshing trait associations for resource provider dcc0ed27-167e-4f3a-a0de-183bb144a50c, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG {{(pid=75245) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 16:41:20 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:41:20 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:41:21 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Compute_service record updated for user:user {{(pid=75245) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 16:41:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.606s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:41:21 user nova-compute[75245]: DEBUG nova.network.neutron [req-1959ad8f-fc40-48d4-b2d0-45208b3a5298 req-66e67091-94ee-4157-ab2b-8eb687575c86 service nova] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] Updated VIF entry in instance network info cache for port e8484c13-9f26-42b4-8790-028d183a911a. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:41:21 user nova-compute[75245]: DEBUG nova.network.neutron [req-1959ad8f-fc40-48d4-b2d0-45208b3a5298 req-66e67091-94ee-4157-ab2b-8eb687575c86 service nova] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] Updating instance_info_cache with network_info: [{"id": "e8484c13-9f26-42b4-8790-028d183a911a", "address": "fa:16:3e:6b:bd:c8", "network": {"id": "55744af1-3291-4de1-9bf4-554f9ee4f057", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1570836437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01e269dbe30d46ccb81d58e2590004db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8484c13-9f", "ovs_interfaceid": "e8484c13-9f26-42b4-8790-028d183a911a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:41:21 user nova-compute[75245]: DEBUG nova.network.neutron [req-08b3fe4b-3473-4e13-8124-53ce6f570961 req-5fc57fa5-f389-426e-ba7e-e7cd7cbc6881 service nova] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Updated VIF entry in instance network info cache for port 2844f77d-297d-4177-974c-22a1cab3590c. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:41:21 user nova-compute[75245]: DEBUG nova.network.neutron [req-08b3fe4b-3473-4e13-8124-53ce6f570961 req-5fc57fa5-f389-426e-ba7e-e7cd7cbc6881 service nova] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Updating instance_info_cache with network_info: [{"id": "2844f77d-297d-4177-974c-22a1cab3590c", "address": "fa:16:3e:f4:3a:98", "network": {"id": "b0e81786-47f3-4a13-90c7-788cb53a4df5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1382922826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebd1ea36980641739f2bdd856a65d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2844f77d-29", "ovs_interfaceid": "2844f77d-297d-4177-974c-22a1cab3590c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:41:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-08b3fe4b-3473-4e13-8124-53ce6f570961 req-5fc57fa5-f389-426e-ba7e-e7cd7cbc6881 service nova] Releasing lock "refresh_cache-c9ad13aa-7c21-4701-88e6-6265c7d19d7b" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:41:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-1959ad8f-fc40-48d4-b2d0-45208b3a5298 req-66e67091-94ee-4157-ab2b-8eb687575c86 service nova] Releasing lock "refresh_cache-ba3662d8-598b-4296-a1e8-4dd57b5c7f3d" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:41:21 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:41:22 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:41:22 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:41:22 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75245) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 16:41:22 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:41:22 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Cleaning up deleted instances {{(pid=75245) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 16:41:22 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] There are 0 instances to clean {{(pid=75245) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 16:41:23 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:41:23 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75245) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 16:41:23 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-a7c791a4-3686-4d8a-9f26-168c60a882e9 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Acquiring lock "ba3662d8-598b-4296-a1e8-4dd57b5c7f3d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:41:23 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-a7c791a4-3686-4d8a-9f26-168c60a882e9 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "ba3662d8-598b-4296-a1e8-4dd57b5c7f3d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:41:23 user nova-compute[75245]: DEBUG nova.objects.instance [None req-a7c791a4-3686-4d8a-9f26-168c60a882e9 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lazy-loading 'flavor' on Instance uuid ba3662d8-598b-4296-a1e8-4dd57b5c7f3d {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:41:23 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-a7c791a4-3686-4d8a-9f26-168c60a882e9 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "ba3662d8-598b-4296-a1e8-4dd57b5c7f3d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:41:23 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-a7c791a4-3686-4d8a-9f26-168c60a882e9 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Acquiring lock "ba3662d8-598b-4296-a1e8-4dd57b5c7f3d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:41:23 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-a7c791a4-3686-4d8a-9f26-168c60a882e9 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "ba3662d8-598b-4296-a1e8-4dd57b5c7f3d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:41:23 user nova-compute[75245]: INFO nova.compute.manager [None req-a7c791a4-3686-4d8a-9f26-168c60a882e9 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] Attaching volume 93473e32-041a-42cb-b0ba-5bae7136e44f to /dev/vdb
Nov 29 16:41:23 user nova-compute[75245]: DEBUG os_brick.utils [None req-a7c791a4-3686-4d8a-9f26-168c60a882e9 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:41:23 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:41:23 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:41:23 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[09128c92-1b4a-489d-91ee-0da2b73b8071]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:69ed8ed87091\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:41:23 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:41:23 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:41:23 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba323352-2052-48a4-9715-58af947e6194]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:41:23 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:41:23 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:41:23 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ed74ed-9c02-4484-a976-5246ae424470]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:41:23 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7f6f9b-d715-425a-a50a-8b1922b40d6d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:41:23 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-a7c791a4-3686-4d8a-9f26-168c60a882e9 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Running cmd (subprocess): nvme version {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:41:23 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-a7c791a4-3686-4d8a-9f26-168c60a882e9 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] 'nvme version' failed. Not Retrying. {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:41:23 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a7c791a4-3686-4d8a-9f26-168c60a882e9 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] nvme not present on system {{(pid=75245) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 16:41:23 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:41:23 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:41:23 user nova-compute[75245]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 16:41:23 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e87912-fd45-44f0-9c9a-76af18e7ad36]: (4, '') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:41:23 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-a7c791a4-3686-4d8a-9f26-168c60a882e9 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75245) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 16:41:23 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-a7c791a4-3686-4d8a-9f26-168c60a882e9 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 16:41:23 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-a7c791a4-3686-4d8a-9f26-168c60a882e9 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] LIGHTOS: no hostnqn found. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 16:41:23 user nova-compute[75245]: DEBUG os_brick.utils [None req-a7c791a4-3686-4d8a-9f26-168c60a882e9 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:69ed8ed87091', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:41:23 user nova-compute[75245]: DEBUG nova.virt.block_device [None req-a7c791a4-3686-4d8a-9f26-168c60a882e9 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] Updating existing volume attachment record: 9bfed8b6-ac0e-46ca-af2b-7dad88068bfc {{(pid=75245) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 16:41:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:41:24 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:41:24 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:41:25 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Acquiring lock "c9ad13aa-7c21-4701-88e6-6265c7d19d7b" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:41:25 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lock "c9ad13aa-7c21-4701-88e6-6265c7d19d7b" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:41:25 user nova-compute[75245]: INFO nova.compute.manager [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Rebooting instance
Nov 29 16:41:25 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Acquiring lock "refresh_cache-c9ad13aa-7c21-4701-88e6-6265c7d19d7b" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:41:25 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Acquired lock "refresh_cache-c9ad13aa-7c21-4701-88e6-6265c7d19d7b" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:41:25 user nova-compute[75245]: DEBUG nova.network.neutron [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 16:41:26 user nova-compute[75245]: DEBUG nova.network.neutron [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Updating instance_info_cache with network_info: [{"id": "2844f77d-297d-4177-974c-22a1cab3590c", "address": "fa:16:3e:f4:3a:98", "network": {"id": "b0e81786-47f3-4a13-90c7-788cb53a4df5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1382922826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebd1ea36980641739f2bdd856a65d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2844f77d-29", "ovs_interfaceid": "2844f77d-297d-4177-974c-22a1cab3590c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:41:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Releasing lock "refresh_cache-c9ad13aa-7c21-4701-88e6-6265c7d19d7b" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:41:26 user nova-compute[75245]: DEBUG nova.compute.manager [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:41:26 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:41:26 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:41:26 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:41:26 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:41:26 user nova-compute[75245]: DEBUG nova.compute.manager [req-c57cf7fa-c9d5-40e8-8d14-7c7daa873e92 req-c6b07d4f-47ff-4e1d-b811-7073eed9ef79 service nova] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Received event network-vif-unplugged-2844f77d-297d-4177-974c-22a1cab3590c {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:41:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-c57cf7fa-c9d5-40e8-8d14-7c7daa873e92 req-c6b07d4f-47ff-4e1d-b811-7073eed9ef79 service nova] Acquiring lock "c9ad13aa-7c21-4701-88e6-6265c7d19d7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:41:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-c57cf7fa-c9d5-40e8-8d14-7c7daa873e92 req-c6b07d4f-47ff-4e1d-b811-7073eed9ef79 service nova] Lock "c9ad13aa-7c21-4701-88e6-6265c7d19d7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:41:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-c57cf7fa-c9d5-40e8-8d14-7c7daa873e92 req-c6b07d4f-47ff-4e1d-b811-7073eed9ef79 service nova] Lock "c9ad13aa-7c21-4701-88e6-6265c7d19d7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:41:26 user nova-compute[75245]: DEBUG nova.compute.manager [req-c57cf7fa-c9d5-40e8-8d14-7c7daa873e92 req-c6b07d4f-47ff-4e1d-b811-7073eed9ef79 service nova] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] No waiting events found dispatching network-vif-unplugged-2844f77d-297d-4177-974c-22a1cab3590c {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:41:26 user nova-compute[75245]: WARNING nova.compute.manager [req-c57cf7fa-c9d5-40e8-8d14-7c7daa873e92 req-c6b07d4f-47ff-4e1d-b811-7073eed9ef79 service nova] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Received unexpected event network-vif-unplugged-2844f77d-297d-4177-974c-22a1cab3590c for instance with vm_state active and task_state reboot_started_hard.
Nov 29 16:41:26 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:41:26 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:41:26 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:41:26 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Instance destroyed successfully.
Nov 29 16:41:26 user nova-compute[75245]: DEBUG nova.objects.instance [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lazy-loading 'resources' on Instance uuid c9ad13aa-7c21-4701-88e6-6265c7d19d7b {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:41:26 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:39:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1892014678',display_name='tempest-TestMinimumBasicScenario-server-1892014678',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1892014678',id=33,image_ref='0fe99299-5682-40ee-b061-9396244f4f30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/fn3VZnaXRp52GgsG0rY0i3RksU9OcRdAeWoRVNMPmpdzBDa1b7iLg4ZNEWFhggmujXFSjcNRV3ybIUYpdHxIBtavYnjhjPvvDSYwscCv4nOgu/eQT6tBitfqYb6Z97A==',key_name='tempest-TestMinimumBasicScenario-1472502262',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:39:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ebd1ea36980641739f2bdd856a65d68a',ramdisk_id='',reservation_id='r-8fk12xb9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0fe99299-5682-40ee-b061-9396244f4f30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1366540792',owner_user_name='tempest-TestMinimumBasicScenario-1366540792-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:41:26Z,user_data=None,user_id='a219fd71b6cc40d88b161ba5ba82f4a7',uuid=c9ad13aa-7c21-4701-88e6-6265c7d19d7b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2844f77d-297d-4177-974c-22a1cab3590c", "address": "fa:16:3e:f4:3a:98", "network": {"id": "b0e81786-47f3-4a13-90c7-788cb53a4df5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1382922826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebd1ea36980641739f2bdd856a65d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2844f77d-29", "ovs_interfaceid": "2844f77d-297d-4177-974c-22a1cab3590c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 16:41:26 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Converting VIF {"id": "2844f77d-297d-4177-974c-22a1cab3590c", "address": "fa:16:3e:f4:3a:98", "network": {"id": "b0e81786-47f3-4a13-90c7-788cb53a4df5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1382922826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebd1ea36980641739f2bdd856a65d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2844f77d-29", "ovs_interfaceid": "2844f77d-297d-4177-974c-22a1cab3590c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:41:26 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:3a:98,bridge_name='br-int',has_traffic_filtering=True,id=2844f77d-297d-4177-974c-22a1cab3590c,network=Network(b0e81786-47f3-4a13-90c7-788cb53a4df5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2844f77d-29') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:41:26 user nova-compute[75245]: DEBUG os_vif [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:3a:98,bridge_name='br-int',has_traffic_filtering=True,id=2844f77d-297d-4177-974c-22a1cab3590c,network=Network(b0e81786-47f3-4a13-90c7-788cb53a4df5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2844f77d-29') {{(pid=75245) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 16:41:26 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:41:26 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2844f77d-29, bridge=br-int, if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:41:26 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:41:26 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:41:26 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:41:26 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4641e079-4550-4078-a996-f46da6ebabbd) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:41:26 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:41:27 user nova-compute[75245]: INFO os_vif [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:3a:98,bridge_name='br-int',has_traffic_filtering=True,id=2844f77d-297d-4177-974c-22a1cab3590c,network=Network(b0e81786-47f3-4a13-90c7-788cb53a4df5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2844f77d-29')
Nov 29 16:41:27 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] calling os-brick to detach iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, {'target_iqn': 'iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yHixFYrN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:41:27 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:41:27 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[35fa069b-3525-4791-999f-efb31f64809c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 16:41:27 user nova-compute[75245]: No targets found.
Nov 29 16:41:27 user nova-compute[75245]: iSNS:
Nov 29 16:41:27 user nova-compute[75245]: No targets found.
Nov 29 16:41:27 user nova-compute[75245]: STATIC:
Nov 29 16:41:27 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d
Nov 29 16:41:27 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:41:27 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:41:27 user nova-compute[75245]: FIRMWARE:
Nov 29 16:41:27 user nova-compute[75245]: No targets found.
Nov 29 16:41:27 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 16:41:27 user nova-compute[75245]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 16:41:27 user nova-compute[75245]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75245) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d', 0)] {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[b344cc04-bb9c-4857-9c1c-55c80fb0d4f1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75f92b6-e6b4-4792-975f-ec08d20d1e39]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d (non-flash)
Nov 29 16:41:27 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d (non-flash)
Nov 29 16:41:27 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0d44186a70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d'): ({'sdb'}, set())}) {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Removing single pathed devices sdb {{(pid=75245) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0173e9-b94b-4b26-9998-18cad07e25af]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[456bcdb6-edf0-4ffd-94cb-0262ff89d845]: (4, ('ok\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Flushing IO for device /dev/sdb {{(pid=75245) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb75086-9f02-498e-b258-4090b047d38a]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75245) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc92cbb-403d-49c3-9937-ad0785e51c6f]: (4, ('1', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] SCSI volumes sdb have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d')] {{(pid=75245) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[95be87a9-e764-443e-9b54-51755431fdac]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d -p 172.16.0.220:3260 --logout {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[0448986b-42c0-49b7-8543-2d5eda3049c0]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d, portal: 172.16.0.220,3260]
Nov 29 16:41:27 user nova-compute[75245]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d, portal: 172.16.0.220,3260] successful.
Nov 29 16:41:27 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d -p 172.16.0.220:3260 --op delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[934989dd-0de7-4870-bc6c-465e49c3e4e0]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] <== disconnect_volume: return (292ms) None {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Disconnected iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Start _get_guest_xml network_info=[{"id": "2844f77d-297d-4177-974c-22a1cab3590c", "address": "fa:16:3e:f4:3a:98", "network": {"id": "b0e81786-47f3-4a13-90c7-788cb53a4df5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1382922826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebd1ea36980641739f2bdd856a65d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2844f77d-29", "ovs_interfaceid": "2844f77d-297d-4177-974c-22a1cab3590c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=0fe99299-5682-40ee-b061-9396244f4f30,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '0fe99299-5682-40ee-b061-9396244f4f30'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'attachment_id': 'eaaadc4b-b037-4b4e-8fda-f97633b5bc73', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yHixFYrN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'c9ad13aa-7c21-4701-88e6-6265c7d19d7b', 'attached_at': '', 'detached_at': '', 'volume_id': '3e40860c-63ee-4df7-87e1-d9e8219f694d', 'serial': '3e40860c-63ee-4df7-87e1-d9e8219f694d'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'guest_format': None, 'volume_type': None} {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 16:41:27 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:41:27 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:41:27 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] CPU controller missing on host. {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] CPU controller found on host. {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75245) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T16:06:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=0fe99299-5682-40ee-b061-9396244f4f30,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Flavor limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Image limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Flavor pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Image pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Got 1 possible topologies {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG nova.objects.instance [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lazy-loading 'vcpu_model' on Instance uuid c9ad13aa-7c21-4701-88e6-6265c7d19d7b {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG nova.objects.base [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Object Instance<c9ad13aa-7c21-4701-88e6-6265c7d19d7b> lazy-loaded attributes: resources,vcpu_model {{(pid=75245) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Calling os-brick to attach iSCSI Volume {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yHixFYrN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:41:27 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:41:27 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:41:27 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:41:27 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:41:27 user nova-compute[75245]: INFO os_brick.initiator.connectors.iscsi [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 16:41:27 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d -p 172.16.0.220:3260 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1472fb-76f4-4ea4-aa66-261cca2b8b3f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 16:41:27 user nova-compute[75245]:  {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d -p 172.16.0.220:3260 --interface default --op new {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c6e73e6-d868-4f68-b407-1252fb489789]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d] added\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d] added
Nov 29 16:41:27 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd9c165-dfe1-4f55-a06d-8f871eeca04d]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd16701-2a1f-404f-b6a1-310e84714767]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yHixFYrN {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yHixFYrN" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb58ed4e-471d-4b3f-9710-6d72f1a9e442]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yHixFYrN'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[92051cbc-63f2-4e98-b0b2-acbc8e4b2adb]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7783621-ba3f-40a9-9943-9d09c5de7ca4]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 16:41:27 user nova-compute[75245]:  {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 16:41:27 user nova-compute[75245]:  {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:41:27 user nova-compute[75245]: WARNING os_brick.initiator.connectors.iscsi [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 16:41:27 user nova-compute[75245]: 
Nov 29 16:41:27 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d -p 172.16.0.220:3260 --login {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d -p 172.16.0.220:3260 --login" returned: 0 in 0.172s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[19aa8012-93e2-4523-bde6-f34b1b183160]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d, portal: 172.16.0.220,3260]
Nov 29 16:41:27 user nova-compute[75245]: Login to [iface: default, target: iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d, portal: 172.16.0.220,3260] successful.
Nov 29 16:41:27 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a1f9643-5d9a-47bf-a05f-a551db83aefb]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[59bfdc12-f3d0-408c-bb68-5d4b11bd0cbd]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d (non-flash)
Nov 29 16:41:27 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d (non-flash)
Nov 29 16:41:27 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.400s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Connected to 172.16.0.220:3260 {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] HCTL ('33', '-', '-', 0) found on session 42 with lun 0 {{(pid=75245) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75245) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[b791889d-4730-474a-b3bb-bf8e44b832c4]: (4, ('- - 0', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75245) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 16:41:27 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yHixFYrN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 16:41:28 user nova-compute[75245]: DEBUG nova.compute.manager [req-0d33bd63-9888-42a7-a25a-68b0d636eb4b req-8d2541ee-de59-43a1-beaf-cf0b3606ea24 service nova] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Received event network-vif-plugged-2844f77d-297d-4177-974c-22a1cab3590c {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:41:28 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-0d33bd63-9888-42a7-a25a-68b0d636eb4b req-8d2541ee-de59-43a1-beaf-cf0b3606ea24 service nova] Acquiring lock "c9ad13aa-7c21-4701-88e6-6265c7d19d7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:41:28 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-0d33bd63-9888-42a7-a25a-68b0d636eb4b req-8d2541ee-de59-43a1-beaf-cf0b3606ea24 service nova] Lock "c9ad13aa-7c21-4701-88e6-6265c7d19d7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:41:28 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-0d33bd63-9888-42a7-a25a-68b0d636eb4b req-8d2541ee-de59-43a1-beaf-cf0b3606ea24 service nova] Lock "c9ad13aa-7c21-4701-88e6-6265c7d19d7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:41:28 user nova-compute[75245]: DEBUG nova.compute.manager [req-0d33bd63-9888-42a7-a25a-68b0d636eb4b req-8d2541ee-de59-43a1-beaf-cf0b3606ea24 service nova] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] No waiting events found dispatching network-vif-plugged-2844f77d-297d-4177-974c-22a1cab3590c {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:41:28 user nova-compute[75245]: WARNING nova.compute.manager [req-0d33bd63-9888-42a7-a25a-68b0d636eb4b req-8d2541ee-de59-43a1-beaf-cf0b3606ea24 service nova] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Received unexpected event network-vif-plugged-2844f77d-297d-4177-974c-22a1cab3590c for instance with vm_state active and task_state reboot_started_hard.
Nov 29 16:41:28 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.434s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:41:28 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] <== connect_volume: return (1436ms) {'type': 'block', 'scsi_wwn': '23134373333323634', 'path': '/dev/sdb'} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:41:28 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23134373333323634', 'path': '/dev/sdb'} {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 16:41:28 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:39:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1892014678',display_name='tempest-TestMinimumBasicScenario-server-1892014678',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1892014678',id=33,image_ref='0fe99299-5682-40ee-b061-9396244f4f30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/fn3VZnaXRp52GgsG0rY0i3RksU9OcRdAeWoRVNMPmpdzBDa1b7iLg4ZNEWFhggmujXFSjcNRV3ybIUYpdHxIBtavYnjhjPvvDSYwscCv4nOgu/eQT6tBitfqYb6Z97A==',key_name='tempest-TestMinimumBasicScenario-1472502262',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:39:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ebd1ea36980641739f2bdd856a65d68a',ramdisk_id='',reservation_id='r-8fk12xb9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0fe99299-5682-40ee-b061-9396244f4f30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1366540792',owner_user_name='tempest-TestMinimumBasicScenario-1366540792-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:41:26Z,user_data=None,user_id='a219fd71b6cc40d88b161ba5ba82f4a7',uuid=c9ad13aa-7c21-4701-88e6-6265c7d19d7b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2844f77d-297d-4177-974c-22a1cab3590c", "address": "fa:16:3e:f4:3a:98", "network": {"id": "b0e81786-47f3-4a13-90c7-788cb53a4df5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1382922826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebd1ea36980641739f2bdd856a65d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2844f77d-29", "ovs_interfaceid": "2844f77d-297d-4177-974c-22a1cab3590c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:41:28 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Converting VIF {"id": "2844f77d-297d-4177-974c-22a1cab3590c", "address": "fa:16:3e:f4:3a:98", "network": {"id": "b0e81786-47f3-4a13-90c7-788cb53a4df5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1382922826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebd1ea36980641739f2bdd856a65d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2844f77d-29", "ovs_interfaceid": "2844f77d-297d-4177-974c-22a1cab3590c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:41:28 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:3a:98,bridge_name='br-int',has_traffic_filtering=True,id=2844f77d-297d-4177-974c-22a1cab3590c,network=Network(b0e81786-47f3-4a13-90c7-788cb53a4df5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2844f77d-29') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:41:28 user nova-compute[75245]: DEBUG nova.objects.instance [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lazy-loading 'pci_devices' on Instance uuid c9ad13aa-7c21-4701-88e6-6265c7d19d7b {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:41:28 user nova-compute[75245]: DEBUG nova.objects.base [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Object Instance<c9ad13aa-7c21-4701-88e6-6265c7d19d7b> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75245) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 16:41:28 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] End _get_guest_xml xml=<domain type="kvm">
Nov 29 16:41:28 user nova-compute[75245]:   <uuid>c9ad13aa-7c21-4701-88e6-6265c7d19d7b</uuid>
Nov 29 16:41:28 user nova-compute[75245]:   <name>instance-00000021</name>
Nov 29 16:41:28 user nova-compute[75245]:   <memory>524288</memory>
Nov 29 16:41:28 user nova-compute[75245]:   <vcpu>1</vcpu>
Nov 29 16:41:28 user nova-compute[75245]:   <metadata>
Nov 29 16:41:28 user nova-compute[75245]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 16:41:28 user nova-compute[75245]:       <nova:package version="0.0.0"/>
Nov 29 16:41:28 user nova-compute[75245]:       <nova:name>tempest-TestMinimumBasicScenario-server-1892014678</nova:name>
Nov 29 16:41:28 user nova-compute[75245]:       <nova:creationTime>2023-11-29 16:41:27</nova:creationTime>
Nov 29 16:41:28 user nova-compute[75245]:       <nova:flavor name="m1.tiny">
Nov 29 16:41:28 user nova-compute[75245]:         <nova:memory>512</nova:memory>
Nov 29 16:41:28 user nova-compute[75245]:         <nova:disk>1</nova:disk>
Nov 29 16:41:28 user nova-compute[75245]:         <nova:swap>0</nova:swap>
Nov 29 16:41:28 user nova-compute[75245]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 16:41:28 user nova-compute[75245]:         <nova:vcpus>1</nova:vcpus>
Nov 29 16:41:28 user nova-compute[75245]:       </nova:flavor>
Nov 29 16:41:28 user nova-compute[75245]:       <nova:owner>
Nov 29 16:41:28 user nova-compute[75245]:         <nova:user uuid="a219fd71b6cc40d88b161ba5ba82f4a7">tempest-TestMinimumBasicScenario-1366540792-project-member</nova:user>
Nov 29 16:41:28 user nova-compute[75245]:         <nova:project uuid="ebd1ea36980641739f2bdd856a65d68a">tempest-TestMinimumBasicScenario-1366540792</nova:project>
Nov 29 16:41:28 user nova-compute[75245]:       </nova:owner>
Nov 29 16:41:28 user nova-compute[75245]:       <nova:root type="image" uuid="0fe99299-5682-40ee-b061-9396244f4f30"/>
Nov 29 16:41:28 user nova-compute[75245]:       <nova:ports>
Nov 29 16:41:28 user nova-compute[75245]:         <nova:port uuid="2844f77d-297d-4177-974c-22a1cab3590c">
Nov 29 16:41:28 user nova-compute[75245]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 29 16:41:28 user nova-compute[75245]:         </nova:port>
Nov 29 16:41:28 user nova-compute[75245]:       </nova:ports>
Nov 29 16:41:28 user nova-compute[75245]:     </nova:instance>
Nov 29 16:41:28 user nova-compute[75245]:   </metadata>
Nov 29 16:41:28 user nova-compute[75245]:   <sysinfo type="smbios">
Nov 29 16:41:28 user nova-compute[75245]:     <system>
Nov 29 16:41:28 user nova-compute[75245]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 16:41:28 user nova-compute[75245]:       <entry name="product">OpenStack Nova</entry>
Nov 29 16:41:28 user nova-compute[75245]:       <entry name="version">0.0.0</entry>
Nov 29 16:41:28 user nova-compute[75245]:       <entry name="serial">c9ad13aa-7c21-4701-88e6-6265c7d19d7b</entry>
Nov 29 16:41:28 user nova-compute[75245]:       <entry name="uuid">c9ad13aa-7c21-4701-88e6-6265c7d19d7b</entry>
Nov 29 16:41:28 user nova-compute[75245]:       <entry name="family">Virtual Machine</entry>
Nov 29 16:41:28 user nova-compute[75245]:     </system>
Nov 29 16:41:28 user nova-compute[75245]:   </sysinfo>
Nov 29 16:41:28 user nova-compute[75245]:   <os>
Nov 29 16:41:28 user nova-compute[75245]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 16:41:28 user nova-compute[75245]:     <boot dev="hd"/>
Nov 29 16:41:28 user nova-compute[75245]:     <smbios mode="sysinfo"/>
Nov 29 16:41:28 user nova-compute[75245]:   </os>
Nov 29 16:41:28 user nova-compute[75245]:   <features>
Nov 29 16:41:28 user nova-compute[75245]:     <acpi/>
Nov 29 16:41:28 user nova-compute[75245]:     <apic/>
Nov 29 16:41:28 user nova-compute[75245]:     <vmcoreinfo/>
Nov 29 16:41:28 user nova-compute[75245]:   </features>
Nov 29 16:41:28 user nova-compute[75245]:   <clock offset="utc">
Nov 29 16:41:28 user nova-compute[75245]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 16:41:28 user nova-compute[75245]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 16:41:28 user nova-compute[75245]:     <timer name="hpet" present="no"/>
Nov 29 16:41:28 user nova-compute[75245]:   </clock>
Nov 29 16:41:28 user nova-compute[75245]:   <cpu mode="custom" match="exact">
Nov 29 16:41:28 user nova-compute[75245]:     <model>Nehalem</model>
Nov 29 16:41:28 user nova-compute[75245]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 16:41:28 user nova-compute[75245]:   </cpu>
Nov 29 16:41:28 user nova-compute[75245]:   <devices>
Nov 29 16:41:28 user nova-compute[75245]:     <disk type="file" device="disk">
Nov 29 16:41:28 user nova-compute[75245]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 16:41:28 user nova-compute[75245]:       <source file="/opt/stack/data/nova/instances/c9ad13aa-7c21-4701-88e6-6265c7d19d7b/disk"/>
Nov 29 16:41:28 user nova-compute[75245]:       <target dev="vda" bus="virtio"/>
Nov 29 16:41:28 user nova-compute[75245]:     </disk>
Nov 29 16:41:28 user nova-compute[75245]:     <disk type="block" device="disk">
Nov 29 16:41:28 user nova-compute[75245]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:41:28 user nova-compute[75245]:       <source dev="/dev/sdb"/>
Nov 29 16:41:28 user nova-compute[75245]:       <target dev="vdb" bus="virtio"/>
Nov 29 16:41:28 user nova-compute[75245]:       <serial>3e40860c-63ee-4df7-87e1-d9e8219f694d</serial>
Nov 29 16:41:28 user nova-compute[75245]:     </disk>
Nov 29 16:41:28 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 16:41:28 user nova-compute[75245]:       <mac address="fa:16:3e:f4:3a:98"/>
Nov 29 16:41:28 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:41:28 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 16:41:28 user nova-compute[75245]:       <target dev="tap2844f77d-29"/>
Nov 29 16:41:28 user nova-compute[75245]:     </interface>
Nov 29 16:41:28 user nova-compute[75245]:     <serial type="pty">
Nov 29 16:41:28 user nova-compute[75245]:       <log file="/opt/stack/data/nova/instances/c9ad13aa-7c21-4701-88e6-6265c7d19d7b/console.log" append="off"/>
Nov 29 16:41:28 user nova-compute[75245]:     </serial>
Nov 29 16:41:28 user nova-compute[75245]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 16:41:28 user nova-compute[75245]:     <video>
Nov 29 16:41:28 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:41:28 user nova-compute[75245]:     </video>
Nov 29 16:41:28 user nova-compute[75245]:     <rng model="virtio">
Nov 29 16:41:28 user nova-compute[75245]:       <backend model="random">/dev/urandom</backend>
Nov 29 16:41:28 user nova-compute[75245]:     </rng>
Nov 29 16:41:28 user nova-compute[75245]:     <controller type="usb" index="0" model="none"/>
Nov 29 16:41:28 user nova-compute[75245]:     <memballoon model="virtio">
Nov 29 16:41:28 user nova-compute[75245]:       <stats period="10"/>
Nov 29 16:41:28 user nova-compute[75245]:     </memballoon>
Nov 29 16:41:28 user nova-compute[75245]:   </devices>
Nov 29 16:41:28 user nova-compute[75245]: </domain>
Nov 29 16:41:28 user nova-compute[75245]:  {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 16:41:28 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ad13aa-7c21-4701-88e6-6265c7d19d7b/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:41:29 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:41:29 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ad13aa-7c21-4701-88e6-6265c7d19d7b/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:41:29 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ad13aa-7c21-4701-88e6-6265c7d19d7b/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:41:29 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ad13aa-7c21-4701-88e6-6265c7d19d7b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:41:29 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:41:29 user nova-compute[75245]: DEBUG nova.objects.instance [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lazy-loading 'trusted_certs' on Instance uuid c9ad13aa-7c21-4701-88e6-6265c7d19d7b {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:41:29 user nova-compute[75245]: DEBUG nova.objects.base [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Object Instance<c9ad13aa-7c21-4701-88e6-6265c7d19d7b> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75245) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 16:41:29 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/42a3184f5fc6a39f11cded1b67adfb5500d7aeb5 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:41:29 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/42a3184f5fc6a39f11cded1b67adfb5500d7aeb5 --force-share --output=json" returned: 0 in 0.179s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:41:29 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c9ad13aa-7c21-4701-88e6-6265c7d19d7b/disk. size=1073741824 {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 16:41:29 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ad13aa-7c21-4701-88e6-6265c7d19d7b/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:41:29 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ad13aa-7c21-4701-88e6-6265c7d19d7b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:41:29 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Cannot resize image /opt/stack/data/nova/instances/c9ad13aa-7c21-4701-88e6-6265c7d19d7b/disk to a smaller size. {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 16:41:29 user nova-compute[75245]: DEBUG nova.objects.instance [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lazy-loading 'migration_context' on Instance uuid c9ad13aa-7c21-4701-88e6-6265c7d19d7b {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:41:29 user nova-compute[75245]: DEBUG nova.objects.base [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Object Instance<c9ad13aa-7c21-4701-88e6-6265c7d19d7b> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75245) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 16:41:29 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:39:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1892014678',display_name='tempest-TestMinimumBasicScenario-server-1892014678',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1892014678',id=33,image_ref='0fe99299-5682-40ee-b061-9396244f4f30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/fn3VZnaXRp52GgsG0rY0i3RksU9OcRdAeWoRVNMPmpdzBDa1b7iLg4ZNEWFhggmujXFSjcNRV3ybIUYpdHxIBtavYnjhjPvvDSYwscCv4nOgu/eQT6tBitfqYb6Z97A==',key_name='tempest-TestMinimumBasicScenario-1472502262',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:39:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='ebd1ea36980641739f2bdd856a65d68a',ramdisk_id='',reservation_id='r-8fk12xb9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0fe99299-5682-40ee-b061-9396244f4f30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1366540792',owner_user_name='tempest-TestMinimumBasicScenario-1366540792-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:41:26Z,user_data=None,user_id='a219fd71b6cc40d88b161ba5ba82f4a7',uuid=c9ad13aa-7c21-4701-88e6-6265c7d19d7b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2844f77d-297d-4177-974c-22a1cab3590c", "address": "fa:16:3e:f4:3a:98", "network": {"id": "b0e81786-47f3-4a13-90c7-788cb53a4df5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1382922826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebd1ea36980641739f2bdd856a65d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2844f77d-29", "ovs_interfaceid": "2844f77d-297d-4177-974c-22a1cab3590c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 16:41:29 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Converting VIF {"id": "2844f77d-297d-4177-974c-22a1cab3590c", "address": "fa:16:3e:f4:3a:98", "network": {"id": "b0e81786-47f3-4a13-90c7-788cb53a4df5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1382922826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebd1ea36980641739f2bdd856a65d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2844f77d-29", "ovs_interfaceid": "2844f77d-297d-4177-974c-22a1cab3590c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:41:29 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:3a:98,bridge_name='br-int',has_traffic_filtering=True,id=2844f77d-297d-4177-974c-22a1cab3590c,network=Network(b0e81786-47f3-4a13-90c7-788cb53a4df5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2844f77d-29') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:41:29 user nova-compute[75245]: DEBUG os_vif [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:3a:98,bridge_name='br-int',has_traffic_filtering=True,id=2844f77d-297d-4177-974c-22a1cab3590c,network=Network(b0e81786-47f3-4a13-90c7-788cb53a4df5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2844f77d-29') {{(pid=75245) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 16:41:29 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:41:29 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:41:29 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 16:41:29 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:41:29 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0fb5b399-542a-5bdd-a10e-a0e2dd3753a8', '_type': 'linux-noop'}}, row=False) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:41:29 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:41:29 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:41:29 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2844f77d-29, may_exist=True, interface_attrs={}) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:41:29 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2844f77d-29, col_values=(('qos', UUID('6bed1fe4-3c3b-4a1b-a99a-24e0581a0169')),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:41:29 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2844f77d-29, col_values=(('external_ids', {'iface-id': '2844f77d-297d-4177-974c-22a1cab3590c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:3a:98', 'vm-uuid': 'c9ad13aa-7c21-4701-88e6-6265c7d19d7b'}),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:41:29 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:41:29 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:41:29 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:41:29 user nova-compute[75245]: INFO os_vif [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:3a:98,bridge_name='br-int',has_traffic_filtering=True,id=2844f77d-297d-4177-974c-22a1cab3590c,network=Network(b0e81786-47f3-4a13-90c7-788cb53a4df5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2844f77d-29')
Nov 29 16:41:31 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:41:31 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:41:31 user nova-compute[75245]: DEBUG nova.compute.manager [req-8dbd4e58-3b87-4043-96d2-2aea44b37167 req-cfebcfc9-77f1-46ac-b54c-975a1326fcdc service nova] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Received event network-vif-plugged-2844f77d-297d-4177-974c-22a1cab3590c {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:41:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-8dbd4e58-3b87-4043-96d2-2aea44b37167 req-cfebcfc9-77f1-46ac-b54c-975a1326fcdc service nova] Acquiring lock "c9ad13aa-7c21-4701-88e6-6265c7d19d7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:41:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-8dbd4e58-3b87-4043-96d2-2aea44b37167 req-cfebcfc9-77f1-46ac-b54c-975a1326fcdc service nova] Lock "c9ad13aa-7c21-4701-88e6-6265c7d19d7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:41:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-8dbd4e58-3b87-4043-96d2-2aea44b37167 req-cfebcfc9-77f1-46ac-b54c-975a1326fcdc service nova] Lock "c9ad13aa-7c21-4701-88e6-6265c7d19d7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:41:31 user nova-compute[75245]: DEBUG nova.compute.manager [req-8dbd4e58-3b87-4043-96d2-2aea44b37167 req-cfebcfc9-77f1-46ac-b54c-975a1326fcdc service nova] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] No waiting events found dispatching network-vif-plugged-2844f77d-297d-4177-974c-22a1cab3590c {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:41:31 user nova-compute[75245]: WARNING nova.compute.manager [req-8dbd4e58-3b87-4043-96d2-2aea44b37167 req-cfebcfc9-77f1-46ac-b54c-975a1326fcdc service nova] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Received unexpected event network-vif-plugged-2844f77d-297d-4177-974c-22a1cab3590c for instance with vm_state active and task_state reboot_started_hard.
Nov 29 16:41:31 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:41:31 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:41:31 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:41:31 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:41:31 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:41:33 user nova-compute[75245]: DEBUG nova.compute.manager [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Instance event wait completed in 0 seconds for  {{(pid=75245) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 16:41:33 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Instance rebooted successfully.
Nov 29 16:41:33 user nova-compute[75245]: DEBUG nova.compute.manager [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:41:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-5f90156a-d598-47fb-819a-6843fc195324 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lock "c9ad13aa-7c21-4701-88e6-6265c7d19d7b" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.833s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:41:33 user nova-compute[75245]: DEBUG nova.compute.manager [req-84b40b56-b5ab-4fa0-8c0a-10e0c3a96a28 req-adbd1d61-5087-4d6a-8e83-ca9b1bc90fef service nova] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Received event network-vif-plugged-2844f77d-297d-4177-974c-22a1cab3590c {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:41:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-84b40b56-b5ab-4fa0-8c0a-10e0c3a96a28 req-adbd1d61-5087-4d6a-8e83-ca9b1bc90fef service nova] Acquiring lock "c9ad13aa-7c21-4701-88e6-6265c7d19d7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:41:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-84b40b56-b5ab-4fa0-8c0a-10e0c3a96a28 req-adbd1d61-5087-4d6a-8e83-ca9b1bc90fef service nova] Lock "c9ad13aa-7c21-4701-88e6-6265c7d19d7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:41:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-84b40b56-b5ab-4fa0-8c0a-10e0c3a96a28 req-adbd1d61-5087-4d6a-8e83-ca9b1bc90fef service nova] Lock "c9ad13aa-7c21-4701-88e6-6265c7d19d7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:41:33 user nova-compute[75245]: DEBUG nova.compute.manager [req-84b40b56-b5ab-4fa0-8c0a-10e0c3a96a28 req-adbd1d61-5087-4d6a-8e83-ca9b1bc90fef service nova] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] No waiting events found dispatching network-vif-plugged-2844f77d-297d-4177-974c-22a1cab3590c {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:41:33 user nova-compute[75245]: WARNING nova.compute.manager [req-84b40b56-b5ab-4fa0-8c0a-10e0c3a96a28 req-adbd1d61-5087-4d6a-8e83-ca9b1bc90fef service nova] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Received unexpected event network-vif-plugged-2844f77d-297d-4177-974c-22a1cab3590c for instance with vm_state active and task_state None.
Nov 29 16:41:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:41:34 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7c791a4-3686-4d8a-9f26-168c60a882e9 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] Calling os-brick to attach iSCSI Volume {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 16:41:34 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7c791a4-3686-4d8a-9f26-168c60a882e9 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:93473e32-041a-42cb-b0ba-5bae7136e44f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QOVbntIL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:41:34 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-a7c791a4-3686-4d8a-9f26-168c60a882e9 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:41:34 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-a7c791a4-3686-4d8a-9f26-168c60a882e9 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:41:34 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-a7c791a4-3686-4d8a-9f26-168c60a882e9 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:41:34 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-a7c791a4-3686-4d8a-9f26-168c60a882e9 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:41:34 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-a7c791a4-3686-4d8a-9f26-168c60a882e9 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93473e32-041a-42cb-b0ba-5bae7136e44f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:41:34 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-a7c791a4-3686-4d8a-9f26-168c60a882e9 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93473e32-041a-42cb-b0ba-5bae7136e44f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:41:34 user nova-compute[75245]: INFO os_brick.initiator.connectors.iscsi [None req-a7c791a4-3686-4d8a-9f26-168c60a882e9 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 16:41:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93473e32-041a-42cb-b0ba-5bae7136e44f -p 172.16.0.220:3260 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:41:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93473e32-041a-42cb-b0ba-5bae7136e44f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:41:34 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[217ad261-8ad3-43d4-8381-8984f25b633e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:41:34 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7c791a4-3686-4d8a-9f26-168c60a882e9 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 16:41:34 user nova-compute[75245]:  {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:41:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93473e32-041a-42cb-b0ba-5bae7136e44f -p 172.16.0.220:3260 --interface default --op new {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:41:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93473e32-041a-42cb-b0ba-5bae7136e44f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:41:34 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[3564c8f4-80cb-4471-aed1-de337ff8b2cf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:93473e32-041a-42cb-b0ba-5bae7136e44f] added\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:41:34 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7c791a4-3686-4d8a-9f26-168c60a882e9 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:93473e32-041a-42cb-b0ba-5bae7136e44f] added
Nov 29 16:41:34 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:41:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93473e32-041a-42cb-b0ba-5bae7136e44f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:41:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93473e32-041a-42cb-b0ba-5bae7136e44f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:41:34 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e87da43-e330-422d-ad45-4ecb33966f81]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:41:34 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7c791a4-3686-4d8a-9f26-168c60a882e9 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:41:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93473e32-041a-42cb-b0ba-5bae7136e44f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:41:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93473e32-041a-42cb-b0ba-5bae7136e44f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:41:34 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[df403a6f-469f-4ad7-bb55-c1be5b1d20c6]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:41:34 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7c791a4-3686-4d8a-9f26-168c60a882e9 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:41:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93473e32-041a-42cb-b0ba-5bae7136e44f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QOVbntIL {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:41:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93473e32-041a-42cb-b0ba-5bae7136e44f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QOVbntIL" returned: 0 in 0.034s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:41:34 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[909d1cec-850e-4e45-ae4f-2fa87d4ce190]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:41:34 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7c791a4-3686-4d8a-9f26-168c60a882e9 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QOVbntIL'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:41:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93473e32-041a-42cb-b0ba-5bae7136e44f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:41:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93473e32-041a-42cb-b0ba-5bae7136e44f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:41:34 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[253cdda2-60cf-4c26-ab55-5b34568b3aef]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:41:34 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7c791a4-3686-4d8a-9f26-168c60a882e9 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:41:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:41:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:41:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:41:34 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[54245bfb-e0e6-4ec7-b55c-4356cc357fe7]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:41:34 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7c791a4-3686-4d8a-9f26-168c60a882e9 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d (non-flash)
Nov 29 16:41:34 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:41:34 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7c791a4-3686-4d8a-9f26-168c60a882e9 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d (non-flash)
Nov 29 16:41:34 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:41:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93473e32-041a-42cb-b0ba-5bae7136e44f -p 172.16.0.220:3260 --login {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:41:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93473e32-041a-42cb-b0ba-5bae7136e44f -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:41:34 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f5cbc0a-af04-4fd1-aea1-ec0d0b88dc29]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:93473e32-041a-42cb-b0ba-5bae7136e44f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:93473e32-041a-42cb-b0ba-5bae7136e44f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:41:34 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7c791a4-3686-4d8a-9f26-168c60a882e9 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:93473e32-041a-42cb-b0ba-5bae7136e44f, portal: 172.16.0.220,3260]
Nov 29 16:41:34 user nova-compute[75245]: Login to [iface: default, target: iqn.2010-10.org.openstack:93473e32-041a-42cb-b0ba-5bae7136e44f, portal: 172.16.0.220,3260] successful.
Nov 29 16:41:34 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:41:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93473e32-041a-42cb-b0ba-5bae7136e44f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:41:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93473e32-041a-42cb-b0ba-5bae7136e44f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:41:34 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[05daa563-ac81-4408-85db-62cf179d2f56]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:41:34 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7c791a4-3686-4d8a-9f26-168c60a882e9 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:41:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:41:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:41:34 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30017e6-a1cd-44d6-8642-f7737558ab9d]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93473e32-041a-42cb-b0ba-5bae7136e44f (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:41:34 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7c791a4-3686-4d8a-9f26-168c60a882e9 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d (non-flash)
Nov 29 16:41:34 user nova-compute[75245]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93473e32-041a-42cb-b0ba-5bae7136e44f (non-flash)
Nov 29 16:41:34 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:41:34 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7c791a4-3686-4d8a-9f26-168c60a882e9 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d (non-flash)
Nov 29 16:41:34 user nova-compute[75245]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93473e32-041a-42cb-b0ba-5bae7136e44f (non-flash)
Nov 29 16:41:34 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:41:34 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-a7c791a4-3686-4d8a-9f26-168c60a882e9 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93473e32-041a-42cb-b0ba-5bae7136e44f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:41:34 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7c791a4-3686-4d8a-9f26-168c60a882e9 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Connected to 172.16.0.220:3260 {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 16:41:34 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-a7c791a4-3686-4d8a-9f26-168c60a882e9 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] HCTL ('34', '-', '-', 0) found on session 43 with lun 0 {{(pid=75245) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 16:41:34 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-a7c791a4-3686-4d8a-9f26-168c60a882e9 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75245) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 16:41:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:41:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:41:34 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8813868-d73d-4ef5-8ebb-85d34a1e1f0a]: (4, ('- - 0', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:41:34 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-a7c791a4-3686-4d8a-9f26-168c60a882e9 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Searching for a device in session 43 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75245) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 16:41:34 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7c791a4-3686-4d8a-9f26-168c60a882e9 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:93473e32-041a-42cb-b0ba-5bae7136e44f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QOVbntIL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 16:41:35 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-a7c791a4-3686-4d8a-9f26-168c60a882e9 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:41:35 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7c791a4-3686-4d8a-9f26-168c60a882e9 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '23537666264333234', 'path': '/dev/sdc'} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:41:35 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7c791a4-3686-4d8a-9f26-168c60a882e9 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23537666264333234', 'path': '/dev/sdc'} {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 16:41:35 user nova-compute[75245]: DEBUG nova.objects.instance [None req-a7c791a4-3686-4d8a-9f26-168c60a882e9 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lazy-loading 'flavor' on Instance uuid ba3662d8-598b-4296-a1e8-4dd57b5c7f3d {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:41:35 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-a7c791a4-3686-4d8a-9f26-168c60a882e9 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 16:41:35 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:41:35 user nova-compute[75245]:   <source dev="/dev/sdc"/>
Nov 29 16:41:35 user nova-compute[75245]:   <target dev="vdb" bus="virtio"/>
Nov 29 16:41:35 user nova-compute[75245]:   <serial>93473e32-041a-42cb-b0ba-5bae7136e44f</serial>
Nov 29 16:41:35 user nova-compute[75245]: </disk>
Nov 29 16:41:35 user nova-compute[75245]:  {{(pid=75245) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 16:41:36 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-a7c791a4-3686-4d8a-9f26-168c60a882e9 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:41:36 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-a7c791a4-3686-4d8a-9f26-168c60a882e9 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:41:36 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-a7c791a4-3686-4d8a-9f26-168c60a882e9 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] No VIF found with MAC fa:16:3e:6b:bd:c8, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:41:36 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-a7c791a4-3686-4d8a-9f26-168c60a882e9 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "ba3662d8-598b-4296-a1e8-4dd57b5c7f3d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.933s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:41:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:41:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:41:40 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Acquiring lock "af6b9740-b1c8-499e-83f4-6f3e5898a608" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:41:40 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "af6b9740-b1c8-499e-83f4-6f3e5898a608" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:41:40 user nova-compute[75245]: DEBUG nova.compute.manager [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: af6b9740-b1c8-499e-83f4-6f3e5898a608] Starting instance... {{(pid=75245) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 16:41:40 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:41:40 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:41:40 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75245) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 16:41:40 user nova-compute[75245]: INFO nova.compute.claims [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: af6b9740-b1c8-499e-83f4-6f3e5898a608] Claim successful on node user
Nov 29 16:41:41 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:41:41 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:41:41 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.355s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:41:41 user nova-compute[75245]: DEBUG nova.compute.manager [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: af6b9740-b1c8-499e-83f4-6f3e5898a608] Start building networks asynchronously for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 16:41:41 user nova-compute[75245]: DEBUG nova.compute.manager [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: af6b9740-b1c8-499e-83f4-6f3e5898a608] Allocating IP information in the background. {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 16:41:41 user nova-compute[75245]: DEBUG nova.network.neutron [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: af6b9740-b1c8-499e-83f4-6f3e5898a608] allocate_for_instance() {{(pid=75245) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 16:41:41 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: af6b9740-b1c8-499e-83f4-6f3e5898a608] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 16:41:41 user nova-compute[75245]: DEBUG nova.compute.manager [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: af6b9740-b1c8-499e-83f4-6f3e5898a608] Start building block device mappings for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 16:41:41 user nova-compute[75245]: DEBUG nova.policy [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fb4c94298bf14753bb9530633e766dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e269dbe30d46ccb81d58e2590004db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75245) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 16:41:41 user nova-compute[75245]: DEBUG nova.compute.manager [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: af6b9740-b1c8-499e-83f4-6f3e5898a608] Start spawning the instance on the hypervisor. {{(pid=75245) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 16:41:41 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: af6b9740-b1c8-499e-83f4-6f3e5898a608] Creating instance directory {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 16:41:41 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: af6b9740-b1c8-499e-83f4-6f3e5898a608] Creating image(s)
Nov 29 16:41:41 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Acquiring lock "/opt/stack/data/nova/instances/af6b9740-b1c8-499e-83f4-6f3e5898a608/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:41:41 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "/opt/stack/data/nova/instances/af6b9740-b1c8-499e-83f4-6f3e5898a608/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:41:41 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "/opt/stack/data/nova/instances/af6b9740-b1c8-499e-83f4-6f3e5898a608/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:41:41 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:41:41 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.174s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:41:41 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Acquiring lock "d654f7206043e05d3525550b0fc885556eb999f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:41:41 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:41:41 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:41:41 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.182s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:41:41 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/af6b9740-b1c8-499e-83f4-6f3e5898a608/disk 1073741824 {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:41:41 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/af6b9740-b1c8-499e-83f4-6f3e5898a608/disk 1073741824" returned: 0 in 0.055s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:41:41 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:41:41 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:41:42 user nova-compute[75245]: DEBUG nova.network.neutron [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: af6b9740-b1c8-499e-83f4-6f3e5898a608] Successfully created port: e2a86e77-c012-4252-9d4a-3c27e3b28042 {{(pid=75245) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 16:41:42 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.221s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:41:42 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Checking if we can resize image /opt/stack/data/nova/instances/af6b9740-b1c8-499e-83f4-6f3e5898a608/disk. size=1073741824 {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 16:41:42 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af6b9740-b1c8-499e-83f4-6f3e5898a608/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:41:42 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af6b9740-b1c8-499e-83f4-6f3e5898a608/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:41:42 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Cannot resize image /opt/stack/data/nova/instances/af6b9740-b1c8-499e-83f4-6f3e5898a608/disk to a smaller size. {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 16:41:42 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: af6b9740-b1c8-499e-83f4-6f3e5898a608] Created local disks {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 16:41:42 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: af6b9740-b1c8-499e-83f4-6f3e5898a608] Ensure instance console log exists: /opt/stack/data/nova/instances/af6b9740-b1c8-499e-83f4-6f3e5898a608/console.log {{(pid=75245) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 16:41:42 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:41:42 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:41:42 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:41:42 user nova-compute[75245]: DEBUG nova.network.neutron [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: af6b9740-b1c8-499e-83f4-6f3e5898a608] Successfully updated port: e2a86e77-c012-4252-9d4a-3c27e3b28042 {{(pid=75245) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 16:41:42 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Acquiring lock "refresh_cache-af6b9740-b1c8-499e-83f4-6f3e5898a608" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:41:42 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Acquired lock "refresh_cache-af6b9740-b1c8-499e-83f4-6f3e5898a608" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:41:42 user nova-compute[75245]: DEBUG nova.network.neutron [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: af6b9740-b1c8-499e-83f4-6f3e5898a608] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 16:41:42 user nova-compute[75245]: DEBUG nova.compute.manager [req-755cf14f-627f-4549-bfd1-af9f3070c866 req-83a10cd1-b502-4f95-bce9-2a53daab521f service nova] [instance: af6b9740-b1c8-499e-83f4-6f3e5898a608] Received event network-changed-e2a86e77-c012-4252-9d4a-3c27e3b28042 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:41:42 user nova-compute[75245]: DEBUG nova.compute.manager [req-755cf14f-627f-4549-bfd1-af9f3070c866 req-83a10cd1-b502-4f95-bce9-2a53daab521f service nova] [instance: af6b9740-b1c8-499e-83f4-6f3e5898a608] Refreshing instance network info cache due to event network-changed-e2a86e77-c012-4252-9d4a-3c27e3b28042. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:41:42 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-755cf14f-627f-4549-bfd1-af9f3070c866 req-83a10cd1-b502-4f95-bce9-2a53daab521f service nova] Acquiring lock "refresh_cache-af6b9740-b1c8-499e-83f4-6f3e5898a608" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:41:42 user nova-compute[75245]: DEBUG nova.network.neutron [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: af6b9740-b1c8-499e-83f4-6f3e5898a608] Instance cache missing network info. {{(pid=75245) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 16:41:42 user nova-compute[75245]: DEBUG nova.network.neutron [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: af6b9740-b1c8-499e-83f4-6f3e5898a608] Updating instance_info_cache with network_info: [{"id": "e2a86e77-c012-4252-9d4a-3c27e3b28042", "address": "fa:16:3e:b5:b9:98", "network": {"id": "55744af1-3291-4de1-9bf4-554f9ee4f057", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1570836437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01e269dbe30d46ccb81d58e2590004db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2a86e77-c0", "ovs_interfaceid": "e2a86e77-c012-4252-9d4a-3c27e3b28042", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:41:42 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Releasing lock "refresh_cache-af6b9740-b1c8-499e-83f4-6f3e5898a608" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:41:42 user nova-compute[75245]: DEBUG nova.compute.manager [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: af6b9740-b1c8-499e-83f4-6f3e5898a608] Instance network_info: |[{"id": "e2a86e77-c012-4252-9d4a-3c27e3b28042", "address": "fa:16:3e:b5:b9:98", "network": {"id": "55744af1-3291-4de1-9bf4-554f9ee4f057", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1570836437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01e269dbe30d46ccb81d58e2590004db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2a86e77-c0", "ovs_interfaceid": "e2a86e77-c012-4252-9d4a-3c27e3b28042", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 16:41:42 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-755cf14f-627f-4549-bfd1-af9f3070c866 req-83a10cd1-b502-4f95-bce9-2a53daab521f service nova] Acquired lock "refresh_cache-af6b9740-b1c8-499e-83f4-6f3e5898a608" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:41:42 user nova-compute[75245]: DEBUG nova.network.neutron [req-755cf14f-627f-4549-bfd1-af9f3070c866 req-83a10cd1-b502-4f95-bce9-2a53daab521f service nova] [instance: af6b9740-b1c8-499e-83f4-6f3e5898a608] Refreshing network info cache for port e2a86e77-c012-4252-9d4a-3c27e3b28042 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:41:42 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: af6b9740-b1c8-499e-83f4-6f3e5898a608] Start _get_guest_xml network_info=[{"id": "e2a86e77-c012-4252-9d4a-3c27e3b28042", "address": "fa:16:3e:b5:b9:98", "network": {"id": "55744af1-3291-4de1-9bf4-554f9ee4f057", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1570836437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01e269dbe30d46ccb81d58e2590004db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2a86e77-c0", "ovs_interfaceid": "e2a86e77-c012-4252-9d4a-3c27e3b28042", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'a291d9c3-be02-4c6c-9649-4b45c5b7f487'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 16:41:42 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:41:42 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:41:42 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 16:41:42 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] CPU controller missing on host. {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 16:41:42 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 16:41:42 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] CPU controller found on host. {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 16:41:42 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75245) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 16:41:42 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T16:06:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 16:41:42 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Flavor limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 16:41:42 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Image limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 16:41:42 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Flavor pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 16:41:42 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Image pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 16:41:42 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 16:41:42 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 16:41:42 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 16:41:42 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Got 1 possible topologies {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 16:41:42 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 16:41:42 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 16:41:43 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:41:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-880187177',display_name='tempest-AttachVolumeNegativeTest-server-880187177',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-880187177',id=37,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2DkhmxZ0H0iBabc+DWLY1YOvvN89CgvlQpcjxNVHI6ldOCK/H+V32SwV/EyBxc3HOEnry/+OyMxql7lj9rFB/Buj/fm0TxNWsPqipw9VQnH52O/el5SJLnzddU7GJpRg==',key_name='tempest-keypair-494609547',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='01e269dbe30d46ccb81d58e2590004db',ramdisk_id='',reservation_id='r-xk2tgrr0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-44169219',owner_user_name='tempest-AttachVolumeNegativeTest-44169219-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:41:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb4c94298bf14753bb9530633e766dee',uuid=af6b9740-b1c8-499e-83f4-6f3e5898a608,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2a86e77-c012-4252-9d4a-3c27e3b28042", "address": "fa:16:3e:b5:b9:98", "network": {"id": "55744af1-3291-4de1-9bf4-554f9ee4f057", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1570836437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01e269dbe30d46ccb81d58e2590004db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2a86e77-c0", "ovs_interfaceid": "e2a86e77-c012-4252-9d4a-3c27e3b28042", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:41:43 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Converting VIF {"id": "e2a86e77-c012-4252-9d4a-3c27e3b28042", "address": "fa:16:3e:b5:b9:98", "network": {"id": "55744af1-3291-4de1-9bf4-554f9ee4f057", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1570836437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01e269dbe30d46ccb81d58e2590004db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2a86e77-c0", "ovs_interfaceid": "e2a86e77-c012-4252-9d4a-3c27e3b28042", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:41:43 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:b9:98,bridge_name='br-int',has_traffic_filtering=True,id=e2a86e77-c012-4252-9d4a-3c27e3b28042,network=Network(55744af1-3291-4de1-9bf4-554f9ee4f057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2a86e77-c0') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:41:43 user nova-compute[75245]: DEBUG nova.objects.instance [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lazy-loading 'pci_devices' on Instance uuid af6b9740-b1c8-499e-83f4-6f3e5898a608 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:41:43 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: af6b9740-b1c8-499e-83f4-6f3e5898a608] End _get_guest_xml xml=<domain type="kvm">
Nov 29 16:41:43 user nova-compute[75245]:   <uuid>af6b9740-b1c8-499e-83f4-6f3e5898a608</uuid>
Nov 29 16:41:43 user nova-compute[75245]:   <name>instance-00000025</name>
Nov 29 16:41:43 user nova-compute[75245]:   <memory>524288</memory>
Nov 29 16:41:43 user nova-compute[75245]:   <vcpu>1</vcpu>
Nov 29 16:41:43 user nova-compute[75245]:   <metadata>
Nov 29 16:41:43 user nova-compute[75245]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 16:41:43 user nova-compute[75245]:       <nova:package version="0.0.0"/>
Nov 29 16:41:43 user nova-compute[75245]:       <nova:name>tempest-AttachVolumeNegativeTest-server-880187177</nova:name>
Nov 29 16:41:43 user nova-compute[75245]:       <nova:creationTime>2023-11-29 16:41:42</nova:creationTime>
Nov 29 16:41:43 user nova-compute[75245]:       <nova:flavor name="m1.tiny">
Nov 29 16:41:43 user nova-compute[75245]:         <nova:memory>512</nova:memory>
Nov 29 16:41:43 user nova-compute[75245]:         <nova:disk>1</nova:disk>
Nov 29 16:41:43 user nova-compute[75245]:         <nova:swap>0</nova:swap>
Nov 29 16:41:43 user nova-compute[75245]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 16:41:43 user nova-compute[75245]:         <nova:vcpus>1</nova:vcpus>
Nov 29 16:41:43 user nova-compute[75245]:       </nova:flavor>
Nov 29 16:41:43 user nova-compute[75245]:       <nova:owner>
Nov 29 16:41:43 user nova-compute[75245]:         <nova:user uuid="fb4c94298bf14753bb9530633e766dee">tempest-AttachVolumeNegativeTest-44169219-project-member</nova:user>
Nov 29 16:41:43 user nova-compute[75245]:         <nova:project uuid="01e269dbe30d46ccb81d58e2590004db">tempest-AttachVolumeNegativeTest-44169219</nova:project>
Nov 29 16:41:43 user nova-compute[75245]:       </nova:owner>
Nov 29 16:41:43 user nova-compute[75245]:       <nova:root type="image" uuid="a291d9c3-be02-4c6c-9649-4b45c5b7f487"/>
Nov 29 16:41:43 user nova-compute[75245]:       <nova:ports>
Nov 29 16:41:43 user nova-compute[75245]:         <nova:port uuid="e2a86e77-c012-4252-9d4a-3c27e3b28042">
Nov 29 16:41:43 user nova-compute[75245]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 29 16:41:43 user nova-compute[75245]:         </nova:port>
Nov 29 16:41:43 user nova-compute[75245]:       </nova:ports>
Nov 29 16:41:43 user nova-compute[75245]:     </nova:instance>
Nov 29 16:41:43 user nova-compute[75245]:   </metadata>
Nov 29 16:41:43 user nova-compute[75245]:   <sysinfo type="smbios">
Nov 29 16:41:43 user nova-compute[75245]:     <system>
Nov 29 16:41:43 user nova-compute[75245]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 16:41:43 user nova-compute[75245]:       <entry name="product">OpenStack Nova</entry>
Nov 29 16:41:43 user nova-compute[75245]:       <entry name="version">0.0.0</entry>
Nov 29 16:41:43 user nova-compute[75245]:       <entry name="serial">af6b9740-b1c8-499e-83f4-6f3e5898a608</entry>
Nov 29 16:41:43 user nova-compute[75245]:       <entry name="uuid">af6b9740-b1c8-499e-83f4-6f3e5898a608</entry>
Nov 29 16:41:43 user nova-compute[75245]:       <entry name="family">Virtual Machine</entry>
Nov 29 16:41:43 user nova-compute[75245]:     </system>
Nov 29 16:41:43 user nova-compute[75245]:   </sysinfo>
Nov 29 16:41:43 user nova-compute[75245]:   <os>
Nov 29 16:41:43 user nova-compute[75245]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 16:41:43 user nova-compute[75245]:     <boot dev="hd"/>
Nov 29 16:41:43 user nova-compute[75245]:     <smbios mode="sysinfo"/>
Nov 29 16:41:43 user nova-compute[75245]:   </os>
Nov 29 16:41:43 user nova-compute[75245]:   <features>
Nov 29 16:41:43 user nova-compute[75245]:     <acpi/>
Nov 29 16:41:43 user nova-compute[75245]:     <apic/>
Nov 29 16:41:43 user nova-compute[75245]:     <vmcoreinfo/>
Nov 29 16:41:43 user nova-compute[75245]:   </features>
Nov 29 16:41:43 user nova-compute[75245]:   <clock offset="utc">
Nov 29 16:41:43 user nova-compute[75245]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 16:41:43 user nova-compute[75245]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 16:41:43 user nova-compute[75245]:     <timer name="hpet" present="no"/>
Nov 29 16:41:43 user nova-compute[75245]:   </clock>
Nov 29 16:41:43 user nova-compute[75245]:   <cpu mode="custom" match="exact">
Nov 29 16:41:43 user nova-compute[75245]:     <model>Nehalem</model>
Nov 29 16:41:43 user nova-compute[75245]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 16:41:43 user nova-compute[75245]:   </cpu>
Nov 29 16:41:43 user nova-compute[75245]:   <devices>
Nov 29 16:41:43 user nova-compute[75245]:     <disk type="file" device="disk">
Nov 29 16:41:43 user nova-compute[75245]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 16:41:43 user nova-compute[75245]:       <source file="/opt/stack/data/nova/instances/af6b9740-b1c8-499e-83f4-6f3e5898a608/disk"/>
Nov 29 16:41:43 user nova-compute[75245]:       <target dev="vda" bus="virtio"/>
Nov 29 16:41:43 user nova-compute[75245]:     </disk>
Nov 29 16:41:43 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 16:41:43 user nova-compute[75245]:       <mac address="fa:16:3e:b5:b9:98"/>
Nov 29 16:41:43 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:41:43 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 16:41:43 user nova-compute[75245]:       <target dev="tape2a86e77-c0"/>
Nov 29 16:41:43 user nova-compute[75245]:     </interface>
Nov 29 16:41:43 user nova-compute[75245]:     <serial type="pty">
Nov 29 16:41:43 user nova-compute[75245]:       <log file="/opt/stack/data/nova/instances/af6b9740-b1c8-499e-83f4-6f3e5898a608/console.log" append="off"/>
Nov 29 16:41:43 user nova-compute[75245]:     </serial>
Nov 29 16:41:43 user nova-compute[75245]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 16:41:43 user nova-compute[75245]:     <video>
Nov 29 16:41:43 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:41:43 user nova-compute[75245]:     </video>
Nov 29 16:41:43 user nova-compute[75245]:     <rng model="virtio">
Nov 29 16:41:43 user nova-compute[75245]:       <backend model="random">/dev/urandom</backend>
Nov 29 16:41:43 user nova-compute[75245]:     </rng>
Nov 29 16:41:43 user nova-compute[75245]:     <controller type="usb" index="0" model="none"/>
Nov 29 16:41:43 user nova-compute[75245]:     <memballoon model="virtio">
Nov 29 16:41:43 user nova-compute[75245]:       <stats period="10"/>
Nov 29 16:41:43 user nova-compute[75245]:     </memballoon>
Nov 29 16:41:43 user nova-compute[75245]:   </devices>
Nov 29 16:41:43 user nova-compute[75245]: </domain>
Nov 29 16:41:43 user nova-compute[75245]:  {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 16:41:43 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:41:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-880187177',display_name='tempest-AttachVolumeNegativeTest-server-880187177',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-880187177',id=37,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2DkhmxZ0H0iBabc+DWLY1YOvvN89CgvlQpcjxNVHI6ldOCK/H+V32SwV/EyBxc3HOEnry/+OyMxql7lj9rFB/Buj/fm0TxNWsPqipw9VQnH52O/el5SJLnzddU7GJpRg==',key_name='tempest-keypair-494609547',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='01e269dbe30d46ccb81d58e2590004db',ramdisk_id='',reservation_id='r-xk2tgrr0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-44169219',owner_user_name='tempest-AttachVolumeNegativeTest-44169219-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:41:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb4c94298bf14753bb9530633e766dee',uuid=af6b9740-b1c8-499e-83f4-6f3e5898a608,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2a86e77-c012-4252-9d4a-3c27e3b28042", "address": "fa:16:3e:b5:b9:98", "network": {"id": "55744af1-3291-4de1-9bf4-554f9ee4f057", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1570836437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01e269dbe30d46ccb81d58e2590004db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2a86e77-c0", "ovs_interfaceid": "e2a86e77-c012-4252-9d4a-3c27e3b28042", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 16:41:43 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Converting VIF {"id": "e2a86e77-c012-4252-9d4a-3c27e3b28042", "address": "fa:16:3e:b5:b9:98", "network": {"id": "55744af1-3291-4de1-9bf4-554f9ee4f057", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1570836437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01e269dbe30d46ccb81d58e2590004db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2a86e77-c0", "ovs_interfaceid": "e2a86e77-c012-4252-9d4a-3c27e3b28042", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:41:43 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:b9:98,bridge_name='br-int',has_traffic_filtering=True,id=e2a86e77-c012-4252-9d4a-3c27e3b28042,network=Network(55744af1-3291-4de1-9bf4-554f9ee4f057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2a86e77-c0') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:41:43 user nova-compute[75245]: DEBUG os_vif [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:b9:98,bridge_name='br-int',has_traffic_filtering=True,id=e2a86e77-c012-4252-9d4a-3c27e3b28042,network=Network(55744af1-3291-4de1-9bf4-554f9ee4f057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2a86e77-c0') {{(pid=75245) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 16:41:43 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:41:43 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:41:43 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 16:41:43 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:41:43 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '02a806ca-d0bf-5cad-9a77-c7d1366102b0', '_type': 'linux-noop'}}, row=False) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:41:43 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:41:43 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:41:43 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:41:43 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape2a86e77-c0, may_exist=True, interface_attrs={}) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:41:43 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape2a86e77-c0, col_values=(('qos', UUID('409226e8-d0bd-4155-8f36-60fea0eb04e1')),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:41:43 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape2a86e77-c0, col_values=(('external_ids', {'iface-id': 'e2a86e77-c012-4252-9d4a-3c27e3b28042', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:b9:98', 'vm-uuid': 'af6b9740-b1c8-499e-83f4-6f3e5898a608'}),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:41:43 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:41:43 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:41:43 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:41:43 user nova-compute[75245]: INFO os_vif [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:b9:98,bridge_name='br-int',has_traffic_filtering=True,id=e2a86e77-c012-4252-9d4a-3c27e3b28042,network=Network(55744af1-3291-4de1-9bf4-554f9ee4f057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2a86e77-c0')
Nov 29 16:41:43 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:41:43 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] No VIF found with MAC fa:16:3e:b5:b9:98, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:41:43 user nova-compute[75245]: DEBUG nova.network.neutron [req-755cf14f-627f-4549-bfd1-af9f3070c866 req-83a10cd1-b502-4f95-bce9-2a53daab521f service nova] [instance: af6b9740-b1c8-499e-83f4-6f3e5898a608] Updated VIF entry in instance network info cache for port e2a86e77-c012-4252-9d4a-3c27e3b28042. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:41:43 user nova-compute[75245]: DEBUG nova.network.neutron [req-755cf14f-627f-4549-bfd1-af9f3070c866 req-83a10cd1-b502-4f95-bce9-2a53daab521f service nova] [instance: af6b9740-b1c8-499e-83f4-6f3e5898a608] Updating instance_info_cache with network_info: [{"id": "e2a86e77-c012-4252-9d4a-3c27e3b28042", "address": "fa:16:3e:b5:b9:98", "network": {"id": "55744af1-3291-4de1-9bf4-554f9ee4f057", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1570836437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01e269dbe30d46ccb81d58e2590004db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2a86e77-c0", "ovs_interfaceid": "e2a86e77-c012-4252-9d4a-3c27e3b28042", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:41:43 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-755cf14f-627f-4549-bfd1-af9f3070c866 req-83a10cd1-b502-4f95-bce9-2a53daab521f service nova] Releasing lock "refresh_cache-af6b9740-b1c8-499e-83f4-6f3e5898a608" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:41:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:41:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:41:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:41:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:41:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:41:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:41:44 user nova-compute[75245]: DEBUG nova.compute.manager [req-28a02d7c-2c21-4545-8672-40f9b68decc0 req-2fe09e55-8b0a-467b-bb18-7a0ecf0ff6e5 service nova] [instance: af6b9740-b1c8-499e-83f4-6f3e5898a608] Received event network-vif-plugged-e2a86e77-c012-4252-9d4a-3c27e3b28042 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:41:44 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-28a02d7c-2c21-4545-8672-40f9b68decc0 req-2fe09e55-8b0a-467b-bb18-7a0ecf0ff6e5 service nova] Acquiring lock "af6b9740-b1c8-499e-83f4-6f3e5898a608-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:41:44 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-28a02d7c-2c21-4545-8672-40f9b68decc0 req-2fe09e55-8b0a-467b-bb18-7a0ecf0ff6e5 service nova] Lock "af6b9740-b1c8-499e-83f4-6f3e5898a608-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:41:44 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-28a02d7c-2c21-4545-8672-40f9b68decc0 req-2fe09e55-8b0a-467b-bb18-7a0ecf0ff6e5 service nova] Lock "af6b9740-b1c8-499e-83f4-6f3e5898a608-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:41:44 user nova-compute[75245]: DEBUG nova.compute.manager [req-28a02d7c-2c21-4545-8672-40f9b68decc0 req-2fe09e55-8b0a-467b-bb18-7a0ecf0ff6e5 service nova] [instance: af6b9740-b1c8-499e-83f4-6f3e5898a608] No waiting events found dispatching network-vif-plugged-e2a86e77-c012-4252-9d4a-3c27e3b28042 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:41:44 user nova-compute[75245]: WARNING nova.compute.manager [req-28a02d7c-2c21-4545-8672-40f9b68decc0 req-2fe09e55-8b0a-467b-bb18-7a0ecf0ff6e5 service nova] [instance: af6b9740-b1c8-499e-83f4-6f3e5898a608] Received unexpected event network-vif-plugged-e2a86e77-c012-4252-9d4a-3c27e3b28042 for instance with vm_state building and task_state spawning.
Nov 29 16:41:46 user nova-compute[75245]: DEBUG nova.compute.manager [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: af6b9740-b1c8-499e-83f4-6f3e5898a608] Instance event wait completed in 0 seconds for  {{(pid=75245) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 16:41:46 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: af6b9740-b1c8-499e-83f4-6f3e5898a608] Guest created on hypervisor {{(pid=75245) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 16:41:46 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: af6b9740-b1c8-499e-83f4-6f3e5898a608] Instance spawned successfully.
Nov 29 16:41:46 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: af6b9740-b1c8-499e-83f4-6f3e5898a608] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 16:41:46 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: af6b9740-b1c8-499e-83f4-6f3e5898a608] Found default for hw_cdrom_bus of ide {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:41:46 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: af6b9740-b1c8-499e-83f4-6f3e5898a608] Found default for hw_disk_bus of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:41:46 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: af6b9740-b1c8-499e-83f4-6f3e5898a608] Found default for hw_input_bus of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:41:46 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: af6b9740-b1c8-499e-83f4-6f3e5898a608] Found default for hw_pointer_model of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:41:46 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: af6b9740-b1c8-499e-83f4-6f3e5898a608] Found default for hw_video_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:41:46 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: af6b9740-b1c8-499e-83f4-6f3e5898a608] Found default for hw_vif_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:41:46 user nova-compute[75245]: INFO nova.compute.manager [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: af6b9740-b1c8-499e-83f4-6f3e5898a608] Took 5.34 seconds to spawn the instance on the hypervisor.
Nov 29 16:41:46 user nova-compute[75245]: DEBUG nova.compute.manager [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: af6b9740-b1c8-499e-83f4-6f3e5898a608] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:41:46 user nova-compute[75245]: INFO nova.compute.manager [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: af6b9740-b1c8-499e-83f4-6f3e5898a608] Took 6.07 seconds to build instance.
Nov 29 16:41:46 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3c820478-a0ba-4b19-936a-7ff6ccce380e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "af6b9740-b1c8-499e-83f4-6f3e5898a608" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.194s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:41:46 user nova-compute[75245]: DEBUG nova.compute.manager [req-a8d6143f-e041-49a7-9cfc-ca70f151df35 req-628af218-f18a-49b0-9ade-6b313e889ea1 service nova] [instance: af6b9740-b1c8-499e-83f4-6f3e5898a608] Received event network-vif-plugged-e2a86e77-c012-4252-9d4a-3c27e3b28042 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:41:46 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a8d6143f-e041-49a7-9cfc-ca70f151df35 req-628af218-f18a-49b0-9ade-6b313e889ea1 service nova] Acquiring lock "af6b9740-b1c8-499e-83f4-6f3e5898a608-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:41:46 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a8d6143f-e041-49a7-9cfc-ca70f151df35 req-628af218-f18a-49b0-9ade-6b313e889ea1 service nova] Lock "af6b9740-b1c8-499e-83f4-6f3e5898a608-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:41:46 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a8d6143f-e041-49a7-9cfc-ca70f151df35 req-628af218-f18a-49b0-9ade-6b313e889ea1 service nova] Lock "af6b9740-b1c8-499e-83f4-6f3e5898a608-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:41:46 user nova-compute[75245]: DEBUG nova.compute.manager [req-a8d6143f-e041-49a7-9cfc-ca70f151df35 req-628af218-f18a-49b0-9ade-6b313e889ea1 service nova] [instance: af6b9740-b1c8-499e-83f4-6f3e5898a608] No waiting events found dispatching network-vif-plugged-e2a86e77-c012-4252-9d4a-3c27e3b28042 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:41:46 user nova-compute[75245]: WARNING nova.compute.manager [req-a8d6143f-e041-49a7-9cfc-ca70f151df35 req-628af218-f18a-49b0-9ade-6b313e889ea1 service nova] [instance: af6b9740-b1c8-499e-83f4-6f3e5898a608] Received unexpected event network-vif-plugged-e2a86e77-c012-4252-9d4a-3c27e3b28042 for instance with vm_state active and task_state None.
Nov 29 16:41:48 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:41:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:41:53 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:41:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:41:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:41:59 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:41:59 user nova-compute[75245]: DEBUG nova.compute.manager [req-b361dba8-aeaf-48ff-b24d-c770fb9c8452 req-76e5c29c-708f-4a50-a92c-37262219ddb8 service nova] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] Received event network-changed-ad62def3-239d-492d-845a-6753c82f6250 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:41:59 user nova-compute[75245]: DEBUG nova.compute.manager [req-b361dba8-aeaf-48ff-b24d-c770fb9c8452 req-76e5c29c-708f-4a50-a92c-37262219ddb8 service nova] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] Refreshing instance network info cache due to event network-changed-ad62def3-239d-492d-845a-6753c82f6250. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:41:59 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b361dba8-aeaf-48ff-b24d-c770fb9c8452 req-76e5c29c-708f-4a50-a92c-37262219ddb8 service nova] Acquiring lock "refresh_cache-3d913349-8ede-4dbc-96bf-27e33881dee0" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:41:59 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b361dba8-aeaf-48ff-b24d-c770fb9c8452 req-76e5c29c-708f-4a50-a92c-37262219ddb8 service nova] Acquired lock "refresh_cache-3d913349-8ede-4dbc-96bf-27e33881dee0" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:41:59 user nova-compute[75245]: DEBUG nova.network.neutron [req-b361dba8-aeaf-48ff-b24d-c770fb9c8452 req-76e5c29c-708f-4a50-a92c-37262219ddb8 service nova] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] Refreshing network info cache for port ad62def3-239d-492d-845a-6753c82f6250 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:41:59 user nova-compute[75245]: DEBUG nova.network.neutron [req-b361dba8-aeaf-48ff-b24d-c770fb9c8452 req-76e5c29c-708f-4a50-a92c-37262219ddb8 service nova] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] Updated VIF entry in instance network info cache for port ad62def3-239d-492d-845a-6753c82f6250. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:41:59 user nova-compute[75245]: DEBUG nova.network.neutron [req-b361dba8-aeaf-48ff-b24d-c770fb9c8452 req-76e5c29c-708f-4a50-a92c-37262219ddb8 service nova] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] Updating instance_info_cache with network_info: [{"id": "ad62def3-239d-492d-845a-6753c82f6250", "address": "fa:16:3e:d9:c7:6f", "network": {"id": "3f83d273-14b6-4405-8725-9d76b79aa767", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1314414874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c15d626475ac4e3686fcbbeeb391d650", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad62def3-23", "ovs_interfaceid": "ad62def3-239d-492d-845a-6753c82f6250", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:41:59 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b361dba8-aeaf-48ff-b24d-c770fb9c8452 req-76e5c29c-708f-4a50-a92c-37262219ddb8 service nova] Releasing lock "refresh_cache-3d913349-8ede-4dbc-96bf-27e33881dee0" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:42:02 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-f1d1b950-2177-4054-882f-0c76439cf960 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Acquiring lock "3d913349-8ede-4dbc-96bf-27e33881dee0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:42:02 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-f1d1b950-2177-4054-882f-0c76439cf960 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Lock "3d913349-8ede-4dbc-96bf-27e33881dee0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:42:02 user nova-compute[75245]: DEBUG nova.objects.instance [None req-f1d1b950-2177-4054-882f-0c76439cf960 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Lazy-loading 'flavor' on Instance uuid 3d913349-8ede-4dbc-96bf-27e33881dee0 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:42:02 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-f1d1b950-2177-4054-882f-0c76439cf960 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Lock "3d913349-8ede-4dbc-96bf-27e33881dee0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:42:02 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-f1d1b950-2177-4054-882f-0c76439cf960 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Acquiring lock "3d913349-8ede-4dbc-96bf-27e33881dee0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:42:02 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-f1d1b950-2177-4054-882f-0c76439cf960 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Lock "3d913349-8ede-4dbc-96bf-27e33881dee0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:42:02 user nova-compute[75245]: INFO nova.compute.manager [None req-f1d1b950-2177-4054-882f-0c76439cf960 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] Attaching volume f5b9d0a9-c7f3-4807-8a28-9615437238a1 to /dev/vdb
Nov 29 16:42:02 user nova-compute[75245]: DEBUG os_brick.utils [None req-f1d1b950-2177-4054-882f-0c76439cf960 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:42:02 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:42:02 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:42:02 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b751019-6ec1-4a03-b788-6e3311430b01]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:69ed8ed87091\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:42:02 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:42:02 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:42:02 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[beffc397-019f-4848-8145-1b78f6fe06f3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:42:02 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:42:02 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:42:02 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de13eaf-dcd0-44d0-a423-fdfdb2c6bb2a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:42:02 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[b06a3642-f774-46e0-9041-ff289a854d57]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:42:02 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-f1d1b950-2177-4054-882f-0c76439cf960 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Running cmd (subprocess): nvme version {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:42:02 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-f1d1b950-2177-4054-882f-0c76439cf960 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] 'nvme version' failed. Not Retrying. {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:42:03 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f1d1b950-2177-4054-882f-0c76439cf960 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] nvme not present on system {{(pid=75245) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 16:42:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:42:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:42:03 user nova-compute[75245]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 16:42:03 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[c607afa2-6652-4b3a-95a8-6cabf4d0ea68]: (4, '') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:42:03 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-f1d1b950-2177-4054-882f-0c76439cf960 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75245) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 16:42:03 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-f1d1b950-2177-4054-882f-0c76439cf960 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 16:42:03 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-f1d1b950-2177-4054-882f-0c76439cf960 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] LIGHTOS: no hostnqn found. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 16:42:03 user nova-compute[75245]: DEBUG os_brick.utils [None req-f1d1b950-2177-4054-882f-0c76439cf960 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:69ed8ed87091', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:42:03 user nova-compute[75245]: DEBUG nova.virt.block_device [None req-f1d1b950-2177-4054-882f-0c76439cf960 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] Updating existing volume attachment record: fdcdba1b-5f1b-4eb5-8e90-eda94b438754 {{(pid=75245) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 16:42:03 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:42:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:42:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:42:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:42:10 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1d1b950-2177-4054-882f-0c76439cf960 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] Calling os-brick to attach iSCSI Volume {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 16:42:10 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1d1b950-2177-4054-882f-0c76439cf960 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f5b9d0a9-c7f3-4807-8a28-9615437238a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZyKSbqPx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:42:10 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-f1d1b950-2177-4054-882f-0c76439cf960 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:42:10 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-f1d1b950-2177-4054-882f-0c76439cf960 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:42:10 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-f1d1b950-2177-4054-882f-0c76439cf960 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:42:10 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-f1d1b950-2177-4054-882f-0c76439cf960 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:42:10 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-f1d1b950-2177-4054-882f-0c76439cf960 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5b9d0a9-c7f3-4807-8a28-9615437238a1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:42:10 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-f1d1b950-2177-4054-882f-0c76439cf960 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5b9d0a9-c7f3-4807-8a28-9615437238a1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:42:10 user nova-compute[75245]: INFO os_brick.initiator.connectors.iscsi [None req-f1d1b950-2177-4054-882f-0c76439cf960 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 16:42:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5b9d0a9-c7f3-4807-8a28-9615437238a1 -p 172.16.0.220:3260 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:42:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5b9d0a9-c7f3-4807-8a28-9615437238a1 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:42:10 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2e7834-5792-4f59-a2cf-2b039f6f5c7e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:42:10 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1d1b950-2177-4054-882f-0c76439cf960 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 16:42:10 user nova-compute[75245]:  {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:42:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5b9d0a9-c7f3-4807-8a28-9615437238a1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:42:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5b9d0a9-c7f3-4807-8a28-9615437238a1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:42:10 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[849a4cf2-6f00-4c54-88e0-8a07d274f7ea]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f5b9d0a9-c7f3-4807-8a28-9615437238a1] added\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:42:10 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1d1b950-2177-4054-882f-0c76439cf960 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f5b9d0a9-c7f3-4807-8a28-9615437238a1] added
Nov 29 16:42:10 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:42:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5b9d0a9-c7f3-4807-8a28-9615437238a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:42:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5b9d0a9-c7f3-4807-8a28-9615437238a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:42:10 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2cc5619-e1ba-4b88-b1f0-2dc88d97c04f]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:42:10 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1d1b950-2177-4054-882f-0c76439cf960 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:42:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5b9d0a9-c7f3-4807-8a28-9615437238a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:42:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5b9d0a9-c7f3-4807-8a28-9615437238a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.081s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:42:10 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[379be778-9311-4d75-a93c-8ed62ea8db5f]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:42:10 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1d1b950-2177-4054-882f-0c76439cf960 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:42:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5b9d0a9-c7f3-4807-8a28-9615437238a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZyKSbqPx {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:42:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5b9d0a9-c7f3-4807-8a28-9615437238a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZyKSbqPx" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:42:10 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[10280b07-f076-4ba2-9f8e-4c496515873e]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:42:10 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1d1b950-2177-4054-882f-0c76439cf960 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZyKSbqPx'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:42:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5b9d0a9-c7f3-4807-8a28-9615437238a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:42:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5b9d0a9-c7f3-4807-8a28-9615437238a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:42:10 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa475881-34b5-46b8-bf55-885e3a478b5b]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:42:10 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1d1b950-2177-4054-882f-0c76439cf960 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:42:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:42:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:42:10 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2d7c84-14b8-4985-9a41-bcf05fc33163]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93473e32-041a-42cb-b0ba-5bae7136e44f (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:42:10 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1d1b950-2177-4054-882f-0c76439cf960 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d (non-flash)
Nov 29 16:42:10 user nova-compute[75245]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93473e32-041a-42cb-b0ba-5bae7136e44f (non-flash)
Nov 29 16:42:10 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:42:10 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1d1b950-2177-4054-882f-0c76439cf960 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d (non-flash)
Nov 29 16:42:10 user nova-compute[75245]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93473e32-041a-42cb-b0ba-5bae7136e44f (non-flash)
Nov 29 16:42:10 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:42:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5b9d0a9-c7f3-4807-8a28-9615437238a1 -p 172.16.0.220:3260 --login {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:42:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5b9d0a9-c7f3-4807-8a28-9615437238a1 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:42:10 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac87b6f4-b1f3-48ba-86d9-00e467656ba1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f5b9d0a9-c7f3-4807-8a28-9615437238a1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f5b9d0a9-c7f3-4807-8a28-9615437238a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:42:10 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1d1b950-2177-4054-882f-0c76439cf960 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f5b9d0a9-c7f3-4807-8a28-9615437238a1, portal: 172.16.0.220,3260]
Nov 29 16:42:10 user nova-compute[75245]: Login to [iface: default, target: iqn.2010-10.org.openstack:f5b9d0a9-c7f3-4807-8a28-9615437238a1, portal: 172.16.0.220,3260] successful.
Nov 29 16:42:10 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:42:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5b9d0a9-c7f3-4807-8a28-9615437238a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:42:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5b9d0a9-c7f3-4807-8a28-9615437238a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:42:10 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ddbf67-1591-4a7b-886a-1903f8238412]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:42:10 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1d1b950-2177-4054-882f-0c76439cf960 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:42:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:42:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:42:10 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d3d3a1-655b-46e8-85e1-53016c56db17]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93473e32-041a-42cb-b0ba-5bae7136e44f (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9d0a9-c7f3-4807-8a28-9615437238a1 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:42:10 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1d1b950-2177-4054-882f-0c76439cf960 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d (non-flash)
Nov 29 16:42:10 user nova-compute[75245]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93473e32-041a-42cb-b0ba-5bae7136e44f (non-flash)
Nov 29 16:42:10 user nova-compute[75245]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9d0a9-c7f3-4807-8a28-9615437238a1 (non-flash)
Nov 29 16:42:10 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:42:10 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1d1b950-2177-4054-882f-0c76439cf960 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d (non-flash)
Nov 29 16:42:10 user nova-compute[75245]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93473e32-041a-42cb-b0ba-5bae7136e44f (non-flash)
Nov 29 16:42:10 user nova-compute[75245]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9d0a9-c7f3-4807-8a28-9615437238a1 (non-flash)
Nov 29 16:42:10 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:42:10 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-f1d1b950-2177-4054-882f-0c76439cf960 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5b9d0a9-c7f3-4807-8a28-9615437238a1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.371s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:42:10 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1d1b950-2177-4054-882f-0c76439cf960 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Connected to 172.16.0.220:3260 {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 16:42:10 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-f1d1b950-2177-4054-882f-0c76439cf960 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] HCTL ('35', '-', '-', 0) found on session 44 with lun 0 {{(pid=75245) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 16:42:10 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-f1d1b950-2177-4054-882f-0c76439cf960 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75245) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 16:42:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:42:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:42:10 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa7c92b-598c-47c4-b983-761ca20b95a0]: (4, ('- - 0', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:42:10 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-f1d1b950-2177-4054-882f-0c76439cf960 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Searching for a device in session 44 and hctl ['35', '*', '*', 0] yield: None {{(pid=75245) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 16:42:11 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-f1d1b950-2177-4054-882f-0c76439cf960 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Searching for a device in session 44 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75245) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 16:42:11 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1d1b950-2177-4054-882f-0c76439cf960 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:f5b9d0a9-c7f3-4807-8a28-9615437238a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZyKSbqPx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 16:42:11 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-f1d1b950-2177-4054-882f-0c76439cf960 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.406s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:42:11 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1d1b950-2177-4054-882f-0c76439cf960 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] <== connect_volume: return (1408ms) {'type': 'block', 'scsi_wwn': '23266646633306331', 'path': '/dev/sdd'} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:42:11 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1d1b950-2177-4054-882f-0c76439cf960 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23266646633306331', 'path': '/dev/sdd'} {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 16:42:11 user nova-compute[75245]: DEBUG nova.objects.instance [None req-f1d1b950-2177-4054-882f-0c76439cf960 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Lazy-loading 'flavor' on Instance uuid 3d913349-8ede-4dbc-96bf-27e33881dee0 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:42:11 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-f1d1b950-2177-4054-882f-0c76439cf960 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 16:42:11 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:42:11 user nova-compute[75245]:   <source dev="/dev/sdd"/>
Nov 29 16:42:11 user nova-compute[75245]:   <target dev="vdb" bus="virtio"/>
Nov 29 16:42:11 user nova-compute[75245]:   <serial>f5b9d0a9-c7f3-4807-8a28-9615437238a1</serial>
Nov 29 16:42:11 user nova-compute[75245]: </disk>
Nov 29 16:42:11 user nova-compute[75245]:  {{(pid=75245) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 16:42:12 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-f1d1b950-2177-4054-882f-0c76439cf960 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:42:12 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-f1d1b950-2177-4054-882f-0c76439cf960 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:42:12 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-f1d1b950-2177-4054-882f-0c76439cf960 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] No VIF found with MAC fa:16:3e:d9:c7:6f, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:42:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-f1d1b950-2177-4054-882f-0c76439cf960 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Lock "3d913349-8ede-4dbc-96bf-27e33881dee0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.304s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:42:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:42:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d9e59310-b1d2-4f92-93e2-d24c9c1d01ff tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Acquiring lock "3d913349-8ede-4dbc-96bf-27e33881dee0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:42:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d9e59310-b1d2-4f92-93e2-d24c9c1d01ff tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Lock "3d913349-8ede-4dbc-96bf-27e33881dee0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:42:13 user nova-compute[75245]: INFO nova.compute.manager [None req-d9e59310-b1d2-4f92-93e2-d24c9c1d01ff tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] Detaching volume f5b9d0a9-c7f3-4807-8a28-9615437238a1
Nov 29 16:42:13 user nova-compute[75245]: INFO nova.virt.block_device [None req-d9e59310-b1d2-4f92-93e2-d24c9c1d01ff tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] Attempting to driver detach volume f5b9d0a9-c7f3-4807-8a28-9615437238a1 from mountpoint /dev/vdb
Nov 29 16:42:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-d9e59310-b1d2-4f92-93e2-d24c9c1d01ff tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Attempting to detach device vdb from instance 3d913349-8ede-4dbc-96bf-27e33881dee0 from the persistent domain config. {{(pid=75245) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 16:42:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-d9e59310-b1d2-4f92-93e2-d24c9c1d01ff tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 16:42:13 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:42:13 user nova-compute[75245]:   <source dev="/dev/sdd"/>
Nov 29 16:42:13 user nova-compute[75245]:   <target dev="vdb" bus="virtio"/>
Nov 29 16:42:13 user nova-compute[75245]:   <serial>f5b9d0a9-c7f3-4807-8a28-9615437238a1</serial>
Nov 29 16:42:13 user nova-compute[75245]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 16:42:13 user nova-compute[75245]: </disk>
Nov 29 16:42:13 user nova-compute[75245]:  {{(pid=75245) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 16:42:13 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-d9e59310-b1d2-4f92-93e2-d24c9c1d01ff tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Successfully detached device vdb from instance 3d913349-8ede-4dbc-96bf-27e33881dee0 from the persistent domain config.
Nov 29 16:42:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-d9e59310-b1d2-4f92-93e2-d24c9c1d01ff tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3d913349-8ede-4dbc-96bf-27e33881dee0 from the live domain config. {{(pid=75245) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 16:42:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-d9e59310-b1d2-4f92-93e2-d24c9c1d01ff tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 16:42:13 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:42:13 user nova-compute[75245]:   <source dev="/dev/sdd"/>
Nov 29 16:42:13 user nova-compute[75245]:   <target dev="vdb" bus="virtio"/>
Nov 29 16:42:13 user nova-compute[75245]:   <serial>f5b9d0a9-c7f3-4807-8a28-9615437238a1</serial>
Nov 29 16:42:13 user nova-compute[75245]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 16:42:13 user nova-compute[75245]: </disk>
Nov 29 16:42:13 user nova-compute[75245]:  {{(pid=75245) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 16:42:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-d9e59310-b1d2-4f92-93e2-d24c9c1d01ff tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3d913349-8ede-4dbc-96bf-27e33881dee0 {{(pid=75245) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 16:42:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:42:14 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:42:14 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Starting heal instance info cache {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 16:42:14 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Rebuilding the list of instances to heal {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 16:42:14 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "refresh_cache-c9ad13aa-7c21-4701-88e6-6265c7d19d7b" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:42:14 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquired lock "refresh_cache-c9ad13aa-7c21-4701-88e6-6265c7d19d7b" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:42:14 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Forcefully refreshing network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 16:42:14 user nova-compute[75245]: DEBUG nova.objects.instance [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lazy-loading 'info_cache' on Instance uuid c9ad13aa-7c21-4701-88e6-6265c7d19d7b {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:42:15 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Updating instance_info_cache with network_info: [{"id": "2844f77d-297d-4177-974c-22a1cab3590c", "address": "fa:16:3e:f4:3a:98", "network": {"id": "b0e81786-47f3-4a13-90c7-788cb53a4df5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1382922826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebd1ea36980641739f2bdd856a65d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2844f77d-29", "ovs_interfaceid": "2844f77d-297d-4177-974c-22a1cab3590c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:42:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Releasing lock "refresh_cache-c9ad13aa-7c21-4701-88e6-6265c7d19d7b" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:42:15 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Updated the network info_cache for instance {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 16:42:16 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:42:16 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:42:16 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:42:16 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:42:16 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:42:16 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75245) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 16:42:16 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d913349-8ede-4dbc-96bf-27e33881dee0/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:42:16 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d913349-8ede-4dbc-96bf-27e33881dee0/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:42:16 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d913349-8ede-4dbc-96bf-27e33881dee0/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:42:17 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d913349-8ede-4dbc-96bf-27e33881dee0/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:42:17 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af6b9740-b1c8-499e-83f4-6f3e5898a608/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:42:17 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af6b9740-b1c8-499e-83f4-6f3e5898a608/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:42:17 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af6b9740-b1c8-499e-83f4-6f3e5898a608/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:42:17 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af6b9740-b1c8-499e-83f4-6f3e5898a608/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:42:17 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba3662d8-598b-4296-a1e8-4dd57b5c7f3d/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:42:17 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba3662d8-598b-4296-a1e8-4dd57b5c7f3d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:42:17 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba3662d8-598b-4296-a1e8-4dd57b5c7f3d/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:42:17 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba3662d8-598b-4296-a1e8-4dd57b5c7f3d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:42:17 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:42:17 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ad13aa-7c21-4701-88e6-6265c7d19d7b/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:42:17 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ad13aa-7c21-4701-88e6-6265c7d19d7b/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:42:17 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ad13aa-7c21-4701-88e6-6265c7d19d7b/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:42:18 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:42:18 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ad13aa-7c21-4701-88e6-6265c7d19d7b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:42:18 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:42:18 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23d4db24-cd37-4fb3-8ab3-ad8721e3714a/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:42:18 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23d4db24-cd37-4fb3-8ab3-ad8721e3714a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:42:18 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23d4db24-cd37-4fb3-8ab3-ad8721e3714a/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:42:18 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23d4db24-cd37-4fb3-8ab3-ad8721e3714a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:42:18 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:42:18 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:42:18 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Hypervisor/Node resource view: name=user free_ram=8297MB free_disk=25.080360412597656GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75245) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 16:42:18 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:42:18 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:42:19 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance c9ad13aa-7c21-4701-88e6-6265c7d19d7b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:42:19 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance ba3662d8-598b-4296-a1e8-4dd57b5c7f3d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:42:19 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 3d913349-8ede-4dbc-96bf-27e33881dee0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:42:19 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 23d4db24-cd37-4fb3-8ab3-ad8721e3714a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:42:19 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance af6b9740-b1c8-499e-83f4-6f3e5898a608 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:42:19 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 16:42:19 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 16:42:19 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:42:19 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:42:19 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:42:19 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Compute_service record updated for user:user {{(pid=75245) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 16:42:19 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.301s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:42:21 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:42:21 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:42:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:42:24 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:42:24 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:42:24 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75245) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 16:42:25 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:42:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:42:29 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:42:33 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:42:33 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-d9e59310-b1d2-4f92-93e2-d24c9c1d01ff tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3d913349-8ede-4dbc-96bf-27e33881dee0 is timed out.
Nov 29 16:42:33 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-d9e59310-b1d2-4f92-93e2-d24c9c1d01ff tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Successfully detached device vdb from instance 3d913349-8ede-4dbc-96bf-27e33881dee0 from the live domain config.
Nov 29 16:42:33 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9e59310-b1d2-4f92-93e2-d24c9c1d01ff tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] calling os-brick to detach iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 16:42:33 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e59310-b1d2-4f92-93e2-d24c9c1d01ff tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, {'target_iqn': 'iqn.2010-10.org.openstack:f5b9d0a9-c7f3-4807-8a28-9615437238a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZyKSbqPx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:42:33 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-d9e59310-b1d2-4f92-93e2-d24c9c1d01ff tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:42:33 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-d9e59310-b1d2-4f92-93e2-d24c9c1d01ff tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:42:33 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-d9e59310-b1d2-4f92-93e2-d24c9c1d01ff tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:42:33 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:42:33 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:42:33 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef1ea74-d185-402d-9713-c79e290fd16c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f5b9d0a9-c7f3-4807-8a28-9615437238a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:93473e32-041a-42cb-b0ba-5bae7136e44f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:42:33 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e59310-b1d2-4f92-93e2-d24c9c1d01ff tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 16:42:33 user nova-compute[75245]: No targets found.
Nov 29 16:42:33 user nova-compute[75245]: iSNS:
Nov 29 16:42:33 user nova-compute[75245]: No targets found.
Nov 29 16:42:33 user nova-compute[75245]: STATIC:
Nov 29 16:42:33 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:f5b9d0a9-c7f3-4807-8a28-9615437238a1
Nov 29 16:42:33 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:42:33 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:42:33 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:93473e32-041a-42cb-b0ba-5bae7136e44f
Nov 29 16:42:33 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:42:33 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:42:33 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d
Nov 29 16:42:33 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:42:33 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:42:33 user nova-compute[75245]: FIRMWARE:
Nov 29 16:42:33 user nova-compute[75245]: No targets found.
Nov 29 16:42:33 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:42:33 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e59310-b1d2-4f92-93e2-d24c9c1d01ff tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 16:42:33 user nova-compute[75245]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 16:42:33 user nova-compute[75245]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75245) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 16:42:33 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e59310-b1d2-4f92-93e2-d24c9c1d01ff tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5b9d0a9-c7f3-4807-8a28-9615437238a1', 0)] {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 16:42:33 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:42:33 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:42:33 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eeb286e-f81f-4fc9-b1fb-d915e5284d36]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93473e32-041a-42cb-b0ba-5bae7136e44f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5b9d0a9-c7f3-4807-8a28-9615437238a1\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:42:33 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:42:33 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:42:33 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe340b7-41b1-41c8-9553-5326c5316cb6]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93473e32-041a-42cb-b0ba-5bae7136e44f (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9d0a9-c7f3-4807-8a28-9615437238a1 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:42:33 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e59310-b1d2-4f92-93e2-d24c9c1d01ff tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d (non-flash)
Nov 29 16:42:33 user nova-compute[75245]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93473e32-041a-42cb-b0ba-5bae7136e44f (non-flash)
Nov 29 16:42:33 user nova-compute[75245]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9d0a9-c7f3-4807-8a28-9615437238a1 (non-flash)
Nov 29 16:42:33 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:42:33 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e59310-b1d2-4f92-93e2-d24c9c1d01ff tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d (non-flash)
Nov 29 16:42:33 user nova-compute[75245]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93473e32-041a-42cb-b0ba-5bae7136e44f (non-flash)
Nov 29 16:42:33 user nova-compute[75245]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9d0a9-c7f3-4807-8a28-9615437238a1 (non-flash)
Nov 29 16:42:33 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:42:33 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e59310-b1d2-4f92-93e2-d24c9c1d01ff tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0d4414fbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5b9d0a9-c7f3-4807-8a28-9615437238a1'): ({'sdd'}, set())}) {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 16:42:33 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-d9e59310-b1d2-4f92-93e2-d24c9c1d01ff tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Removing single pathed devices sdd {{(pid=75245) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 16:42:33 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:42:33 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:42:33 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[597e6c70-57f1-47ca-919f-d54acf00bbf4]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:42:33 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:42:33 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:42:33 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd4e8c0-395d-41a5-b983-c272e8d7b14c]: (4, ('ok\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:42:33 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-d9e59310-b1d2-4f92-93e2-d24c9c1d01ff tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Flushing IO for device /dev/sdd {{(pid=75245) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 16:42:33 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:42:33 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:42:33 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c486ec-d728-48fc-ad41-2f18aeeed2d2]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:42:33 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-d9e59310-b1d2-4f92-93e2-d24c9c1d01ff tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75245) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 16:42:33 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:42:33 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:42:33 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f7d88df-37dd-469b-ad37-3d5dad31d92d]: (4, ('1', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:42:33 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-d9e59310-b1d2-4f92-93e2-d24c9c1d01ff tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 16:42:33 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-d9e59310-b1d2-4f92-93e2-d24c9c1d01ff tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] SCSI volumes sdd have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 16:42:33 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e59310-b1d2-4f92-93e2-d24c9c1d01ff tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5b9d0a9-c7f3-4807-8a28-9615437238a1')] {{(pid=75245) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 16:42:33 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5b9d0a9-c7f3-4807-8a28-9615437238a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:42:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5b9d0a9-c7f3-4807-8a28-9615437238a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.067s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:42:34 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[82501f78-19d0-4ad0-8189-6eb16b4bb025]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:42:34 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e59310-b1d2-4f92-93e2-d24c9c1d01ff tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:42:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5b9d0a9-c7f3-4807-8a28-9615437238a1 -p 172.16.0.220:3260 --logout {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:42:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:42:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5b9d0a9-c7f3-4807-8a28-9615437238a1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:42:34 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd35b24-e624-4c2c-ba90-a14cdb99483a]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:f5b9d0a9-c7f3-4807-8a28-9615437238a1, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:f5b9d0a9-c7f3-4807-8a28-9615437238a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:42:34 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e59310-b1d2-4f92-93e2-d24c9c1d01ff tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:f5b9d0a9-c7f3-4807-8a28-9615437238a1, portal: 172.16.0.220,3260]
Nov 29 16:42:34 user nova-compute[75245]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:f5b9d0a9-c7f3-4807-8a28-9615437238a1, portal: 172.16.0.220,3260] successful.
Nov 29 16:42:34 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:42:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5b9d0a9-c7f3-4807-8a28-9615437238a1 -p 172.16.0.220:3260 --op delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:42:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5b9d0a9-c7f3-4807-8a28-9615437238a1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:42:34 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e44967b-034f-483b-8d80-9aa47e67ed7a]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:42:34 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e59310-b1d2-4f92-93e2-d24c9c1d01ff tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:42:34 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-d9e59310-b1d2-4f92-93e2-d24c9c1d01ff tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:42:34 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e59310-b1d2-4f92-93e2-d24c9c1d01ff tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] <== disconnect_volume: return (351ms) None {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:42:34 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9e59310-b1d2-4f92-93e2-d24c9c1d01ff tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] Disconnected iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 16:42:34 user nova-compute[75245]: DEBUG nova.objects.instance [None req-d9e59310-b1d2-4f92-93e2-d24c9c1d01ff tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Lazy-loading 'flavor' on Instance uuid 3d913349-8ede-4dbc-96bf-27e33881dee0 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:42:34 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d9e59310-b1d2-4f92-93e2-d24c9c1d01ff tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Lock "3d913349-8ede-4dbc-96bf-27e33881dee0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.700s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:42:36 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:42:38 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:42:43 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:42:48 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:42:53 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:42:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:43:03 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:43:04 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2722f507-d60c-4977-b1a4-32e84526915b tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Acquiring lock "23d4db24-cd37-4fb3-8ab3-ad8721e3714a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:43:04 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2722f507-d60c-4977-b1a4-32e84526915b tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Lock "23d4db24-cd37-4fb3-8ab3-ad8721e3714a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:43:04 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2722f507-d60c-4977-b1a4-32e84526915b tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Acquiring lock "23d4db24-cd37-4fb3-8ab3-ad8721e3714a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:43:04 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2722f507-d60c-4977-b1a4-32e84526915b tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Lock "23d4db24-cd37-4fb3-8ab3-ad8721e3714a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:43:04 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2722f507-d60c-4977-b1a4-32e84526915b tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Lock "23d4db24-cd37-4fb3-8ab3-ad8721e3714a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:43:04 user nova-compute[75245]: INFO nova.compute.manager [None req-2722f507-d60c-4977-b1a4-32e84526915b tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] [instance: 23d4db24-cd37-4fb3-8ab3-ad8721e3714a] Terminating instance
Nov 29 16:43:04 user nova-compute[75245]: DEBUG nova.compute.manager [None req-2722f507-d60c-4977-b1a4-32e84526915b tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] [instance: 23d4db24-cd37-4fb3-8ab3-ad8721e3714a] Start destroying the instance on the hypervisor. {{(pid=75245) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 16:43:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:43:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:43:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:43:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:43:05 user nova-compute[75245]: DEBUG nova.compute.manager [req-392e42ca-6c7b-424b-a0a4-1013b9d5da96 req-b512caed-6aed-4862-9e35-2c55c2c74a69 service nova] [instance: 23d4db24-cd37-4fb3-8ab3-ad8721e3714a] Received event network-vif-unplugged-d1f96728-4585-4399-8490-7d55437b21bb {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:43:05 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-392e42ca-6c7b-424b-a0a4-1013b9d5da96 req-b512caed-6aed-4862-9e35-2c55c2c74a69 service nova] Acquiring lock "23d4db24-cd37-4fb3-8ab3-ad8721e3714a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:43:05 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-392e42ca-6c7b-424b-a0a4-1013b9d5da96 req-b512caed-6aed-4862-9e35-2c55c2c74a69 service nova] Lock "23d4db24-cd37-4fb3-8ab3-ad8721e3714a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:43:05 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-392e42ca-6c7b-424b-a0a4-1013b9d5da96 req-b512caed-6aed-4862-9e35-2c55c2c74a69 service nova] Lock "23d4db24-cd37-4fb3-8ab3-ad8721e3714a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:43:05 user nova-compute[75245]: DEBUG nova.compute.manager [req-392e42ca-6c7b-424b-a0a4-1013b9d5da96 req-b512caed-6aed-4862-9e35-2c55c2c74a69 service nova] [instance: 23d4db24-cd37-4fb3-8ab3-ad8721e3714a] No waiting events found dispatching network-vif-unplugged-d1f96728-4585-4399-8490-7d55437b21bb {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:43:05 user nova-compute[75245]: DEBUG nova.compute.manager [req-392e42ca-6c7b-424b-a0a4-1013b9d5da96 req-b512caed-6aed-4862-9e35-2c55c2c74a69 service nova] [instance: 23d4db24-cd37-4fb3-8ab3-ad8721e3714a] Received event network-vif-unplugged-d1f96728-4585-4399-8490-7d55437b21bb for instance with task_state deleting. {{(pid=75245) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 16:43:05 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:43:05 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 23d4db24-cd37-4fb3-8ab3-ad8721e3714a] Instance destroyed successfully.
Nov 29 16:43:05 user nova-compute[75245]: DEBUG nova.objects.instance [None req-2722f507-d60c-4977-b1a4-32e84526915b tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Lazy-loading 'resources' on Instance uuid 23d4db24-cd37-4fb3-8ab3-ad8721e3714a {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:43:05 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-2722f507-d60c-4977-b1a4-32e84526915b tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:41:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1794048252',display_name='tempest-VolumesActionsTest-instance-1794048252',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1794048252',id=36,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:41:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7fa8698b2fbe4e45a02a50397fdc15c0',ramdisk_id='',reservation_id='r-000xqpq6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1420605510',owner_user_name='tempest-VolumesActionsTest-1420605510-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:41:21Z,user_data=None,user_id='ad0b7d0571224f208814582c802fe0c7',uuid=23d4db24-cd37-4fb3-8ab3-ad8721e3714a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d1f96728-4585-4399-8490-7d55437b21bb", "address": "fa:16:3e:2d:3e:dc", "network": {"id": "02425e20-f9ba-4d18-a4ae-3805376f9ffc", "bridge": "br-int", "label": "tempest-VolumesActionsTest-437049831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fa8698b2fbe4e45a02a50397fdc15c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1f96728-45", "ovs_interfaceid": "d1f96728-4585-4399-8490-7d55437b21bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 16:43:05 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-2722f507-d60c-4977-b1a4-32e84526915b tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Converting VIF {"id": "d1f96728-4585-4399-8490-7d55437b21bb", "address": "fa:16:3e:2d:3e:dc", "network": {"id": "02425e20-f9ba-4d18-a4ae-3805376f9ffc", "bridge": "br-int", "label": "tempest-VolumesActionsTest-437049831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fa8698b2fbe4e45a02a50397fdc15c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1f96728-45", "ovs_interfaceid": "d1f96728-4585-4399-8490-7d55437b21bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:43:05 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-2722f507-d60c-4977-b1a4-32e84526915b tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:3e:dc,bridge_name='br-int',has_traffic_filtering=True,id=d1f96728-4585-4399-8490-7d55437b21bb,network=Network(02425e20-f9ba-4d18-a4ae-3805376f9ffc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1f96728-45') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:43:05 user nova-compute[75245]: DEBUG os_vif [None req-2722f507-d60c-4977-b1a4-32e84526915b tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:3e:dc,bridge_name='br-int',has_traffic_filtering=True,id=d1f96728-4585-4399-8490-7d55437b21bb,network=Network(02425e20-f9ba-4d18-a4ae-3805376f9ffc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1f96728-45') {{(pid=75245) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 16:43:05 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:43:05 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd1f96728-45, bridge=br-int, if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:43:05 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:43:05 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:43:05 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:43:05 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3ea608ad-58f9-43f7-b344-dfc52491a528) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:43:05 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:43:05 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:43:05 user nova-compute[75245]: INFO os_vif [None req-2722f507-d60c-4977-b1a4-32e84526915b tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:3e:dc,bridge_name='br-int',has_traffic_filtering=True,id=d1f96728-4585-4399-8490-7d55437b21bb,network=Network(02425e20-f9ba-4d18-a4ae-3805376f9ffc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1f96728-45')
Nov 29 16:43:05 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-2722f507-d60c-4977-b1a4-32e84526915b tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] [instance: 23d4db24-cd37-4fb3-8ab3-ad8721e3714a] Deleting instance files /opt/stack/data/nova/instances/23d4db24-cd37-4fb3-8ab3-ad8721e3714a_del
Nov 29 16:43:05 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-2722f507-d60c-4977-b1a4-32e84526915b tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] [instance: 23d4db24-cd37-4fb3-8ab3-ad8721e3714a] Deletion of /opt/stack/data/nova/instances/23d4db24-cd37-4fb3-8ab3-ad8721e3714a_del complete
Nov 29 16:43:05 user nova-compute[75245]: INFO nova.compute.manager [None req-2722f507-d60c-4977-b1a4-32e84526915b tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] [instance: 23d4db24-cd37-4fb3-8ab3-ad8721e3714a] Took 0.66 seconds to destroy the instance on the hypervisor.
Nov 29 16:43:05 user nova-compute[75245]: DEBUG oslo.service.loopingcall [None req-2722f507-d60c-4977-b1a4-32e84526915b tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75245) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 16:43:05 user nova-compute[75245]: DEBUG nova.compute.manager [-] [instance: 23d4db24-cd37-4fb3-8ab3-ad8721e3714a] Deallocating network for instance {{(pid=75245) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 16:43:05 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: 23d4db24-cd37-4fb3-8ab3-ad8721e3714a] deallocate_for_instance() {{(pid=75245) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 16:43:05 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: 23d4db24-cd37-4fb3-8ab3-ad8721e3714a] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:43:05 user nova-compute[75245]: INFO nova.compute.manager [-] [instance: 23d4db24-cd37-4fb3-8ab3-ad8721e3714a] Took 0.49 seconds to deallocate network for instance.
Nov 29 16:43:05 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2722f507-d60c-4977-b1a4-32e84526915b tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:43:05 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2722f507-d60c-4977-b1a4-32e84526915b tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:43:06 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-2722f507-d60c-4977-b1a4-32e84526915b tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:43:06 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-2722f507-d60c-4977-b1a4-32e84526915b tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:43:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2722f507-d60c-4977-b1a4-32e84526915b tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.212s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:43:06 user nova-compute[75245]: INFO nova.scheduler.client.report [None req-2722f507-d60c-4977-b1a4-32e84526915b tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Deleted allocations for instance 23d4db24-cd37-4fb3-8ab3-ad8721e3714a
Nov 29 16:43:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2722f507-d60c-4977-b1a4-32e84526915b tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Lock "23d4db24-cd37-4fb3-8ab3-ad8721e3714a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.531s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:43:07 user nova-compute[75245]: DEBUG nova.compute.manager [req-71680ed1-9ae2-44a4-b964-a0cc90a46eb6 req-a5487c94-9acc-4f9b-96eb-14252f3a7919 service nova] [instance: 23d4db24-cd37-4fb3-8ab3-ad8721e3714a] Received event network-vif-plugged-d1f96728-4585-4399-8490-7d55437b21bb {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:43:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-71680ed1-9ae2-44a4-b964-a0cc90a46eb6 req-a5487c94-9acc-4f9b-96eb-14252f3a7919 service nova] Acquiring lock "23d4db24-cd37-4fb3-8ab3-ad8721e3714a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:43:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-71680ed1-9ae2-44a4-b964-a0cc90a46eb6 req-a5487c94-9acc-4f9b-96eb-14252f3a7919 service nova] Lock "23d4db24-cd37-4fb3-8ab3-ad8721e3714a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:43:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-71680ed1-9ae2-44a4-b964-a0cc90a46eb6 req-a5487c94-9acc-4f9b-96eb-14252f3a7919 service nova] Lock "23d4db24-cd37-4fb3-8ab3-ad8721e3714a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:43:07 user nova-compute[75245]: DEBUG nova.compute.manager [req-71680ed1-9ae2-44a4-b964-a0cc90a46eb6 req-a5487c94-9acc-4f9b-96eb-14252f3a7919 service nova] [instance: 23d4db24-cd37-4fb3-8ab3-ad8721e3714a] No waiting events found dispatching network-vif-plugged-d1f96728-4585-4399-8490-7d55437b21bb {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:43:07 user nova-compute[75245]: WARNING nova.compute.manager [req-71680ed1-9ae2-44a4-b964-a0cc90a46eb6 req-a5487c94-9acc-4f9b-96eb-14252f3a7919 service nova] [instance: 23d4db24-cd37-4fb3-8ab3-ad8721e3714a] Received unexpected event network-vif-plugged-d1f96728-4585-4399-8490-7d55437b21bb for instance with vm_state deleted and task_state None.
Nov 29 16:43:07 user nova-compute[75245]: DEBUG nova.compute.manager [req-71680ed1-9ae2-44a4-b964-a0cc90a46eb6 req-a5487c94-9acc-4f9b-96eb-14252f3a7919 service nova] [instance: 23d4db24-cd37-4fb3-8ab3-ad8721e3714a] Received event network-vif-deleted-d1f96728-4585-4399-8490-7d55437b21bb {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:43:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-b3da27db-3d09-4953-a36a-05d8f8871fb3 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Acquiring lock "3d913349-8ede-4dbc-96bf-27e33881dee0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:43:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-b3da27db-3d09-4953-a36a-05d8f8871fb3 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Lock "3d913349-8ede-4dbc-96bf-27e33881dee0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:43:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-b3da27db-3d09-4953-a36a-05d8f8871fb3 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Acquiring lock "3d913349-8ede-4dbc-96bf-27e33881dee0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:43:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-b3da27db-3d09-4953-a36a-05d8f8871fb3 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Lock "3d913349-8ede-4dbc-96bf-27e33881dee0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:43:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-b3da27db-3d09-4953-a36a-05d8f8871fb3 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Lock "3d913349-8ede-4dbc-96bf-27e33881dee0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:43:08 user nova-compute[75245]: INFO nova.compute.manager [None req-b3da27db-3d09-4953-a36a-05d8f8871fb3 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] Terminating instance
Nov 29 16:43:08 user nova-compute[75245]: DEBUG nova.compute.manager [None req-b3da27db-3d09-4953-a36a-05d8f8871fb3 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] Start destroying the instance on the hypervisor. {{(pid=75245) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 16:43:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:43:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:43:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:43:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:43:08 user nova-compute[75245]: DEBUG nova.compute.manager [req-1949baf6-4509-4878-993c-211801464eaf req-e987812f-8185-4d53-a14e-dc90367db49c service nova] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] Received event network-vif-unplugged-ad62def3-239d-492d-845a-6753c82f6250 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:43:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-1949baf6-4509-4878-993c-211801464eaf req-e987812f-8185-4d53-a14e-dc90367db49c service nova] Acquiring lock "3d913349-8ede-4dbc-96bf-27e33881dee0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:43:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-1949baf6-4509-4878-993c-211801464eaf req-e987812f-8185-4d53-a14e-dc90367db49c service nova] Lock "3d913349-8ede-4dbc-96bf-27e33881dee0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:43:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-1949baf6-4509-4878-993c-211801464eaf req-e987812f-8185-4d53-a14e-dc90367db49c service nova] Lock "3d913349-8ede-4dbc-96bf-27e33881dee0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:43:08 user nova-compute[75245]: DEBUG nova.compute.manager [req-1949baf6-4509-4878-993c-211801464eaf req-e987812f-8185-4d53-a14e-dc90367db49c service nova] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] No waiting events found dispatching network-vif-unplugged-ad62def3-239d-492d-845a-6753c82f6250 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:43:08 user nova-compute[75245]: DEBUG nova.compute.manager [req-1949baf6-4509-4878-993c-211801464eaf req-e987812f-8185-4d53-a14e-dc90367db49c service nova] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] Received event network-vif-unplugged-ad62def3-239d-492d-845a-6753c82f6250 for instance with task_state deleting. {{(pid=75245) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 16:43:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:43:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:43:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:43:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:43:08 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] Instance destroyed successfully.
Nov 29 16:43:08 user nova-compute[75245]: DEBUG nova.objects.instance [None req-b3da27db-3d09-4953-a36a-05d8f8871fb3 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Lazy-loading 'resources' on Instance uuid 3d913349-8ede-4dbc-96bf-27e33881dee0 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:43:08 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-b3da27db-3d09-4953-a36a-05d8f8871fb3 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:40:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-598348180',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-598348180',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-5983481',id=35,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVOzyqwN6Rm1tscolBevHqSmaN50xcLetfSVmazmhcgzqOJkAu9kIFnFNsT7Z7Kw4OMD+We2MinhjYDLA6MdK8YuaiNuXMnYVimhwd8zg0x1m8MD7dCQ6YyxnB3yXP/ZQ==',key_name='tempest-keypair-1209648044',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:40:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c15d626475ac4e3686fcbbeeb391d650',ramdisk_id='',reservation_id='r-vvbkqz5o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1811877478',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:40:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c6bb5bcfd11494a975a40e8fcc29765',uuid=3d913349-8ede-4dbc-96bf-27e33881dee0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ad62def3-239d-492d-845a-6753c82f6250", "address": "fa:16:3e:d9:c7:6f", "network": {"id": "3f83d273-14b6-4405-8725-9d76b79aa767", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1314414874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c15d626475ac4e3686fcbbeeb391d650", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad62def3-23", "ovs_interfaceid": "ad62def3-239d-492d-845a-6753c82f6250", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 16:43:08 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-b3da27db-3d09-4953-a36a-05d8f8871fb3 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Converting VIF {"id": "ad62def3-239d-492d-845a-6753c82f6250", "address": "fa:16:3e:d9:c7:6f", "network": {"id": "3f83d273-14b6-4405-8725-9d76b79aa767", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1314414874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c15d626475ac4e3686fcbbeeb391d650", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad62def3-23", "ovs_interfaceid": "ad62def3-239d-492d-845a-6753c82f6250", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:43:08 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-b3da27db-3d09-4953-a36a-05d8f8871fb3 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d9:c7:6f,bridge_name='br-int',has_traffic_filtering=True,id=ad62def3-239d-492d-845a-6753c82f6250,network=Network(3f83d273-14b6-4405-8725-9d76b79aa767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad62def3-23') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:43:08 user nova-compute[75245]: DEBUG os_vif [None req-b3da27db-3d09-4953-a36a-05d8f8871fb3 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:c7:6f,bridge_name='br-int',has_traffic_filtering=True,id=ad62def3-239d-492d-845a-6753c82f6250,network=Network(3f83d273-14b6-4405-8725-9d76b79aa767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad62def3-23') {{(pid=75245) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 16:43:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:43:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapad62def3-23, bridge=br-int, if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:43:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:43:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:43:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:43:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fd3fa8ba-f131-4189-b7ed-1c462f060bab) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:43:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:43:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:43:08 user nova-compute[75245]: INFO os_vif [None req-b3da27db-3d09-4953-a36a-05d8f8871fb3 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:c7:6f,bridge_name='br-int',has_traffic_filtering=True,id=ad62def3-239d-492d-845a-6753c82f6250,network=Network(3f83d273-14b6-4405-8725-9d76b79aa767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad62def3-23')
Nov 29 16:43:08 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-b3da27db-3d09-4953-a36a-05d8f8871fb3 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] Deleting instance files /opt/stack/data/nova/instances/3d913349-8ede-4dbc-96bf-27e33881dee0_del
Nov 29 16:43:08 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-b3da27db-3d09-4953-a36a-05d8f8871fb3 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] Deletion of /opt/stack/data/nova/instances/3d913349-8ede-4dbc-96bf-27e33881dee0_del complete
Nov 29 16:43:08 user nova-compute[75245]: INFO nova.compute.manager [None req-b3da27db-3d09-4953-a36a-05d8f8871fb3 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 29 16:43:08 user nova-compute[75245]: DEBUG oslo.service.loopingcall [None req-b3da27db-3d09-4953-a36a-05d8f8871fb3 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75245) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 16:43:08 user nova-compute[75245]: DEBUG nova.compute.manager [-] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] Deallocating network for instance {{(pid=75245) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 16:43:08 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] deallocate_for_instance() {{(pid=75245) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 16:43:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:43:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:43:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:43:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:43:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:43:09 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:43:09 user nova-compute[75245]: INFO nova.compute.manager [-] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] Took 0.81 seconds to deallocate network for instance.
Nov 29 16:43:09 user nova-compute[75245]: DEBUG nova.compute.manager [req-c0764646-102e-41df-b312-e4296a22c901 req-d2179ef8-65f8-47b8-b8ff-5a3b1f196547 service nova] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] Received event network-vif-deleted-ad62def3-239d-492d-845a-6753c82f6250 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:43:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-b3da27db-3d09-4953-a36a-05d8f8871fb3 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:43:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-b3da27db-3d09-4953-a36a-05d8f8871fb3 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:43:09 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-b3da27db-3d09-4953-a36a-05d8f8871fb3 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:43:10 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-b3da27db-3d09-4953-a36a-05d8f8871fb3 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:43:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-b3da27db-3d09-4953-a36a-05d8f8871fb3 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.185s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:43:10 user nova-compute[75245]: INFO nova.scheduler.client.report [None req-b3da27db-3d09-4953-a36a-05d8f8871fb3 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Deleted allocations for instance 3d913349-8ede-4dbc-96bf-27e33881dee0
Nov 29 16:43:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-b3da27db-3d09-4953-a36a-05d8f8871fb3 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478 tempest-TestServerVolumeAttachScenarioOldVersion-1811877478-project-member] Lock "3d913349-8ede-4dbc-96bf-27e33881dee0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.143s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:43:10 user nova-compute[75245]: DEBUG nova.compute.manager [req-d90c49a7-6cd1-4d15-a240-1cc359642d7c req-f7dec41c-911f-4643-ab67-46fd494e1d44 service nova] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] Received event network-vif-plugged-ad62def3-239d-492d-845a-6753c82f6250 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:43:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d90c49a7-6cd1-4d15-a240-1cc359642d7c req-f7dec41c-911f-4643-ab67-46fd494e1d44 service nova] Acquiring lock "3d913349-8ede-4dbc-96bf-27e33881dee0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:43:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d90c49a7-6cd1-4d15-a240-1cc359642d7c req-f7dec41c-911f-4643-ab67-46fd494e1d44 service nova] Lock "3d913349-8ede-4dbc-96bf-27e33881dee0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:43:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d90c49a7-6cd1-4d15-a240-1cc359642d7c req-f7dec41c-911f-4643-ab67-46fd494e1d44 service nova] Lock "3d913349-8ede-4dbc-96bf-27e33881dee0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:43:10 user nova-compute[75245]: DEBUG nova.compute.manager [req-d90c49a7-6cd1-4d15-a240-1cc359642d7c req-f7dec41c-911f-4643-ab67-46fd494e1d44 service nova] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] No waiting events found dispatching network-vif-plugged-ad62def3-239d-492d-845a-6753c82f6250 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:43:10 user nova-compute[75245]: WARNING nova.compute.manager [req-d90c49a7-6cd1-4d15-a240-1cc359642d7c req-f7dec41c-911f-4643-ab67-46fd494e1d44 service nova] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] Received unexpected event network-vif-plugged-ad62def3-239d-492d-845a-6753c82f6250 for instance with vm_state deleted and task_state None.
Nov 29 16:43:10 user nova-compute[75245]: DEBUG nova.compute.manager [req-d90c49a7-6cd1-4d15-a240-1cc359642d7c req-f7dec41c-911f-4643-ab67-46fd494e1d44 service nova] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] Received event network-vif-plugged-ad62def3-239d-492d-845a-6753c82f6250 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:43:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d90c49a7-6cd1-4d15-a240-1cc359642d7c req-f7dec41c-911f-4643-ab67-46fd494e1d44 service nova] Acquiring lock "3d913349-8ede-4dbc-96bf-27e33881dee0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:43:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d90c49a7-6cd1-4d15-a240-1cc359642d7c req-f7dec41c-911f-4643-ab67-46fd494e1d44 service nova] Lock "3d913349-8ede-4dbc-96bf-27e33881dee0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:43:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d90c49a7-6cd1-4d15-a240-1cc359642d7c req-f7dec41c-911f-4643-ab67-46fd494e1d44 service nova] Lock "3d913349-8ede-4dbc-96bf-27e33881dee0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:43:10 user nova-compute[75245]: DEBUG nova.compute.manager [req-d90c49a7-6cd1-4d15-a240-1cc359642d7c req-f7dec41c-911f-4643-ab67-46fd494e1d44 service nova] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] No waiting events found dispatching network-vif-plugged-ad62def3-239d-492d-845a-6753c82f6250 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:43:10 user nova-compute[75245]: WARNING nova.compute.manager [req-d90c49a7-6cd1-4d15-a240-1cc359642d7c req-f7dec41c-911f-4643-ab67-46fd494e1d44 service nova] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] Received unexpected event network-vif-plugged-ad62def3-239d-492d-845a-6753c82f6250 for instance with vm_state deleted and task_state None.
Nov 29 16:43:10 user nova-compute[75245]: DEBUG nova.compute.manager [req-d90c49a7-6cd1-4d15-a240-1cc359642d7c req-f7dec41c-911f-4643-ab67-46fd494e1d44 service nova] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] Received event network-vif-plugged-ad62def3-239d-492d-845a-6753c82f6250 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:43:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d90c49a7-6cd1-4d15-a240-1cc359642d7c req-f7dec41c-911f-4643-ab67-46fd494e1d44 service nova] Acquiring lock "3d913349-8ede-4dbc-96bf-27e33881dee0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:43:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d90c49a7-6cd1-4d15-a240-1cc359642d7c req-f7dec41c-911f-4643-ab67-46fd494e1d44 service nova] Lock "3d913349-8ede-4dbc-96bf-27e33881dee0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:43:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d90c49a7-6cd1-4d15-a240-1cc359642d7c req-f7dec41c-911f-4643-ab67-46fd494e1d44 service nova] Lock "3d913349-8ede-4dbc-96bf-27e33881dee0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:43:10 user nova-compute[75245]: DEBUG nova.compute.manager [req-d90c49a7-6cd1-4d15-a240-1cc359642d7c req-f7dec41c-911f-4643-ab67-46fd494e1d44 service nova] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] No waiting events found dispatching network-vif-plugged-ad62def3-239d-492d-845a-6753c82f6250 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:43:10 user nova-compute[75245]: WARNING nova.compute.manager [req-d90c49a7-6cd1-4d15-a240-1cc359642d7c req-f7dec41c-911f-4643-ab67-46fd494e1d44 service nova] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] Received unexpected event network-vif-plugged-ad62def3-239d-492d-845a-6753c82f6250 for instance with vm_state deleted and task_state None.
Nov 29 16:43:10 user nova-compute[75245]: DEBUG nova.compute.manager [req-d90c49a7-6cd1-4d15-a240-1cc359642d7c req-f7dec41c-911f-4643-ab67-46fd494e1d44 service nova] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] Received event network-vif-unplugged-ad62def3-239d-492d-845a-6753c82f6250 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:43:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d90c49a7-6cd1-4d15-a240-1cc359642d7c req-f7dec41c-911f-4643-ab67-46fd494e1d44 service nova] Acquiring lock "3d913349-8ede-4dbc-96bf-27e33881dee0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:43:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d90c49a7-6cd1-4d15-a240-1cc359642d7c req-f7dec41c-911f-4643-ab67-46fd494e1d44 service nova] Lock "3d913349-8ede-4dbc-96bf-27e33881dee0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:43:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d90c49a7-6cd1-4d15-a240-1cc359642d7c req-f7dec41c-911f-4643-ab67-46fd494e1d44 service nova] Lock "3d913349-8ede-4dbc-96bf-27e33881dee0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:43:10 user nova-compute[75245]: DEBUG nova.compute.manager [req-d90c49a7-6cd1-4d15-a240-1cc359642d7c req-f7dec41c-911f-4643-ab67-46fd494e1d44 service nova] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] No waiting events found dispatching network-vif-unplugged-ad62def3-239d-492d-845a-6753c82f6250 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:43:10 user nova-compute[75245]: WARNING nova.compute.manager [req-d90c49a7-6cd1-4d15-a240-1cc359642d7c req-f7dec41c-911f-4643-ab67-46fd494e1d44 service nova] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] Received unexpected event network-vif-unplugged-ad62def3-239d-492d-845a-6753c82f6250 for instance with vm_state deleted and task_state None.
Nov 29 16:43:10 user nova-compute[75245]: DEBUG nova.compute.manager [req-d90c49a7-6cd1-4d15-a240-1cc359642d7c req-f7dec41c-911f-4643-ab67-46fd494e1d44 service nova] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] Received event network-vif-plugged-ad62def3-239d-492d-845a-6753c82f6250 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:43:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d90c49a7-6cd1-4d15-a240-1cc359642d7c req-f7dec41c-911f-4643-ab67-46fd494e1d44 service nova] Acquiring lock "3d913349-8ede-4dbc-96bf-27e33881dee0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:43:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d90c49a7-6cd1-4d15-a240-1cc359642d7c req-f7dec41c-911f-4643-ab67-46fd494e1d44 service nova] Lock "3d913349-8ede-4dbc-96bf-27e33881dee0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:43:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d90c49a7-6cd1-4d15-a240-1cc359642d7c req-f7dec41c-911f-4643-ab67-46fd494e1d44 service nova] Lock "3d913349-8ede-4dbc-96bf-27e33881dee0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:43:10 user nova-compute[75245]: DEBUG nova.compute.manager [req-d90c49a7-6cd1-4d15-a240-1cc359642d7c req-f7dec41c-911f-4643-ab67-46fd494e1d44 service nova] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] No waiting events found dispatching network-vif-plugged-ad62def3-239d-492d-845a-6753c82f6250 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:43:10 user nova-compute[75245]: WARNING nova.compute.manager [req-d90c49a7-6cd1-4d15-a240-1cc359642d7c req-f7dec41c-911f-4643-ab67-46fd494e1d44 service nova] [instance: 3d913349-8ede-4dbc-96bf-27e33881dee0] Received unexpected event network-vif-plugged-ad62def3-239d-492d-845a-6753c82f6250 for instance with vm_state deleted and task_state None.
Nov 29 16:43:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:43:16 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:43:16 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Starting heal instance info cache {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 16:43:16 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "refresh_cache-ba3662d8-598b-4296-a1e8-4dd57b5c7f3d" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:43:16 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquired lock "refresh_cache-ba3662d8-598b-4296-a1e8-4dd57b5c7f3d" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:43:16 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] Forcefully refreshing network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 16:43:16 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] Updating instance_info_cache with network_info: [{"id": "e8484c13-9f26-42b4-8790-028d183a911a", "address": "fa:16:3e:6b:bd:c8", "network": {"id": "55744af1-3291-4de1-9bf4-554f9ee4f057", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1570836437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01e269dbe30d46ccb81d58e2590004db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8484c13-9f", "ovs_interfaceid": "e8484c13-9f26-42b4-8790-028d183a911a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:43:16 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Releasing lock "refresh_cache-ba3662d8-598b-4296-a1e8-4dd57b5c7f3d" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:43:16 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] Updated the network info_cache for instance {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 16:43:17 user nova-compute[75245]: DEBUG nova.compute.manager [req-3fd32e8d-9764-404e-b4f5-fbed3efd4f80 req-a7b332de-19df-4420-860b-23f56853acd9 service nova] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Received event network-changed-2844f77d-297d-4177-974c-22a1cab3590c {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:43:17 user nova-compute[75245]: DEBUG nova.compute.manager [req-3fd32e8d-9764-404e-b4f5-fbed3efd4f80 req-a7b332de-19df-4420-860b-23f56853acd9 service nova] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Refreshing instance network info cache due to event network-changed-2844f77d-297d-4177-974c-22a1cab3590c. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:43:17 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-3fd32e8d-9764-404e-b4f5-fbed3efd4f80 req-a7b332de-19df-4420-860b-23f56853acd9 service nova] Acquiring lock "refresh_cache-c9ad13aa-7c21-4701-88e6-6265c7d19d7b" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:43:17 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-3fd32e8d-9764-404e-b4f5-fbed3efd4f80 req-a7b332de-19df-4420-860b-23f56853acd9 service nova] Acquired lock "refresh_cache-c9ad13aa-7c21-4701-88e6-6265c7d19d7b" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:43:17 user nova-compute[75245]: DEBUG nova.network.neutron [req-3fd32e8d-9764-404e-b4f5-fbed3efd4f80 req-a7b332de-19df-4420-860b-23f56853acd9 service nova] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Refreshing network info cache for port 2844f77d-297d-4177-974c-22a1cab3590c {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:43:17 user nova-compute[75245]: DEBUG nova.network.neutron [req-3fd32e8d-9764-404e-b4f5-fbed3efd4f80 req-a7b332de-19df-4420-860b-23f56853acd9 service nova] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Updated VIF entry in instance network info cache for port 2844f77d-297d-4177-974c-22a1cab3590c. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:43:17 user nova-compute[75245]: DEBUG nova.network.neutron [req-3fd32e8d-9764-404e-b4f5-fbed3efd4f80 req-a7b332de-19df-4420-860b-23f56853acd9 service nova] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Updating instance_info_cache with network_info: [{"id": "2844f77d-297d-4177-974c-22a1cab3590c", "address": "fa:16:3e:f4:3a:98", "network": {"id": "b0e81786-47f3-4a13-90c7-788cb53a4df5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1382922826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebd1ea36980641739f2bdd856a65d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2844f77d-29", "ovs_interfaceid": "2844f77d-297d-4177-974c-22a1cab3590c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:43:17 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-3fd32e8d-9764-404e-b4f5-fbed3efd4f80 req-a7b332de-19df-4420-860b-23f56853acd9 service nova] Releasing lock "refresh_cache-c9ad13aa-7c21-4701-88e6-6265c7d19d7b" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:43:18 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d329aa8a-bbd8-4d3e-8b7f-b5d0ebaec721 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Acquiring lock "c9ad13aa-7c21-4701-88e6-6265c7d19d7b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:43:18 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d329aa8a-bbd8-4d3e-8b7f-b5d0ebaec721 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lock "c9ad13aa-7c21-4701-88e6-6265c7d19d7b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:43:18 user nova-compute[75245]: INFO nova.compute.manager [None req-d329aa8a-bbd8-4d3e-8b7f-b5d0ebaec721 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Detaching volume 3e40860c-63ee-4df7-87e1-d9e8219f694d
Nov 29 16:43:18 user nova-compute[75245]: INFO nova.virt.block_device [None req-d329aa8a-bbd8-4d3e-8b7f-b5d0ebaec721 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Attempting to driver detach volume 3e40860c-63ee-4df7-87e1-d9e8219f694d from mountpoint /dev/vdb
Nov 29 16:43:18 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-d329aa8a-bbd8-4d3e-8b7f-b5d0ebaec721 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Attempting to detach device vdb from instance c9ad13aa-7c21-4701-88e6-6265c7d19d7b from the persistent domain config. {{(pid=75245) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 16:43:18 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-d329aa8a-bbd8-4d3e-8b7f-b5d0ebaec721 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 16:43:18 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:43:18 user nova-compute[75245]:   <source dev="/dev/sdb"/>
Nov 29 16:43:18 user nova-compute[75245]:   <target dev="vdb" bus="virtio"/>
Nov 29 16:43:18 user nova-compute[75245]:   <serial>3e40860c-63ee-4df7-87e1-d9e8219f694d</serial>
Nov 29 16:43:18 user nova-compute[75245]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 16:43:18 user nova-compute[75245]: </disk>
Nov 29 16:43:18 user nova-compute[75245]:  {{(pid=75245) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 16:43:18 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-d329aa8a-bbd8-4d3e-8b7f-b5d0ebaec721 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Successfully detached device vdb from instance c9ad13aa-7c21-4701-88e6-6265c7d19d7b from the persistent domain config.
Nov 29 16:43:18 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-d329aa8a-bbd8-4d3e-8b7f-b5d0ebaec721 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c9ad13aa-7c21-4701-88e6-6265c7d19d7b from the live domain config. {{(pid=75245) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 16:43:18 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-d329aa8a-bbd8-4d3e-8b7f-b5d0ebaec721 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 16:43:18 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:43:18 user nova-compute[75245]:   <source dev="/dev/sdb"/>
Nov 29 16:43:18 user nova-compute[75245]:   <target dev="vdb" bus="virtio"/>
Nov 29 16:43:18 user nova-compute[75245]:   <serial>3e40860c-63ee-4df7-87e1-d9e8219f694d</serial>
Nov 29 16:43:18 user nova-compute[75245]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 16:43:18 user nova-compute[75245]: </disk>
Nov 29 16:43:18 user nova-compute[75245]:  {{(pid=75245) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 16:43:18 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:43:18 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:43:18 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:43:18 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:43:18 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:43:18 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:43:18 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75245) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 16:43:18 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af6b9740-b1c8-499e-83f4-6f3e5898a608/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:43:18 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af6b9740-b1c8-499e-83f4-6f3e5898a608/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:43:18 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af6b9740-b1c8-499e-83f4-6f3e5898a608/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:43:18 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:43:18 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-d329aa8a-bbd8-4d3e-8b7f-b5d0ebaec721 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c9ad13aa-7c21-4701-88e6-6265c7d19d7b {{(pid=75245) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 16:43:18 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af6b9740-b1c8-499e-83f4-6f3e5898a608/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:43:18 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba3662d8-598b-4296-a1e8-4dd57b5c7f3d/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:43:19 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:43:19 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba3662d8-598b-4296-a1e8-4dd57b5c7f3d/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:43:19 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba3662d8-598b-4296-a1e8-4dd57b5c7f3d/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:43:19 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba3662d8-598b-4296-a1e8-4dd57b5c7f3d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:43:19 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:43:19 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ad13aa-7c21-4701-88e6-6265c7d19d7b/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:43:19 user nova-compute[75245]: DEBUG nova.compute.manager [req-e75f81af-65bd-4f44-bd72-3084b3618750 req-e7962341-f614-41f0-a9a3-2ad0babdfbcd service nova] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Received event network-changed-2844f77d-297d-4177-974c-22a1cab3590c {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:43:19 user nova-compute[75245]: DEBUG nova.compute.manager [req-e75f81af-65bd-4f44-bd72-3084b3618750 req-e7962341-f614-41f0-a9a3-2ad0babdfbcd service nova] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Refreshing instance network info cache due to event network-changed-2844f77d-297d-4177-974c-22a1cab3590c. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:43:19 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-e75f81af-65bd-4f44-bd72-3084b3618750 req-e7962341-f614-41f0-a9a3-2ad0babdfbcd service nova] Acquiring lock "refresh_cache-c9ad13aa-7c21-4701-88e6-6265c7d19d7b" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:43:19 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-e75f81af-65bd-4f44-bd72-3084b3618750 req-e7962341-f614-41f0-a9a3-2ad0babdfbcd service nova] Acquired lock "refresh_cache-c9ad13aa-7c21-4701-88e6-6265c7d19d7b" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:43:19 user nova-compute[75245]: DEBUG nova.network.neutron [req-e75f81af-65bd-4f44-bd72-3084b3618750 req-e7962341-f614-41f0-a9a3-2ad0babdfbcd service nova] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Refreshing network info cache for port 2844f77d-297d-4177-974c-22a1cab3590c {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:43:19 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ad13aa-7c21-4701-88e6-6265c7d19d7b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:43:19 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ad13aa-7c21-4701-88e6-6265c7d19d7b/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:43:19 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ad13aa-7c21-4701-88e6-6265c7d19d7b/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:43:20 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:43:20 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:43:20 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Hypervisor/Node resource view: name=user free_ram=8640MB free_disk=25.127132415771484GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75245) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 16:43:20 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:43:20 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:43:20 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance c9ad13aa-7c21-4701-88e6-6265c7d19d7b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:43:20 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance ba3662d8-598b-4296-a1e8-4dd57b5c7f3d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:43:20 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance af6b9740-b1c8-499e-83f4-6f3e5898a608 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:43:20 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 16:43:20 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 16:43:20 user nova-compute[75245]: DEBUG nova.network.neutron [req-e75f81af-65bd-4f44-bd72-3084b3618750 req-e7962341-f614-41f0-a9a3-2ad0babdfbcd service nova] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Updated VIF entry in instance network info cache for port 2844f77d-297d-4177-974c-22a1cab3590c. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:43:20 user nova-compute[75245]: DEBUG nova.network.neutron [req-e75f81af-65bd-4f44-bd72-3084b3618750 req-e7962341-f614-41f0-a9a3-2ad0babdfbcd service nova] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Updating instance_info_cache with network_info: [{"id": "2844f77d-297d-4177-974c-22a1cab3590c", "address": "fa:16:3e:f4:3a:98", "network": {"id": "b0e81786-47f3-4a13-90c7-788cb53a4df5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1382922826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebd1ea36980641739f2bdd856a65d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2844f77d-29", "ovs_interfaceid": "2844f77d-297d-4177-974c-22a1cab3590c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:43:20 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-e75f81af-65bd-4f44-bd72-3084b3618750 req-e7962341-f614-41f0-a9a3-2ad0babdfbcd service nova] Releasing lock "refresh_cache-c9ad13aa-7c21-4701-88e6-6265c7d19d7b" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:43:20 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:43:20 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:43:20 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Compute_service record updated for user:user {{(pid=75245) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 16:43:20 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.256s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:43:22 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:43:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:43:24 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:43:25 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:43:25 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75245) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 16:43:26 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:43:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:43:31 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:43:31 user nova-compute[75245]: DEBUG nova.compute.manager [req-8862676c-ff4c-4614-8d2f-336f12b2fcb7 req-a943c2a2-7fd5-4ab9-b171-8d88aff94ed1 service nova] [instance: af6b9740-b1c8-499e-83f4-6f3e5898a608] Received event network-changed-e2a86e77-c012-4252-9d4a-3c27e3b28042 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:43:31 user nova-compute[75245]: DEBUG nova.compute.manager [req-8862676c-ff4c-4614-8d2f-336f12b2fcb7 req-a943c2a2-7fd5-4ab9-b171-8d88aff94ed1 service nova] [instance: af6b9740-b1c8-499e-83f4-6f3e5898a608] Refreshing instance network info cache due to event network-changed-e2a86e77-c012-4252-9d4a-3c27e3b28042. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:43:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-8862676c-ff4c-4614-8d2f-336f12b2fcb7 req-a943c2a2-7fd5-4ab9-b171-8d88aff94ed1 service nova] Acquiring lock "refresh_cache-af6b9740-b1c8-499e-83f4-6f3e5898a608" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:43:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-8862676c-ff4c-4614-8d2f-336f12b2fcb7 req-a943c2a2-7fd5-4ab9-b171-8d88aff94ed1 service nova] Acquired lock "refresh_cache-af6b9740-b1c8-499e-83f4-6f3e5898a608" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:43:31 user nova-compute[75245]: DEBUG nova.network.neutron [req-8862676c-ff4c-4614-8d2f-336f12b2fcb7 req-a943c2a2-7fd5-4ab9-b171-8d88aff94ed1 service nova] [instance: af6b9740-b1c8-499e-83f4-6f3e5898a608] Refreshing network info cache for port e2a86e77-c012-4252-9d4a-3c27e3b28042 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:43:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-f0c37fda-4dd8-40e0-9c70-fb5eef2216c9 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Acquiring lock "af6b9740-b1c8-499e-83f4-6f3e5898a608" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:43:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-f0c37fda-4dd8-40e0-9c70-fb5eef2216c9 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "af6b9740-b1c8-499e-83f4-6f3e5898a608" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.004s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:43:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-f0c37fda-4dd8-40e0-9c70-fb5eef2216c9 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Acquiring lock "af6b9740-b1c8-499e-83f4-6f3e5898a608-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:43:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-f0c37fda-4dd8-40e0-9c70-fb5eef2216c9 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "af6b9740-b1c8-499e-83f4-6f3e5898a608-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:43:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-f0c37fda-4dd8-40e0-9c70-fb5eef2216c9 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "af6b9740-b1c8-499e-83f4-6f3e5898a608-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:43:31 user nova-compute[75245]: INFO nova.compute.manager [None req-f0c37fda-4dd8-40e0-9c70-fb5eef2216c9 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: af6b9740-b1c8-499e-83f4-6f3e5898a608] Terminating instance
Nov 29 16:43:31 user nova-compute[75245]: DEBUG nova.compute.manager [None req-f0c37fda-4dd8-40e0-9c70-fb5eef2216c9 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: af6b9740-b1c8-499e-83f4-6f3e5898a608] Start destroying the instance on the hypervisor. {{(pid=75245) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 16:43:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:43:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:43:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:43:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:43:32 user nova-compute[75245]: DEBUG nova.network.neutron [req-8862676c-ff4c-4614-8d2f-336f12b2fcb7 req-a943c2a2-7fd5-4ab9-b171-8d88aff94ed1 service nova] [instance: af6b9740-b1c8-499e-83f4-6f3e5898a608] Updated VIF entry in instance network info cache for port e2a86e77-c012-4252-9d4a-3c27e3b28042. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:43:32 user nova-compute[75245]: DEBUG nova.network.neutron [req-8862676c-ff4c-4614-8d2f-336f12b2fcb7 req-a943c2a2-7fd5-4ab9-b171-8d88aff94ed1 service nova] [instance: af6b9740-b1c8-499e-83f4-6f3e5898a608] Updating instance_info_cache with network_info: [{"id": "e2a86e77-c012-4252-9d4a-3c27e3b28042", "address": "fa:16:3e:b5:b9:98", "network": {"id": "55744af1-3291-4de1-9bf4-554f9ee4f057", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1570836437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01e269dbe30d46ccb81d58e2590004db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2a86e77-c0", "ovs_interfaceid": "e2a86e77-c012-4252-9d4a-3c27e3b28042", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:43:32 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-8862676c-ff4c-4614-8d2f-336f12b2fcb7 req-a943c2a2-7fd5-4ab9-b171-8d88aff94ed1 service nova] Releasing lock "refresh_cache-af6b9740-b1c8-499e-83f4-6f3e5898a608" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:43:32 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: af6b9740-b1c8-499e-83f4-6f3e5898a608] Instance destroyed successfully.
Nov 29 16:43:32 user nova-compute[75245]: DEBUG nova.objects.instance [None req-f0c37fda-4dd8-40e0-9c70-fb5eef2216c9 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lazy-loading 'resources' on Instance uuid af6b9740-b1c8-499e-83f4-6f3e5898a608 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:43:32 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-f0c37fda-4dd8-40e0-9c70-fb5eef2216c9 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:41:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-880187177',display_name='tempest-AttachVolumeNegativeTest-server-880187177',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-880187177',id=37,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2DkhmxZ0H0iBabc+DWLY1YOvvN89CgvlQpcjxNVHI6ldOCK/H+V32SwV/EyBxc3HOEnry/+OyMxql7lj9rFB/Buj/fm0TxNWsPqipw9VQnH52O/el5SJLnzddU7GJpRg==',key_name='tempest-keypair-494609547',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:41:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='01e269dbe30d46ccb81d58e2590004db',ramdisk_id='',reservation_id='r-xk2tgrr0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-44169219',owner_user_name='tempest-AttachVolumeNegativeTest-44169219-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:41:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb4c94298bf14753bb9530633e766dee',uuid=af6b9740-b1c8-499e-83f4-6f3e5898a608,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e2a86e77-c012-4252-9d4a-3c27e3b28042", "address": "fa:16:3e:b5:b9:98", "network": {"id": "55744af1-3291-4de1-9bf4-554f9ee4f057", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1570836437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01e269dbe30d46ccb81d58e2590004db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2a86e77-c0", "ovs_interfaceid": "e2a86e77-c012-4252-9d4a-3c27e3b28042", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 16:43:32 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-f0c37fda-4dd8-40e0-9c70-fb5eef2216c9 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Converting VIF {"id": "e2a86e77-c012-4252-9d4a-3c27e3b28042", "address": "fa:16:3e:b5:b9:98", "network": {"id": "55744af1-3291-4de1-9bf4-554f9ee4f057", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1570836437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01e269dbe30d46ccb81d58e2590004db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2a86e77-c0", "ovs_interfaceid": "e2a86e77-c012-4252-9d4a-3c27e3b28042", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:43:32 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-f0c37fda-4dd8-40e0-9c70-fb5eef2216c9 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:b9:98,bridge_name='br-int',has_traffic_filtering=True,id=e2a86e77-c012-4252-9d4a-3c27e3b28042,network=Network(55744af1-3291-4de1-9bf4-554f9ee4f057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2a86e77-c0') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:43:32 user nova-compute[75245]: DEBUG os_vif [None req-f0c37fda-4dd8-40e0-9c70-fb5eef2216c9 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:b9:98,bridge_name='br-int',has_traffic_filtering=True,id=e2a86e77-c012-4252-9d4a-3c27e3b28042,network=Network(55744af1-3291-4de1-9bf4-554f9ee4f057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2a86e77-c0') {{(pid=75245) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 16:43:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:43:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape2a86e77-c0, bridge=br-int, if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:43:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:43:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:43:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=409226e8-d0bd-4155-8f36-60fea0eb04e1) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:43:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:43:32 user nova-compute[75245]: INFO os_vif [None req-f0c37fda-4dd8-40e0-9c70-fb5eef2216c9 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:b9:98,bridge_name='br-int',has_traffic_filtering=True,id=e2a86e77-c012-4252-9d4a-3c27e3b28042,network=Network(55744af1-3291-4de1-9bf4-554f9ee4f057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2a86e77-c0')
Nov 29 16:43:32 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-f0c37fda-4dd8-40e0-9c70-fb5eef2216c9 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: af6b9740-b1c8-499e-83f4-6f3e5898a608] Deleting instance files /opt/stack/data/nova/instances/af6b9740-b1c8-499e-83f4-6f3e5898a608_del
Nov 29 16:43:32 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-f0c37fda-4dd8-40e0-9c70-fb5eef2216c9 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: af6b9740-b1c8-499e-83f4-6f3e5898a608] Deletion of /opt/stack/data/nova/instances/af6b9740-b1c8-499e-83f4-6f3e5898a608_del complete
Nov 29 16:43:32 user nova-compute[75245]: INFO nova.compute.manager [None req-f0c37fda-4dd8-40e0-9c70-fb5eef2216c9 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: af6b9740-b1c8-499e-83f4-6f3e5898a608] Took 0.64 seconds to destroy the instance on the hypervisor.
Nov 29 16:43:32 user nova-compute[75245]: DEBUG oslo.service.loopingcall [None req-f0c37fda-4dd8-40e0-9c70-fb5eef2216c9 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75245) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 16:43:32 user nova-compute[75245]: DEBUG nova.compute.manager [-] [instance: af6b9740-b1c8-499e-83f4-6f3e5898a608] Deallocating network for instance {{(pid=75245) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 16:43:32 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: af6b9740-b1c8-499e-83f4-6f3e5898a608] deallocate_for_instance() {{(pid=75245) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 16:43:33 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: af6b9740-b1c8-499e-83f4-6f3e5898a608] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:43:33 user nova-compute[75245]: INFO nova.compute.manager [-] [instance: af6b9740-b1c8-499e-83f4-6f3e5898a608] Took 0.66 seconds to deallocate network for instance.
Nov 29 16:43:33 user nova-compute[75245]: DEBUG nova.compute.manager [req-b4af3a22-72b4-4f1f-b93d-235f3dfc17ea req-f6bb35c4-852e-4379-8d81-764b12cf50ff service nova] [instance: af6b9740-b1c8-499e-83f4-6f3e5898a608] Received event network-vif-deleted-e2a86e77-c012-4252-9d4a-3c27e3b28042 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:43:33 user nova-compute[75245]: INFO nova.compute.manager [req-b4af3a22-72b4-4f1f-b93d-235f3dfc17ea req-f6bb35c4-852e-4379-8d81-764b12cf50ff service nova] [instance: af6b9740-b1c8-499e-83f4-6f3e5898a608] Neutron deleted interface e2a86e77-c012-4252-9d4a-3c27e3b28042; detaching it from the instance and deleting it from the info cache
Nov 29 16:43:33 user nova-compute[75245]: DEBUG nova.network.neutron [req-b4af3a22-72b4-4f1f-b93d-235f3dfc17ea req-f6bb35c4-852e-4379-8d81-764b12cf50ff service nova] [instance: af6b9740-b1c8-499e-83f4-6f3e5898a608] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:43:33 user nova-compute[75245]: DEBUG nova.compute.manager [req-b4af3a22-72b4-4f1f-b93d-235f3dfc17ea req-f6bb35c4-852e-4379-8d81-764b12cf50ff service nova] [instance: af6b9740-b1c8-499e-83f4-6f3e5898a608] Detach interface failed, port_id=e2a86e77-c012-4252-9d4a-3c27e3b28042, reason: Instance af6b9740-b1c8-499e-83f4-6f3e5898a608 could not be found. {{(pid=75245) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 16:43:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-f0c37fda-4dd8-40e0-9c70-fb5eef2216c9 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:43:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-f0c37fda-4dd8-40e0-9c70-fb5eef2216c9 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:43:33 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-f0c37fda-4dd8-40e0-9c70-fb5eef2216c9 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:43:33 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-f0c37fda-4dd8-40e0-9c70-fb5eef2216c9 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:43:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-f0c37fda-4dd8-40e0-9c70-fb5eef2216c9 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.182s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:43:33 user nova-compute[75245]: INFO nova.scheduler.client.report [None req-f0c37fda-4dd8-40e0-9c70-fb5eef2216c9 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Deleted allocations for instance af6b9740-b1c8-499e-83f4-6f3e5898a608
Nov 29 16:43:33 user nova-compute[75245]: DEBUG nova.compute.manager [req-489a5385-4e9a-4862-a61d-0ea0803508f6 req-c899d770-80c7-4dbc-a40d-91faa168b587 service nova] [instance: af6b9740-b1c8-499e-83f4-6f3e5898a608] Received event network-vif-unplugged-e2a86e77-c012-4252-9d4a-3c27e3b28042 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:43:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-489a5385-4e9a-4862-a61d-0ea0803508f6 req-c899d770-80c7-4dbc-a40d-91faa168b587 service nova] Acquiring lock "af6b9740-b1c8-499e-83f4-6f3e5898a608-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:43:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-489a5385-4e9a-4862-a61d-0ea0803508f6 req-c899d770-80c7-4dbc-a40d-91faa168b587 service nova] Lock "af6b9740-b1c8-499e-83f4-6f3e5898a608-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:43:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-489a5385-4e9a-4862-a61d-0ea0803508f6 req-c899d770-80c7-4dbc-a40d-91faa168b587 service nova] Lock "af6b9740-b1c8-499e-83f4-6f3e5898a608-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:43:33 user nova-compute[75245]: DEBUG nova.compute.manager [req-489a5385-4e9a-4862-a61d-0ea0803508f6 req-c899d770-80c7-4dbc-a40d-91faa168b587 service nova] [instance: af6b9740-b1c8-499e-83f4-6f3e5898a608] No waiting events found dispatching network-vif-unplugged-e2a86e77-c012-4252-9d4a-3c27e3b28042 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:43:33 user nova-compute[75245]: WARNING nova.compute.manager [req-489a5385-4e9a-4862-a61d-0ea0803508f6 req-c899d770-80c7-4dbc-a40d-91faa168b587 service nova] [instance: af6b9740-b1c8-499e-83f4-6f3e5898a608] Received unexpected event network-vif-unplugged-e2a86e77-c012-4252-9d4a-3c27e3b28042 for instance with vm_state deleted and task_state None.
Nov 29 16:43:33 user nova-compute[75245]: DEBUG nova.compute.manager [req-489a5385-4e9a-4862-a61d-0ea0803508f6 req-c899d770-80c7-4dbc-a40d-91faa168b587 service nova] [instance: af6b9740-b1c8-499e-83f4-6f3e5898a608] Received event network-vif-plugged-e2a86e77-c012-4252-9d4a-3c27e3b28042 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:43:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-489a5385-4e9a-4862-a61d-0ea0803508f6 req-c899d770-80c7-4dbc-a40d-91faa168b587 service nova] Acquiring lock "af6b9740-b1c8-499e-83f4-6f3e5898a608-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:43:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-489a5385-4e9a-4862-a61d-0ea0803508f6 req-c899d770-80c7-4dbc-a40d-91faa168b587 service nova] Lock "af6b9740-b1c8-499e-83f4-6f3e5898a608-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:43:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-489a5385-4e9a-4862-a61d-0ea0803508f6 req-c899d770-80c7-4dbc-a40d-91faa168b587 service nova] Lock "af6b9740-b1c8-499e-83f4-6f3e5898a608-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:43:33 user nova-compute[75245]: DEBUG nova.compute.manager [req-489a5385-4e9a-4862-a61d-0ea0803508f6 req-c899d770-80c7-4dbc-a40d-91faa168b587 service nova] [instance: af6b9740-b1c8-499e-83f4-6f3e5898a608] No waiting events found dispatching network-vif-plugged-e2a86e77-c012-4252-9d4a-3c27e3b28042 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:43:33 user nova-compute[75245]: WARNING nova.compute.manager [req-489a5385-4e9a-4862-a61d-0ea0803508f6 req-c899d770-80c7-4dbc-a40d-91faa168b587 service nova] [instance: af6b9740-b1c8-499e-83f4-6f3e5898a608] Received unexpected event network-vif-plugged-e2a86e77-c012-4252-9d4a-3c27e3b28042 for instance with vm_state deleted and task_state None.
Nov 29 16:43:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-f0c37fda-4dd8-40e0-9c70-fb5eef2216c9 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "af6b9740-b1c8-499e-83f4-6f3e5898a608" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.676s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:43:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:43:37 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:43:38 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-d329aa8a-bbd8-4d3e-8b7f-b5d0ebaec721 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c9ad13aa-7c21-4701-88e6-6265c7d19d7b is timed out.
Nov 29 16:43:38 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-d329aa8a-bbd8-4d3e-8b7f-b5d0ebaec721 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Successfully detached device vdb from instance c9ad13aa-7c21-4701-88e6-6265c7d19d7b from the live domain config.
Nov 29 16:43:38 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d329aa8a-bbd8-4d3e-8b7f-b5d0ebaec721 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] calling os-brick to detach iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 16:43:38 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-d329aa8a-bbd8-4d3e-8b7f-b5d0ebaec721 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, {'target_iqn': 'iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yHixFYrN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:43:38 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-d329aa8a-bbd8-4d3e-8b7f-b5d0ebaec721 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:43:38 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-d329aa8a-bbd8-4d3e-8b7f-b5d0ebaec721 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:43:38 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-d329aa8a-bbd8-4d3e-8b7f-b5d0ebaec721 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:43:38 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:43:38 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:43:38 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[80fae859-56f8-4831-9515-1a554b51946a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:93473e32-041a-42cb-b0ba-5bae7136e44f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:43:38 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-d329aa8a-bbd8-4d3e-8b7f-b5d0ebaec721 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 16:43:38 user nova-compute[75245]: No targets found.
Nov 29 16:43:38 user nova-compute[75245]: iSNS:
Nov 29 16:43:38 user nova-compute[75245]: No targets found.
Nov 29 16:43:38 user nova-compute[75245]: STATIC:
Nov 29 16:43:38 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:93473e32-041a-42cb-b0ba-5bae7136e44f
Nov 29 16:43:38 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:43:38 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:43:38 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d
Nov 29 16:43:38 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:43:38 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:43:38 user nova-compute[75245]: FIRMWARE:
Nov 29 16:43:38 user nova-compute[75245]: No targets found.
Nov 29 16:43:38 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:43:38 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-d329aa8a-bbd8-4d3e-8b7f-b5d0ebaec721 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 16:43:38 user nova-compute[75245]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 16:43:38 user nova-compute[75245]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75245) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 16:43:38 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-d329aa8a-bbd8-4d3e-8b7f-b5d0ebaec721 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d', 0)] {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 16:43:38 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:43:38 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:43:38 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[678bc4ab-144c-45a5-9109-0a3b65919d2f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93473e32-041a-42cb-b0ba-5bae7136e44f\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:43:38 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:43:38 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:43:38 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f18eb85-0d56-440b-a1be-c67008682620]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93473e32-041a-42cb-b0ba-5bae7136e44f (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:43:38 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-d329aa8a-bbd8-4d3e-8b7f-b5d0ebaec721 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d (non-flash)
Nov 29 16:43:38 user nova-compute[75245]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93473e32-041a-42cb-b0ba-5bae7136e44f (non-flash)
Nov 29 16:43:38 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:43:38 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-d329aa8a-bbd8-4d3e-8b7f-b5d0ebaec721 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d (non-flash)
Nov 29 16:43:38 user nova-compute[75245]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93473e32-041a-42cb-b0ba-5bae7136e44f (non-flash)
Nov 29 16:43:38 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:43:38 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-d329aa8a-bbd8-4d3e-8b7f-b5d0ebaec721 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0d44472320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d'): ({'sdb'}, set())}) {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 16:43:38 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-d329aa8a-bbd8-4d3e-8b7f-b5d0ebaec721 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Removing single pathed devices sdb {{(pid=75245) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 16:43:38 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:43:38 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:43:38 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[89825aa8-baaa-4a7c-990d-c80128895c34]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:43:38 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:43:38 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:43:38 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1db9d1-2d6b-4a6d-accf-1631d7467e6b]: (4, ('ok\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:43:38 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-d329aa8a-bbd8-4d3e-8b7f-b5d0ebaec721 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Flushing IO for device /dev/sdb {{(pid=75245) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 16:43:38 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:43:39 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:43:39 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9803e4c-0a99-4e0a-b75d-5e890afdc0e1]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:43:39 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-d329aa8a-bbd8-4d3e-8b7f-b5d0ebaec721 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75245) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 16:43:39 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:43:39 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:43:39 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[74298328-e96a-4293-8b90-ae3e6089f98f]: (4, ('1', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:43:39 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-d329aa8a-bbd8-4d3e-8b7f-b5d0ebaec721 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 16:43:39 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-d329aa8a-bbd8-4d3e-8b7f-b5d0ebaec721 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] SCSI volumes sdb have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 16:43:39 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-d329aa8a-bbd8-4d3e-8b7f-b5d0ebaec721 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d')] {{(pid=75245) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 16:43:39 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:43:39 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:43:39 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b477419-0db4-4875-b7e0-a0531b3e1c4d]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:43:39 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-d329aa8a-bbd8-4d3e-8b7f-b5d0ebaec721 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:43:39 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d -p 172.16.0.220:3260 --logout {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:43:39 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:43:39 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a5e411-78fa-42e0-b23f-3facac497417]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:43:39 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-d329aa8a-bbd8-4d3e-8b7f-b5d0ebaec721 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d, portal: 172.16.0.220,3260]
Nov 29 16:43:39 user nova-compute[75245]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d, portal: 172.16.0.220,3260] successful.
Nov 29 16:43:39 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:43:39 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d -p 172.16.0.220:3260 --op delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:43:39 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e40860c-63ee-4df7-87e1-d9e8219f694d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:43:39 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cacffe6-3fd4-4fe1-abca-16cf8fa35bfd]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:43:39 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-d329aa8a-bbd8-4d3e-8b7f-b5d0ebaec721 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:43:39 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-d329aa8a-bbd8-4d3e-8b7f-b5d0ebaec721 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:43:39 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-d329aa8a-bbd8-4d3e-8b7f-b5d0ebaec721 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] <== disconnect_volume: return (284ms) None {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:43:39 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d329aa8a-bbd8-4d3e-8b7f-b5d0ebaec721 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Disconnected iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 16:43:39 user nova-compute[75245]: DEBUG nova.objects.instance [None req-d329aa8a-bbd8-4d3e-8b7f-b5d0ebaec721 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lazy-loading 'flavor' on Instance uuid c9ad13aa-7c21-4701-88e6-6265c7d19d7b {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:43:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d329aa8a-bbd8-4d3e-8b7f-b5d0ebaec721 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lock "c9ad13aa-7c21-4701-88e6-6265c7d19d7b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.624s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:43:42 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:43:47 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:43:52 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:43:56 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Acquiring lock "e0fa6b82-c816-460d-bd42-b2bcd0d0d966" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:43:56 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Lock "e0fa6b82-c816-460d-bd42-b2bcd0d0d966" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:43:56 user nova-compute[75245]: DEBUG nova.compute.manager [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] [instance: e0fa6b82-c816-460d-bd42-b2bcd0d0d966] Starting instance... {{(pid=75245) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 16:43:56 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:43:56 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:43:56 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75245) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 16:43:56 user nova-compute[75245]: INFO nova.compute.claims [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] [instance: e0fa6b82-c816-460d-bd42-b2bcd0d0d966] Claim successful on node user
Nov 29 16:43:56 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:43:56 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:43:56 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.217s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:43:56 user nova-compute[75245]: DEBUG nova.compute.manager [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] [instance: e0fa6b82-c816-460d-bd42-b2bcd0d0d966] Start building networks asynchronously for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 16:43:56 user nova-compute[75245]: DEBUG nova.compute.manager [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] [instance: e0fa6b82-c816-460d-bd42-b2bcd0d0d966] Allocating IP information in the background. {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 16:43:56 user nova-compute[75245]: DEBUG nova.network.neutron [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] [instance: e0fa6b82-c816-460d-bd42-b2bcd0d0d966] allocate_for_instance() {{(pid=75245) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 16:43:56 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] [instance: e0fa6b82-c816-460d-bd42-b2bcd0d0d966] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 16:43:56 user nova-compute[75245]: DEBUG nova.compute.manager [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] [instance: e0fa6b82-c816-460d-bd42-b2bcd0d0d966] Start building block device mappings for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 16:43:56 user nova-compute[75245]: DEBUG nova.policy [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ad0b7d0571224f208814582c802fe0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa8698b2fbe4e45a02a50397fdc15c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75245) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 16:43:56 user nova-compute[75245]: DEBUG nova.compute.manager [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] [instance: e0fa6b82-c816-460d-bd42-b2bcd0d0d966] Start spawning the instance on the hypervisor. {{(pid=75245) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 16:43:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] [instance: e0fa6b82-c816-460d-bd42-b2bcd0d0d966] Creating instance directory {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 16:43:56 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] [instance: e0fa6b82-c816-460d-bd42-b2bcd0d0d966] Creating image(s)
Nov 29 16:43:56 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Acquiring lock "/opt/stack/data/nova/instances/e0fa6b82-c816-460d-bd42-b2bcd0d0d966/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:43:56 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Lock "/opt/stack/data/nova/instances/e0fa6b82-c816-460d-bd42-b2bcd0d0d966/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:43:56 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Lock "/opt/stack/data/nova/instances/e0fa6b82-c816-460d-bd42-b2bcd0d0d966/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:43:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:43:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.192s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:43:56 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Acquiring lock "d654f7206043e05d3525550b0fc885556eb999f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:43:56 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:43:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:43:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.185s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:43:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/e0fa6b82-c816-460d-bd42-b2bcd0d0d966/disk 1073741824 {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:43:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/e0fa6b82-c816-460d-bd42-b2bcd0d0d966/disk 1073741824" returned: 0 in 0.053s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:43:57 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:43:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:43:57 user nova-compute[75245]: DEBUG nova.network.neutron [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] [instance: e0fa6b82-c816-460d-bd42-b2bcd0d0d966] Successfully created port: df8f2eed-83d2-421d-b9b1-db1bdcedcd56 {{(pid=75245) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 16:43:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.183s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:43:57 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e0fa6b82-c816-460d-bd42-b2bcd0d0d966/disk. size=1073741824 {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 16:43:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0fa6b82-c816-460d-bd42-b2bcd0d0d966/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:43:57 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0fa6b82-c816-460d-bd42-b2bcd0d0d966/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:43:57 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Cannot resize image /opt/stack/data/nova/instances/e0fa6b82-c816-460d-bd42-b2bcd0d0d966/disk to a smaller size. {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 16:43:57 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] [instance: e0fa6b82-c816-460d-bd42-b2bcd0d0d966] Created local disks {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 16:43:57 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] [instance: e0fa6b82-c816-460d-bd42-b2bcd0d0d966] Ensure instance console log exists: /opt/stack/data/nova/instances/e0fa6b82-c816-460d-bd42-b2bcd0d0d966/console.log {{(pid=75245) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 16:43:57 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:43:57 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:43:57 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:43:57 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:43:57 user nova-compute[75245]: DEBUG nova.network.neutron [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] [instance: e0fa6b82-c816-460d-bd42-b2bcd0d0d966] Successfully updated port: df8f2eed-83d2-421d-b9b1-db1bdcedcd56 {{(pid=75245) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 16:43:57 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Acquiring lock "refresh_cache-e0fa6b82-c816-460d-bd42-b2bcd0d0d966" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:43:57 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Acquired lock "refresh_cache-e0fa6b82-c816-460d-bd42-b2bcd0d0d966" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:43:57 user nova-compute[75245]: DEBUG nova.network.neutron [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] [instance: e0fa6b82-c816-460d-bd42-b2bcd0d0d966] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 16:43:57 user nova-compute[75245]: DEBUG nova.compute.manager [req-5fa80f36-cfa1-4e89-b13d-49738d168be7 req-3b7b8a9f-f033-413a-8234-61a923b0e2a5 service nova] [instance: e0fa6b82-c816-460d-bd42-b2bcd0d0d966] Received event network-changed-df8f2eed-83d2-421d-b9b1-db1bdcedcd56 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:43:57 user nova-compute[75245]: DEBUG nova.compute.manager [req-5fa80f36-cfa1-4e89-b13d-49738d168be7 req-3b7b8a9f-f033-413a-8234-61a923b0e2a5 service nova] [instance: e0fa6b82-c816-460d-bd42-b2bcd0d0d966] Refreshing instance network info cache due to event network-changed-df8f2eed-83d2-421d-b9b1-db1bdcedcd56. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:43:57 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-5fa80f36-cfa1-4e89-b13d-49738d168be7 req-3b7b8a9f-f033-413a-8234-61a923b0e2a5 service nova] Acquiring lock "refresh_cache-e0fa6b82-c816-460d-bd42-b2bcd0d0d966" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:43:57 user nova-compute[75245]: DEBUG nova.network.neutron [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] [instance: e0fa6b82-c816-460d-bd42-b2bcd0d0d966] Instance cache missing network info. {{(pid=75245) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 16:43:58 user nova-compute[75245]: DEBUG nova.network.neutron [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] [instance: e0fa6b82-c816-460d-bd42-b2bcd0d0d966] Updating instance_info_cache with network_info: [{"id": "df8f2eed-83d2-421d-b9b1-db1bdcedcd56", "address": "fa:16:3e:4d:f0:12", "network": {"id": "02425e20-f9ba-4d18-a4ae-3805376f9ffc", "bridge": "br-int", "label": "tempest-VolumesActionsTest-437049831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fa8698b2fbe4e45a02a50397fdc15c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf8f2eed-83", "ovs_interfaceid": "df8f2eed-83d2-421d-b9b1-db1bdcedcd56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:43:58 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Releasing lock "refresh_cache-e0fa6b82-c816-460d-bd42-b2bcd0d0d966" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:43:58 user nova-compute[75245]: DEBUG nova.compute.manager [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] [instance: e0fa6b82-c816-460d-bd42-b2bcd0d0d966] Instance network_info: |[{"id": "df8f2eed-83d2-421d-b9b1-db1bdcedcd56", "address": "fa:16:3e:4d:f0:12", "network": {"id": "02425e20-f9ba-4d18-a4ae-3805376f9ffc", "bridge": "br-int", "label": "tempest-VolumesActionsTest-437049831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fa8698b2fbe4e45a02a50397fdc15c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf8f2eed-83", "ovs_interfaceid": "df8f2eed-83d2-421d-b9b1-db1bdcedcd56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 16:43:58 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-5fa80f36-cfa1-4e89-b13d-49738d168be7 req-3b7b8a9f-f033-413a-8234-61a923b0e2a5 service nova] Acquired lock "refresh_cache-e0fa6b82-c816-460d-bd42-b2bcd0d0d966" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:43:58 user nova-compute[75245]: DEBUG nova.network.neutron [req-5fa80f36-cfa1-4e89-b13d-49738d168be7 req-3b7b8a9f-f033-413a-8234-61a923b0e2a5 service nova] [instance: e0fa6b82-c816-460d-bd42-b2bcd0d0d966] Refreshing network info cache for port df8f2eed-83d2-421d-b9b1-db1bdcedcd56 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:43:58 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] [instance: e0fa6b82-c816-460d-bd42-b2bcd0d0d966] Start _get_guest_xml network_info=[{"id": "df8f2eed-83d2-421d-b9b1-db1bdcedcd56", "address": "fa:16:3e:4d:f0:12", "network": {"id": "02425e20-f9ba-4d18-a4ae-3805376f9ffc", "bridge": "br-int", "label": "tempest-VolumesActionsTest-437049831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fa8698b2fbe4e45a02a50397fdc15c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf8f2eed-83", "ovs_interfaceid": "df8f2eed-83d2-421d-b9b1-db1bdcedcd56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'a291d9c3-be02-4c6c-9649-4b45c5b7f487'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 16:43:58 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:43:58 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:43:58 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 16:43:58 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] CPU controller missing on host. {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 16:43:58 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 16:43:58 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] CPU controller found on host. {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 16:43:58 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75245) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 16:43:58 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T16:06:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 16:43:58 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Flavor limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 16:43:58 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Image limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 16:43:58 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Flavor pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 16:43:58 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Image pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 16:43:58 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 16:43:58 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 16:43:58 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 16:43:58 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Got 1 possible topologies {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 16:43:58 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 16:43:58 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 16:43:58 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:43:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-212068212',display_name='tempest-VolumesActionsTest-instance-212068212',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-212068212',id=38,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7fa8698b2fbe4e45a02a50397fdc15c0',ramdisk_id='',reservation_id='r-urxelrb5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1420605510',owner_user_name='tempest-VolumesActionsTest-1420605510-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:43:57Z,user_data=None,user_id='ad0b7d0571224f208814582c802fe0c7',uuid=e0fa6b82-c816-460d-bd42-b2bcd0d0d966,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df8f2eed-83d2-421d-b9b1-db1bdcedcd56", "address": "fa:16:3e:4d:f0:12", "network": {"id": "02425e20-f9ba-4d18-a4ae-3805376f9ffc", "bridge": "br-int", "label": "tempest-VolumesActionsTest-437049831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fa8698b2fbe4e45a02a50397fdc15c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf8f2eed-83", "ovs_interfaceid": "df8f2eed-83d2-421d-b9b1-db1bdcedcd56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:43:58 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Converting VIF {"id": "df8f2eed-83d2-421d-b9b1-db1bdcedcd56", "address": "fa:16:3e:4d:f0:12", "network": {"id": "02425e20-f9ba-4d18-a4ae-3805376f9ffc", "bridge": "br-int", "label": "tempest-VolumesActionsTest-437049831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fa8698b2fbe4e45a02a50397fdc15c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf8f2eed-83", "ovs_interfaceid": "df8f2eed-83d2-421d-b9b1-db1bdcedcd56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:43:58 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:f0:12,bridge_name='br-int',has_traffic_filtering=True,id=df8f2eed-83d2-421d-b9b1-db1bdcedcd56,network=Network(02425e20-f9ba-4d18-a4ae-3805376f9ffc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf8f2eed-83') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:43:58 user nova-compute[75245]: DEBUG nova.objects.instance [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Lazy-loading 'pci_devices' on Instance uuid e0fa6b82-c816-460d-bd42-b2bcd0d0d966 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:43:58 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] [instance: e0fa6b82-c816-460d-bd42-b2bcd0d0d966] End _get_guest_xml xml=<domain type="kvm">
Nov 29 16:43:58 user nova-compute[75245]:   <uuid>e0fa6b82-c816-460d-bd42-b2bcd0d0d966</uuid>
Nov 29 16:43:58 user nova-compute[75245]:   <name>instance-00000026</name>
Nov 29 16:43:58 user nova-compute[75245]:   <memory>524288</memory>
Nov 29 16:43:58 user nova-compute[75245]:   <vcpu>1</vcpu>
Nov 29 16:43:58 user nova-compute[75245]:   <metadata>
Nov 29 16:43:58 user nova-compute[75245]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 16:43:58 user nova-compute[75245]:       <nova:package version="0.0.0"/>
Nov 29 16:43:58 user nova-compute[75245]:       <nova:name>tempest-VolumesActionsTest-instance-212068212</nova:name>
Nov 29 16:43:58 user nova-compute[75245]:       <nova:creationTime>2023-11-29 16:43:58</nova:creationTime>
Nov 29 16:43:58 user nova-compute[75245]:       <nova:flavor name="m1.tiny">
Nov 29 16:43:58 user nova-compute[75245]:         <nova:memory>512</nova:memory>
Nov 29 16:43:58 user nova-compute[75245]:         <nova:disk>1</nova:disk>
Nov 29 16:43:58 user nova-compute[75245]:         <nova:swap>0</nova:swap>
Nov 29 16:43:58 user nova-compute[75245]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 16:43:58 user nova-compute[75245]:         <nova:vcpus>1</nova:vcpus>
Nov 29 16:43:58 user nova-compute[75245]:       </nova:flavor>
Nov 29 16:43:58 user nova-compute[75245]:       <nova:owner>
Nov 29 16:43:58 user nova-compute[75245]:         <nova:user uuid="ad0b7d0571224f208814582c802fe0c7">tempest-VolumesActionsTest-1420605510-project-member</nova:user>
Nov 29 16:43:58 user nova-compute[75245]:         <nova:project uuid="7fa8698b2fbe4e45a02a50397fdc15c0">tempest-VolumesActionsTest-1420605510</nova:project>
Nov 29 16:43:58 user nova-compute[75245]:       </nova:owner>
Nov 29 16:43:58 user nova-compute[75245]:       <nova:root type="image" uuid="a291d9c3-be02-4c6c-9649-4b45c5b7f487"/>
Nov 29 16:43:58 user nova-compute[75245]:       <nova:ports>
Nov 29 16:43:58 user nova-compute[75245]:         <nova:port uuid="df8f2eed-83d2-421d-b9b1-db1bdcedcd56">
Nov 29 16:43:58 user nova-compute[75245]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 29 16:43:58 user nova-compute[75245]:         </nova:port>
Nov 29 16:43:58 user nova-compute[75245]:       </nova:ports>
Nov 29 16:43:58 user nova-compute[75245]:     </nova:instance>
Nov 29 16:43:58 user nova-compute[75245]:   </metadata>
Nov 29 16:43:58 user nova-compute[75245]:   <sysinfo type="smbios">
Nov 29 16:43:58 user nova-compute[75245]:     <system>
Nov 29 16:43:58 user nova-compute[75245]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 16:43:58 user nova-compute[75245]:       <entry name="product">OpenStack Nova</entry>
Nov 29 16:43:58 user nova-compute[75245]:       <entry name="version">0.0.0</entry>
Nov 29 16:43:58 user nova-compute[75245]:       <entry name="serial">e0fa6b82-c816-460d-bd42-b2bcd0d0d966</entry>
Nov 29 16:43:58 user nova-compute[75245]:       <entry name="uuid">e0fa6b82-c816-460d-bd42-b2bcd0d0d966</entry>
Nov 29 16:43:58 user nova-compute[75245]:       <entry name="family">Virtual Machine</entry>
Nov 29 16:43:58 user nova-compute[75245]:     </system>
Nov 29 16:43:58 user nova-compute[75245]:   </sysinfo>
Nov 29 16:43:58 user nova-compute[75245]:   <os>
Nov 29 16:43:58 user nova-compute[75245]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 16:43:58 user nova-compute[75245]:     <boot dev="hd"/>
Nov 29 16:43:58 user nova-compute[75245]:     <smbios mode="sysinfo"/>
Nov 29 16:43:58 user nova-compute[75245]:   </os>
Nov 29 16:43:58 user nova-compute[75245]:   <features>
Nov 29 16:43:58 user nova-compute[75245]:     <acpi/>
Nov 29 16:43:58 user nova-compute[75245]:     <apic/>
Nov 29 16:43:58 user nova-compute[75245]:     <vmcoreinfo/>
Nov 29 16:43:58 user nova-compute[75245]:   </features>
Nov 29 16:43:58 user nova-compute[75245]:   <clock offset="utc">
Nov 29 16:43:58 user nova-compute[75245]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 16:43:58 user nova-compute[75245]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 16:43:58 user nova-compute[75245]:     <timer name="hpet" present="no"/>
Nov 29 16:43:58 user nova-compute[75245]:   </clock>
Nov 29 16:43:58 user nova-compute[75245]:   <cpu mode="custom" match="exact">
Nov 29 16:43:58 user nova-compute[75245]:     <model>Nehalem</model>
Nov 29 16:43:58 user nova-compute[75245]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 16:43:58 user nova-compute[75245]:   </cpu>
Nov 29 16:43:58 user nova-compute[75245]:   <devices>
Nov 29 16:43:58 user nova-compute[75245]:     <disk type="file" device="disk">
Nov 29 16:43:58 user nova-compute[75245]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 16:43:58 user nova-compute[75245]:       <source file="/opt/stack/data/nova/instances/e0fa6b82-c816-460d-bd42-b2bcd0d0d966/disk"/>
Nov 29 16:43:58 user nova-compute[75245]:       <target dev="vda" bus="virtio"/>
Nov 29 16:43:58 user nova-compute[75245]:     </disk>
Nov 29 16:43:58 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 16:43:58 user nova-compute[75245]:       <mac address="fa:16:3e:4d:f0:12"/>
Nov 29 16:43:58 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:43:58 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 16:43:58 user nova-compute[75245]:       <target dev="tapdf8f2eed-83"/>
Nov 29 16:43:58 user nova-compute[75245]:     </interface>
Nov 29 16:43:58 user nova-compute[75245]:     <serial type="pty">
Nov 29 16:43:58 user nova-compute[75245]:       <log file="/opt/stack/data/nova/instances/e0fa6b82-c816-460d-bd42-b2bcd0d0d966/console.log" append="off"/>
Nov 29 16:43:58 user nova-compute[75245]:     </serial>
Nov 29 16:43:58 user nova-compute[75245]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 16:43:58 user nova-compute[75245]:     <video>
Nov 29 16:43:58 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:43:58 user nova-compute[75245]:     </video>
Nov 29 16:43:58 user nova-compute[75245]:     <rng model="virtio">
Nov 29 16:43:58 user nova-compute[75245]:       <backend model="random">/dev/urandom</backend>
Nov 29 16:43:58 user nova-compute[75245]:     </rng>
Nov 29 16:43:58 user nova-compute[75245]:     <controller type="usb" index="0" model="none"/>
Nov 29 16:43:58 user nova-compute[75245]:     <memballoon model="virtio">
Nov 29 16:43:58 user nova-compute[75245]:       <stats period="10"/>
Nov 29 16:43:58 user nova-compute[75245]:     </memballoon>
Nov 29 16:43:58 user nova-compute[75245]:   </devices>
Nov 29 16:43:58 user nova-compute[75245]: </domain>
Nov 29 16:43:58 user nova-compute[75245]:  {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 16:43:58 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:43:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-212068212',display_name='tempest-VolumesActionsTest-instance-212068212',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-212068212',id=38,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7fa8698b2fbe4e45a02a50397fdc15c0',ramdisk_id='',reservation_id='r-urxelrb5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1420605510',owner_user_name='tempest-VolumesActionsTest-1420605510-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:43:57Z,user_data=None,user_id='ad0b7d0571224f208814582c802fe0c7',uuid=e0fa6b82-c816-460d-bd42-b2bcd0d0d966,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df8f2eed-83d2-421d-b9b1-db1bdcedcd56", "address": "fa:16:3e:4d:f0:12", "network": {"id": "02425e20-f9ba-4d18-a4ae-3805376f9ffc", "bridge": "br-int", "label": "tempest-VolumesActionsTest-437049831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fa8698b2fbe4e45a02a50397fdc15c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf8f2eed-83", "ovs_interfaceid": "df8f2eed-83d2-421d-b9b1-db1bdcedcd56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 16:43:58 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Converting VIF {"id": "df8f2eed-83d2-421d-b9b1-db1bdcedcd56", "address": "fa:16:3e:4d:f0:12", "network": {"id": "02425e20-f9ba-4d18-a4ae-3805376f9ffc", "bridge": "br-int", "label": "tempest-VolumesActionsTest-437049831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fa8698b2fbe4e45a02a50397fdc15c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf8f2eed-83", "ovs_interfaceid": "df8f2eed-83d2-421d-b9b1-db1bdcedcd56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:43:58 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:f0:12,bridge_name='br-int',has_traffic_filtering=True,id=df8f2eed-83d2-421d-b9b1-db1bdcedcd56,network=Network(02425e20-f9ba-4d18-a4ae-3805376f9ffc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf8f2eed-83') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:43:58 user nova-compute[75245]: DEBUG os_vif [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:f0:12,bridge_name='br-int',has_traffic_filtering=True,id=df8f2eed-83d2-421d-b9b1-db1bdcedcd56,network=Network(02425e20-f9ba-4d18-a4ae-3805376f9ffc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf8f2eed-83') {{(pid=75245) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 16:43:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:43:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:43:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 16:43:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:43:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cb941384-2a01-59ce-8ac9-de4bb36d6a1d', '_type': 'linux-noop'}}, row=False) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:43:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:43:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:43:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:43:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdf8f2eed-83, may_exist=True, interface_attrs={}) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:43:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdf8f2eed-83, col_values=(('qos', UUID('201b5087-94de-4a9d-9d32-18df183e61ef')),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:43:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdf8f2eed-83, col_values=(('external_ids', {'iface-id': 'df8f2eed-83d2-421d-b9b1-db1bdcedcd56', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:f0:12', 'vm-uuid': 'e0fa6b82-c816-460d-bd42-b2bcd0d0d966'}),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:43:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:43:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:43:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:43:58 user nova-compute[75245]: INFO os_vif [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:f0:12,bridge_name='br-int',has_traffic_filtering=True,id=df8f2eed-83d2-421d-b9b1-db1bdcedcd56,network=Network(02425e20-f9ba-4d18-a4ae-3805376f9ffc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf8f2eed-83')
Nov 29 16:43:58 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:43:58 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] No VIF found with MAC fa:16:3e:4d:f0:12, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:43:58 user nova-compute[75245]: DEBUG nova.network.neutron [req-5fa80f36-cfa1-4e89-b13d-49738d168be7 req-3b7b8a9f-f033-413a-8234-61a923b0e2a5 service nova] [instance: e0fa6b82-c816-460d-bd42-b2bcd0d0d966] Updated VIF entry in instance network info cache for port df8f2eed-83d2-421d-b9b1-db1bdcedcd56. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:43:58 user nova-compute[75245]: DEBUG nova.network.neutron [req-5fa80f36-cfa1-4e89-b13d-49738d168be7 req-3b7b8a9f-f033-413a-8234-61a923b0e2a5 service nova] [instance: e0fa6b82-c816-460d-bd42-b2bcd0d0d966] Updating instance_info_cache with network_info: [{"id": "df8f2eed-83d2-421d-b9b1-db1bdcedcd56", "address": "fa:16:3e:4d:f0:12", "network": {"id": "02425e20-f9ba-4d18-a4ae-3805376f9ffc", "bridge": "br-int", "label": "tempest-VolumesActionsTest-437049831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fa8698b2fbe4e45a02a50397fdc15c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf8f2eed-83", "ovs_interfaceid": "df8f2eed-83d2-421d-b9b1-db1bdcedcd56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:43:58 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-5fa80f36-cfa1-4e89-b13d-49738d168be7 req-3b7b8a9f-f033-413a-8234-61a923b0e2a5 service nova] Releasing lock "refresh_cache-e0fa6b82-c816-460d-bd42-b2bcd0d0d966" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:43:59 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:43:59 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:43:59 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:43:59 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:43:59 user nova-compute[75245]: DEBUG nova.compute.manager [req-d4975e92-2aab-400c-beae-1d6403dc5713 req-0f34e189-9053-4fc5-9281-e0f101fb75de service nova] [instance: e0fa6b82-c816-460d-bd42-b2bcd0d0d966] Received event network-vif-plugged-df8f2eed-83d2-421d-b9b1-db1bdcedcd56 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:43:59 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d4975e92-2aab-400c-beae-1d6403dc5713 req-0f34e189-9053-4fc5-9281-e0f101fb75de service nova] Acquiring lock "e0fa6b82-c816-460d-bd42-b2bcd0d0d966-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:43:59 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d4975e92-2aab-400c-beae-1d6403dc5713 req-0f34e189-9053-4fc5-9281-e0f101fb75de service nova] Lock "e0fa6b82-c816-460d-bd42-b2bcd0d0d966-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:43:59 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d4975e92-2aab-400c-beae-1d6403dc5713 req-0f34e189-9053-4fc5-9281-e0f101fb75de service nova] Lock "e0fa6b82-c816-460d-bd42-b2bcd0d0d966-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:43:59 user nova-compute[75245]: DEBUG nova.compute.manager [req-d4975e92-2aab-400c-beae-1d6403dc5713 req-0f34e189-9053-4fc5-9281-e0f101fb75de service nova] [instance: e0fa6b82-c816-460d-bd42-b2bcd0d0d966] No waiting events found dispatching network-vif-plugged-df8f2eed-83d2-421d-b9b1-db1bdcedcd56 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:43:59 user nova-compute[75245]: WARNING nova.compute.manager [req-d4975e92-2aab-400c-beae-1d6403dc5713 req-0f34e189-9053-4fc5-9281-e0f101fb75de service nova] [instance: e0fa6b82-c816-460d-bd42-b2bcd0d0d966] Received unexpected event network-vif-plugged-df8f2eed-83d2-421d-b9b1-db1bdcedcd56 for instance with vm_state building and task_state spawning.
Nov 29 16:44:00 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:44:00 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:44:00 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:44:01 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:44:01 user nova-compute[75245]: DEBUG nova.compute.manager [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] [instance: e0fa6b82-c816-460d-bd42-b2bcd0d0d966] Instance event wait completed in 0 seconds for  {{(pid=75245) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 16:44:01 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] [instance: e0fa6b82-c816-460d-bd42-b2bcd0d0d966] Guest created on hypervisor {{(pid=75245) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 16:44:01 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: e0fa6b82-c816-460d-bd42-b2bcd0d0d966] Instance spawned successfully.
Nov 29 16:44:01 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] [instance: e0fa6b82-c816-460d-bd42-b2bcd0d0d966] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 16:44:01 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] [instance: e0fa6b82-c816-460d-bd42-b2bcd0d0d966] Found default for hw_cdrom_bus of ide {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:44:01 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] [instance: e0fa6b82-c816-460d-bd42-b2bcd0d0d966] Found default for hw_disk_bus of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:44:01 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] [instance: e0fa6b82-c816-460d-bd42-b2bcd0d0d966] Found default for hw_input_bus of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:44:01 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] [instance: e0fa6b82-c816-460d-bd42-b2bcd0d0d966] Found default for hw_pointer_model of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:44:01 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] [instance: e0fa6b82-c816-460d-bd42-b2bcd0d0d966] Found default for hw_video_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:44:01 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] [instance: e0fa6b82-c816-460d-bd42-b2bcd0d0d966] Found default for hw_vif_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:44:01 user nova-compute[75245]: INFO nova.compute.manager [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] [instance: e0fa6b82-c816-460d-bd42-b2bcd0d0d966] Took 5.13 seconds to spawn the instance on the hypervisor.
Nov 29 16:44:01 user nova-compute[75245]: DEBUG nova.compute.manager [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] [instance: e0fa6b82-c816-460d-bd42-b2bcd0d0d966] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:44:01 user nova-compute[75245]: DEBUG nova.compute.manager [req-70dd3656-b631-4f9e-9aec-b52cce6c1ef9 req-bc0035a6-a3a1-48dd-95dc-0cd50e2c159d service nova] [instance: e0fa6b82-c816-460d-bd42-b2bcd0d0d966] Received event network-vif-plugged-df8f2eed-83d2-421d-b9b1-db1bdcedcd56 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:44:01 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-70dd3656-b631-4f9e-9aec-b52cce6c1ef9 req-bc0035a6-a3a1-48dd-95dc-0cd50e2c159d service nova] Acquiring lock "e0fa6b82-c816-460d-bd42-b2bcd0d0d966-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:44:01 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-70dd3656-b631-4f9e-9aec-b52cce6c1ef9 req-bc0035a6-a3a1-48dd-95dc-0cd50e2c159d service nova] Lock "e0fa6b82-c816-460d-bd42-b2bcd0d0d966-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:44:01 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-70dd3656-b631-4f9e-9aec-b52cce6c1ef9 req-bc0035a6-a3a1-48dd-95dc-0cd50e2c159d service nova] Lock "e0fa6b82-c816-460d-bd42-b2bcd0d0d966-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:44:01 user nova-compute[75245]: DEBUG nova.compute.manager [req-70dd3656-b631-4f9e-9aec-b52cce6c1ef9 req-bc0035a6-a3a1-48dd-95dc-0cd50e2c159d service nova] [instance: e0fa6b82-c816-460d-bd42-b2bcd0d0d966] No waiting events found dispatching network-vif-plugged-df8f2eed-83d2-421d-b9b1-db1bdcedcd56 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:44:01 user nova-compute[75245]: WARNING nova.compute.manager [req-70dd3656-b631-4f9e-9aec-b52cce6c1ef9 req-bc0035a6-a3a1-48dd-95dc-0cd50e2c159d service nova] [instance: e0fa6b82-c816-460d-bd42-b2bcd0d0d966] Received unexpected event network-vif-plugged-df8f2eed-83d2-421d-b9b1-db1bdcedcd56 for instance with vm_state building and task_state spawning.
Nov 29 16:44:01 user nova-compute[75245]: INFO nova.compute.manager [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] [instance: e0fa6b82-c816-460d-bd42-b2bcd0d0d966] Took 5.69 seconds to build instance.
Nov 29 16:44:01 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-7386664a-3b2e-4b94-8794-43b55cb5c579 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Lock "e0fa6b82-c816-460d-bd42-b2bcd0d0d966" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.810s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:44:03 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:44:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:44:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:44:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:44:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:44:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d3ea3ca3-bf87-402c-a52f-666cdf5a77f6 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Acquiring lock "c9ad13aa-7c21-4701-88e6-6265c7d19d7b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:44:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d3ea3ca3-bf87-402c-a52f-666cdf5a77f6 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lock "c9ad13aa-7c21-4701-88e6-6265c7d19d7b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:44:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d3ea3ca3-bf87-402c-a52f-666cdf5a77f6 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Acquiring lock "c9ad13aa-7c21-4701-88e6-6265c7d19d7b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:44:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d3ea3ca3-bf87-402c-a52f-666cdf5a77f6 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lock "c9ad13aa-7c21-4701-88e6-6265c7d19d7b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:44:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d3ea3ca3-bf87-402c-a52f-666cdf5a77f6 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lock "c9ad13aa-7c21-4701-88e6-6265c7d19d7b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:44:13 user nova-compute[75245]: INFO nova.compute.manager [None req-d3ea3ca3-bf87-402c-a52f-666cdf5a77f6 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Terminating instance
Nov 29 16:44:13 user nova-compute[75245]: DEBUG nova.compute.manager [None req-d3ea3ca3-bf87-402c-a52f-666cdf5a77f6 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Start destroying the instance on the hypervisor. {{(pid=75245) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 16:44:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:44:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:44:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:44:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:44:13 user nova-compute[75245]: DEBUG nova.compute.manager [req-b0aa83f0-43a7-4144-95ea-32e18e5d6330 req-84e8c7c6-31cb-481e-ad9b-e6c43f352b49 service nova] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Received event network-vif-unplugged-2844f77d-297d-4177-974c-22a1cab3590c {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:44:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b0aa83f0-43a7-4144-95ea-32e18e5d6330 req-84e8c7c6-31cb-481e-ad9b-e6c43f352b49 service nova] Acquiring lock "c9ad13aa-7c21-4701-88e6-6265c7d19d7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:44:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b0aa83f0-43a7-4144-95ea-32e18e5d6330 req-84e8c7c6-31cb-481e-ad9b-e6c43f352b49 service nova] Lock "c9ad13aa-7c21-4701-88e6-6265c7d19d7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:44:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b0aa83f0-43a7-4144-95ea-32e18e5d6330 req-84e8c7c6-31cb-481e-ad9b-e6c43f352b49 service nova] Lock "c9ad13aa-7c21-4701-88e6-6265c7d19d7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:44:13 user nova-compute[75245]: DEBUG nova.compute.manager [req-b0aa83f0-43a7-4144-95ea-32e18e5d6330 req-84e8c7c6-31cb-481e-ad9b-e6c43f352b49 service nova] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] No waiting events found dispatching network-vif-unplugged-2844f77d-297d-4177-974c-22a1cab3590c {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:44:13 user nova-compute[75245]: DEBUG nova.compute.manager [req-b0aa83f0-43a7-4144-95ea-32e18e5d6330 req-84e8c7c6-31cb-481e-ad9b-e6c43f352b49 service nova] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Received event network-vif-unplugged-2844f77d-297d-4177-974c-22a1cab3590c for instance with task_state deleting. {{(pid=75245) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 16:44:14 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Instance destroyed successfully.
Nov 29 16:44:14 user nova-compute[75245]: DEBUG nova.objects.instance [None req-d3ea3ca3-bf87-402c-a52f-666cdf5a77f6 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lazy-loading 'resources' on Instance uuid c9ad13aa-7c21-4701-88e6-6265c7d19d7b {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:44:14 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-d3ea3ca3-bf87-402c-a52f-666cdf5a77f6 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:39:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1892014678',display_name='tempest-TestMinimumBasicScenario-server-1892014678',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1892014678',id=33,image_ref='0fe99299-5682-40ee-b061-9396244f4f30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/fn3VZnaXRp52GgsG0rY0i3RksU9OcRdAeWoRVNMPmpdzBDa1b7iLg4ZNEWFhggmujXFSjcNRV3ybIUYpdHxIBtavYnjhjPvvDSYwscCv4nOgu/eQT6tBitfqYb6Z97A==',key_name='tempest-TestMinimumBasicScenario-1472502262',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:39:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ebd1ea36980641739f2bdd856a65d68a',ramdisk_id='',reservation_id='r-8fk12xb9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0fe99299-5682-40ee-b061-9396244f4f30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1366540792',owner_user_name='tempest-TestMinimumBasicScenario-1366540792-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:41:33Z,user_data=None,user_id='a219fd71b6cc40d88b161ba5ba82f4a7',uuid=c9ad13aa-7c21-4701-88e6-6265c7d19d7b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2844f77d-297d-4177-974c-22a1cab3590c", "address": "fa:16:3e:f4:3a:98", "network": {"id": "b0e81786-47f3-4a13-90c7-788cb53a4df5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1382922826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebd1ea36980641739f2bdd856a65d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2844f77d-29", "ovs_interfaceid": "2844f77d-297d-4177-974c-22a1cab3590c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 16:44:14 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-d3ea3ca3-bf87-402c-a52f-666cdf5a77f6 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Converting VIF {"id": "2844f77d-297d-4177-974c-22a1cab3590c", "address": "fa:16:3e:f4:3a:98", "network": {"id": "b0e81786-47f3-4a13-90c7-788cb53a4df5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1382922826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebd1ea36980641739f2bdd856a65d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2844f77d-29", "ovs_interfaceid": "2844f77d-297d-4177-974c-22a1cab3590c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:44:14 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-d3ea3ca3-bf87-402c-a52f-666cdf5a77f6 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:3a:98,bridge_name='br-int',has_traffic_filtering=True,id=2844f77d-297d-4177-974c-22a1cab3590c,network=Network(b0e81786-47f3-4a13-90c7-788cb53a4df5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2844f77d-29') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:44:14 user nova-compute[75245]: DEBUG os_vif [None req-d3ea3ca3-bf87-402c-a52f-666cdf5a77f6 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:3a:98,bridge_name='br-int',has_traffic_filtering=True,id=2844f77d-297d-4177-974c-22a1cab3590c,network=Network(b0e81786-47f3-4a13-90c7-788cb53a4df5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2844f77d-29') {{(pid=75245) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 16:44:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:44:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2844f77d-29, bridge=br-int, if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:44:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:44:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:44:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:44:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6bed1fe4-3c3b-4a1b-a99a-24e0581a0169) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:44:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:44:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:44:14 user nova-compute[75245]: INFO os_vif [None req-d3ea3ca3-bf87-402c-a52f-666cdf5a77f6 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:3a:98,bridge_name='br-int',has_traffic_filtering=True,id=2844f77d-297d-4177-974c-22a1cab3590c,network=Network(b0e81786-47f3-4a13-90c7-788cb53a4df5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2844f77d-29')
Nov 29 16:44:14 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-d3ea3ca3-bf87-402c-a52f-666cdf5a77f6 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Deleting instance files /opt/stack/data/nova/instances/c9ad13aa-7c21-4701-88e6-6265c7d19d7b_del
Nov 29 16:44:14 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-d3ea3ca3-bf87-402c-a52f-666cdf5a77f6 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Deletion of /opt/stack/data/nova/instances/c9ad13aa-7c21-4701-88e6-6265c7d19d7b_del complete
Nov 29 16:44:14 user nova-compute[75245]: INFO nova.compute.manager [None req-d3ea3ca3-bf87-402c-a52f-666cdf5a77f6 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 29 16:44:14 user nova-compute[75245]: DEBUG oslo.service.loopingcall [None req-d3ea3ca3-bf87-402c-a52f-666cdf5a77f6 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75245) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 16:44:14 user nova-compute[75245]: DEBUG nova.compute.manager [-] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Deallocating network for instance {{(pid=75245) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 16:44:14 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] deallocate_for_instance() {{(pid=75245) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 16:44:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:44:14 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:44:14 user nova-compute[75245]: INFO nova.compute.manager [-] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Took 0.58 seconds to deallocate network for instance.
Nov 29 16:44:14 user nova-compute[75245]: DEBUG nova.compute.manager [req-8dddefc9-6a1e-4ea2-bb13-7e61fdbd8278 req-fc0bec45-414e-4be8-80a0-d532df9090a8 service nova] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Received event network-vif-deleted-2844f77d-297d-4177-974c-22a1cab3590c {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:44:14 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d3ea3ca3-bf87-402c-a52f-666cdf5a77f6 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:44:14 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d3ea3ca3-bf87-402c-a52f-666cdf5a77f6 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:44:15 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-d3ea3ca3-bf87-402c-a52f-666cdf5a77f6 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:44:15 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-d3ea3ca3-bf87-402c-a52f-666cdf5a77f6 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:44:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d3ea3ca3-bf87-402c-a52f-666cdf5a77f6 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.179s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:44:15 user nova-compute[75245]: INFO nova.scheduler.client.report [None req-d3ea3ca3-bf87-402c-a52f-666cdf5a77f6 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Deleted allocations for instance c9ad13aa-7c21-4701-88e6-6265c7d19d7b
Nov 29 16:44:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d3ea3ca3-bf87-402c-a52f-666cdf5a77f6 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lock "c9ad13aa-7c21-4701-88e6-6265c7d19d7b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.818s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:44:15 user nova-compute[75245]: DEBUG nova.compute.manager [req-4464ca87-9426-47d2-aece-b484b6265243 req-b324aad5-8aa2-4019-a330-9a0427f7eb2a service nova] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Received event network-vif-plugged-2844f77d-297d-4177-974c-22a1cab3590c {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:44:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-4464ca87-9426-47d2-aece-b484b6265243 req-b324aad5-8aa2-4019-a330-9a0427f7eb2a service nova] Acquiring lock "c9ad13aa-7c21-4701-88e6-6265c7d19d7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:44:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-4464ca87-9426-47d2-aece-b484b6265243 req-b324aad5-8aa2-4019-a330-9a0427f7eb2a service nova] Lock "c9ad13aa-7c21-4701-88e6-6265c7d19d7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:44:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-4464ca87-9426-47d2-aece-b484b6265243 req-b324aad5-8aa2-4019-a330-9a0427f7eb2a service nova] Lock "c9ad13aa-7c21-4701-88e6-6265c7d19d7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:44:15 user nova-compute[75245]: DEBUG nova.compute.manager [req-4464ca87-9426-47d2-aece-b484b6265243 req-b324aad5-8aa2-4019-a330-9a0427f7eb2a service nova] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] No waiting events found dispatching network-vif-plugged-2844f77d-297d-4177-974c-22a1cab3590c {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:44:15 user nova-compute[75245]: WARNING nova.compute.manager [req-4464ca87-9426-47d2-aece-b484b6265243 req-b324aad5-8aa2-4019-a330-9a0427f7eb2a service nova] [instance: c9ad13aa-7c21-4701-88e6-6265c7d19d7b] Received unexpected event network-vif-plugged-2844f77d-297d-4177-974c-22a1cab3590c for instance with vm_state deleted and task_state None.
Nov 29 16:44:17 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:44:17 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Starting heal instance info cache {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 16:44:17 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Didn't find any instances for network info cache update. {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 16:44:18 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:44:19 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:44:19 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:44:19 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:44:20 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:44:20 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:44:20 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:44:20 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:44:20 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:44:20 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75245) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 16:44:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba3662d8-598b-4296-a1e8-4dd57b5c7f3d/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:44:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba3662d8-598b-4296-a1e8-4dd57b5c7f3d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:44:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba3662d8-598b-4296-a1e8-4dd57b5c7f3d/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:44:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba3662d8-598b-4296-a1e8-4dd57b5c7f3d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:44:20 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:44:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0fa6b82-c816-460d-bd42-b2bcd0d0d966/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:44:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0fa6b82-c816-460d-bd42-b2bcd0d0d966/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:44:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0fa6b82-c816-460d-bd42-b2bcd0d0d966/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:44:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0fa6b82-c816-460d-bd42-b2bcd0d0d966/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:44:21 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:44:21 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:44:21 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Hypervisor/Node resource view: name=user free_ram=8784MB free_disk=25.154342651367188GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75245) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 16:44:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:44:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:44:21 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance ba3662d8-598b-4296-a1e8-4dd57b5c7f3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:44:21 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance e0fa6b82-c816-460d-bd42-b2bcd0d0d966 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:44:21 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 16:44:21 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 16:44:21 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:44:21 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:44:21 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Compute_service record updated for user:user {{(pid=75245) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 16:44:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.219s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:44:23 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-ebae16e5-bcdb-4d78-a264-5eaaf8298ed3 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Acquiring lock "ba3662d8-598b-4296-a1e8-4dd57b5c7f3d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:44:23 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-ebae16e5-bcdb-4d78-a264-5eaaf8298ed3 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "ba3662d8-598b-4296-a1e8-4dd57b5c7f3d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:44:23 user nova-compute[75245]: INFO nova.compute.manager [None req-ebae16e5-bcdb-4d78-a264-5eaaf8298ed3 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] Detaching volume 93473e32-041a-42cb-b0ba-5bae7136e44f
Nov 29 16:44:23 user nova-compute[75245]: INFO nova.virt.block_device [None req-ebae16e5-bcdb-4d78-a264-5eaaf8298ed3 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] Attempting to driver detach volume 93473e32-041a-42cb-b0ba-5bae7136e44f from mountpoint /dev/vdb
Nov 29 16:44:23 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-ebae16e5-bcdb-4d78-a264-5eaaf8298ed3 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Attempting to detach device vdb from instance ba3662d8-598b-4296-a1e8-4dd57b5c7f3d from the persistent domain config. {{(pid=75245) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 16:44:23 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-ebae16e5-bcdb-4d78-a264-5eaaf8298ed3 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 16:44:23 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:44:23 user nova-compute[75245]:   <source dev="/dev/sdc"/>
Nov 29 16:44:23 user nova-compute[75245]:   <target dev="vdb" bus="virtio"/>
Nov 29 16:44:23 user nova-compute[75245]:   <serial>93473e32-041a-42cb-b0ba-5bae7136e44f</serial>
Nov 29 16:44:23 user nova-compute[75245]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 16:44:23 user nova-compute[75245]: </disk>
Nov 29 16:44:23 user nova-compute[75245]:  {{(pid=75245) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 16:44:23 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-ebae16e5-bcdb-4d78-a264-5eaaf8298ed3 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Successfully detached device vdb from instance ba3662d8-598b-4296-a1e8-4dd57b5c7f3d from the persistent domain config.
Nov 29 16:44:23 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-ebae16e5-bcdb-4d78-a264-5eaaf8298ed3 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ba3662d8-598b-4296-a1e8-4dd57b5c7f3d from the live domain config. {{(pid=75245) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 16:44:23 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-ebae16e5-bcdb-4d78-a264-5eaaf8298ed3 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 16:44:23 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:44:23 user nova-compute[75245]:   <source dev="/dev/sdc"/>
Nov 29 16:44:23 user nova-compute[75245]:   <target dev="vdb" bus="virtio"/>
Nov 29 16:44:23 user nova-compute[75245]:   <serial>93473e32-041a-42cb-b0ba-5bae7136e44f</serial>
Nov 29 16:44:23 user nova-compute[75245]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 16:44:23 user nova-compute[75245]: </disk>
Nov 29 16:44:23 user nova-compute[75245]:  {{(pid=75245) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 16:44:23 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-ebae16e5-bcdb-4d78-a264-5eaaf8298ed3 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ba3662d8-598b-4296-a1e8-4dd57b5c7f3d {{(pid=75245) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 16:44:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:44:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:44:27 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:44:27 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:44:27 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75245) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 16:44:28 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:44:29 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:44:29 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:44:33 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:44:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:44:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:44:36 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:44:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:44:43 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-ebae16e5-bcdb-4d78-a264-5eaaf8298ed3 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ba3662d8-598b-4296-a1e8-4dd57b5c7f3d is timed out.
Nov 29 16:44:43 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-ebae16e5-bcdb-4d78-a264-5eaaf8298ed3 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Successfully detached device vdb from instance ba3662d8-598b-4296-a1e8-4dd57b5c7f3d from the live domain config.
Nov 29 16:44:43 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebae16e5-bcdb-4d78-a264-5eaaf8298ed3 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] calling os-brick to detach iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 16:44:43 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebae16e5-bcdb-4d78-a264-5eaaf8298ed3 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, {'target_iqn': 'iqn.2010-10.org.openstack:93473e32-041a-42cb-b0ba-5bae7136e44f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QOVbntIL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:44:43 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-ebae16e5-bcdb-4d78-a264-5eaaf8298ed3 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:44:43 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-ebae16e5-bcdb-4d78-a264-5eaaf8298ed3 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:44:43 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-ebae16e5-bcdb-4d78-a264-5eaaf8298ed3 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:44:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:44:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:44:43 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[8beed41d-19c1-4681-94a7-f68e01c2e7c4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:93473e32-041a-42cb-b0ba-5bae7136e44f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:44:43 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebae16e5-bcdb-4d78-a264-5eaaf8298ed3 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 16:44:43 user nova-compute[75245]: No targets found.
Nov 29 16:44:43 user nova-compute[75245]: iSNS:
Nov 29 16:44:43 user nova-compute[75245]: No targets found.
Nov 29 16:44:43 user nova-compute[75245]: STATIC:
Nov 29 16:44:43 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:93473e32-041a-42cb-b0ba-5bae7136e44f
Nov 29 16:44:43 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:44:43 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:44:43 user nova-compute[75245]: FIRMWARE:
Nov 29 16:44:43 user nova-compute[75245]: No targets found.
Nov 29 16:44:43 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:44:43 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebae16e5-bcdb-4d78-a264-5eaaf8298ed3 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 16:44:43 user nova-compute[75245]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 16:44:43 user nova-compute[75245]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75245) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 16:44:43 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebae16e5-bcdb-4d78-a264-5eaaf8298ed3 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93473e32-041a-42cb-b0ba-5bae7136e44f', 0)] {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 16:44:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:44:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:44:43 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b819db-aadb-4ae7-b338-44d3545034c3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93473e32-041a-42cb-b0ba-5bae7136e44f\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:44:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:44:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:44:43 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd34956-d982-4b74-a89f-c9308c86c271]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93473e32-041a-42cb-b0ba-5bae7136e44f (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:44:43 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebae16e5-bcdb-4d78-a264-5eaaf8298ed3 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93473e32-041a-42cb-b0ba-5bae7136e44f (non-flash)
Nov 29 16:44:43 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:44:43 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebae16e5-bcdb-4d78-a264-5eaaf8298ed3 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93473e32-041a-42cb-b0ba-5bae7136e44f (non-flash)
Nov 29 16:44:43 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:44:43 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebae16e5-bcdb-4d78-a264-5eaaf8298ed3 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0d20750f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93473e32-041a-42cb-b0ba-5bae7136e44f'): ({'sdc'}, set())}) {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 16:44:43 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-ebae16e5-bcdb-4d78-a264-5eaaf8298ed3 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Removing single pathed devices sdc {{(pid=75245) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 16:44:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:44:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:44:43 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[f35cebba-8ab0-4996-bf9e-0e400c2a8ae5]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:44:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:44:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:44:43 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1978ab0-5fc9-477e-958b-cd35c54c919b]: (4, ('ok\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:44:43 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-ebae16e5-bcdb-4d78-a264-5eaaf8298ed3 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Flushing IO for device /dev/sdc {{(pid=75245) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 16:44:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:44:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:44:43 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ee9e10-d397-4d9c-97c1-38b8f7096bfc]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:44:43 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-ebae16e5-bcdb-4d78-a264-5eaaf8298ed3 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75245) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 16:44:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:44:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:44:43 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[722b3a81-0acc-4b8d-8b62-dc428a916062]: (4, ('1', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:44:43 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-ebae16e5-bcdb-4d78-a264-5eaaf8298ed3 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 16:44:43 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-ebae16e5-bcdb-4d78-a264-5eaaf8298ed3 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] SCSI volumes sdc have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 16:44:43 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebae16e5-bcdb-4d78-a264-5eaaf8298ed3 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93473e32-041a-42cb-b0ba-5bae7136e44f')] {{(pid=75245) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 16:44:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93473e32-041a-42cb-b0ba-5bae7136e44f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:44:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93473e32-041a-42cb-b0ba-5bae7136e44f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:44:43 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a9ec6f-97c1-4a77-8bef-722833138a5e]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:44:43 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebae16e5-bcdb-4d78-a264-5eaaf8298ed3 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:44:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93473e32-041a-42cb-b0ba-5bae7136e44f -p 172.16.0.220:3260 --logout {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:44:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93473e32-041a-42cb-b0ba-5bae7136e44f -p 172.16.0.220:3260 --logout" returned: 0 in 0.039s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:44:43 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9000bf7-70eb-4e35-8cc8-bd3a9700c345]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:93473e32-041a-42cb-b0ba-5bae7136e44f, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:93473e32-041a-42cb-b0ba-5bae7136e44f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:44:43 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebae16e5-bcdb-4d78-a264-5eaaf8298ed3 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:93473e32-041a-42cb-b0ba-5bae7136e44f, portal: 172.16.0.220,3260]
Nov 29 16:44:43 user nova-compute[75245]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:93473e32-041a-42cb-b0ba-5bae7136e44f, portal: 172.16.0.220,3260] successful.
Nov 29 16:44:43 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:44:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93473e32-041a-42cb-b0ba-5bae7136e44f -p 172.16.0.220:3260 --op delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:44:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93473e32-041a-42cb-b0ba-5bae7136e44f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:44:43 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c4cfb2-ea3c-4205-929a-17d8726bf595]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:44:43 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebae16e5-bcdb-4d78-a264-5eaaf8298ed3 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:44:43 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-ebae16e5-bcdb-4d78-a264-5eaaf8298ed3 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.272s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:44:43 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebae16e5-bcdb-4d78-a264-5eaaf8298ed3 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] <== disconnect_volume: return (273ms) None {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:44:43 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebae16e5-bcdb-4d78-a264-5eaaf8298ed3 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] Disconnected iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 16:44:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:44:44 user nova-compute[75245]: DEBUG nova.objects.instance [None req-ebae16e5-bcdb-4d78-a264-5eaaf8298ed3 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lazy-loading 'flavor' on Instance uuid ba3662d8-598b-4296-a1e8-4dd57b5c7f3d {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:44:44 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-ebae16e5-bcdb-4d78-a264-5eaaf8298ed3 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "ba3662d8-598b-4296-a1e8-4dd57b5c7f3d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.745s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:44:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:44:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:44:59 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:45:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:45:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Acquiring lock "7b03f1f3-2061-4962-ba07-3a4f9da2ea90" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:45:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lock "7b03f1f3-2061-4962-ba07-3a4f9da2ea90" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:45:07 user nova-compute[75245]: DEBUG nova.compute.manager [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Starting instance... {{(pid=75245) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 16:45:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:45:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:45:07 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75245) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 16:45:07 user nova-compute[75245]: INFO nova.compute.claims [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Claim successful on node user
Nov 29 16:45:07 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:45:07 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:45:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.411s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:45:07 user nova-compute[75245]: DEBUG nova.compute.manager [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Start building networks asynchronously for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 16:45:07 user nova-compute[75245]: DEBUG nova.compute.manager [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Allocating IP information in the background. {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 16:45:07 user nova-compute[75245]: DEBUG nova.network.neutron [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] allocate_for_instance() {{(pid=75245) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 16:45:07 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 16:45:07 user nova-compute[75245]: DEBUG nova.compute.manager [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Start building block device mappings for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 16:45:08 user nova-compute[75245]: DEBUG nova.policy [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a219fd71b6cc40d88b161ba5ba82f4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd1ea36980641739f2bdd856a65d68a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75245) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 16:45:08 user nova-compute[75245]: DEBUG nova.compute.manager [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Start spawning the instance on the hypervisor. {{(pid=75245) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 16:45:08 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Creating instance directory {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 16:45:08 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Creating image(s)
Nov 29 16:45:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Acquiring lock "/opt/stack/data/nova/instances/7b03f1f3-2061-4962-ba07-3a4f9da2ea90/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:45:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lock "/opt/stack/data/nova/instances/7b03f1f3-2061-4962-ba07-3a4f9da2ea90/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:45:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lock "/opt/stack/data/nova/instances/7b03f1f3-2061-4962-ba07-3a4f9da2ea90/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:45:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Acquiring lock "45b77643bb3bf69fcf53d1d72c80ca993e44022d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:45:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lock "45b77643bb3bf69fcf53d1d72c80ca993e44022d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:45:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45b77643bb3bf69fcf53d1d72c80ca993e44022d.part --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:45:08 user nova-compute[75245]: DEBUG nova.network.neutron [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Successfully created port: 0599b1d1-85cd-4003-9d3d-c343f09a5b2b {{(pid=75245) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 16:45:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45b77643bb3bf69fcf53d1d72c80ca993e44022d.part --force-share --output=json" returned: 0 in 0.185s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:45:08 user nova-compute[75245]: DEBUG nova.virt.images [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] aa336f1d-5522-4fcf-aa9f-bc3836a74f50 was qcow2, converting to raw {{(pid=75245) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 16:45:08 user nova-compute[75245]: DEBUG nova.privsep.utils [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75245) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 16:45:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/45b77643bb3bf69fcf53d1d72c80ca993e44022d.part /opt/stack/data/nova/instances/_base/45b77643bb3bf69fcf53d1d72c80ca993e44022d.converted {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:45:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/45b77643bb3bf69fcf53d1d72c80ca993e44022d.part /opt/stack/data/nova/instances/_base/45b77643bb3bf69fcf53d1d72c80ca993e44022d.converted" returned: 0 in 0.332s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:45:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45b77643bb3bf69fcf53d1d72c80ca993e44022d.converted --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:45:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45b77643bb3bf69fcf53d1d72c80ca993e44022d.converted --force-share --output=json" returned: 0 in 0.188s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:45:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lock "45b77643bb3bf69fcf53d1d72c80ca993e44022d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.156s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:45:09 user nova-compute[75245]: DEBUG nova.network.neutron [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Successfully updated port: 0599b1d1-85cd-4003-9d3d-c343f09a5b2b {{(pid=75245) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 16:45:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45b77643bb3bf69fcf53d1d72c80ca993e44022d --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:45:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:45:09 user nova-compute[75245]: DEBUG nova.compute.manager [req-98a0fdf1-817e-4701-bd0c-5309180e0ee1 req-c7b10d5c-2af2-4112-a9fe-fbe44926de4d service nova] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Received event network-changed-0599b1d1-85cd-4003-9d3d-c343f09a5b2b {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:45:09 user nova-compute[75245]: DEBUG nova.compute.manager [req-98a0fdf1-817e-4701-bd0c-5309180e0ee1 req-c7b10d5c-2af2-4112-a9fe-fbe44926de4d service nova] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Refreshing instance network info cache due to event network-changed-0599b1d1-85cd-4003-9d3d-c343f09a5b2b. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:45:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-98a0fdf1-817e-4701-bd0c-5309180e0ee1 req-c7b10d5c-2af2-4112-a9fe-fbe44926de4d service nova] Acquiring lock "refresh_cache-7b03f1f3-2061-4962-ba07-3a4f9da2ea90" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:45:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-98a0fdf1-817e-4701-bd0c-5309180e0ee1 req-c7b10d5c-2af2-4112-a9fe-fbe44926de4d service nova] Acquired lock "refresh_cache-7b03f1f3-2061-4962-ba07-3a4f9da2ea90" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:45:09 user nova-compute[75245]: DEBUG nova.network.neutron [req-98a0fdf1-817e-4701-bd0c-5309180e0ee1 req-c7b10d5c-2af2-4112-a9fe-fbe44926de4d service nova] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Refreshing network info cache for port 0599b1d1-85cd-4003-9d3d-c343f09a5b2b {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:45:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Acquiring lock "refresh_cache-7b03f1f3-2061-4962-ba07-3a4f9da2ea90" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:45:09 user nova-compute[75245]: DEBUG nova.network.neutron [req-98a0fdf1-817e-4701-bd0c-5309180e0ee1 req-c7b10d5c-2af2-4112-a9fe-fbe44926de4d service nova] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Instance cache missing network info. {{(pid=75245) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 16:45:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45b77643bb3bf69fcf53d1d72c80ca993e44022d --force-share --output=json" returned: 0 in 0.189s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:45:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Acquiring lock "45b77643bb3bf69fcf53d1d72c80ca993e44022d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:45:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lock "45b77643bb3bf69fcf53d1d72c80ca993e44022d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:45:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45b77643bb3bf69fcf53d1d72c80ca993e44022d --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:45:09 user nova-compute[75245]: DEBUG nova.network.neutron [req-98a0fdf1-817e-4701-bd0c-5309180e0ee1 req-c7b10d5c-2af2-4112-a9fe-fbe44926de4d service nova] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:45:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-98a0fdf1-817e-4701-bd0c-5309180e0ee1 req-c7b10d5c-2af2-4112-a9fe-fbe44926de4d service nova] Releasing lock "refresh_cache-7b03f1f3-2061-4962-ba07-3a4f9da2ea90" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:45:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Acquired lock "refresh_cache-7b03f1f3-2061-4962-ba07-3a4f9da2ea90" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:45:09 user nova-compute[75245]: DEBUG nova.network.neutron [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 16:45:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45b77643bb3bf69fcf53d1d72c80ca993e44022d --force-share --output=json" returned: 0 in 0.181s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:45:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45b77643bb3bf69fcf53d1d72c80ca993e44022d,backing_fmt=raw /opt/stack/data/nova/instances/7b03f1f3-2061-4962-ba07-3a4f9da2ea90/disk 1073741824 {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:45:09 user nova-compute[75245]: DEBUG nova.network.neutron [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Instance cache missing network info. {{(pid=75245) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 16:45:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45b77643bb3bf69fcf53d1d72c80ca993e44022d,backing_fmt=raw /opt/stack/data/nova/instances/7b03f1f3-2061-4962-ba07-3a4f9da2ea90/disk 1073741824" returned: 0 in 0.065s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:45:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lock "45b77643bb3bf69fcf53d1d72c80ca993e44022d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:45:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45b77643bb3bf69fcf53d1d72c80ca993e44022d --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:45:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45b77643bb3bf69fcf53d1d72c80ca993e44022d --force-share --output=json" returned: 0 in 0.182s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:45:09 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7b03f1f3-2061-4962-ba07-3a4f9da2ea90/disk. size=1073741824 {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 16:45:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b03f1f3-2061-4962-ba07-3a4f9da2ea90/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:45:09 user nova-compute[75245]: DEBUG nova.network.neutron [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Updating instance_info_cache with network_info: [{"id": "0599b1d1-85cd-4003-9d3d-c343f09a5b2b", "address": "fa:16:3e:61:06:fc", "network": {"id": "b0e81786-47f3-4a13-90c7-788cb53a4df5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1382922826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebd1ea36980641739f2bdd856a65d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0599b1d1-85", "ovs_interfaceid": "0599b1d1-85cd-4003-9d3d-c343f09a5b2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:45:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Releasing lock "refresh_cache-7b03f1f3-2061-4962-ba07-3a4f9da2ea90" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:45:10 user nova-compute[75245]: DEBUG nova.compute.manager [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Instance network_info: |[{"id": "0599b1d1-85cd-4003-9d3d-c343f09a5b2b", "address": "fa:16:3e:61:06:fc", "network": {"id": "b0e81786-47f3-4a13-90c7-788cb53a4df5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1382922826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebd1ea36980641739f2bdd856a65d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0599b1d1-85", "ovs_interfaceid": "0599b1d1-85cd-4003-9d3d-c343f09a5b2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 16:45:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b03f1f3-2061-4962-ba07-3a4f9da2ea90/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:45:10 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Cannot resize image /opt/stack/data/nova/instances/7b03f1f3-2061-4962-ba07-3a4f9da2ea90/disk to a smaller size. {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 16:45:10 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Created local disks {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 16:45:10 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Ensure instance console log exists: /opt/stack/data/nova/instances/7b03f1f3-2061-4962-ba07-3a4f9da2ea90/console.log {{(pid=75245) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 16:45:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:45:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:45:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:45:10 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Start _get_guest_xml network_info=[{"id": "0599b1d1-85cd-4003-9d3d-c343f09a5b2b", "address": "fa:16:3e:61:06:fc", "network": {"id": "b0e81786-47f3-4a13-90c7-788cb53a4df5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1382922826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebd1ea36980641739f2bdd856a65d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0599b1d1-85", "ovs_interfaceid": "0599b1d1-85cd-4003-9d3d-c343f09a5b2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:45:05Z,direct_url=<?>,disk_format='qcow2',id=aa336f1d-5522-4fcf-aa9f-bc3836a74f50,min_disk=0,min_ram=0,name='tempest-scenario-img--831285017',owner='ebd1ea36980641739f2bdd856a65d68a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:45:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'aa336f1d-5522-4fcf-aa9f-bc3836a74f50'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 16:45:10 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:45:10 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:45:10 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 16:45:10 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] CPU controller missing on host. {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 16:45:10 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 16:45:10 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] CPU controller found on host. {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 16:45:10 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75245) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 16:45:10 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T16:06:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:45:05Z,direct_url=<?>,disk_format='qcow2',id=aa336f1d-5522-4fcf-aa9f-bc3836a74f50,min_disk=0,min_ram=0,name='tempest-scenario-img--831285017',owner='ebd1ea36980641739f2bdd856a65d68a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:45:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 16:45:10 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Flavor limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 16:45:10 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Image limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 16:45:10 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Flavor pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 16:45:10 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Image pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 16:45:10 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 16:45:10 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 16:45:10 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 16:45:10 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Got 1 possible topologies {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 16:45:10 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 16:45:10 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 16:45:10 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:45:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1350917926',display_name='tempest-TestMinimumBasicScenario-server-1350917926',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1350917926',id=39,image_ref='aa336f1d-5522-4fcf-aa9f-bc3836a74f50',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHP13/JpyOWEDU+dgL481xjMctfPgIML/fqfOBy5OZ6z/LH/hCzAWTp3cxr55EL0QZxguh2kFAfXYAS8ygu5fz5rxfCAv4GQG5MpKSZCl4Mn2mxPQGCAJLRKIp/mt8ziJA==',key_name='tempest-TestMinimumBasicScenario-828675410',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ebd1ea36980641739f2bdd856a65d68a',ramdisk_id='',reservation_id='r-1rea6njd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa336f1d-5522-4fcf-aa9f-bc3836a74f50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1366540792',owner_user_name='tempest-TestMinimumBasicScenario-1366540792-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:45:08Z,user_data=None,user_id='a219fd71b6cc40d88b161ba5ba82f4a7',uuid=7b03f1f3-2061-4962-ba07-3a4f9da2ea90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0599b1d1-85cd-4003-9d3d-c343f09a5b2b", "address": "fa:16:3e:61:06:fc", "network": {"id": "b0e81786-47f3-4a13-90c7-788cb53a4df5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1382922826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebd1ea36980641739f2bdd856a65d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0599b1d1-85", "ovs_interfaceid": "0599b1d1-85cd-4003-9d3d-c343f09a5b2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:45:10 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Converting VIF {"id": "0599b1d1-85cd-4003-9d3d-c343f09a5b2b", "address": "fa:16:3e:61:06:fc", "network": {"id": "b0e81786-47f3-4a13-90c7-788cb53a4df5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1382922826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebd1ea36980641739f2bdd856a65d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0599b1d1-85", "ovs_interfaceid": "0599b1d1-85cd-4003-9d3d-c343f09a5b2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:45:10 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:06:fc,bridge_name='br-int',has_traffic_filtering=True,id=0599b1d1-85cd-4003-9d3d-c343f09a5b2b,network=Network(b0e81786-47f3-4a13-90c7-788cb53a4df5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0599b1d1-85') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:45:10 user nova-compute[75245]: DEBUG nova.objects.instance [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lazy-loading 'pci_devices' on Instance uuid 7b03f1f3-2061-4962-ba07-3a4f9da2ea90 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:45:10 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] End _get_guest_xml xml=<domain type="kvm">
Nov 29 16:45:10 user nova-compute[75245]:   <uuid>7b03f1f3-2061-4962-ba07-3a4f9da2ea90</uuid>
Nov 29 16:45:10 user nova-compute[75245]:   <name>instance-00000027</name>
Nov 29 16:45:10 user nova-compute[75245]:   <memory>524288</memory>
Nov 29 16:45:10 user nova-compute[75245]:   <vcpu>1</vcpu>
Nov 29 16:45:10 user nova-compute[75245]:   <metadata>
Nov 29 16:45:10 user nova-compute[75245]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 16:45:10 user nova-compute[75245]:       <nova:package version="0.0.0"/>
Nov 29 16:45:10 user nova-compute[75245]:       <nova:name>tempest-TestMinimumBasicScenario-server-1350917926</nova:name>
Nov 29 16:45:10 user nova-compute[75245]:       <nova:creationTime>2023-11-29 16:45:10</nova:creationTime>
Nov 29 16:45:10 user nova-compute[75245]:       <nova:flavor name="m1.tiny">
Nov 29 16:45:10 user nova-compute[75245]:         <nova:memory>512</nova:memory>
Nov 29 16:45:10 user nova-compute[75245]:         <nova:disk>1</nova:disk>
Nov 29 16:45:10 user nova-compute[75245]:         <nova:swap>0</nova:swap>
Nov 29 16:45:10 user nova-compute[75245]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 16:45:10 user nova-compute[75245]:         <nova:vcpus>1</nova:vcpus>
Nov 29 16:45:10 user nova-compute[75245]:       </nova:flavor>
Nov 29 16:45:10 user nova-compute[75245]:       <nova:owner>
Nov 29 16:45:10 user nova-compute[75245]:         <nova:user uuid="a219fd71b6cc40d88b161ba5ba82f4a7">tempest-TestMinimumBasicScenario-1366540792-project-member</nova:user>
Nov 29 16:45:10 user nova-compute[75245]:         <nova:project uuid="ebd1ea36980641739f2bdd856a65d68a">tempest-TestMinimumBasicScenario-1366540792</nova:project>
Nov 29 16:45:10 user nova-compute[75245]:       </nova:owner>
Nov 29 16:45:10 user nova-compute[75245]:       <nova:root type="image" uuid="aa336f1d-5522-4fcf-aa9f-bc3836a74f50"/>
Nov 29 16:45:10 user nova-compute[75245]:       <nova:ports>
Nov 29 16:45:10 user nova-compute[75245]:         <nova:port uuid="0599b1d1-85cd-4003-9d3d-c343f09a5b2b">
Nov 29 16:45:10 user nova-compute[75245]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 29 16:45:10 user nova-compute[75245]:         </nova:port>
Nov 29 16:45:10 user nova-compute[75245]:       </nova:ports>
Nov 29 16:45:10 user nova-compute[75245]:     </nova:instance>
Nov 29 16:45:10 user nova-compute[75245]:   </metadata>
Nov 29 16:45:10 user nova-compute[75245]:   <sysinfo type="smbios">
Nov 29 16:45:10 user nova-compute[75245]:     <system>
Nov 29 16:45:10 user nova-compute[75245]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 16:45:10 user nova-compute[75245]:       <entry name="product">OpenStack Nova</entry>
Nov 29 16:45:10 user nova-compute[75245]:       <entry name="version">0.0.0</entry>
Nov 29 16:45:10 user nova-compute[75245]:       <entry name="serial">7b03f1f3-2061-4962-ba07-3a4f9da2ea90</entry>
Nov 29 16:45:10 user nova-compute[75245]:       <entry name="uuid">7b03f1f3-2061-4962-ba07-3a4f9da2ea90</entry>
Nov 29 16:45:10 user nova-compute[75245]:       <entry name="family">Virtual Machine</entry>
Nov 29 16:45:10 user nova-compute[75245]:     </system>
Nov 29 16:45:10 user nova-compute[75245]:   </sysinfo>
Nov 29 16:45:10 user nova-compute[75245]:   <os>
Nov 29 16:45:10 user nova-compute[75245]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 16:45:10 user nova-compute[75245]:     <boot dev="hd"/>
Nov 29 16:45:10 user nova-compute[75245]:     <smbios mode="sysinfo"/>
Nov 29 16:45:10 user nova-compute[75245]:   </os>
Nov 29 16:45:10 user nova-compute[75245]:   <features>
Nov 29 16:45:10 user nova-compute[75245]:     <acpi/>
Nov 29 16:45:10 user nova-compute[75245]:     <apic/>
Nov 29 16:45:10 user nova-compute[75245]:     <vmcoreinfo/>
Nov 29 16:45:10 user nova-compute[75245]:   </features>
Nov 29 16:45:10 user nova-compute[75245]:   <clock offset="utc">
Nov 29 16:45:10 user nova-compute[75245]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 16:45:10 user nova-compute[75245]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 16:45:10 user nova-compute[75245]:     <timer name="hpet" present="no"/>
Nov 29 16:45:10 user nova-compute[75245]:   </clock>
Nov 29 16:45:10 user nova-compute[75245]:   <cpu mode="custom" match="exact">
Nov 29 16:45:10 user nova-compute[75245]:     <model>Nehalem</model>
Nov 29 16:45:10 user nova-compute[75245]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 16:45:10 user nova-compute[75245]:   </cpu>
Nov 29 16:45:10 user nova-compute[75245]:   <devices>
Nov 29 16:45:10 user nova-compute[75245]:     <disk type="file" device="disk">
Nov 29 16:45:10 user nova-compute[75245]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 16:45:10 user nova-compute[75245]:       <source file="/opt/stack/data/nova/instances/7b03f1f3-2061-4962-ba07-3a4f9da2ea90/disk"/>
Nov 29 16:45:10 user nova-compute[75245]:       <target dev="vda" bus="virtio"/>
Nov 29 16:45:10 user nova-compute[75245]:     </disk>
Nov 29 16:45:10 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 16:45:10 user nova-compute[75245]:       <mac address="fa:16:3e:61:06:fc"/>
Nov 29 16:45:10 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:45:10 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 16:45:10 user nova-compute[75245]:       <target dev="tap0599b1d1-85"/>
Nov 29 16:45:10 user nova-compute[75245]:     </interface>
Nov 29 16:45:10 user nova-compute[75245]:     <serial type="pty">
Nov 29 16:45:10 user nova-compute[75245]:       <log file="/opt/stack/data/nova/instances/7b03f1f3-2061-4962-ba07-3a4f9da2ea90/console.log" append="off"/>
Nov 29 16:45:10 user nova-compute[75245]:     </serial>
Nov 29 16:45:10 user nova-compute[75245]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 16:45:10 user nova-compute[75245]:     <video>
Nov 29 16:45:10 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:45:10 user nova-compute[75245]:     </video>
Nov 29 16:45:10 user nova-compute[75245]:     <rng model="virtio">
Nov 29 16:45:10 user nova-compute[75245]:       <backend model="random">/dev/urandom</backend>
Nov 29 16:45:10 user nova-compute[75245]:     </rng>
Nov 29 16:45:10 user nova-compute[75245]:     <controller type="usb" index="0" model="none"/>
Nov 29 16:45:10 user nova-compute[75245]:     <memballoon model="virtio">
Nov 29 16:45:10 user nova-compute[75245]:       <stats period="10"/>
Nov 29 16:45:10 user nova-compute[75245]:     </memballoon>
Nov 29 16:45:10 user nova-compute[75245]:   </devices>
Nov 29 16:45:10 user nova-compute[75245]: </domain>
Nov 29 16:45:10 user nova-compute[75245]:  {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 16:45:10 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:45:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1350917926',display_name='tempest-TestMinimumBasicScenario-server-1350917926',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1350917926',id=39,image_ref='aa336f1d-5522-4fcf-aa9f-bc3836a74f50',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHP13/JpyOWEDU+dgL481xjMctfPgIML/fqfOBy5OZ6z/LH/hCzAWTp3cxr55EL0QZxguh2kFAfXYAS8ygu5fz5rxfCAv4GQG5MpKSZCl4Mn2mxPQGCAJLRKIp/mt8ziJA==',key_name='tempest-TestMinimumBasicScenario-828675410',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ebd1ea36980641739f2bdd856a65d68a',ramdisk_id='',reservation_id='r-1rea6njd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa336f1d-5522-4fcf-aa9f-bc3836a74f50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1366540792',owner_user_name='tempest-TestMinimumBasicScenario-1366540792-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:45:08Z,user_data=None,user_id='a219fd71b6cc40d88b161ba5ba82f4a7',uuid=7b03f1f3-2061-4962-ba07-3a4f9da2ea90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0599b1d1-85cd-4003-9d3d-c343f09a5b2b", "address": "fa:16:3e:61:06:fc", "network": {"id": "b0e81786-47f3-4a13-90c7-788cb53a4df5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1382922826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebd1ea36980641739f2bdd856a65d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0599b1d1-85", "ovs_interfaceid": "0599b1d1-85cd-4003-9d3d-c343f09a5b2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 16:45:10 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Converting VIF {"id": "0599b1d1-85cd-4003-9d3d-c343f09a5b2b", "address": "fa:16:3e:61:06:fc", "network": {"id": "b0e81786-47f3-4a13-90c7-788cb53a4df5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1382922826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebd1ea36980641739f2bdd856a65d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0599b1d1-85", "ovs_interfaceid": "0599b1d1-85cd-4003-9d3d-c343f09a5b2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:45:10 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:06:fc,bridge_name='br-int',has_traffic_filtering=True,id=0599b1d1-85cd-4003-9d3d-c343f09a5b2b,network=Network(b0e81786-47f3-4a13-90c7-788cb53a4df5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0599b1d1-85') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:45:10 user nova-compute[75245]: DEBUG os_vif [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:06:fc,bridge_name='br-int',has_traffic_filtering=True,id=0599b1d1-85cd-4003-9d3d-c343f09a5b2b,network=Network(b0e81786-47f3-4a13-90c7-788cb53a4df5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0599b1d1-85') {{(pid=75245) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 16:45:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:45:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:45:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 16:45:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:45:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '442a4cbe-5502-5158-9137-080c175e62aa', '_type': 'linux-noop'}}, row=False) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:45:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:45:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:45:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:45:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0599b1d1-85, may_exist=True, interface_attrs={}) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:45:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0599b1d1-85, col_values=(('qos', UUID('1d8427be-52b2-441d-898c-2c4532e6242f')),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:45:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0599b1d1-85, col_values=(('external_ids', {'iface-id': '0599b1d1-85cd-4003-9d3d-c343f09a5b2b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:06:fc', 'vm-uuid': '7b03f1f3-2061-4962-ba07-3a4f9da2ea90'}),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:45:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:45:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:45:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:45:10 user nova-compute[75245]: INFO os_vif [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:06:fc,bridge_name='br-int',has_traffic_filtering=True,id=0599b1d1-85cd-4003-9d3d-c343f09a5b2b,network=Network(b0e81786-47f3-4a13-90c7-788cb53a4df5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0599b1d1-85')
Nov 29 16:45:10 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:45:10 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] No VIF found with MAC fa:16:3e:61:06:fc, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:45:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:45:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:45:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:45:11 user nova-compute[75245]: DEBUG nova.compute.manager [req-93aff759-c88c-4195-9149-9854d73459f3 req-3007864c-cedd-4774-a181-9252076f2e29 service nova] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Received event network-vif-plugged-0599b1d1-85cd-4003-9d3d-c343f09a5b2b {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:45:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-93aff759-c88c-4195-9149-9854d73459f3 req-3007864c-cedd-4774-a181-9252076f2e29 service nova] Acquiring lock "7b03f1f3-2061-4962-ba07-3a4f9da2ea90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:45:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-93aff759-c88c-4195-9149-9854d73459f3 req-3007864c-cedd-4774-a181-9252076f2e29 service nova] Lock "7b03f1f3-2061-4962-ba07-3a4f9da2ea90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:45:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-93aff759-c88c-4195-9149-9854d73459f3 req-3007864c-cedd-4774-a181-9252076f2e29 service nova] Lock "7b03f1f3-2061-4962-ba07-3a4f9da2ea90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:45:11 user nova-compute[75245]: DEBUG nova.compute.manager [req-93aff759-c88c-4195-9149-9854d73459f3 req-3007864c-cedd-4774-a181-9252076f2e29 service nova] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] No waiting events found dispatching network-vif-plugged-0599b1d1-85cd-4003-9d3d-c343f09a5b2b {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:45:11 user nova-compute[75245]: WARNING nova.compute.manager [req-93aff759-c88c-4195-9149-9854d73459f3 req-3007864c-cedd-4774-a181-9252076f2e29 service nova] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Received unexpected event network-vif-plugged-0599b1d1-85cd-4003-9d3d-c343f09a5b2b for instance with vm_state building and task_state spawning.
Nov 29 16:45:12 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:45:12 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:45:12 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:45:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-5979ad42-5f4a-4f02-9ebd-b77ff87a692a tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Acquiring lock "ba3662d8-598b-4296-a1e8-4dd57b5c7f3d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:45:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-5979ad42-5f4a-4f02-9ebd-b77ff87a692a tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "ba3662d8-598b-4296-a1e8-4dd57b5c7f3d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:45:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-5979ad42-5f4a-4f02-9ebd-b77ff87a692a tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Acquiring lock "ba3662d8-598b-4296-a1e8-4dd57b5c7f3d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:45:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-5979ad42-5f4a-4f02-9ebd-b77ff87a692a tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "ba3662d8-598b-4296-a1e8-4dd57b5c7f3d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:45:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-5979ad42-5f4a-4f02-9ebd-b77ff87a692a tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "ba3662d8-598b-4296-a1e8-4dd57b5c7f3d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:45:13 user nova-compute[75245]: INFO nova.compute.manager [None req-5979ad42-5f4a-4f02-9ebd-b77ff87a692a tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] Terminating instance
Nov 29 16:45:13 user nova-compute[75245]: DEBUG nova.compute.manager [None req-5979ad42-5f4a-4f02-9ebd-b77ff87a692a tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] Start destroying the instance on the hypervisor. {{(pid=75245) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 16:45:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:45:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:45:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:45:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:45:13 user nova-compute[75245]: DEBUG nova.compute.manager [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Instance event wait completed in 0 seconds for  {{(pid=75245) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 16:45:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Guest created on hypervisor {{(pid=75245) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 16:45:13 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Instance spawned successfully.
Nov 29 16:45:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 16:45:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Found default for hw_cdrom_bus of ide {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:45:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Found default for hw_disk_bus of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:45:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Found default for hw_input_bus of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:45:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Found default for hw_pointer_model of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:45:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Found default for hw_video_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:45:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Found default for hw_vif_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:45:13 user nova-compute[75245]: DEBUG nova.compute.manager [req-d07fbfcb-aaf5-4f8f-894f-6fb330089de1 req-20da969a-fce8-4353-8c9f-6a9066718f69 service nova] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] Received event network-vif-unplugged-e8484c13-9f26-42b4-8790-028d183a911a {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:45:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d07fbfcb-aaf5-4f8f-894f-6fb330089de1 req-20da969a-fce8-4353-8c9f-6a9066718f69 service nova] Acquiring lock "ba3662d8-598b-4296-a1e8-4dd57b5c7f3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:45:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d07fbfcb-aaf5-4f8f-894f-6fb330089de1 req-20da969a-fce8-4353-8c9f-6a9066718f69 service nova] Lock "ba3662d8-598b-4296-a1e8-4dd57b5c7f3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:45:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d07fbfcb-aaf5-4f8f-894f-6fb330089de1 req-20da969a-fce8-4353-8c9f-6a9066718f69 service nova] Lock "ba3662d8-598b-4296-a1e8-4dd57b5c7f3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:45:13 user nova-compute[75245]: DEBUG nova.compute.manager [req-d07fbfcb-aaf5-4f8f-894f-6fb330089de1 req-20da969a-fce8-4353-8c9f-6a9066718f69 service nova] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] No waiting events found dispatching network-vif-unplugged-e8484c13-9f26-42b4-8790-028d183a911a {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:45:13 user nova-compute[75245]: DEBUG nova.compute.manager [req-d07fbfcb-aaf5-4f8f-894f-6fb330089de1 req-20da969a-fce8-4353-8c9f-6a9066718f69 service nova] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] Received event network-vif-unplugged-e8484c13-9f26-42b4-8790-028d183a911a for instance with task_state deleting. {{(pid=75245) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 16:45:13 user nova-compute[75245]: DEBUG nova.compute.manager [req-e80746f5-59b7-44ec-b679-d124a4982e1a req-c27faf2f-9c24-4dce-9492-453f265cf865 service nova] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Received event network-vif-plugged-0599b1d1-85cd-4003-9d3d-c343f09a5b2b {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:45:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-e80746f5-59b7-44ec-b679-d124a4982e1a req-c27faf2f-9c24-4dce-9492-453f265cf865 service nova] Acquiring lock "7b03f1f3-2061-4962-ba07-3a4f9da2ea90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:45:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-e80746f5-59b7-44ec-b679-d124a4982e1a req-c27faf2f-9c24-4dce-9492-453f265cf865 service nova] Lock "7b03f1f3-2061-4962-ba07-3a4f9da2ea90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:45:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-e80746f5-59b7-44ec-b679-d124a4982e1a req-c27faf2f-9c24-4dce-9492-453f265cf865 service nova] Lock "7b03f1f3-2061-4962-ba07-3a4f9da2ea90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:45:13 user nova-compute[75245]: DEBUG nova.compute.manager [req-e80746f5-59b7-44ec-b679-d124a4982e1a req-c27faf2f-9c24-4dce-9492-453f265cf865 service nova] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] No waiting events found dispatching network-vif-plugged-0599b1d1-85cd-4003-9d3d-c343f09a5b2b {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:45:13 user nova-compute[75245]: WARNING nova.compute.manager [req-e80746f5-59b7-44ec-b679-d124a4982e1a req-c27faf2f-9c24-4dce-9492-453f265cf865 service nova] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Received unexpected event network-vif-plugged-0599b1d1-85cd-4003-9d3d-c343f09a5b2b for instance with vm_state building and task_state spawning.
Nov 29 16:45:13 user nova-compute[75245]: INFO nova.compute.manager [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Took 5.71 seconds to spawn the instance on the hypervisor.
Nov 29 16:45:13 user nova-compute[75245]: DEBUG nova.compute.manager [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:45:13 user nova-compute[75245]: INFO nova.compute.manager [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Took 6.45 seconds to build instance.
Nov 29 16:45:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-521415f4-a2e3-4b7b-a0a7-84bdae7cc6f0 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lock "7b03f1f3-2061-4962-ba07-3a4f9da2ea90" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.551s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:45:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:45:14 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] Instance destroyed successfully.
Nov 29 16:45:14 user nova-compute[75245]: DEBUG nova.objects.instance [None req-5979ad42-5f4a-4f02-9ebd-b77ff87a692a tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lazy-loading 'resources' on Instance uuid ba3662d8-598b-4296-a1e8-4dd57b5c7f3d {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:45:14 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-5979ad42-5f4a-4f02-9ebd-b77ff87a692a tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:39:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-368707389',display_name='tempest-AttachVolumeNegativeTest-server-368707389',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-368707389',id=34,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL0XbW+77+5IttR4DxQwPCY4hhMFWKhFR+XJp0lFoitlFyoxe3lxDdIOwf9MUD+bloTjHJZFssgDEl27H9m8DnQ7OVg0KiJD/eouTn859qnkNTxBMnZybn/iAKPLsfQN1w==',key_name='tempest-keypair-1307614818',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:39:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='01e269dbe30d46ccb81d58e2590004db',ramdisk_id='',reservation_id='r-6lm85bep',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-44169219',owner_user_name='tempest-AttachVolumeNegativeTest-44169219-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:39:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb4c94298bf14753bb9530633e766dee',uuid=ba3662d8-598b-4296-a1e8-4dd57b5c7f3d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e8484c13-9f26-42b4-8790-028d183a911a", "address": "fa:16:3e:6b:bd:c8", "network": {"id": "55744af1-3291-4de1-9bf4-554f9ee4f057", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1570836437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01e269dbe30d46ccb81d58e2590004db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8484c13-9f", "ovs_interfaceid": "e8484c13-9f26-42b4-8790-028d183a911a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 16:45:14 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-5979ad42-5f4a-4f02-9ebd-b77ff87a692a tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Converting VIF {"id": "e8484c13-9f26-42b4-8790-028d183a911a", "address": "fa:16:3e:6b:bd:c8", "network": {"id": "55744af1-3291-4de1-9bf4-554f9ee4f057", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1570836437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01e269dbe30d46ccb81d58e2590004db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8484c13-9f", "ovs_interfaceid": "e8484c13-9f26-42b4-8790-028d183a911a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:45:14 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-5979ad42-5f4a-4f02-9ebd-b77ff87a692a tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6b:bd:c8,bridge_name='br-int',has_traffic_filtering=True,id=e8484c13-9f26-42b4-8790-028d183a911a,network=Network(55744af1-3291-4de1-9bf4-554f9ee4f057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8484c13-9f') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:45:14 user nova-compute[75245]: DEBUG os_vif [None req-5979ad42-5f4a-4f02-9ebd-b77ff87a692a tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:bd:c8,bridge_name='br-int',has_traffic_filtering=True,id=e8484c13-9f26-42b4-8790-028d183a911a,network=Network(55744af1-3291-4de1-9bf4-554f9ee4f057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8484c13-9f') {{(pid=75245) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 16:45:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:45:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape8484c13-9f, bridge=br-int, if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:45:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:45:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:45:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:45:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c2b4962b-964b-4f72-9e36-8dacd98a7804) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:45:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:45:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:45:14 user nova-compute[75245]: INFO os_vif [None req-5979ad42-5f4a-4f02-9ebd-b77ff87a692a tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:bd:c8,bridge_name='br-int',has_traffic_filtering=True,id=e8484c13-9f26-42b4-8790-028d183a911a,network=Network(55744af1-3291-4de1-9bf4-554f9ee4f057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8484c13-9f')
Nov 29 16:45:14 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-5979ad42-5f4a-4f02-9ebd-b77ff87a692a tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] Deleting instance files /opt/stack/data/nova/instances/ba3662d8-598b-4296-a1e8-4dd57b5c7f3d_del
Nov 29 16:45:14 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-5979ad42-5f4a-4f02-9ebd-b77ff87a692a tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] Deletion of /opt/stack/data/nova/instances/ba3662d8-598b-4296-a1e8-4dd57b5c7f3d_del complete
Nov 29 16:45:14 user nova-compute[75245]: INFO nova.compute.manager [None req-5979ad42-5f4a-4f02-9ebd-b77ff87a692a tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 29 16:45:14 user nova-compute[75245]: DEBUG oslo.service.loopingcall [None req-5979ad42-5f4a-4f02-9ebd-b77ff87a692a tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75245) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 16:45:14 user nova-compute[75245]: DEBUG nova.compute.manager [-] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] Deallocating network for instance {{(pid=75245) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 16:45:14 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] deallocate_for_instance() {{(pid=75245) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 16:45:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:45:15 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:45:15 user nova-compute[75245]: INFO nova.compute.manager [-] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] Took 1.25 seconds to deallocate network for instance.
Nov 29 16:45:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-5979ad42-5f4a-4f02-9ebd-b77ff87a692a tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:45:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-5979ad42-5f4a-4f02-9ebd-b77ff87a692a tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:45:15 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-5979ad42-5f4a-4f02-9ebd-b77ff87a692a tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:45:15 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-5979ad42-5f4a-4f02-9ebd-b77ff87a692a tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:45:15 user nova-compute[75245]: DEBUG nova.compute.manager [req-4adcec65-88b7-4548-aa05-ba3f744c218c req-8ee1382c-2aaa-47b6-8272-6cfc3bcb6242 service nova] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] Received event network-vif-plugged-e8484c13-9f26-42b4-8790-028d183a911a {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:45:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-4adcec65-88b7-4548-aa05-ba3f744c218c req-8ee1382c-2aaa-47b6-8272-6cfc3bcb6242 service nova] Acquiring lock "ba3662d8-598b-4296-a1e8-4dd57b5c7f3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:45:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-4adcec65-88b7-4548-aa05-ba3f744c218c req-8ee1382c-2aaa-47b6-8272-6cfc3bcb6242 service nova] Lock "ba3662d8-598b-4296-a1e8-4dd57b5c7f3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:45:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-4adcec65-88b7-4548-aa05-ba3f744c218c req-8ee1382c-2aaa-47b6-8272-6cfc3bcb6242 service nova] Lock "ba3662d8-598b-4296-a1e8-4dd57b5c7f3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:45:15 user nova-compute[75245]: DEBUG nova.compute.manager [req-4adcec65-88b7-4548-aa05-ba3f744c218c req-8ee1382c-2aaa-47b6-8272-6cfc3bcb6242 service nova] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] No waiting events found dispatching network-vif-plugged-e8484c13-9f26-42b4-8790-028d183a911a {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:45:15 user nova-compute[75245]: WARNING nova.compute.manager [req-4adcec65-88b7-4548-aa05-ba3f744c218c req-8ee1382c-2aaa-47b6-8272-6cfc3bcb6242 service nova] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] Received unexpected event network-vif-plugged-e8484c13-9f26-42b4-8790-028d183a911a for instance with vm_state deleted and task_state None.
Nov 29 16:45:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-5979ad42-5f4a-4f02-9ebd-b77ff87a692a tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.164s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:45:15 user nova-compute[75245]: DEBUG nova.compute.manager [req-db066cc6-6bad-4ba5-be42-d636e0c9b9b1 req-ef7e7bcd-ee61-4187-adc1-b71da21bae34 service nova] [instance: ba3662d8-598b-4296-a1e8-4dd57b5c7f3d] Received event network-vif-deleted-e8484c13-9f26-42b4-8790-028d183a911a {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:45:15 user nova-compute[75245]: INFO nova.scheduler.client.report [None req-5979ad42-5f4a-4f02-9ebd-b77ff87a692a tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Deleted allocations for instance ba3662d8-598b-4296-a1e8-4dd57b5c7f3d
Nov 29 16:45:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-5979ad42-5f4a-4f02-9ebd-b77ff87a692a tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "ba3662d8-598b-4296-a1e8-4dd57b5c7f3d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.508s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:45:18 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:45:18 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Starting heal instance info cache {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 16:45:18 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Rebuilding the list of instances to heal {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 16:45:18 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "refresh_cache-e0fa6b82-c816-460d-bd42-b2bcd0d0d966" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:45:18 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquired lock "refresh_cache-e0fa6b82-c816-460d-bd42-b2bcd0d0d966" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:45:18 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: e0fa6b82-c816-460d-bd42-b2bcd0d0d966] Forcefully refreshing network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 16:45:18 user nova-compute[75245]: DEBUG nova.objects.instance [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lazy-loading 'info_cache' on Instance uuid e0fa6b82-c816-460d-bd42-b2bcd0d0d966 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:45:19 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: e0fa6b82-c816-460d-bd42-b2bcd0d0d966] Updating instance_info_cache with network_info: [{"id": "df8f2eed-83d2-421d-b9b1-db1bdcedcd56", "address": "fa:16:3e:4d:f0:12", "network": {"id": "02425e20-f9ba-4d18-a4ae-3805376f9ffc", "bridge": "br-int", "label": "tempest-VolumesActionsTest-437049831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fa8698b2fbe4e45a02a50397fdc15c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf8f2eed-83", "ovs_interfaceid": "df8f2eed-83d2-421d-b9b1-db1bdcedcd56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:45:19 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Releasing lock "refresh_cache-e0fa6b82-c816-460d-bd42-b2bcd0d0d966" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:45:19 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: e0fa6b82-c816-460d-bd42-b2bcd0d0d966] Updated the network info_cache for instance {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 16:45:19 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:45:19 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:45:19 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:45:20 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:45:20 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:45:20 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:45:20 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:45:20 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75245) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 16:45:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b03f1f3-2061-4962-ba07-3a4f9da2ea90/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:45:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b03f1f3-2061-4962-ba07-3a4f9da2ea90/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:45:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b03f1f3-2061-4962-ba07-3a4f9da2ea90/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:45:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b03f1f3-2061-4962-ba07-3a4f9da2ea90/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:45:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0fa6b82-c816-460d-bd42-b2bcd0d0d966/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:45:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0fa6b82-c816-460d-bd42-b2bcd0d0d966/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:45:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0fa6b82-c816-460d-bd42-b2bcd0d0d966/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:45:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0fa6b82-c816-460d-bd42-b2bcd0d0d966/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:45:21 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:45:21 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:45:21 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Hypervisor/Node resource view: name=user free_ram=8752MB free_disk=25.157562255859375GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75245) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 16:45:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:45:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:45:21 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance e0fa6b82-c816-460d-bd42-b2bcd0d0d966 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:45:21 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 7b03f1f3-2061-4962-ba07-3a4f9da2ea90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:45:21 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 16:45:21 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 16:45:21 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:45:21 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:45:21 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Compute_service record updated for user:user {{(pid=75245) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 16:45:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.220s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:45:22 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:45:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:45:28 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:45:28 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:45:28 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75245) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 16:45:29 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:45:29 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:45:30 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:45:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:45:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:45:34 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:45:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:45:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:45:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:45:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:45:47 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2ed10043-bf00-45c1-bed7-54cfbbed37c8 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Acquiring lock "e0fa6b82-c816-460d-bd42-b2bcd0d0d966" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:45:47 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2ed10043-bf00-45c1-bed7-54cfbbed37c8 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Lock "e0fa6b82-c816-460d-bd42-b2bcd0d0d966" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:45:47 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2ed10043-bf00-45c1-bed7-54cfbbed37c8 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Acquiring lock "e0fa6b82-c816-460d-bd42-b2bcd0d0d966-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:45:47 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2ed10043-bf00-45c1-bed7-54cfbbed37c8 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Lock "e0fa6b82-c816-460d-bd42-b2bcd0d0d966-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:45:47 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2ed10043-bf00-45c1-bed7-54cfbbed37c8 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Lock "e0fa6b82-c816-460d-bd42-b2bcd0d0d966-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:45:47 user nova-compute[75245]: INFO nova.compute.manager [None req-2ed10043-bf00-45c1-bed7-54cfbbed37c8 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] [instance: e0fa6b82-c816-460d-bd42-b2bcd0d0d966] Terminating instance
Nov 29 16:45:47 user nova-compute[75245]: DEBUG nova.compute.manager [None req-2ed10043-bf00-45c1-bed7-54cfbbed37c8 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] [instance: e0fa6b82-c816-460d-bd42-b2bcd0d0d966] Start destroying the instance on the hypervisor. {{(pid=75245) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 16:45:47 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:45:47 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:45:47 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:45:47 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:45:47 user nova-compute[75245]: DEBUG nova.compute.manager [req-0ba7df96-2c12-48cf-8d13-b7d9ae5222ae req-39169607-6fc1-4ffb-88c7-e2c26bf96f43 service nova] [instance: e0fa6b82-c816-460d-bd42-b2bcd0d0d966] Received event network-vif-unplugged-df8f2eed-83d2-421d-b9b1-db1bdcedcd56 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:45:47 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-0ba7df96-2c12-48cf-8d13-b7d9ae5222ae req-39169607-6fc1-4ffb-88c7-e2c26bf96f43 service nova] Acquiring lock "e0fa6b82-c816-460d-bd42-b2bcd0d0d966-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:45:47 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-0ba7df96-2c12-48cf-8d13-b7d9ae5222ae req-39169607-6fc1-4ffb-88c7-e2c26bf96f43 service nova] Lock "e0fa6b82-c816-460d-bd42-b2bcd0d0d966-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:45:47 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-0ba7df96-2c12-48cf-8d13-b7d9ae5222ae req-39169607-6fc1-4ffb-88c7-e2c26bf96f43 service nova] Lock "e0fa6b82-c816-460d-bd42-b2bcd0d0d966-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:45:47 user nova-compute[75245]: DEBUG nova.compute.manager [req-0ba7df96-2c12-48cf-8d13-b7d9ae5222ae req-39169607-6fc1-4ffb-88c7-e2c26bf96f43 service nova] [instance: e0fa6b82-c816-460d-bd42-b2bcd0d0d966] No waiting events found dispatching network-vif-unplugged-df8f2eed-83d2-421d-b9b1-db1bdcedcd56 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:45:47 user nova-compute[75245]: DEBUG nova.compute.manager [req-0ba7df96-2c12-48cf-8d13-b7d9ae5222ae req-39169607-6fc1-4ffb-88c7-e2c26bf96f43 service nova] [instance: e0fa6b82-c816-460d-bd42-b2bcd0d0d966] Received event network-vif-unplugged-df8f2eed-83d2-421d-b9b1-db1bdcedcd56 for instance with task_state deleting. {{(pid=75245) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 16:45:47 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: e0fa6b82-c816-460d-bd42-b2bcd0d0d966] Instance destroyed successfully.
Nov 29 16:45:47 user nova-compute[75245]: DEBUG nova.objects.instance [None req-2ed10043-bf00-45c1-bed7-54cfbbed37c8 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Lazy-loading 'resources' on Instance uuid e0fa6b82-c816-460d-bd42-b2bcd0d0d966 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:45:47 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-2ed10043-bf00-45c1-bed7-54cfbbed37c8 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:43:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-212068212',display_name='tempest-VolumesActionsTest-instance-212068212',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-212068212',id=38,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:44:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7fa8698b2fbe4e45a02a50397fdc15c0',ramdisk_id='',reservation_id='r-urxelrb5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1420605510',owner_user_name='tempest-VolumesActionsTest-1420605510-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:44:02Z,user_data=None,user_id='ad0b7d0571224f208814582c802fe0c7',uuid=e0fa6b82-c816-460d-bd42-b2bcd0d0d966,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "df8f2eed-83d2-421d-b9b1-db1bdcedcd56", "address": "fa:16:3e:4d:f0:12", "network": {"id": "02425e20-f9ba-4d18-a4ae-3805376f9ffc", "bridge": "br-int", "label": "tempest-VolumesActionsTest-437049831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fa8698b2fbe4e45a02a50397fdc15c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf8f2eed-83", "ovs_interfaceid": "df8f2eed-83d2-421d-b9b1-db1bdcedcd56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 16:45:47 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-2ed10043-bf00-45c1-bed7-54cfbbed37c8 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Converting VIF {"id": "df8f2eed-83d2-421d-b9b1-db1bdcedcd56", "address": "fa:16:3e:4d:f0:12", "network": {"id": "02425e20-f9ba-4d18-a4ae-3805376f9ffc", "bridge": "br-int", "label": "tempest-VolumesActionsTest-437049831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fa8698b2fbe4e45a02a50397fdc15c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf8f2eed-83", "ovs_interfaceid": "df8f2eed-83d2-421d-b9b1-db1bdcedcd56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:45:47 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-2ed10043-bf00-45c1-bed7-54cfbbed37c8 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4d:f0:12,bridge_name='br-int',has_traffic_filtering=True,id=df8f2eed-83d2-421d-b9b1-db1bdcedcd56,network=Network(02425e20-f9ba-4d18-a4ae-3805376f9ffc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf8f2eed-83') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:45:47 user nova-compute[75245]: DEBUG os_vif [None req-2ed10043-bf00-45c1-bed7-54cfbbed37c8 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:f0:12,bridge_name='br-int',has_traffic_filtering=True,id=df8f2eed-83d2-421d-b9b1-db1bdcedcd56,network=Network(02425e20-f9ba-4d18-a4ae-3805376f9ffc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf8f2eed-83') {{(pid=75245) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 16:45:47 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:45:47 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdf8f2eed-83, bridge=br-int, if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:45:47 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:45:47 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:45:47 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:45:47 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=201b5087-94de-4a9d-9d32-18df183e61ef) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:45:47 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:45:47 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:45:47 user nova-compute[75245]: INFO os_vif [None req-2ed10043-bf00-45c1-bed7-54cfbbed37c8 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:f0:12,bridge_name='br-int',has_traffic_filtering=True,id=df8f2eed-83d2-421d-b9b1-db1bdcedcd56,network=Network(02425e20-f9ba-4d18-a4ae-3805376f9ffc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf8f2eed-83')
Nov 29 16:45:47 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-2ed10043-bf00-45c1-bed7-54cfbbed37c8 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] [instance: e0fa6b82-c816-460d-bd42-b2bcd0d0d966] Deleting instance files /opt/stack/data/nova/instances/e0fa6b82-c816-460d-bd42-b2bcd0d0d966_del
Nov 29 16:45:47 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-2ed10043-bf00-45c1-bed7-54cfbbed37c8 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] [instance: e0fa6b82-c816-460d-bd42-b2bcd0d0d966] Deletion of /opt/stack/data/nova/instances/e0fa6b82-c816-460d-bd42-b2bcd0d0d966_del complete
Nov 29 16:45:47 user nova-compute[75245]: INFO nova.compute.manager [None req-2ed10043-bf00-45c1-bed7-54cfbbed37c8 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] [instance: e0fa6b82-c816-460d-bd42-b2bcd0d0d966] Took 0.64 seconds to destroy the instance on the hypervisor.
Nov 29 16:45:47 user nova-compute[75245]: DEBUG oslo.service.loopingcall [None req-2ed10043-bf00-45c1-bed7-54cfbbed37c8 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75245) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 16:45:47 user nova-compute[75245]: DEBUG nova.compute.manager [-] [instance: e0fa6b82-c816-460d-bd42-b2bcd0d0d966] Deallocating network for instance {{(pid=75245) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 16:45:47 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: e0fa6b82-c816-460d-bd42-b2bcd0d0d966] deallocate_for_instance() {{(pid=75245) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 16:45:48 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: e0fa6b82-c816-460d-bd42-b2bcd0d0d966] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:45:48 user nova-compute[75245]: INFO nova.compute.manager [-] [instance: e0fa6b82-c816-460d-bd42-b2bcd0d0d966] Took 0.56 seconds to deallocate network for instance.
Nov 29 16:45:48 user nova-compute[75245]: DEBUG nova.compute.manager [req-8158d110-4f31-47f5-b3f4-5e7d9428b5ab req-47ae8396-99c4-4ffd-bace-d1b18aedc330 service nova] [instance: e0fa6b82-c816-460d-bd42-b2bcd0d0d966] Received event network-vif-deleted-df8f2eed-83d2-421d-b9b1-db1bdcedcd56 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:45:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2ed10043-bf00-45c1-bed7-54cfbbed37c8 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:45:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2ed10043-bf00-45c1-bed7-54cfbbed37c8 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:45:48 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-2ed10043-bf00-45c1-bed7-54cfbbed37c8 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:45:48 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-2ed10043-bf00-45c1-bed7-54cfbbed37c8 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:45:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2ed10043-bf00-45c1-bed7-54cfbbed37c8 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.123s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:45:48 user nova-compute[75245]: INFO nova.scheduler.client.report [None req-2ed10043-bf00-45c1-bed7-54cfbbed37c8 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Deleted allocations for instance e0fa6b82-c816-460d-bd42-b2bcd0d0d966
Nov 29 16:45:48 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:45:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:45:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:45:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:45:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:45:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:45:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:45:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2ed10043-bf00-45c1-bed7-54cfbbed37c8 tempest-VolumesActionsTest-1420605510 tempest-VolumesActionsTest-1420605510-project-member] Lock "e0fa6b82-c816-460d-bd42-b2bcd0d0d966" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.494s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:45:48 user nova-compute[75245]: DEBUG nova.virt.libvirt.imagecache [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Verify base images {{(pid=75245) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 29 16:45:48 user nova-compute[75245]: DEBUG nova.virt.libvirt.imagecache [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Image id aa336f1d-5522-4fcf-aa9f-bc3836a74f50 yields fingerprint 45b77643bb3bf69fcf53d1d72c80ca993e44022d {{(pid=75245) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 29 16:45:48 user nova-compute[75245]: INFO nova.virt.libvirt.imagecache [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] image aa336f1d-5522-4fcf-aa9f-bc3836a74f50 at (/opt/stack/data/nova/instances/_base/45b77643bb3bf69fcf53d1d72c80ca993e44022d): checking
Nov 29 16:45:48 user nova-compute[75245]: DEBUG nova.virt.libvirt.imagecache [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] image aa336f1d-5522-4fcf-aa9f-bc3836a74f50 at (/opt/stack/data/nova/instances/_base/45b77643bb3bf69fcf53d1d72c80ca993e44022d): image is in use {{(pid=75245) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 29 16:45:48 user nova-compute[75245]: DEBUG nova.virt.libvirt.imagecache [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=75245) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 29 16:45:48 user nova-compute[75245]: DEBUG nova.virt.libvirt.imagecache [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] 7b03f1f3-2061-4962-ba07-3a4f9da2ea90 is a valid instance name {{(pid=75245) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 29 16:45:48 user nova-compute[75245]: DEBUG nova.virt.libvirt.imagecache [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] 7b03f1f3-2061-4962-ba07-3a4f9da2ea90 has a disk file {{(pid=75245) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 29 16:45:48 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b03f1f3-2061-4962-ba07-3a4f9da2ea90/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:45:48 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b03f1f3-2061-4962-ba07-3a4f9da2ea90/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:45:48 user nova-compute[75245]: DEBUG nova.virt.libvirt.imagecache [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 7b03f1f3-2061-4962-ba07-3a4f9da2ea90 is backed by 45b77643bb3bf69fcf53d1d72c80ca993e44022d {{(pid=75245) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 29 16:45:48 user nova-compute[75245]: WARNING nova.virt.libvirt.imagecache [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Unknown base file: /opt/stack/data/nova/instances/_base/42a3184f5fc6a39f11cded1b67adfb5500d7aeb5
Nov 29 16:45:48 user nova-compute[75245]: WARNING nova.virt.libvirt.imagecache [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Unknown base file: /opt/stack/data/nova/instances/_base/ea6da71bbf7123df6b08bb492d82cdcfd59c518b
Nov 29 16:45:48 user nova-compute[75245]: WARNING nova.virt.libvirt.imagecache [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Unknown base file: /opt/stack/data/nova/instances/_base/dc6624775858b84e292a573852ec5a2d0c0d13bc
Nov 29 16:45:48 user nova-compute[75245]: WARNING nova.virt.libvirt.imagecache [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Unknown base file: /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8
Nov 29 16:45:48 user nova-compute[75245]: WARNING nova.virt.libvirt.imagecache [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Unknown base file: /opt/stack/data/nova/instances/_base/3da94cdb71c42a63e00a6479f569c325643a68c0
Nov 29 16:45:48 user nova-compute[75245]: WARNING nova.virt.libvirt.imagecache [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Unknown base file: /opt/stack/data/nova/instances/_base/932d53ba158621cdac285967046ddc39b8b49ae9
Nov 29 16:45:48 user nova-compute[75245]: WARNING nova.virt.libvirt.imagecache [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Unknown base file: /opt/stack/data/nova/instances/_base/573aa58529069529738f3e1c5de4a66818b0e23d
Nov 29 16:45:48 user nova-compute[75245]: WARNING nova.virt.libvirt.imagecache [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Unknown base file: /opt/stack/data/nova/instances/_base/1fe4e30e7d34178cb5f15ed957023dfad042ea33
Nov 29 16:45:48 user nova-compute[75245]: INFO nova.virt.libvirt.imagecache [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Active base files: /opt/stack/data/nova/instances/_base/45b77643bb3bf69fcf53d1d72c80ca993e44022d
Nov 29 16:45:48 user nova-compute[75245]: INFO nova.virt.libvirt.imagecache [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Removable base files: /opt/stack/data/nova/instances/_base/42a3184f5fc6a39f11cded1b67adfb5500d7aeb5 /opt/stack/data/nova/instances/_base/ea6da71bbf7123df6b08bb492d82cdcfd59c518b /opt/stack/data/nova/instances/_base/dc6624775858b84e292a573852ec5a2d0c0d13bc /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 /opt/stack/data/nova/instances/_base/3da94cdb71c42a63e00a6479f569c325643a68c0 /opt/stack/data/nova/instances/_base/932d53ba158621cdac285967046ddc39b8b49ae9 /opt/stack/data/nova/instances/_base/573aa58529069529738f3e1c5de4a66818b0e23d /opt/stack/data/nova/instances/_base/1fe4e30e7d34178cb5f15ed957023dfad042ea33
Nov 29 16:45:48 user nova-compute[75245]: INFO nova.virt.libvirt.imagecache [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/42a3184f5fc6a39f11cded1b67adfb5500d7aeb5
Nov 29 16:45:48 user nova-compute[75245]: INFO nova.virt.libvirt.imagecache [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ea6da71bbf7123df6b08bb492d82cdcfd59c518b
Nov 29 16:45:48 user nova-compute[75245]: INFO nova.virt.libvirt.imagecache [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/dc6624775858b84e292a573852ec5a2d0c0d13bc
Nov 29 16:45:48 user nova-compute[75245]: INFO nova.virt.libvirt.imagecache [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8
Nov 29 16:45:48 user nova-compute[75245]: INFO nova.virt.libvirt.imagecache [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/3da94cdb71c42a63e00a6479f569c325643a68c0
Nov 29 16:45:48 user nova-compute[75245]: INFO nova.virt.libvirt.imagecache [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/932d53ba158621cdac285967046ddc39b8b49ae9
Nov 29 16:45:48 user nova-compute[75245]: INFO nova.virt.libvirt.imagecache [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/573aa58529069529738f3e1c5de4a66818b0e23d
Nov 29 16:45:48 user nova-compute[75245]: INFO nova.virt.libvirt.imagecache [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/1fe4e30e7d34178cb5f15ed957023dfad042ea33
Nov 29 16:45:48 user nova-compute[75245]: DEBUG nova.virt.libvirt.imagecache [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Verification complete {{(pid=75245) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 29 16:45:48 user nova-compute[75245]: DEBUG nova.virt.libvirt.imagecache [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Verify swap images {{(pid=75245) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 29 16:45:48 user nova-compute[75245]: DEBUG nova.virt.libvirt.imagecache [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Verify ephemeral images {{(pid=75245) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 29 16:45:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:45:49 user nova-compute[75245]: DEBUG nova.compute.manager [req-c40cd748-7ee2-408a-87e2-9d0e74dbb082 req-7816d8cf-6d4e-4074-996c-1b0a2444ecd3 service nova] [instance: e0fa6b82-c816-460d-bd42-b2bcd0d0d966] Received event network-vif-plugged-df8f2eed-83d2-421d-b9b1-db1bdcedcd56 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:45:49 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-c40cd748-7ee2-408a-87e2-9d0e74dbb082 req-7816d8cf-6d4e-4074-996c-1b0a2444ecd3 service nova] Acquiring lock "e0fa6b82-c816-460d-bd42-b2bcd0d0d966-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:45:49 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-c40cd748-7ee2-408a-87e2-9d0e74dbb082 req-7816d8cf-6d4e-4074-996c-1b0a2444ecd3 service nova] Lock "e0fa6b82-c816-460d-bd42-b2bcd0d0d966-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:45:49 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-c40cd748-7ee2-408a-87e2-9d0e74dbb082 req-7816d8cf-6d4e-4074-996c-1b0a2444ecd3 service nova] Lock "e0fa6b82-c816-460d-bd42-b2bcd0d0d966-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:45:49 user nova-compute[75245]: DEBUG nova.compute.manager [req-c40cd748-7ee2-408a-87e2-9d0e74dbb082 req-7816d8cf-6d4e-4074-996c-1b0a2444ecd3 service nova] [instance: e0fa6b82-c816-460d-bd42-b2bcd0d0d966] No waiting events found dispatching network-vif-plugged-df8f2eed-83d2-421d-b9b1-db1bdcedcd56 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:45:49 user nova-compute[75245]: WARNING nova.compute.manager [req-c40cd748-7ee2-408a-87e2-9d0e74dbb082 req-7816d8cf-6d4e-4074-996c-1b0a2444ecd3 service nova] [instance: e0fa6b82-c816-460d-bd42-b2bcd0d0d966] Received unexpected event network-vif-plugged-df8f2eed-83d2-421d-b9b1-db1bdcedcd56 for instance with vm_state deleted and task_state None.
Nov 29 16:45:52 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:45:57 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:46:02 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:46:03 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:46:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Acquiring lock "f987507f-708e-4218-a49c-2a94bc5edc3c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:46:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "f987507f-708e-4218-a49c-2a94bc5edc3c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:46:06 user nova-compute[75245]: DEBUG nova.compute.manager [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: f987507f-708e-4218-a49c-2a94bc5edc3c] Starting instance... {{(pid=75245) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 16:46:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:46:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:46:07 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75245) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 16:46:07 user nova-compute[75245]: INFO nova.compute.claims [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: f987507f-708e-4218-a49c-2a94bc5edc3c] Claim successful on node user
Nov 29 16:46:07 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:46:07 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:46:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.212s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:46:07 user nova-compute[75245]: DEBUG nova.compute.manager [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: f987507f-708e-4218-a49c-2a94bc5edc3c] Start building networks asynchronously for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 16:46:07 user nova-compute[75245]: DEBUG nova.compute.manager [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: f987507f-708e-4218-a49c-2a94bc5edc3c] Allocating IP information in the background. {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 16:46:07 user nova-compute[75245]: DEBUG nova.network.neutron [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: f987507f-708e-4218-a49c-2a94bc5edc3c] allocate_for_instance() {{(pid=75245) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 16:46:07 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: f987507f-708e-4218-a49c-2a94bc5edc3c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 16:46:07 user nova-compute[75245]: DEBUG nova.compute.manager [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: f987507f-708e-4218-a49c-2a94bc5edc3c] Start building block device mappings for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 16:46:07 user nova-compute[75245]: DEBUG nova.policy [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fb4c94298bf14753bb9530633e766dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e269dbe30d46ccb81d58e2590004db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75245) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 16:46:07 user nova-compute[75245]: DEBUG nova.compute.manager [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: f987507f-708e-4218-a49c-2a94bc5edc3c] Start spawning the instance on the hypervisor. {{(pid=75245) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 16:46:07 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: f987507f-708e-4218-a49c-2a94bc5edc3c] Creating instance directory {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 16:46:07 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: f987507f-708e-4218-a49c-2a94bc5edc3c] Creating image(s)
Nov 29 16:46:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Acquiring lock "/opt/stack/data/nova/instances/f987507f-708e-4218-a49c-2a94bc5edc3c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:46:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "/opt/stack/data/nova/instances/f987507f-708e-4218-a49c-2a94bc5edc3c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:46:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "/opt/stack/data/nova/instances/f987507f-708e-4218-a49c-2a94bc5edc3c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:46:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:46:07 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:46:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.182s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:46:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Acquiring lock "d654f7206043e05d3525550b0fc885556eb999f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:46:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:46:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:46:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.183s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:46:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/f987507f-708e-4218-a49c-2a94bc5edc3c/disk 1073741824 {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:46:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/f987507f-708e-4218-a49c-2a94bc5edc3c/disk 1073741824" returned: 0 in 0.051s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:46:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:46:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:46:08 user nova-compute[75245]: DEBUG nova.network.neutron [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: f987507f-708e-4218-a49c-2a94bc5edc3c] Successfully created port: d47f72a3-e0ce-4368-ad36-f8a7d20e221b {{(pid=75245) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 16:46:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.178s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:46:08 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f987507f-708e-4218-a49c-2a94bc5edc3c/disk. size=1073741824 {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 16:46:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f987507f-708e-4218-a49c-2a94bc5edc3c/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:46:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f987507f-708e-4218-a49c-2a94bc5edc3c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:46:08 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Cannot resize image /opt/stack/data/nova/instances/f987507f-708e-4218-a49c-2a94bc5edc3c/disk to a smaller size. {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 16:46:08 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: f987507f-708e-4218-a49c-2a94bc5edc3c] Created local disks {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 16:46:08 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: f987507f-708e-4218-a49c-2a94bc5edc3c] Ensure instance console log exists: /opt/stack/data/nova/instances/f987507f-708e-4218-a49c-2a94bc5edc3c/console.log {{(pid=75245) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 16:46:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:46:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:46:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:46:08 user nova-compute[75245]: DEBUG nova.network.neutron [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: f987507f-708e-4218-a49c-2a94bc5edc3c] Successfully updated port: d47f72a3-e0ce-4368-ad36-f8a7d20e221b {{(pid=75245) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 16:46:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Acquiring lock "refresh_cache-f987507f-708e-4218-a49c-2a94bc5edc3c" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:46:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Acquired lock "refresh_cache-f987507f-708e-4218-a49c-2a94bc5edc3c" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:46:08 user nova-compute[75245]: DEBUG nova.network.neutron [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: f987507f-708e-4218-a49c-2a94bc5edc3c] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 16:46:08 user nova-compute[75245]: DEBUG nova.compute.manager [req-eb9b7dbd-60e8-4c30-91fb-b16b29a1352b req-5326b1ec-fae3-4a9f-a225-548d9d98059d service nova] [instance: f987507f-708e-4218-a49c-2a94bc5edc3c] Received event network-changed-d47f72a3-e0ce-4368-ad36-f8a7d20e221b {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:46:08 user nova-compute[75245]: DEBUG nova.compute.manager [req-eb9b7dbd-60e8-4c30-91fb-b16b29a1352b req-5326b1ec-fae3-4a9f-a225-548d9d98059d service nova] [instance: f987507f-708e-4218-a49c-2a94bc5edc3c] Refreshing instance network info cache due to event network-changed-d47f72a3-e0ce-4368-ad36-f8a7d20e221b. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:46:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-eb9b7dbd-60e8-4c30-91fb-b16b29a1352b req-5326b1ec-fae3-4a9f-a225-548d9d98059d service nova] Acquiring lock "refresh_cache-f987507f-708e-4218-a49c-2a94bc5edc3c" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:46:08 user nova-compute[75245]: DEBUG nova.network.neutron [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: f987507f-708e-4218-a49c-2a94bc5edc3c] Instance cache missing network info. {{(pid=75245) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 16:46:09 user nova-compute[75245]: DEBUG nova.network.neutron [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: f987507f-708e-4218-a49c-2a94bc5edc3c] Updating instance_info_cache with network_info: [{"id": "d47f72a3-e0ce-4368-ad36-f8a7d20e221b", "address": "fa:16:3e:7c:42:39", "network": {"id": "55744af1-3291-4de1-9bf4-554f9ee4f057", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1570836437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01e269dbe30d46ccb81d58e2590004db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd47f72a3-e0", "ovs_interfaceid": "d47f72a3-e0ce-4368-ad36-f8a7d20e221b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:46:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Releasing lock "refresh_cache-f987507f-708e-4218-a49c-2a94bc5edc3c" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:46:09 user nova-compute[75245]: DEBUG nova.compute.manager [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: f987507f-708e-4218-a49c-2a94bc5edc3c] Instance network_info: |[{"id": "d47f72a3-e0ce-4368-ad36-f8a7d20e221b", "address": "fa:16:3e:7c:42:39", "network": {"id": "55744af1-3291-4de1-9bf4-554f9ee4f057", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1570836437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01e269dbe30d46ccb81d58e2590004db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd47f72a3-e0", "ovs_interfaceid": "d47f72a3-e0ce-4368-ad36-f8a7d20e221b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 16:46:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-eb9b7dbd-60e8-4c30-91fb-b16b29a1352b req-5326b1ec-fae3-4a9f-a225-548d9d98059d service nova] Acquired lock "refresh_cache-f987507f-708e-4218-a49c-2a94bc5edc3c" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:46:09 user nova-compute[75245]: DEBUG nova.network.neutron [req-eb9b7dbd-60e8-4c30-91fb-b16b29a1352b req-5326b1ec-fae3-4a9f-a225-548d9d98059d service nova] [instance: f987507f-708e-4218-a49c-2a94bc5edc3c] Refreshing network info cache for port d47f72a3-e0ce-4368-ad36-f8a7d20e221b {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:46:09 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: f987507f-708e-4218-a49c-2a94bc5edc3c] Start _get_guest_xml network_info=[{"id": "d47f72a3-e0ce-4368-ad36-f8a7d20e221b", "address": "fa:16:3e:7c:42:39", "network": {"id": "55744af1-3291-4de1-9bf4-554f9ee4f057", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1570836437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01e269dbe30d46ccb81d58e2590004db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd47f72a3-e0", "ovs_interfaceid": "d47f72a3-e0ce-4368-ad36-f8a7d20e221b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'a291d9c3-be02-4c6c-9649-4b45c5b7f487'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 16:46:09 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:46:09 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:46:09 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 16:46:09 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] CPU controller missing on host. {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 16:46:09 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 16:46:09 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] CPU controller found on host. {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 16:46:09 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75245) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 16:46:09 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T16:06:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 16:46:09 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Flavor limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 16:46:09 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Image limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 16:46:09 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Flavor pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 16:46:09 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Image pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 16:46:09 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 16:46:09 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 16:46:09 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 16:46:09 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Got 1 possible topologies {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 16:46:09 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 16:46:09 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 16:46:09 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:46:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1671404722',display_name='tempest-AttachVolumeNegativeTest-server-1671404722',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1671404722',id=40,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEPM+0da/lwksF0WBr+VnTGMTdw9NrT+clgPyKb/QglYIhltShJMc/SAcKzE6mTkrIVzPoiwlJZj6kKG23ngMKQA0YNNTmkHVqEUadceXLqy6vHZ7+efaUAtSYYBE1cOQ==',key_name='tempest-keypair-281181805',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='01e269dbe30d46ccb81d58e2590004db',ramdisk_id='',reservation_id='r-ndyyd9sq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-44169219',owner_user_name='tempest-AttachVolumeNegativeTest-44169219-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:46:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb4c94298bf14753bb9530633e766dee',uuid=f987507f-708e-4218-a49c-2a94bc5edc3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d47f72a3-e0ce-4368-ad36-f8a7d20e221b", "address": "fa:16:3e:7c:42:39", "network": {"id": "55744af1-3291-4de1-9bf4-554f9ee4f057", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1570836437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01e269dbe30d46ccb81d58e2590004db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd47f72a3-e0", "ovs_interfaceid": "d47f72a3-e0ce-4368-ad36-f8a7d20e221b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:46:09 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Converting VIF {"id": "d47f72a3-e0ce-4368-ad36-f8a7d20e221b", "address": "fa:16:3e:7c:42:39", "network": {"id": "55744af1-3291-4de1-9bf4-554f9ee4f057", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1570836437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01e269dbe30d46ccb81d58e2590004db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd47f72a3-e0", "ovs_interfaceid": "d47f72a3-e0ce-4368-ad36-f8a7d20e221b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:46:09 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:42:39,bridge_name='br-int',has_traffic_filtering=True,id=d47f72a3-e0ce-4368-ad36-f8a7d20e221b,network=Network(55744af1-3291-4de1-9bf4-554f9ee4f057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd47f72a3-e0') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:46:09 user nova-compute[75245]: DEBUG nova.objects.instance [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lazy-loading 'pci_devices' on Instance uuid f987507f-708e-4218-a49c-2a94bc5edc3c {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:46:09 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: f987507f-708e-4218-a49c-2a94bc5edc3c] End _get_guest_xml xml=<domain type="kvm">
Nov 29 16:46:09 user nova-compute[75245]:   <uuid>f987507f-708e-4218-a49c-2a94bc5edc3c</uuid>
Nov 29 16:46:09 user nova-compute[75245]:   <name>instance-00000028</name>
Nov 29 16:46:09 user nova-compute[75245]:   <memory>524288</memory>
Nov 29 16:46:09 user nova-compute[75245]:   <vcpu>1</vcpu>
Nov 29 16:46:09 user nova-compute[75245]:   <metadata>
Nov 29 16:46:09 user nova-compute[75245]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 16:46:09 user nova-compute[75245]:       <nova:package version="0.0.0"/>
Nov 29 16:46:09 user nova-compute[75245]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1671404722</nova:name>
Nov 29 16:46:09 user nova-compute[75245]:       <nova:creationTime>2023-11-29 16:46:09</nova:creationTime>
Nov 29 16:46:09 user nova-compute[75245]:       <nova:flavor name="m1.tiny">
Nov 29 16:46:09 user nova-compute[75245]:         <nova:memory>512</nova:memory>
Nov 29 16:46:09 user nova-compute[75245]:         <nova:disk>1</nova:disk>
Nov 29 16:46:09 user nova-compute[75245]:         <nova:swap>0</nova:swap>
Nov 29 16:46:09 user nova-compute[75245]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 16:46:09 user nova-compute[75245]:         <nova:vcpus>1</nova:vcpus>
Nov 29 16:46:09 user nova-compute[75245]:       </nova:flavor>
Nov 29 16:46:09 user nova-compute[75245]:       <nova:owner>
Nov 29 16:46:09 user nova-compute[75245]:         <nova:user uuid="fb4c94298bf14753bb9530633e766dee">tempest-AttachVolumeNegativeTest-44169219-project-member</nova:user>
Nov 29 16:46:09 user nova-compute[75245]:         <nova:project uuid="01e269dbe30d46ccb81d58e2590004db">tempest-AttachVolumeNegativeTest-44169219</nova:project>
Nov 29 16:46:09 user nova-compute[75245]:       </nova:owner>
Nov 29 16:46:09 user nova-compute[75245]:       <nova:root type="image" uuid="a291d9c3-be02-4c6c-9649-4b45c5b7f487"/>
Nov 29 16:46:09 user nova-compute[75245]:       <nova:ports>
Nov 29 16:46:09 user nova-compute[75245]:         <nova:port uuid="d47f72a3-e0ce-4368-ad36-f8a7d20e221b">
Nov 29 16:46:09 user nova-compute[75245]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 29 16:46:09 user nova-compute[75245]:         </nova:port>
Nov 29 16:46:09 user nova-compute[75245]:       </nova:ports>
Nov 29 16:46:09 user nova-compute[75245]:     </nova:instance>
Nov 29 16:46:09 user nova-compute[75245]:   </metadata>
Nov 29 16:46:09 user nova-compute[75245]:   <sysinfo type="smbios">
Nov 29 16:46:09 user nova-compute[75245]:     <system>
Nov 29 16:46:09 user nova-compute[75245]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 16:46:09 user nova-compute[75245]:       <entry name="product">OpenStack Nova</entry>
Nov 29 16:46:09 user nova-compute[75245]:       <entry name="version">0.0.0</entry>
Nov 29 16:46:09 user nova-compute[75245]:       <entry name="serial">f987507f-708e-4218-a49c-2a94bc5edc3c</entry>
Nov 29 16:46:09 user nova-compute[75245]:       <entry name="uuid">f987507f-708e-4218-a49c-2a94bc5edc3c</entry>
Nov 29 16:46:09 user nova-compute[75245]:       <entry name="family">Virtual Machine</entry>
Nov 29 16:46:09 user nova-compute[75245]:     </system>
Nov 29 16:46:09 user nova-compute[75245]:   </sysinfo>
Nov 29 16:46:09 user nova-compute[75245]:   <os>
Nov 29 16:46:09 user nova-compute[75245]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 16:46:09 user nova-compute[75245]:     <boot dev="hd"/>
Nov 29 16:46:09 user nova-compute[75245]:     <smbios mode="sysinfo"/>
Nov 29 16:46:09 user nova-compute[75245]:   </os>
Nov 29 16:46:09 user nova-compute[75245]:   <features>
Nov 29 16:46:09 user nova-compute[75245]:     <acpi/>
Nov 29 16:46:09 user nova-compute[75245]:     <apic/>
Nov 29 16:46:09 user nova-compute[75245]:     <vmcoreinfo/>
Nov 29 16:46:09 user nova-compute[75245]:   </features>
Nov 29 16:46:09 user nova-compute[75245]:   <clock offset="utc">
Nov 29 16:46:09 user nova-compute[75245]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 16:46:09 user nova-compute[75245]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 16:46:09 user nova-compute[75245]:     <timer name="hpet" present="no"/>
Nov 29 16:46:09 user nova-compute[75245]:   </clock>
Nov 29 16:46:09 user nova-compute[75245]:   <cpu mode="custom" match="exact">
Nov 29 16:46:09 user nova-compute[75245]:     <model>Nehalem</model>
Nov 29 16:46:09 user nova-compute[75245]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 16:46:09 user nova-compute[75245]:   </cpu>
Nov 29 16:46:09 user nova-compute[75245]:   <devices>
Nov 29 16:46:09 user nova-compute[75245]:     <disk type="file" device="disk">
Nov 29 16:46:09 user nova-compute[75245]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 16:46:09 user nova-compute[75245]:       <source file="/opt/stack/data/nova/instances/f987507f-708e-4218-a49c-2a94bc5edc3c/disk"/>
Nov 29 16:46:09 user nova-compute[75245]:       <target dev="vda" bus="virtio"/>
Nov 29 16:46:09 user nova-compute[75245]:     </disk>
Nov 29 16:46:09 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 16:46:09 user nova-compute[75245]:       <mac address="fa:16:3e:7c:42:39"/>
Nov 29 16:46:09 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:46:09 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 16:46:09 user nova-compute[75245]:       <target dev="tapd47f72a3-e0"/>
Nov 29 16:46:09 user nova-compute[75245]:     </interface>
Nov 29 16:46:09 user nova-compute[75245]:     <serial type="pty">
Nov 29 16:46:09 user nova-compute[75245]:       <log file="/opt/stack/data/nova/instances/f987507f-708e-4218-a49c-2a94bc5edc3c/console.log" append="off"/>
Nov 29 16:46:09 user nova-compute[75245]:     </serial>
Nov 29 16:46:09 user nova-compute[75245]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 16:46:09 user nova-compute[75245]:     <video>
Nov 29 16:46:09 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:46:09 user nova-compute[75245]:     </video>
Nov 29 16:46:09 user nova-compute[75245]:     <rng model="virtio">
Nov 29 16:46:09 user nova-compute[75245]:       <backend model="random">/dev/urandom</backend>
Nov 29 16:46:09 user nova-compute[75245]:     </rng>
Nov 29 16:46:09 user nova-compute[75245]:     <controller type="usb" index="0" model="none"/>
Nov 29 16:46:09 user nova-compute[75245]:     <memballoon model="virtio">
Nov 29 16:46:09 user nova-compute[75245]:       <stats period="10"/>
Nov 29 16:46:09 user nova-compute[75245]:     </memballoon>
Nov 29 16:46:09 user nova-compute[75245]:   </devices>
Nov 29 16:46:09 user nova-compute[75245]: </domain>
Nov 29 16:46:09 user nova-compute[75245]:  {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 16:46:09 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:46:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1671404722',display_name='tempest-AttachVolumeNegativeTest-server-1671404722',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1671404722',id=40,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEPM+0da/lwksF0WBr+VnTGMTdw9NrT+clgPyKb/QglYIhltShJMc/SAcKzE6mTkrIVzPoiwlJZj6kKG23ngMKQA0YNNTmkHVqEUadceXLqy6vHZ7+efaUAtSYYBE1cOQ==',key_name='tempest-keypair-281181805',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='01e269dbe30d46ccb81d58e2590004db',ramdisk_id='',reservation_id='r-ndyyd9sq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-44169219',owner_user_name='tempest-AttachVolumeNegativeTest-44169219-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:46:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb4c94298bf14753bb9530633e766dee',uuid=f987507f-708e-4218-a49c-2a94bc5edc3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d47f72a3-e0ce-4368-ad36-f8a7d20e221b", "address": "fa:16:3e:7c:42:39", "network": {"id": "55744af1-3291-4de1-9bf4-554f9ee4f057", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1570836437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01e269dbe30d46ccb81d58e2590004db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd47f72a3-e0", "ovs_interfaceid": "d47f72a3-e0ce-4368-ad36-f8a7d20e221b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 16:46:09 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Converting VIF {"id": "d47f72a3-e0ce-4368-ad36-f8a7d20e221b", "address": "fa:16:3e:7c:42:39", "network": {"id": "55744af1-3291-4de1-9bf4-554f9ee4f057", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1570836437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01e269dbe30d46ccb81d58e2590004db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd47f72a3-e0", "ovs_interfaceid": "d47f72a3-e0ce-4368-ad36-f8a7d20e221b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:46:09 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:42:39,bridge_name='br-int',has_traffic_filtering=True,id=d47f72a3-e0ce-4368-ad36-f8a7d20e221b,network=Network(55744af1-3291-4de1-9bf4-554f9ee4f057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd47f72a3-e0') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:46:09 user nova-compute[75245]: DEBUG os_vif [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:42:39,bridge_name='br-int',has_traffic_filtering=True,id=d47f72a3-e0ce-4368-ad36-f8a7d20e221b,network=Network(55744af1-3291-4de1-9bf4-554f9ee4f057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd47f72a3-e0') {{(pid=75245) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 16:46:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:46:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:46:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 16:46:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:46:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd3f90379-1826-59cb-99f7-f967862bcf4f', '_type': 'linux-noop'}}, row=False) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:46:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:46:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:46:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:46:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd47f72a3-e0, may_exist=True, interface_attrs={}) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:46:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd47f72a3-e0, col_values=(('qos', UUID('becb4964-860d-4b97-be2f-8d1f65f26243')),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:46:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd47f72a3-e0, col_values=(('external_ids', {'iface-id': 'd47f72a3-e0ce-4368-ad36-f8a7d20e221b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:42:39', 'vm-uuid': 'f987507f-708e-4218-a49c-2a94bc5edc3c'}),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:46:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:46:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:46:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:46:09 user nova-compute[75245]: INFO os_vif [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:42:39,bridge_name='br-int',has_traffic_filtering=True,id=d47f72a3-e0ce-4368-ad36-f8a7d20e221b,network=Network(55744af1-3291-4de1-9bf4-554f9ee4f057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd47f72a3-e0')
Nov 29 16:46:09 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:46:09 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] No VIF found with MAC fa:16:3e:7c:42:39, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:46:09 user nova-compute[75245]: DEBUG nova.network.neutron [req-eb9b7dbd-60e8-4c30-91fb-b16b29a1352b req-5326b1ec-fae3-4a9f-a225-548d9d98059d service nova] [instance: f987507f-708e-4218-a49c-2a94bc5edc3c] Updated VIF entry in instance network info cache for port d47f72a3-e0ce-4368-ad36-f8a7d20e221b. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:46:09 user nova-compute[75245]: DEBUG nova.network.neutron [req-eb9b7dbd-60e8-4c30-91fb-b16b29a1352b req-5326b1ec-fae3-4a9f-a225-548d9d98059d service nova] [instance: f987507f-708e-4218-a49c-2a94bc5edc3c] Updating instance_info_cache with network_info: [{"id": "d47f72a3-e0ce-4368-ad36-f8a7d20e221b", "address": "fa:16:3e:7c:42:39", "network": {"id": "55744af1-3291-4de1-9bf4-554f9ee4f057", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1570836437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01e269dbe30d46ccb81d58e2590004db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd47f72a3-e0", "ovs_interfaceid": "d47f72a3-e0ce-4368-ad36-f8a7d20e221b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:46:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-eb9b7dbd-60e8-4c30-91fb-b16b29a1352b req-5326b1ec-fae3-4a9f-a225-548d9d98059d service nova] Releasing lock "refresh_cache-f987507f-708e-4218-a49c-2a94bc5edc3c" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:46:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:46:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:46:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:46:10 user nova-compute[75245]: DEBUG nova.compute.manager [req-a613d779-d6db-4f7d-b836-69d324e1ca33 req-3304ee4a-42e1-4964-b4c0-2ca21909afe0 service nova] [instance: f987507f-708e-4218-a49c-2a94bc5edc3c] Received event network-vif-plugged-d47f72a3-e0ce-4368-ad36-f8a7d20e221b {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:46:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a613d779-d6db-4f7d-b836-69d324e1ca33 req-3304ee4a-42e1-4964-b4c0-2ca21909afe0 service nova] Acquiring lock "f987507f-708e-4218-a49c-2a94bc5edc3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:46:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a613d779-d6db-4f7d-b836-69d324e1ca33 req-3304ee4a-42e1-4964-b4c0-2ca21909afe0 service nova] Lock "f987507f-708e-4218-a49c-2a94bc5edc3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:46:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a613d779-d6db-4f7d-b836-69d324e1ca33 req-3304ee4a-42e1-4964-b4c0-2ca21909afe0 service nova] Lock "f987507f-708e-4218-a49c-2a94bc5edc3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:46:10 user nova-compute[75245]: DEBUG nova.compute.manager [req-a613d779-d6db-4f7d-b836-69d324e1ca33 req-3304ee4a-42e1-4964-b4c0-2ca21909afe0 service nova] [instance: f987507f-708e-4218-a49c-2a94bc5edc3c] No waiting events found dispatching network-vif-plugged-d47f72a3-e0ce-4368-ad36-f8a7d20e221b {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:46:10 user nova-compute[75245]: WARNING nova.compute.manager [req-a613d779-d6db-4f7d-b836-69d324e1ca33 req-3304ee4a-42e1-4964-b4c0-2ca21909afe0 service nova] [instance: f987507f-708e-4218-a49c-2a94bc5edc3c] Received unexpected event network-vif-plugged-d47f72a3-e0ce-4368-ad36-f8a7d20e221b for instance with vm_state building and task_state spawning.
Nov 29 16:46:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:46:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:46:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:46:12 user nova-compute[75245]: DEBUG nova.compute.manager [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: f987507f-708e-4218-a49c-2a94bc5edc3c] Instance event wait completed in 0 seconds for  {{(pid=75245) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 16:46:12 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: f987507f-708e-4218-a49c-2a94bc5edc3c] Guest created on hypervisor {{(pid=75245) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 16:46:12 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: f987507f-708e-4218-a49c-2a94bc5edc3c] Instance spawned successfully.
Nov 29 16:46:12 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: f987507f-708e-4218-a49c-2a94bc5edc3c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 16:46:12 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: f987507f-708e-4218-a49c-2a94bc5edc3c] Found default for hw_cdrom_bus of ide {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:46:12 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: f987507f-708e-4218-a49c-2a94bc5edc3c] Found default for hw_disk_bus of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:46:12 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: f987507f-708e-4218-a49c-2a94bc5edc3c] Found default for hw_input_bus of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:46:12 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: f987507f-708e-4218-a49c-2a94bc5edc3c] Found default for hw_pointer_model of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:46:12 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: f987507f-708e-4218-a49c-2a94bc5edc3c] Found default for hw_video_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:46:12 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: f987507f-708e-4218-a49c-2a94bc5edc3c] Found default for hw_vif_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:46:12 user nova-compute[75245]: INFO nova.compute.manager [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: f987507f-708e-4218-a49c-2a94bc5edc3c] Took 5.17 seconds to spawn the instance on the hypervisor.
Nov 29 16:46:12 user nova-compute[75245]: DEBUG nova.compute.manager [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: f987507f-708e-4218-a49c-2a94bc5edc3c] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:46:12 user nova-compute[75245]: DEBUG nova.compute.manager [req-810c19fd-5c72-4d0c-ba87-af4f4f58dae9 req-3d85af4d-1ad7-45bc-80ed-5aa5e5a8f282 service nova] [instance: f987507f-708e-4218-a49c-2a94bc5edc3c] Received event network-vif-plugged-d47f72a3-e0ce-4368-ad36-f8a7d20e221b {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:46:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-810c19fd-5c72-4d0c-ba87-af4f4f58dae9 req-3d85af4d-1ad7-45bc-80ed-5aa5e5a8f282 service nova] Acquiring lock "f987507f-708e-4218-a49c-2a94bc5edc3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:46:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-810c19fd-5c72-4d0c-ba87-af4f4f58dae9 req-3d85af4d-1ad7-45bc-80ed-5aa5e5a8f282 service nova] Lock "f987507f-708e-4218-a49c-2a94bc5edc3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:46:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-810c19fd-5c72-4d0c-ba87-af4f4f58dae9 req-3d85af4d-1ad7-45bc-80ed-5aa5e5a8f282 service nova] Lock "f987507f-708e-4218-a49c-2a94bc5edc3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:46:12 user nova-compute[75245]: DEBUG nova.compute.manager [req-810c19fd-5c72-4d0c-ba87-af4f4f58dae9 req-3d85af4d-1ad7-45bc-80ed-5aa5e5a8f282 service nova] [instance: f987507f-708e-4218-a49c-2a94bc5edc3c] No waiting events found dispatching network-vif-plugged-d47f72a3-e0ce-4368-ad36-f8a7d20e221b {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:46:12 user nova-compute[75245]: WARNING nova.compute.manager [req-810c19fd-5c72-4d0c-ba87-af4f4f58dae9 req-3d85af4d-1ad7-45bc-80ed-5aa5e5a8f282 service nova] [instance: f987507f-708e-4218-a49c-2a94bc5edc3c] Received unexpected event network-vif-plugged-d47f72a3-e0ce-4368-ad36-f8a7d20e221b for instance with vm_state building and task_state spawning.
Nov 29 16:46:12 user nova-compute[75245]: INFO nova.compute.manager [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: f987507f-708e-4218-a49c-2a94bc5edc3c] Took 5.72 seconds to build instance.
Nov 29 16:46:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-67b26bdd-db1d-493f-aca4-8629eca6c589 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "f987507f-708e-4218-a49c-2a94bc5edc3c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.808s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:46:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:46:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:46:18 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:46:18 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Starting heal instance info cache {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 16:46:18 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "refresh_cache-7b03f1f3-2061-4962-ba07-3a4f9da2ea90" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:46:18 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquired lock "refresh_cache-7b03f1f3-2061-4962-ba07-3a4f9da2ea90" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:46:18 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Forcefully refreshing network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 16:46:19 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:46:19 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Updating instance_info_cache with network_info: [{"id": "0599b1d1-85cd-4003-9d3d-c343f09a5b2b", "address": "fa:16:3e:61:06:fc", "network": {"id": "b0e81786-47f3-4a13-90c7-788cb53a4df5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1382922826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebd1ea36980641739f2bdd856a65d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0599b1d1-85", "ovs_interfaceid": "0599b1d1-85cd-4003-9d3d-c343f09a5b2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:46:19 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Releasing lock "refresh_cache-7b03f1f3-2061-4962-ba07-3a4f9da2ea90" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:46:19 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Updated the network info_cache for instance {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 16:46:20 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:46:20 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:46:20 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:46:20 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:46:20 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:46:20 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75245) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 16:46:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b03f1f3-2061-4962-ba07-3a4f9da2ea90/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:46:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b03f1f3-2061-4962-ba07-3a4f9da2ea90/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:46:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b03f1f3-2061-4962-ba07-3a4f9da2ea90/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:46:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b03f1f3-2061-4962-ba07-3a4f9da2ea90/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:46:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f987507f-708e-4218-a49c-2a94bc5edc3c/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:46:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f987507f-708e-4218-a49c-2a94bc5edc3c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:46:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f987507f-708e-4218-a49c-2a94bc5edc3c/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:46:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f987507f-708e-4218-a49c-2a94bc5edc3c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:46:21 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:46:21 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:46:21 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Hypervisor/Node resource view: name=user free_ram=8741MB free_disk=25.155494689941406GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75245) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 16:46:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:46:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:46:21 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 7b03f1f3-2061-4962-ba07-3a4f9da2ea90 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:46:21 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance f987507f-708e-4218-a49c-2a94bc5edc3c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:46:21 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 16:46:21 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 16:46:21 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Refreshing inventories for resource provider dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 16:46:21 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Updating ProviderTree inventory for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 16:46:21 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Updating inventory in ProviderTree for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 16:46:21 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Refreshing aggregate associations for resource provider dcc0ed27-167e-4f3a-a0de-183bb144a50c, aggregates: None {{(pid=75245) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 16:46:22 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Refreshing trait associations for resource provider dcc0ed27-167e-4f3a-a0de-183bb144a50c, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG {{(pid=75245) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 16:46:22 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:46:22 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:46:22 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Compute_service record updated for user:user {{(pid=75245) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 16:46:22 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.471s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:46:23 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:46:23 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:46:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:46:24 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:46:24 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Cleaning up deleted instances {{(pid=75245) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 16:46:24 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] There are 0 instances to clean {{(pid=75245) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 16:46:29 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:46:29 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:46:29 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:46:29 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:46:29 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75245) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 16:46:30 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:46:32 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:46:32 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75245) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 16:46:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:46:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:46:36 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:46:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:46:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:46:39 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:46:39 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:46:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:46:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:46:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:46:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:46:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75245) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 16:46:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:46:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:46:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:46:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:46:59 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:47:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-5c0342c3-1b59-4966-a81d-aca73629b55e tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Acquiring lock "7b03f1f3-2061-4962-ba07-3a4f9da2ea90" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:47:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-5c0342c3-1b59-4966-a81d-aca73629b55e tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lock "7b03f1f3-2061-4962-ba07-3a4f9da2ea90" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:47:03 user nova-compute[75245]: DEBUG nova.objects.instance [None req-5c0342c3-1b59-4966-a81d-aca73629b55e tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lazy-loading 'flavor' on Instance uuid 7b03f1f3-2061-4962-ba07-3a4f9da2ea90 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:47:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-5c0342c3-1b59-4966-a81d-aca73629b55e tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lock "7b03f1f3-2061-4962-ba07-3a4f9da2ea90" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:47:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-5c0342c3-1b59-4966-a81d-aca73629b55e tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Acquiring lock "7b03f1f3-2061-4962-ba07-3a4f9da2ea90" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:47:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-5c0342c3-1b59-4966-a81d-aca73629b55e tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lock "7b03f1f3-2061-4962-ba07-3a4f9da2ea90" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:47:03 user nova-compute[75245]: INFO nova.compute.manager [None req-5c0342c3-1b59-4966-a81d-aca73629b55e tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Attaching volume adf000a4-d2ea-41f7-ac53-bec752956c3c to /dev/vdb
Nov 29 16:47:03 user nova-compute[75245]: DEBUG os_brick.utils [None req-5c0342c3-1b59-4966-a81d-aca73629b55e tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:47:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:47:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:47:03 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[e95f64dc-aacb-45eb-ab68-178b8fc7bfde]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:69ed8ed87091\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:47:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:47:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:47:03 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[5025b682-0453-41a7-925d-5497a3e7d2a6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:47:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:47:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:47:03 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8352ede-9039-499b-849a-ab9449f3e462]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:47:03 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[a67666c3-73dc-45d8-b6f1-7207346e8a27]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:47:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-5c0342c3-1b59-4966-a81d-aca73629b55e tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Running cmd (subprocess): nvme version {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:47:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-5c0342c3-1b59-4966-a81d-aca73629b55e tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] 'nvme version' failed. Not Retrying. {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:47:03 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5c0342c3-1b59-4966-a81d-aca73629b55e tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] nvme not present on system {{(pid=75245) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 16:47:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:47:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:47:03 user nova-compute[75245]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 16:47:03 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[974e13db-e4ac-44a0-b9ec-249ef542a49e]: (4, '') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:47:03 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-5c0342c3-1b59-4966-a81d-aca73629b55e tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75245) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 16:47:03 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-5c0342c3-1b59-4966-a81d-aca73629b55e tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 16:47:03 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-5c0342c3-1b59-4966-a81d-aca73629b55e tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] LIGHTOS: no hostnqn found. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 16:47:03 user nova-compute[75245]: DEBUG os_brick.utils [None req-5c0342c3-1b59-4966-a81d-aca73629b55e tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:69ed8ed87091', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:47:03 user nova-compute[75245]: DEBUG nova.virt.block_device [None req-5c0342c3-1b59-4966-a81d-aca73629b55e tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Updating existing volume attachment record: 475be9b9-a9ed-4e8f-9e51-696b2c764d79 {{(pid=75245) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 16:47:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:47:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:47:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:47:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75245) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 16:47:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:47:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:47:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:47:10 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c0342c3-1b59-4966-a81d-aca73629b55e tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Calling os-brick to attach iSCSI Volume {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 16:47:10 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0342c3-1b59-4966-a81d-aca73629b55e tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:adf000a4-d2ea-41f7-ac53-bec752956c3c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XvxBNTop', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:47:10 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-5c0342c3-1b59-4966-a81d-aca73629b55e tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:47:10 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-5c0342c3-1b59-4966-a81d-aca73629b55e tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:47:10 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-5c0342c3-1b59-4966-a81d-aca73629b55e tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:47:10 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-5c0342c3-1b59-4966-a81d-aca73629b55e tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:47:10 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-5c0342c3-1b59-4966-a81d-aca73629b55e tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:adf000a4-d2ea-41f7-ac53-bec752956c3c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:47:10 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-5c0342c3-1b59-4966-a81d-aca73629b55e tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:adf000a4-d2ea-41f7-ac53-bec752956c3c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:47:10 user nova-compute[75245]: INFO os_brick.initiator.connectors.iscsi [None req-5c0342c3-1b59-4966-a81d-aca73629b55e tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 16:47:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adf000a4-d2ea-41f7-ac53-bec752956c3c -p 172.16.0.220:3260 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:47:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adf000a4-d2ea-41f7-ac53-bec752956c3c -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:47:10 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d51045-3020-45a7-a495-73e8b48ff69a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:47:10 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0342c3-1b59-4966-a81d-aca73629b55e tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 16:47:10 user nova-compute[75245]:  {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:47:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adf000a4-d2ea-41f7-ac53-bec752956c3c -p 172.16.0.220:3260 --interface default --op new {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:47:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adf000a4-d2ea-41f7-ac53-bec752956c3c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:47:10 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06c21fe-2933-4204-9c6c-4dee85cb8b6d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:adf000a4-d2ea-41f7-ac53-bec752956c3c] added\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:47:10 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0342c3-1b59-4966-a81d-aca73629b55e tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:adf000a4-d2ea-41f7-ac53-bec752956c3c] added
Nov 29 16:47:10 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:47:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adf000a4-d2ea-41f7-ac53-bec752956c3c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:47:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adf000a4-d2ea-41f7-ac53-bec752956c3c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:47:10 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f3ec74-881a-4532-a9f3-1879d3207f13]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:47:10 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0342c3-1b59-4966-a81d-aca73629b55e tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:47:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adf000a4-d2ea-41f7-ac53-bec752956c3c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:47:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adf000a4-d2ea-41f7-ac53-bec752956c3c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:47:10 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e6a25f8-8a09-43df-860f-ff7956980203]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:47:10 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0342c3-1b59-4966-a81d-aca73629b55e tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:47:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adf000a4-d2ea-41f7-ac53-bec752956c3c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XvxBNTop {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:47:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adf000a4-d2ea-41f7-ac53-bec752956c3c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XvxBNTop" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:47:10 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[451d27e8-afa8-43ae-99fc-5bfb7366f60b]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:47:10 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0342c3-1b59-4966-a81d-aca73629b55e tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XvxBNTop'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:47:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adf000a4-d2ea-41f7-ac53-bec752956c3c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:47:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adf000a4-d2ea-41f7-ac53-bec752956c3c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:47:10 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e2f635e-21cd-4e3c-b2d5-fb27579feb05]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:47:10 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0342c3-1b59-4966-a81d-aca73629b55e tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:47:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:47:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:47:10 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8c503c-39d9-45ec-bc36-d23e018415b1]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:47:10 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0342c3-1b59-4966-a81d-aca73629b55e tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 16:47:10 user nova-compute[75245]:  {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:47:10 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0342c3-1b59-4966-a81d-aca73629b55e tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 16:47:10 user nova-compute[75245]:  {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:47:10 user nova-compute[75245]: WARNING os_brick.initiator.connectors.iscsi [None req-5c0342c3-1b59-4966-a81d-aca73629b55e tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 16:47:10 user nova-compute[75245]: 
Nov 29 16:47:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adf000a4-d2ea-41f7-ac53-bec752956c3c -p 172.16.0.220:3260 --login {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:47:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adf000a4-d2ea-41f7-ac53-bec752956c3c -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:47:10 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae73ec10-a9de-432e-a4b4-1dd28fa5b84a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:adf000a4-d2ea-41f7-ac53-bec752956c3c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:adf000a4-d2ea-41f7-ac53-bec752956c3c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:47:10 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0342c3-1b59-4966-a81d-aca73629b55e tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:adf000a4-d2ea-41f7-ac53-bec752956c3c, portal: 172.16.0.220,3260]
Nov 29 16:47:10 user nova-compute[75245]: Login to [iface: default, target: iqn.2010-10.org.openstack:adf000a4-d2ea-41f7-ac53-bec752956c3c, portal: 172.16.0.220,3260] successful.
Nov 29 16:47:10 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:47:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adf000a4-d2ea-41f7-ac53-bec752956c3c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:47:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adf000a4-d2ea-41f7-ac53-bec752956c3c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:47:10 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c21cc31-10d1-4dd5-a852-83a6806aa33d]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:47:10 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0342c3-1b59-4966-a81d-aca73629b55e tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:47:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:47:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:47:10 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c215175-33eb-4353-80b2-728d70bb5a34]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adf000a4-d2ea-41f7-ac53-bec752956c3c (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:47:10 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0342c3-1b59-4966-a81d-aca73629b55e tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adf000a4-d2ea-41f7-ac53-bec752956c3c (non-flash)
Nov 29 16:47:10 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:47:10 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0342c3-1b59-4966-a81d-aca73629b55e tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adf000a4-d2ea-41f7-ac53-bec752956c3c (non-flash)
Nov 29 16:47:10 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:47:10 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-5c0342c3-1b59-4966-a81d-aca73629b55e tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:adf000a4-d2ea-41f7-ac53-bec752956c3c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:47:10 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0342c3-1b59-4966-a81d-aca73629b55e tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Connected to 172.16.0.220:3260 {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 16:47:10 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-5c0342c3-1b59-4966-a81d-aca73629b55e tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=75245) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 16:47:10 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-5c0342c3-1b59-4966-a81d-aca73629b55e tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75245) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 16:47:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:47:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:47:10 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d79d28b-b39e-4016-903c-0dc928764ba7]: (4, ('- - 0', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:47:10 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-5c0342c3-1b59-4966-a81d-aca73629b55e tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: None {{(pid=75245) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 16:47:11 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-5c0342c3-1b59-4966-a81d-aca73629b55e tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75245) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 16:47:11 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0342c3-1b59-4966-a81d-aca73629b55e tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:adf000a4-d2ea-41f7-ac53-bec752956c3c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XvxBNTop', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 16:47:11 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-5c0342c3-1b59-4966-a81d-aca73629b55e tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:47:11 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0342c3-1b59-4966-a81d-aca73629b55e tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '26334363134336334', 'path': '/dev/sdb'} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:47:11 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c0342c3-1b59-4966-a81d-aca73629b55e tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26334363134336334', 'path': '/dev/sdb'} {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 16:47:11 user nova-compute[75245]: DEBUG nova.objects.instance [None req-5c0342c3-1b59-4966-a81d-aca73629b55e tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lazy-loading 'flavor' on Instance uuid 7b03f1f3-2061-4962-ba07-3a4f9da2ea90 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:47:11 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-5c0342c3-1b59-4966-a81d-aca73629b55e tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 16:47:11 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:47:11 user nova-compute[75245]:   <source dev="/dev/sdb"/>
Nov 29 16:47:11 user nova-compute[75245]:   <target dev="vdb" bus="virtio"/>
Nov 29 16:47:11 user nova-compute[75245]:   <serial>adf000a4-d2ea-41f7-ac53-bec752956c3c</serial>
Nov 29 16:47:11 user nova-compute[75245]: </disk>
Nov 29 16:47:11 user nova-compute[75245]:  {{(pid=75245) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 16:47:12 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:47:12 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-5c0342c3-1b59-4966-a81d-aca73629b55e tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:47:12 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-5c0342c3-1b59-4966-a81d-aca73629b55e tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:47:12 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-5c0342c3-1b59-4966-a81d-aca73629b55e tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] No VIF found with MAC fa:16:3e:61:06:fc, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:47:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-5c0342c3-1b59-4966-a81d-aca73629b55e tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lock "7b03f1f3-2061-4962-ba07-3a4f9da2ea90" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.323s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:47:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:47:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:47:15 user nova-compute[75245]: DEBUG nova.compute.manager [req-6f6c9727-2005-45eb-bd9c-bc7c3c12e54a req-d4a3e3eb-9904-4ff5-852b-154975c6dd63 service nova] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Received event network-changed-0599b1d1-85cd-4003-9d3d-c343f09a5b2b {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:47:15 user nova-compute[75245]: DEBUG nova.compute.manager [req-6f6c9727-2005-45eb-bd9c-bc7c3c12e54a req-d4a3e3eb-9904-4ff5-852b-154975c6dd63 service nova] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Refreshing instance network info cache due to event network-changed-0599b1d1-85cd-4003-9d3d-c343f09a5b2b. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:47:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-6f6c9727-2005-45eb-bd9c-bc7c3c12e54a req-d4a3e3eb-9904-4ff5-852b-154975c6dd63 service nova] Acquiring lock "refresh_cache-7b03f1f3-2061-4962-ba07-3a4f9da2ea90" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:47:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-6f6c9727-2005-45eb-bd9c-bc7c3c12e54a req-d4a3e3eb-9904-4ff5-852b-154975c6dd63 service nova] Acquired lock "refresh_cache-7b03f1f3-2061-4962-ba07-3a4f9da2ea90" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:47:15 user nova-compute[75245]: DEBUG nova.network.neutron [req-6f6c9727-2005-45eb-bd9c-bc7c3c12e54a req-d4a3e3eb-9904-4ff5-852b-154975c6dd63 service nova] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Refreshing network info cache for port 0599b1d1-85cd-4003-9d3d-c343f09a5b2b {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:47:15 user nova-compute[75245]: DEBUG nova.network.neutron [req-6f6c9727-2005-45eb-bd9c-bc7c3c12e54a req-d4a3e3eb-9904-4ff5-852b-154975c6dd63 service nova] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Updated VIF entry in instance network info cache for port 0599b1d1-85cd-4003-9d3d-c343f09a5b2b. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:47:15 user nova-compute[75245]: DEBUG nova.network.neutron [req-6f6c9727-2005-45eb-bd9c-bc7c3c12e54a req-d4a3e3eb-9904-4ff5-852b-154975c6dd63 service nova] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Updating instance_info_cache with network_info: [{"id": "0599b1d1-85cd-4003-9d3d-c343f09a5b2b", "address": "fa:16:3e:61:06:fc", "network": {"id": "b0e81786-47f3-4a13-90c7-788cb53a4df5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1382922826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebd1ea36980641739f2bdd856a65d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0599b1d1-85", "ovs_interfaceid": "0599b1d1-85cd-4003-9d3d-c343f09a5b2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:47:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-6f6c9727-2005-45eb-bd9c-bc7c3c12e54a req-d4a3e3eb-9904-4ff5-852b-154975c6dd63 service nova] Releasing lock "refresh_cache-7b03f1f3-2061-4962-ba07-3a4f9da2ea90" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:47:17 user nova-compute[75245]: DEBUG nova.compute.manager [req-fa764055-d295-40e4-93e8-01cd645e4c8b req-2d07fcb0-4278-47ce-9715-7d6b23a99b85 service nova] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Received event network-changed-0599b1d1-85cd-4003-9d3d-c343f09a5b2b {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:47:17 user nova-compute[75245]: DEBUG nova.compute.manager [req-fa764055-d295-40e4-93e8-01cd645e4c8b req-2d07fcb0-4278-47ce-9715-7d6b23a99b85 service nova] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Refreshing instance network info cache due to event network-changed-0599b1d1-85cd-4003-9d3d-c343f09a5b2b. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:47:17 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-fa764055-d295-40e4-93e8-01cd645e4c8b req-2d07fcb0-4278-47ce-9715-7d6b23a99b85 service nova] Acquiring lock "refresh_cache-7b03f1f3-2061-4962-ba07-3a4f9da2ea90" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:47:17 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-fa764055-d295-40e4-93e8-01cd645e4c8b req-2d07fcb0-4278-47ce-9715-7d6b23a99b85 service nova] Acquired lock "refresh_cache-7b03f1f3-2061-4962-ba07-3a4f9da2ea90" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:47:17 user nova-compute[75245]: DEBUG nova.network.neutron [req-fa764055-d295-40e4-93e8-01cd645e4c8b req-2d07fcb0-4278-47ce-9715-7d6b23a99b85 service nova] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Refreshing network info cache for port 0599b1d1-85cd-4003-9d3d-c343f09a5b2b {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:47:17 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-cffdf0d9-3c42-4e1f-aa2c-958f2555ac5c tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Acquiring lock "7b03f1f3-2061-4962-ba07-3a4f9da2ea90" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:47:17 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-cffdf0d9-3c42-4e1f-aa2c-958f2555ac5c tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lock "7b03f1f3-2061-4962-ba07-3a4f9da2ea90" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:47:17 user nova-compute[75245]: INFO nova.compute.manager [None req-cffdf0d9-3c42-4e1f-aa2c-958f2555ac5c tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Rebooting instance
Nov 29 16:47:17 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-cffdf0d9-3c42-4e1f-aa2c-958f2555ac5c tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Acquiring lock "refresh_cache-7b03f1f3-2061-4962-ba07-3a4f9da2ea90" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:47:18 user nova-compute[75245]: DEBUG nova.network.neutron [req-fa764055-d295-40e4-93e8-01cd645e4c8b req-2d07fcb0-4278-47ce-9715-7d6b23a99b85 service nova] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Updated VIF entry in instance network info cache for port 0599b1d1-85cd-4003-9d3d-c343f09a5b2b. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:47:18 user nova-compute[75245]: DEBUG nova.network.neutron [req-fa764055-d295-40e4-93e8-01cd645e4c8b req-2d07fcb0-4278-47ce-9715-7d6b23a99b85 service nova] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Updating instance_info_cache with network_info: [{"id": "0599b1d1-85cd-4003-9d3d-c343f09a5b2b", "address": "fa:16:3e:61:06:fc", "network": {"id": "b0e81786-47f3-4a13-90c7-788cb53a4df5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1382922826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebd1ea36980641739f2bdd856a65d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0599b1d1-85", "ovs_interfaceid": "0599b1d1-85cd-4003-9d3d-c343f09a5b2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:47:18 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-fa764055-d295-40e4-93e8-01cd645e4c8b req-2d07fcb0-4278-47ce-9715-7d6b23a99b85 service nova] Releasing lock "refresh_cache-7b03f1f3-2061-4962-ba07-3a4f9da2ea90" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:47:18 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-cffdf0d9-3c42-4e1f-aa2c-958f2555ac5c tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Acquired lock "refresh_cache-7b03f1f3-2061-4962-ba07-3a4f9da2ea90" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:47:18 user nova-compute[75245]: DEBUG nova.network.neutron [None req-cffdf0d9-3c42-4e1f-aa2c-958f2555ac5c tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 16:47:19 user nova-compute[75245]: DEBUG nova.network.neutron [None req-cffdf0d9-3c42-4e1f-aa2c-958f2555ac5c tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Updating instance_info_cache with network_info: [{"id": "0599b1d1-85cd-4003-9d3d-c343f09a5b2b", "address": "fa:16:3e:61:06:fc", "network": {"id": "b0e81786-47f3-4a13-90c7-788cb53a4df5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1382922826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebd1ea36980641739f2bdd856a65d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0599b1d1-85", "ovs_interfaceid": "0599b1d1-85cd-4003-9d3d-c343f09a5b2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:47:19 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-cffdf0d9-3c42-4e1f-aa2c-958f2555ac5c tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Releasing lock "refresh_cache-7b03f1f3-2061-4962-ba07-3a4f9da2ea90" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:47:19 user nova-compute[75245]: DEBUG nova.compute.manager [None req-cffdf0d9-3c42-4e1f-aa2c-958f2555ac5c tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:47:19 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:47:19 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:47:19 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Starting heal instance info cache {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 16:47:19 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Rebuilding the list of instances to heal {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 16:47:19 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "refresh_cache-7b03f1f3-2061-4962-ba07-3a4f9da2ea90" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:47:19 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquired lock "refresh_cache-7b03f1f3-2061-4962-ba07-3a4f9da2ea90" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:47:19 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Forcefully refreshing network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 16:47:19 user nova-compute[75245]: DEBUG nova.objects.instance [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lazy-loading 'info_cache' on Instance uuid 7b03f1f3-2061-4962-ba07-3a4f9da2ea90 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:47:20 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Updating instance_info_cache with network_info: [{"id": "0599b1d1-85cd-4003-9d3d-c343f09a5b2b", "address": "fa:16:3e:61:06:fc", "network": {"id": "b0e81786-47f3-4a13-90c7-788cb53a4df5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1382922826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebd1ea36980641739f2bdd856a65d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0599b1d1-85", "ovs_interfaceid": "0599b1d1-85cd-4003-9d3d-c343f09a5b2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:47:20 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Releasing lock "refresh_cache-7b03f1f3-2061-4962-ba07-3a4f9da2ea90" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:47:20 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Updated the network info_cache for instance {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 16:47:20 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:47:20 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:47:20 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:47:20 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:47:20 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75245) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 16:47:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b03f1f3-2061-4962-ba07-3a4f9da2ea90/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:47:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b03f1f3-2061-4962-ba07-3a4f9da2ea90/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:47:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b03f1f3-2061-4962-ba07-3a4f9da2ea90/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:47:20 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:47:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b03f1f3-2061-4962-ba07-3a4f9da2ea90/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:47:21 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:47:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f987507f-708e-4218-a49c-2a94bc5edc3c/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:47:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f987507f-708e-4218-a49c-2a94bc5edc3c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:47:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f987507f-708e-4218-a49c-2a94bc5edc3c/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:47:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f987507f-708e-4218-a49c-2a94bc5edc3c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:47:21 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:47:21 user nova-compute[75245]: DEBUG nova.compute.manager [req-dc66cd08-d6a5-415f-a358-6ddacda09e27 req-c0b23636-e41b-4945-a2b4-86f75c211503 service nova] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Received event network-vif-unplugged-0599b1d1-85cd-4003-9d3d-c343f09a5b2b {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:47:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-dc66cd08-d6a5-415f-a358-6ddacda09e27 req-c0b23636-e41b-4945-a2b4-86f75c211503 service nova] Acquiring lock "7b03f1f3-2061-4962-ba07-3a4f9da2ea90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:47:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-dc66cd08-d6a5-415f-a358-6ddacda09e27 req-c0b23636-e41b-4945-a2b4-86f75c211503 service nova] Lock "7b03f1f3-2061-4962-ba07-3a4f9da2ea90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:47:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-dc66cd08-d6a5-415f-a358-6ddacda09e27 req-c0b23636-e41b-4945-a2b4-86f75c211503 service nova] Lock "7b03f1f3-2061-4962-ba07-3a4f9da2ea90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:47:21 user nova-compute[75245]: DEBUG nova.compute.manager [req-dc66cd08-d6a5-415f-a358-6ddacda09e27 req-c0b23636-e41b-4945-a2b4-86f75c211503 service nova] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] No waiting events found dispatching network-vif-unplugged-0599b1d1-85cd-4003-9d3d-c343f09a5b2b {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:47:21 user nova-compute[75245]: WARNING nova.compute.manager [req-dc66cd08-d6a5-415f-a358-6ddacda09e27 req-c0b23636-e41b-4945-a2b4-86f75c211503 service nova] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Received unexpected event network-vif-unplugged-0599b1d1-85cd-4003-9d3d-c343f09a5b2b for instance with vm_state active and task_state reboot_started.
Nov 29 16:47:21 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:47:21 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:47:21 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Hypervisor/Node resource view: name=user free_ram=8835MB free_disk=25.109874725341797GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75245) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 16:47:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:47:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:47:22 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 7b03f1f3-2061-4962-ba07-3a4f9da2ea90 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:47:22 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance f987507f-708e-4218-a49c-2a94bc5edc3c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:47:22 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 16:47:22 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 16:47:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:47:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:47:22 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:47:22 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:47:22 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-cffdf0d9-3c42-4e1f-aa2c-958f2555ac5c tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Instance shutdown successfully.
Nov 29 16:47:22 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Compute_service record updated for user:user {{(pid=75245) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 16:47:22 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.393s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:47:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:47:23 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:47:23 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:47:23 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:47:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:47:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:47:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:47:23 user nova-compute[75245]: DEBUG nova.compute.manager [req-2ec59711-8f70-4133-ae94-3c2c0dddbbbe req-a9ba90c1-9af3-4cb0-bb8a-f2af67dc99d4 service nova] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Received event network-vif-plugged-0599b1d1-85cd-4003-9d3d-c343f09a5b2b {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:47:23 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-2ec59711-8f70-4133-ae94-3c2c0dddbbbe req-a9ba90c1-9af3-4cb0-bb8a-f2af67dc99d4 service nova] Acquiring lock "7b03f1f3-2061-4962-ba07-3a4f9da2ea90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:47:23 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-2ec59711-8f70-4133-ae94-3c2c0dddbbbe req-a9ba90c1-9af3-4cb0-bb8a-f2af67dc99d4 service nova] Lock "7b03f1f3-2061-4962-ba07-3a4f9da2ea90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:47:23 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-2ec59711-8f70-4133-ae94-3c2c0dddbbbe req-a9ba90c1-9af3-4cb0-bb8a-f2af67dc99d4 service nova] Lock "7b03f1f3-2061-4962-ba07-3a4f9da2ea90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:47:23 user nova-compute[75245]: DEBUG nova.compute.manager [req-2ec59711-8f70-4133-ae94-3c2c0dddbbbe req-a9ba90c1-9af3-4cb0-bb8a-f2af67dc99d4 service nova] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] No waiting events found dispatching network-vif-plugged-0599b1d1-85cd-4003-9d3d-c343f09a5b2b {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:47:23 user nova-compute[75245]: WARNING nova.compute.manager [req-2ec59711-8f70-4133-ae94-3c2c0dddbbbe req-a9ba90c1-9af3-4cb0-bb8a-f2af67dc99d4 service nova] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Received unexpected event network-vif-plugged-0599b1d1-85cd-4003-9d3d-c343f09a5b2b for instance with vm_state active and task_state reboot_started.
Nov 29 16:47:23 user nova-compute[75245]: DEBUG nova.compute.manager [req-2ec59711-8f70-4133-ae94-3c2c0dddbbbe req-a9ba90c1-9af3-4cb0-bb8a-f2af67dc99d4 service nova] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Received event network-vif-plugged-0599b1d1-85cd-4003-9d3d-c343f09a5b2b {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:47:23 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-2ec59711-8f70-4133-ae94-3c2c0dddbbbe req-a9ba90c1-9af3-4cb0-bb8a-f2af67dc99d4 service nova] Acquiring lock "7b03f1f3-2061-4962-ba07-3a4f9da2ea90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:47:23 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-2ec59711-8f70-4133-ae94-3c2c0dddbbbe req-a9ba90c1-9af3-4cb0-bb8a-f2af67dc99d4 service nova] Lock "7b03f1f3-2061-4962-ba07-3a4f9da2ea90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:47:23 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-2ec59711-8f70-4133-ae94-3c2c0dddbbbe req-a9ba90c1-9af3-4cb0-bb8a-f2af67dc99d4 service nova] Lock "7b03f1f3-2061-4962-ba07-3a4f9da2ea90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:47:23 user nova-compute[75245]: DEBUG nova.compute.manager [req-2ec59711-8f70-4133-ae94-3c2c0dddbbbe req-a9ba90c1-9af3-4cb0-bb8a-f2af67dc99d4 service nova] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] No waiting events found dispatching network-vif-plugged-0599b1d1-85cd-4003-9d3d-c343f09a5b2b {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:47:23 user nova-compute[75245]: WARNING nova.compute.manager [req-2ec59711-8f70-4133-ae94-3c2c0dddbbbe req-a9ba90c1-9af3-4cb0-bb8a-f2af67dc99d4 service nova] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Received unexpected event network-vif-plugged-0599b1d1-85cd-4003-9d3d-c343f09a5b2b for instance with vm_state active and task_state reboot_started.
Nov 29 16:47:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:47:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:47:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:47:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:47:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:47:25 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Instance running successfully.
Nov 29 16:47:25 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-cffdf0d9-3c42-4e1f-aa2c-958f2555ac5c tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Instance soft rebooted successfully.
Nov 29 16:47:25 user nova-compute[75245]: DEBUG nova.compute.manager [None req-cffdf0d9-3c42-4e1f-aa2c-958f2555ac5c tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:47:25 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-cffdf0d9-3c42-4e1f-aa2c-958f2555ac5c tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lock "7b03f1f3-2061-4962-ba07-3a4f9da2ea90" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.963s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:47:25 user nova-compute[75245]: DEBUG nova.compute.manager [req-95f875cc-3a34-4aae-b790-30a99087aa4c req-8408cb11-998a-4873-9fa4-7cc1c4637cb5 service nova] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Received event network-vif-plugged-0599b1d1-85cd-4003-9d3d-c343f09a5b2b {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:47:25 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-95f875cc-3a34-4aae-b790-30a99087aa4c req-8408cb11-998a-4873-9fa4-7cc1c4637cb5 service nova] Acquiring lock "7b03f1f3-2061-4962-ba07-3a4f9da2ea90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:47:25 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-95f875cc-3a34-4aae-b790-30a99087aa4c req-8408cb11-998a-4873-9fa4-7cc1c4637cb5 service nova] Lock "7b03f1f3-2061-4962-ba07-3a4f9da2ea90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:47:25 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-95f875cc-3a34-4aae-b790-30a99087aa4c req-8408cb11-998a-4873-9fa4-7cc1c4637cb5 service nova] Lock "7b03f1f3-2061-4962-ba07-3a4f9da2ea90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:47:25 user nova-compute[75245]: DEBUG nova.compute.manager [req-95f875cc-3a34-4aae-b790-30a99087aa4c req-8408cb11-998a-4873-9fa4-7cc1c4637cb5 service nova] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] No waiting events found dispatching network-vif-plugged-0599b1d1-85cd-4003-9d3d-c343f09a5b2b {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:47:25 user nova-compute[75245]: WARNING nova.compute.manager [req-95f875cc-3a34-4aae-b790-30a99087aa4c req-8408cb11-998a-4873-9fa4-7cc1c4637cb5 service nova] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Received unexpected event network-vif-plugged-0599b1d1-85cd-4003-9d3d-c343f09a5b2b for instance with vm_state active and task_state None.
Nov 29 16:47:26 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:47:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:47:29 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:47:30 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:47:30 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:47:31 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:47:31 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75245) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 16:47:32 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Acquiring lock "25a0a73c-ed89-4530-aabb-a6a85e030482" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:47:32 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Lock "25a0a73c-ed89-4530-aabb-a6a85e030482" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:47:32 user nova-compute[75245]: DEBUG nova.compute.manager [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Starting instance... {{(pid=75245) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 16:47:32 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:47:32 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:47:32 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75245) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 16:47:32 user nova-compute[75245]: INFO nova.compute.claims [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Claim successful on node user
Nov 29 16:47:33 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:47:33 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:47:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.229s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:47:33 user nova-compute[75245]: DEBUG nova.compute.manager [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Start building networks asynchronously for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 16:47:33 user nova-compute[75245]: DEBUG nova.compute.manager [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Allocating IP information in the background. {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 16:47:33 user nova-compute[75245]: DEBUG nova.network.neutron [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] allocate_for_instance() {{(pid=75245) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 16:47:33 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 16:47:33 user nova-compute[75245]: DEBUG nova.compute.manager [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Start building block device mappings for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 16:47:33 user nova-compute[75245]: DEBUG nova.policy [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0acde563960c46268a890ac370800146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd056f7dae1d94936bd1fed295f0eba16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75245) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 16:47:33 user nova-compute[75245]: DEBUG nova.compute.manager [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Start spawning the instance on the hypervisor. {{(pid=75245) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 16:47:33 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Creating instance directory {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 16:47:33 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Creating image(s)
Nov 29 16:47:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Acquiring lock "/opt/stack/data/nova/instances/25a0a73c-ed89-4530-aabb-a6a85e030482/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:47:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Lock "/opt/stack/data/nova/instances/25a0a73c-ed89-4530-aabb-a6a85e030482/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:47:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Lock "/opt/stack/data/nova/instances/25a0a73c-ed89-4530-aabb-a6a85e030482/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:47:33 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:47:33 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.181s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:47:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Acquiring lock "d654f7206043e05d3525550b0fc885556eb999f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:47:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:47:33 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:47:33 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:47:33 user nova-compute[75245]: WARNING nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] While synchronizing instance power states, found 3 instances in the database and 2 instances on the hypervisor.
Nov 29 16:47:33 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Triggering sync for uuid 7b03f1f3-2061-4962-ba07-3a4f9da2ea90 {{(pid=75245) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 16:47:33 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Triggering sync for uuid f987507f-708e-4218-a49c-2a94bc5edc3c {{(pid=75245) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 16:47:33 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Triggering sync for uuid 25a0a73c-ed89-4530-aabb-a6a85e030482 {{(pid=75245) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 16:47:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "7b03f1f3-2061-4962-ba07-3a4f9da2ea90" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:47:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "7b03f1f3-2061-4962-ba07-3a4f9da2ea90" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:47:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "f987507f-708e-4218-a49c-2a94bc5edc3c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:47:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "f987507f-708e-4218-a49c-2a94bc5edc3c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:47:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "25a0a73c-ed89-4530-aabb-a6a85e030482" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:47:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "7b03f1f3-2061-4962-ba07-3a4f9da2ea90" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:47:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "f987507f-708e-4218-a49c-2a94bc5edc3c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:47:33 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.207s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:47:33 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/25a0a73c-ed89-4530-aabb-a6a85e030482/disk 1073741824 {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:47:33 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/25a0a73c-ed89-4530-aabb-a6a85e030482/disk 1073741824" returned: 0 in 0.053s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:47:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:47:33 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:47:33 user nova-compute[75245]: DEBUG nova.network.neutron [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Successfully created port: 8f62d901-5ef0-4879-9f19-8a51f55fde1f {{(pid=75245) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 16:47:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.199s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:47:34 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Checking if we can resize image /opt/stack/data/nova/instances/25a0a73c-ed89-4530-aabb-a6a85e030482/disk. size=1073741824 {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 16:47:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25a0a73c-ed89-4530-aabb-a6a85e030482/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:47:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:47:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25a0a73c-ed89-4530-aabb-a6a85e030482/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:47:34 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Cannot resize image /opt/stack/data/nova/instances/25a0a73c-ed89-4530-aabb-a6a85e030482/disk to a smaller size. {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 16:47:34 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Created local disks {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 16:47:34 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Ensure instance console log exists: /opt/stack/data/nova/instances/25a0a73c-ed89-4530-aabb-a6a85e030482/console.log {{(pid=75245) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 16:47:34 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:47:34 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:47:34 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:47:34 user nova-compute[75245]: DEBUG nova.network.neutron [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Successfully updated port: 8f62d901-5ef0-4879-9f19-8a51f55fde1f {{(pid=75245) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 16:47:34 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Acquiring lock "refresh_cache-25a0a73c-ed89-4530-aabb-a6a85e030482" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:47:34 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Acquired lock "refresh_cache-25a0a73c-ed89-4530-aabb-a6a85e030482" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:47:34 user nova-compute[75245]: DEBUG nova.network.neutron [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 16:47:34 user nova-compute[75245]: DEBUG nova.compute.manager [req-4d0acd57-ff65-4f36-928a-65d2f83839ea req-356fc7eb-7c2a-4a09-803d-430372b67db0 service nova] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Received event network-changed-8f62d901-5ef0-4879-9f19-8a51f55fde1f {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:47:34 user nova-compute[75245]: DEBUG nova.compute.manager [req-4d0acd57-ff65-4f36-928a-65d2f83839ea req-356fc7eb-7c2a-4a09-803d-430372b67db0 service nova] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Refreshing instance network info cache due to event network-changed-8f62d901-5ef0-4879-9f19-8a51f55fde1f. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:47:34 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-4d0acd57-ff65-4f36-928a-65d2f83839ea req-356fc7eb-7c2a-4a09-803d-430372b67db0 service nova] Acquiring lock "refresh_cache-25a0a73c-ed89-4530-aabb-a6a85e030482" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:47:34 user nova-compute[75245]: DEBUG nova.network.neutron [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Instance cache missing network info. {{(pid=75245) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 16:47:34 user nova-compute[75245]: DEBUG nova.network.neutron [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Updating instance_info_cache with network_info: [{"id": "8f62d901-5ef0-4879-9f19-8a51f55fde1f", "address": "fa:16:3e:8b:42:60", "network": {"id": "2eac25a6-c643-4348-98eb-91d044f1714c", "bridge": "br-int", "label": "tempest-TestStampPattern-1438802163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d056f7dae1d94936bd1fed295f0eba16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f62d901-5e", "ovs_interfaceid": "8f62d901-5ef0-4879-9f19-8a51f55fde1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:47:34 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Releasing lock "refresh_cache-25a0a73c-ed89-4530-aabb-a6a85e030482" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:47:34 user nova-compute[75245]: DEBUG nova.compute.manager [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Instance network_info: |[{"id": "8f62d901-5ef0-4879-9f19-8a51f55fde1f", "address": "fa:16:3e:8b:42:60", "network": {"id": "2eac25a6-c643-4348-98eb-91d044f1714c", "bridge": "br-int", "label": "tempest-TestStampPattern-1438802163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d056f7dae1d94936bd1fed295f0eba16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f62d901-5e", "ovs_interfaceid": "8f62d901-5ef0-4879-9f19-8a51f55fde1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 16:47:34 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-4d0acd57-ff65-4f36-928a-65d2f83839ea req-356fc7eb-7c2a-4a09-803d-430372b67db0 service nova] Acquired lock "refresh_cache-25a0a73c-ed89-4530-aabb-a6a85e030482" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:47:34 user nova-compute[75245]: DEBUG nova.network.neutron [req-4d0acd57-ff65-4f36-928a-65d2f83839ea req-356fc7eb-7c2a-4a09-803d-430372b67db0 service nova] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Refreshing network info cache for port 8f62d901-5ef0-4879-9f19-8a51f55fde1f {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:47:34 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Start _get_guest_xml network_info=[{"id": "8f62d901-5ef0-4879-9f19-8a51f55fde1f", "address": "fa:16:3e:8b:42:60", "network": {"id": "2eac25a6-c643-4348-98eb-91d044f1714c", "bridge": "br-int", "label": "tempest-TestStampPattern-1438802163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d056f7dae1d94936bd1fed295f0eba16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f62d901-5e", "ovs_interfaceid": "8f62d901-5ef0-4879-9f19-8a51f55fde1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'a291d9c3-be02-4c6c-9649-4b45c5b7f487'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 16:47:34 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:47:34 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:47:34 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 16:47:34 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] CPU controller missing on host. {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 16:47:34 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 16:47:34 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] CPU controller found on host. {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 16:47:34 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75245) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 16:47:34 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T16:06:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 16:47:34 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Flavor limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 16:47:34 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Image limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 16:47:34 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Flavor pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 16:47:34 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Image pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 16:47:34 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 16:47:34 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 16:47:34 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 16:47:34 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Got 1 possible topologies {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 16:47:34 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 16:47:34 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 16:47:34 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:47:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-403547569',display_name='tempest-TestStampPattern-server-403547569',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-403547569',id=41,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImoWxFDnu4c8KDr10Q6Ubx68e8gn5RNIGqBgLtWDemy3wpgxbiBAYLS+wfSKYPtQ2DWWp70/Ts0kN1P7Ewenibb2M76FreHbG7l7wWc3VZE00W0BrocAjgoRPqW16wYoQ==',key_name='tempest-TestStampPattern-428472352',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d056f7dae1d94936bd1fed295f0eba16',ramdisk_id='',reservation_id='r-3xydtuhr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1627008304',owner_user_name='tempest-TestStampPattern-1627008304-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:47:33Z,user_data=None,user_id='0acde563960c46268a890ac370800146',uuid=25a0a73c-ed89-4530-aabb-a6a85e030482,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f62d901-5ef0-4879-9f19-8a51f55fde1f", "address": "fa:16:3e:8b:42:60", "network": {"id": "2eac25a6-c643-4348-98eb-91d044f1714c", "bridge": "br-int", "label": "tempest-TestStampPattern-1438802163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d056f7dae1d94936bd1fed295f0eba16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f62d901-5e", "ovs_interfaceid": "8f62d901-5ef0-4879-9f19-8a51f55fde1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:47:34 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Converting VIF {"id": "8f62d901-5ef0-4879-9f19-8a51f55fde1f", "address": "fa:16:3e:8b:42:60", "network": {"id": "2eac25a6-c643-4348-98eb-91d044f1714c", "bridge": "br-int", "label": "tempest-TestStampPattern-1438802163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d056f7dae1d94936bd1fed295f0eba16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f62d901-5e", "ovs_interfaceid": "8f62d901-5ef0-4879-9f19-8a51f55fde1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:47:34 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:42:60,bridge_name='br-int',has_traffic_filtering=True,id=8f62d901-5ef0-4879-9f19-8a51f55fde1f,network=Network(2eac25a6-c643-4348-98eb-91d044f1714c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f62d901-5e') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:47:34 user nova-compute[75245]: DEBUG nova.objects.instance [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Lazy-loading 'pci_devices' on Instance uuid 25a0a73c-ed89-4530-aabb-a6a85e030482 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:47:34 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] End _get_guest_xml xml=<domain type="kvm">
Nov 29 16:47:34 user nova-compute[75245]:   <uuid>25a0a73c-ed89-4530-aabb-a6a85e030482</uuid>
Nov 29 16:47:34 user nova-compute[75245]:   <name>instance-00000029</name>
Nov 29 16:47:34 user nova-compute[75245]:   <memory>524288</memory>
Nov 29 16:47:34 user nova-compute[75245]:   <vcpu>1</vcpu>
Nov 29 16:47:34 user nova-compute[75245]:   <metadata>
Nov 29 16:47:34 user nova-compute[75245]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 16:47:34 user nova-compute[75245]:       <nova:package version="0.0.0"/>
Nov 29 16:47:34 user nova-compute[75245]:       <nova:name>tempest-TestStampPattern-server-403547569</nova:name>
Nov 29 16:47:34 user nova-compute[75245]:       <nova:creationTime>2023-11-29 16:47:34</nova:creationTime>
Nov 29 16:47:34 user nova-compute[75245]:       <nova:flavor name="m1.tiny">
Nov 29 16:47:34 user nova-compute[75245]:         <nova:memory>512</nova:memory>
Nov 29 16:47:34 user nova-compute[75245]:         <nova:disk>1</nova:disk>
Nov 29 16:47:34 user nova-compute[75245]:         <nova:swap>0</nova:swap>
Nov 29 16:47:34 user nova-compute[75245]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 16:47:34 user nova-compute[75245]:         <nova:vcpus>1</nova:vcpus>
Nov 29 16:47:34 user nova-compute[75245]:       </nova:flavor>
Nov 29 16:47:34 user nova-compute[75245]:       <nova:owner>
Nov 29 16:47:34 user nova-compute[75245]:         <nova:user uuid="0acde563960c46268a890ac370800146">tempest-TestStampPattern-1627008304-project-member</nova:user>
Nov 29 16:47:34 user nova-compute[75245]:         <nova:project uuid="d056f7dae1d94936bd1fed295f0eba16">tempest-TestStampPattern-1627008304</nova:project>
Nov 29 16:47:34 user nova-compute[75245]:       </nova:owner>
Nov 29 16:47:34 user nova-compute[75245]:       <nova:root type="image" uuid="a291d9c3-be02-4c6c-9649-4b45c5b7f487"/>
Nov 29 16:47:34 user nova-compute[75245]:       <nova:ports>
Nov 29 16:47:34 user nova-compute[75245]:         <nova:port uuid="8f62d901-5ef0-4879-9f19-8a51f55fde1f">
Nov 29 16:47:34 user nova-compute[75245]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 16:47:34 user nova-compute[75245]:         </nova:port>
Nov 29 16:47:34 user nova-compute[75245]:       </nova:ports>
Nov 29 16:47:34 user nova-compute[75245]:     </nova:instance>
Nov 29 16:47:34 user nova-compute[75245]:   </metadata>
Nov 29 16:47:34 user nova-compute[75245]:   <sysinfo type="smbios">
Nov 29 16:47:34 user nova-compute[75245]:     <system>
Nov 29 16:47:34 user nova-compute[75245]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 16:47:34 user nova-compute[75245]:       <entry name="product">OpenStack Nova</entry>
Nov 29 16:47:34 user nova-compute[75245]:       <entry name="version">0.0.0</entry>
Nov 29 16:47:34 user nova-compute[75245]:       <entry name="serial">25a0a73c-ed89-4530-aabb-a6a85e030482</entry>
Nov 29 16:47:34 user nova-compute[75245]:       <entry name="uuid">25a0a73c-ed89-4530-aabb-a6a85e030482</entry>
Nov 29 16:47:34 user nova-compute[75245]:       <entry name="family">Virtual Machine</entry>
Nov 29 16:47:34 user nova-compute[75245]:     </system>
Nov 29 16:47:34 user nova-compute[75245]:   </sysinfo>
Nov 29 16:47:34 user nova-compute[75245]:   <os>
Nov 29 16:47:34 user nova-compute[75245]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 16:47:34 user nova-compute[75245]:     <boot dev="hd"/>
Nov 29 16:47:34 user nova-compute[75245]:     <smbios mode="sysinfo"/>
Nov 29 16:47:34 user nova-compute[75245]:   </os>
Nov 29 16:47:34 user nova-compute[75245]:   <features>
Nov 29 16:47:34 user nova-compute[75245]:     <acpi/>
Nov 29 16:47:34 user nova-compute[75245]:     <apic/>
Nov 29 16:47:34 user nova-compute[75245]:     <vmcoreinfo/>
Nov 29 16:47:34 user nova-compute[75245]:   </features>
Nov 29 16:47:34 user nova-compute[75245]:   <clock offset="utc">
Nov 29 16:47:34 user nova-compute[75245]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 16:47:34 user nova-compute[75245]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 16:47:34 user nova-compute[75245]:     <timer name="hpet" present="no"/>
Nov 29 16:47:34 user nova-compute[75245]:   </clock>
Nov 29 16:47:34 user nova-compute[75245]:   <cpu mode="custom" match="exact">
Nov 29 16:47:34 user nova-compute[75245]:     <model>Nehalem</model>
Nov 29 16:47:34 user nova-compute[75245]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 16:47:34 user nova-compute[75245]:   </cpu>
Nov 29 16:47:34 user nova-compute[75245]:   <devices>
Nov 29 16:47:34 user nova-compute[75245]:     <disk type="file" device="disk">
Nov 29 16:47:34 user nova-compute[75245]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 16:47:34 user nova-compute[75245]:       <source file="/opt/stack/data/nova/instances/25a0a73c-ed89-4530-aabb-a6a85e030482/disk"/>
Nov 29 16:47:34 user nova-compute[75245]:       <target dev="vda" bus="virtio"/>
Nov 29 16:47:34 user nova-compute[75245]:     </disk>
Nov 29 16:47:34 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 16:47:34 user nova-compute[75245]:       <mac address="fa:16:3e:8b:42:60"/>
Nov 29 16:47:34 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:47:34 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 16:47:34 user nova-compute[75245]:       <target dev="tap8f62d901-5e"/>
Nov 29 16:47:34 user nova-compute[75245]:     </interface>
Nov 29 16:47:34 user nova-compute[75245]:     <serial type="pty">
Nov 29 16:47:34 user nova-compute[75245]:       <log file="/opt/stack/data/nova/instances/25a0a73c-ed89-4530-aabb-a6a85e030482/console.log" append="off"/>
Nov 29 16:47:34 user nova-compute[75245]:     </serial>
Nov 29 16:47:34 user nova-compute[75245]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 16:47:34 user nova-compute[75245]:     <video>
Nov 29 16:47:34 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:47:34 user nova-compute[75245]:     </video>
Nov 29 16:47:34 user nova-compute[75245]:     <rng model="virtio">
Nov 29 16:47:34 user nova-compute[75245]:       <backend model="random">/dev/urandom</backend>
Nov 29 16:47:34 user nova-compute[75245]:     </rng>
Nov 29 16:47:34 user nova-compute[75245]:     <controller type="usb" index="0" model="none"/>
Nov 29 16:47:34 user nova-compute[75245]:     <memballoon model="virtio">
Nov 29 16:47:34 user nova-compute[75245]:       <stats period="10"/>
Nov 29 16:47:34 user nova-compute[75245]:     </memballoon>
Nov 29 16:47:34 user nova-compute[75245]:   </devices>
Nov 29 16:47:34 user nova-compute[75245]: </domain>
Nov 29 16:47:34 user nova-compute[75245]:  {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 16:47:34 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:47:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-403547569',display_name='tempest-TestStampPattern-server-403547569',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-403547569',id=41,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImoWxFDnu4c8KDr10Q6Ubx68e8gn5RNIGqBgLtWDemy3wpgxbiBAYLS+wfSKYPtQ2DWWp70/Ts0kN1P7Ewenibb2M76FreHbG7l7wWc3VZE00W0BrocAjgoRPqW16wYoQ==',key_name='tempest-TestStampPattern-428472352',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d056f7dae1d94936bd1fed295f0eba16',ramdisk_id='',reservation_id='r-3xydtuhr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1627008304',owner_user_name='tempest-TestStampPattern-1627008304-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:47:33Z,user_data=None,user_id='0acde563960c46268a890ac370800146',uuid=25a0a73c-ed89-4530-aabb-a6a85e030482,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f62d901-5ef0-4879-9f19-8a51f55fde1f", "address": "fa:16:3e:8b:42:60", "network": {"id": "2eac25a6-c643-4348-98eb-91d044f1714c", "bridge": "br-int", "label": "tempest-TestStampPattern-1438802163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d056f7dae1d94936bd1fed295f0eba16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f62d901-5e", "ovs_interfaceid": "8f62d901-5ef0-4879-9f19-8a51f55fde1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 16:47:34 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Converting VIF {"id": "8f62d901-5ef0-4879-9f19-8a51f55fde1f", "address": "fa:16:3e:8b:42:60", "network": {"id": "2eac25a6-c643-4348-98eb-91d044f1714c", "bridge": "br-int", "label": "tempest-TestStampPattern-1438802163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d056f7dae1d94936bd1fed295f0eba16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f62d901-5e", "ovs_interfaceid": "8f62d901-5ef0-4879-9f19-8a51f55fde1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:47:34 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:42:60,bridge_name='br-int',has_traffic_filtering=True,id=8f62d901-5ef0-4879-9f19-8a51f55fde1f,network=Network(2eac25a6-c643-4348-98eb-91d044f1714c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f62d901-5e') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:47:34 user nova-compute[75245]: DEBUG os_vif [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:42:60,bridge_name='br-int',has_traffic_filtering=True,id=8f62d901-5ef0-4879-9f19-8a51f55fde1f,network=Network(2eac25a6-c643-4348-98eb-91d044f1714c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f62d901-5e') {{(pid=75245) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 16:47:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:47:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:47:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 16:47:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:47:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3073c150-b29c-50ef-a149-6455fb02fa0e', '_type': 'linux-noop'}}, row=False) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:47:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:47:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:47:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:47:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8f62d901-5e, may_exist=True, interface_attrs={}) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:47:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8f62d901-5e, col_values=(('qos', UUID('f2a47f9e-9379-4d61-b5c0-f22a446cdb57')),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:47:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8f62d901-5e, col_values=(('external_ids', {'iface-id': '8f62d901-5ef0-4879-9f19-8a51f55fde1f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:42:60', 'vm-uuid': '25a0a73c-ed89-4530-aabb-a6a85e030482'}),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:47:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:47:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:47:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:47:34 user nova-compute[75245]: INFO os_vif [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:42:60,bridge_name='br-int',has_traffic_filtering=True,id=8f62d901-5ef0-4879-9f19-8a51f55fde1f,network=Network(2eac25a6-c643-4348-98eb-91d044f1714c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f62d901-5e')
Nov 29 16:47:35 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:47:35 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] No VIF found with MAC fa:16:3e:8b:42:60, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:47:35 user nova-compute[75245]: DEBUG nova.network.neutron [req-4d0acd57-ff65-4f36-928a-65d2f83839ea req-356fc7eb-7c2a-4a09-803d-430372b67db0 service nova] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Updated VIF entry in instance network info cache for port 8f62d901-5ef0-4879-9f19-8a51f55fde1f. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:47:35 user nova-compute[75245]: DEBUG nova.network.neutron [req-4d0acd57-ff65-4f36-928a-65d2f83839ea req-356fc7eb-7c2a-4a09-803d-430372b67db0 service nova] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Updating instance_info_cache with network_info: [{"id": "8f62d901-5ef0-4879-9f19-8a51f55fde1f", "address": "fa:16:3e:8b:42:60", "network": {"id": "2eac25a6-c643-4348-98eb-91d044f1714c", "bridge": "br-int", "label": "tempest-TestStampPattern-1438802163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d056f7dae1d94936bd1fed295f0eba16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f62d901-5e", "ovs_interfaceid": "8f62d901-5ef0-4879-9f19-8a51f55fde1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:47:35 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-4d0acd57-ff65-4f36-928a-65d2f83839ea req-356fc7eb-7c2a-4a09-803d-430372b67db0 service nova] Releasing lock "refresh_cache-25a0a73c-ed89-4530-aabb-a6a85e030482" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:47:36 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:47:36 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:47:36 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:47:36 user nova-compute[75245]: DEBUG nova.compute.manager [req-fc5e433c-55a2-48bc-b7b0-2930c3167cfd req-6a95e845-1ef0-46af-a5d2-48edb1850d77 service nova] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Received event network-vif-plugged-8f62d901-5ef0-4879-9f19-8a51f55fde1f {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:47:36 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-fc5e433c-55a2-48bc-b7b0-2930c3167cfd req-6a95e845-1ef0-46af-a5d2-48edb1850d77 service nova] Acquiring lock "25a0a73c-ed89-4530-aabb-a6a85e030482-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:47:36 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-fc5e433c-55a2-48bc-b7b0-2930c3167cfd req-6a95e845-1ef0-46af-a5d2-48edb1850d77 service nova] Lock "25a0a73c-ed89-4530-aabb-a6a85e030482-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:47:36 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-fc5e433c-55a2-48bc-b7b0-2930c3167cfd req-6a95e845-1ef0-46af-a5d2-48edb1850d77 service nova] Lock "25a0a73c-ed89-4530-aabb-a6a85e030482-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:47:36 user nova-compute[75245]: DEBUG nova.compute.manager [req-fc5e433c-55a2-48bc-b7b0-2930c3167cfd req-6a95e845-1ef0-46af-a5d2-48edb1850d77 service nova] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] No waiting events found dispatching network-vif-plugged-8f62d901-5ef0-4879-9f19-8a51f55fde1f {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:47:36 user nova-compute[75245]: WARNING nova.compute.manager [req-fc5e433c-55a2-48bc-b7b0-2930c3167cfd req-6a95e845-1ef0-46af-a5d2-48edb1850d77 service nova] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Received unexpected event network-vif-plugged-8f62d901-5ef0-4879-9f19-8a51f55fde1f for instance with vm_state building and task_state spawning.
Nov 29 16:47:37 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:47:37 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:47:37 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:47:38 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:47:38 user nova-compute[75245]: DEBUG nova.compute.manager [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Instance event wait completed in 0 seconds for  {{(pid=75245) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 16:47:38 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Guest created on hypervisor {{(pid=75245) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 16:47:38 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Instance spawned successfully.
Nov 29 16:47:38 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 16:47:38 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Found default for hw_cdrom_bus of ide {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:47:38 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Found default for hw_disk_bus of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:47:38 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Found default for hw_input_bus of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:47:38 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Found default for hw_pointer_model of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:47:38 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Found default for hw_video_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:47:38 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Found default for hw_vif_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:47:38 user nova-compute[75245]: INFO nova.compute.manager [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Took 5.26 seconds to spawn the instance on the hypervisor.
Nov 29 16:47:38 user nova-compute[75245]: DEBUG nova.compute.manager [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:47:38 user nova-compute[75245]: DEBUG nova.compute.manager [req-4bbce323-1207-4cd1-b97e-9bcc482b2f54 req-8fe9b975-8eb0-4dc0-9f61-f4636d0ba9e3 service nova] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Received event network-vif-plugged-8f62d901-5ef0-4879-9f19-8a51f55fde1f {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:47:38 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-4bbce323-1207-4cd1-b97e-9bcc482b2f54 req-8fe9b975-8eb0-4dc0-9f61-f4636d0ba9e3 service nova] Acquiring lock "25a0a73c-ed89-4530-aabb-a6a85e030482-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:47:38 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-4bbce323-1207-4cd1-b97e-9bcc482b2f54 req-8fe9b975-8eb0-4dc0-9f61-f4636d0ba9e3 service nova] Lock "25a0a73c-ed89-4530-aabb-a6a85e030482-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:47:38 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-4bbce323-1207-4cd1-b97e-9bcc482b2f54 req-8fe9b975-8eb0-4dc0-9f61-f4636d0ba9e3 service nova] Lock "25a0a73c-ed89-4530-aabb-a6a85e030482-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:47:38 user nova-compute[75245]: DEBUG nova.compute.manager [req-4bbce323-1207-4cd1-b97e-9bcc482b2f54 req-8fe9b975-8eb0-4dc0-9f61-f4636d0ba9e3 service nova] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] No waiting events found dispatching network-vif-plugged-8f62d901-5ef0-4879-9f19-8a51f55fde1f {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:47:38 user nova-compute[75245]: WARNING nova.compute.manager [req-4bbce323-1207-4cd1-b97e-9bcc482b2f54 req-8fe9b975-8eb0-4dc0-9f61-f4636d0ba9e3 service nova] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Received unexpected event network-vif-plugged-8f62d901-5ef0-4879-9f19-8a51f55fde1f for instance with vm_state building and task_state spawning.
Nov 29 16:47:38 user nova-compute[75245]: INFO nova.compute.manager [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Took 5.86 seconds to build instance.
Nov 29 16:47:38 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-8282f84b-db14-4ad5-b555-eb03e70248bb tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Lock "25a0a73c-ed89-4530-aabb-a6a85e030482" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.952s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:47:38 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "25a0a73c-ed89-4530-aabb-a6a85e030482" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 5.081s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:47:38 user nova-compute[75245]: INFO nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] During sync_power_state the instance has a pending task (spawning). Skip.
Nov 29 16:47:38 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "25a0a73c-ed89-4530-aabb-a6a85e030482" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:47:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:47:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:47:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:47:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:47:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:47:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:47:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:47:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:47:57 user nova-compute[75245]: DEBUG nova.compute.manager [req-d44ab3b4-633b-4dd1-a621-5c860fdbaae9 req-3abd9817-650e-4dcb-9b97-805445056f84 service nova] [instance: f987507f-708e-4218-a49c-2a94bc5edc3c] Received event network-changed-d47f72a3-e0ce-4368-ad36-f8a7d20e221b {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:47:57 user nova-compute[75245]: DEBUG nova.compute.manager [req-d44ab3b4-633b-4dd1-a621-5c860fdbaae9 req-3abd9817-650e-4dcb-9b97-805445056f84 service nova] [instance: f987507f-708e-4218-a49c-2a94bc5edc3c] Refreshing instance network info cache due to event network-changed-d47f72a3-e0ce-4368-ad36-f8a7d20e221b. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:47:57 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d44ab3b4-633b-4dd1-a621-5c860fdbaae9 req-3abd9817-650e-4dcb-9b97-805445056f84 service nova] Acquiring lock "refresh_cache-f987507f-708e-4218-a49c-2a94bc5edc3c" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:47:57 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d44ab3b4-633b-4dd1-a621-5c860fdbaae9 req-3abd9817-650e-4dcb-9b97-805445056f84 service nova] Acquired lock "refresh_cache-f987507f-708e-4218-a49c-2a94bc5edc3c" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:47:57 user nova-compute[75245]: DEBUG nova.network.neutron [req-d44ab3b4-633b-4dd1-a621-5c860fdbaae9 req-3abd9817-650e-4dcb-9b97-805445056f84 service nova] [instance: f987507f-708e-4218-a49c-2a94bc5edc3c] Refreshing network info cache for port d47f72a3-e0ce-4368-ad36-f8a7d20e221b {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:47:58 user nova-compute[75245]: DEBUG nova.network.neutron [req-d44ab3b4-633b-4dd1-a621-5c860fdbaae9 req-3abd9817-650e-4dcb-9b97-805445056f84 service nova] [instance: f987507f-708e-4218-a49c-2a94bc5edc3c] Updated VIF entry in instance network info cache for port d47f72a3-e0ce-4368-ad36-f8a7d20e221b. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:47:58 user nova-compute[75245]: DEBUG nova.network.neutron [req-d44ab3b4-633b-4dd1-a621-5c860fdbaae9 req-3abd9817-650e-4dcb-9b97-805445056f84 service nova] [instance: f987507f-708e-4218-a49c-2a94bc5edc3c] Updating instance_info_cache with network_info: [{"id": "d47f72a3-e0ce-4368-ad36-f8a7d20e221b", "address": "fa:16:3e:7c:42:39", "network": {"id": "55744af1-3291-4de1-9bf4-554f9ee4f057", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1570836437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01e269dbe30d46ccb81d58e2590004db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd47f72a3-e0", "ovs_interfaceid": "d47f72a3-e0ce-4368-ad36-f8a7d20e221b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:47:58 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d44ab3b4-633b-4dd1-a621-5c860fdbaae9 req-3abd9817-650e-4dcb-9b97-805445056f84 service nova] Releasing lock "refresh_cache-f987507f-708e-4218-a49c-2a94bc5edc3c" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:47:59 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:47:59 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:48:00 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2f957dad-f738-4efb-9020-ef3b2d300a1d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Acquiring lock "f987507f-708e-4218-a49c-2a94bc5edc3c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:48:00 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2f957dad-f738-4efb-9020-ef3b2d300a1d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "f987507f-708e-4218-a49c-2a94bc5edc3c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:48:00 user nova-compute[75245]: DEBUG nova.objects.instance [None req-2f957dad-f738-4efb-9020-ef3b2d300a1d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lazy-loading 'flavor' on Instance uuid f987507f-708e-4218-a49c-2a94bc5edc3c {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:48:00 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2f957dad-f738-4efb-9020-ef3b2d300a1d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "f987507f-708e-4218-a49c-2a94bc5edc3c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:48:00 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2f957dad-f738-4efb-9020-ef3b2d300a1d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Acquiring lock "f987507f-708e-4218-a49c-2a94bc5edc3c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:48:00 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2f957dad-f738-4efb-9020-ef3b2d300a1d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "f987507f-708e-4218-a49c-2a94bc5edc3c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:48:00 user nova-compute[75245]: INFO nova.compute.manager [None req-2f957dad-f738-4efb-9020-ef3b2d300a1d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: f987507f-708e-4218-a49c-2a94bc5edc3c] Attaching volume 40e23f96-5baa-4fad-bf3e-55735e63c106 to /dev/vdb
Nov 29 16:48:00 user nova-compute[75245]: DEBUG os_brick.utils [None req-2f957dad-f738-4efb-9020-ef3b2d300a1d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:48:00 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:48:00 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:48:00 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98fde98-9039-482f-ab77-65d2e2e5dc24]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:69ed8ed87091\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:48:00 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:48:00 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:48:00 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f89559-36cc-47e3-aa4e-b35ddbfd9275]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:48:00 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:48:00 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:48:00 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[d683b939-0880-4f68-82b4-0119e6493d77]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:48:00 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f69ab0-83a2-4a51-8091-d52c1ada8669]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:48:00 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-2f957dad-f738-4efb-9020-ef3b2d300a1d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Running cmd (subprocess): nvme version {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:48:00 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-2f957dad-f738-4efb-9020-ef3b2d300a1d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] 'nvme version' failed. Not Retrying. {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:48:00 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2f957dad-f738-4efb-9020-ef3b2d300a1d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] nvme not present on system {{(pid=75245) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 16:48:00 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:48:00 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:48:00 user nova-compute[75245]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 16:48:00 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a07e4c4-3d51-40ba-9f7f-d77563cd5682]: (4, '') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:48:00 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-2f957dad-f738-4efb-9020-ef3b2d300a1d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75245) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 16:48:00 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-2f957dad-f738-4efb-9020-ef3b2d300a1d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 16:48:00 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-2f957dad-f738-4efb-9020-ef3b2d300a1d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] LIGHTOS: no hostnqn found. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 16:48:00 user nova-compute[75245]: DEBUG os_brick.utils [None req-2f957dad-f738-4efb-9020-ef3b2d300a1d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:69ed8ed87091', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:48:00 user nova-compute[75245]: DEBUG nova.virt.block_device [None req-2f957dad-f738-4efb-9020-ef3b2d300a1d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: f987507f-708e-4218-a49c-2a94bc5edc3c] Updating existing volume attachment record: be9f3476-609d-4a44-99d2-f7aab86d5e28 {{(pid=75245) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 16:48:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:48:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:48:08 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f957dad-f738-4efb-9020-ef3b2d300a1d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: f987507f-708e-4218-a49c-2a94bc5edc3c] Calling os-brick to attach iSCSI Volume {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 16:48:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f957dad-f738-4efb-9020-ef3b2d300a1d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:40e23f96-5baa-4fad-bf3e-55735e63c106', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AHZNKzVE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:48:08 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-2f957dad-f738-4efb-9020-ef3b2d300a1d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:48:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-2f957dad-f738-4efb-9020-ef3b2d300a1d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:48:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-2f957dad-f738-4efb-9020-ef3b2d300a1d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:48:08 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-2f957dad-f738-4efb-9020-ef3b2d300a1d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:48:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-2f957dad-f738-4efb-9020-ef3b2d300a1d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40e23f96-5baa-4fad-bf3e-55735e63c106" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:48:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-2f957dad-f738-4efb-9020-ef3b2d300a1d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40e23f96-5baa-4fad-bf3e-55735e63c106" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:48:08 user nova-compute[75245]: INFO os_brick.initiator.connectors.iscsi [None req-2f957dad-f738-4efb-9020-ef3b2d300a1d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 16:48:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40e23f96-5baa-4fad-bf3e-55735e63c106 -p 172.16.0.220:3260 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:48:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40e23f96-5baa-4fad-bf3e-55735e63c106 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:48:08 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d410457-6313-4443-af69-d99ef8e0ecd3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:48:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f957dad-f738-4efb-9020-ef3b2d300a1d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 16:48:08 user nova-compute[75245]:  {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:48:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40e23f96-5baa-4fad-bf3e-55735e63c106 -p 172.16.0.220:3260 --interface default --op new {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:48:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40e23f96-5baa-4fad-bf3e-55735e63c106 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:48:08 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddcff935-ad84-41af-ade8-cdcb25d71ca6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:40e23f96-5baa-4fad-bf3e-55735e63c106] added\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:48:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f957dad-f738-4efb-9020-ef3b2d300a1d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:40e23f96-5baa-4fad-bf3e-55735e63c106] added
Nov 29 16:48:08 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:48:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40e23f96-5baa-4fad-bf3e-55735e63c106 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:48:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40e23f96-5baa-4fad-bf3e-55735e63c106 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:48:08 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[db688b53-60ec-4110-8eac-52be3194d3ea]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:48:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f957dad-f738-4efb-9020-ef3b2d300a1d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:48:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40e23f96-5baa-4fad-bf3e-55735e63c106 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:48:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40e23f96-5baa-4fad-bf3e-55735e63c106 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.145s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:48:08 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a3c3f1-3938-4008-951e-4c50f82ed827]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:48:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f957dad-f738-4efb-9020-ef3b2d300a1d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:48:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40e23f96-5baa-4fad-bf3e-55735e63c106 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AHZNKzVE {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:48:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40e23f96-5baa-4fad-bf3e-55735e63c106 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AHZNKzVE" returned: 0 in 0.031s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:48:08 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[44789585-696a-40b7-8222-af7b102032ac]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:48:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f957dad-f738-4efb-9020-ef3b2d300a1d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AHZNKzVE'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:48:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40e23f96-5baa-4fad-bf3e-55735e63c106 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:48:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40e23f96-5baa-4fad-bf3e-55735e63c106 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:48:08 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[5310e9ff-a618-4148-bf41-7d6023eaed95]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:48:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f957dad-f738-4efb-9020-ef3b2d300a1d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:48:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:48:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:48:08 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ea6e07-8179-493f-93c9-9a61c9e3fbfb]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adf000a4-d2ea-41f7-ac53-bec752956c3c (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:48:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f957dad-f738-4efb-9020-ef3b2d300a1d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adf000a4-d2ea-41f7-ac53-bec752956c3c (non-flash)
Nov 29 16:48:08 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:48:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f957dad-f738-4efb-9020-ef3b2d300a1d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adf000a4-d2ea-41f7-ac53-bec752956c3c (non-flash)
Nov 29 16:48:08 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:48:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40e23f96-5baa-4fad-bf3e-55735e63c106 -p 172.16.0.220:3260 --login {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:48:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40e23f96-5baa-4fad-bf3e-55735e63c106 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:48:08 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[4330c654-c13e-4c90-a01b-7a324ffa3ad8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:40e23f96-5baa-4fad-bf3e-55735e63c106, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:40e23f96-5baa-4fad-bf3e-55735e63c106, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:48:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f957dad-f738-4efb-9020-ef3b2d300a1d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:40e23f96-5baa-4fad-bf3e-55735e63c106, portal: 172.16.0.220,3260]
Nov 29 16:48:08 user nova-compute[75245]: Login to [iface: default, target: iqn.2010-10.org.openstack:40e23f96-5baa-4fad-bf3e-55735e63c106, portal: 172.16.0.220,3260] successful.
Nov 29 16:48:08 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:48:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40e23f96-5baa-4fad-bf3e-55735e63c106 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:48:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40e23f96-5baa-4fad-bf3e-55735e63c106 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:48:08 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5fdaa4-d022-409b-95e1-6595829104d3]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:48:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f957dad-f738-4efb-9020-ef3b2d300a1d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:48:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:48:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:48:08 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7250ade-379d-4704-9a36-ebcfab4649b3]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adf000a4-d2ea-41f7-ac53-bec752956c3c (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40e23f96-5baa-4fad-bf3e-55735e63c106 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:48:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f957dad-f738-4efb-9020-ef3b2d300a1d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adf000a4-d2ea-41f7-ac53-bec752956c3c (non-flash)
Nov 29 16:48:08 user nova-compute[75245]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40e23f96-5baa-4fad-bf3e-55735e63c106 (non-flash)
Nov 29 16:48:08 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:48:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f957dad-f738-4efb-9020-ef3b2d300a1d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adf000a4-d2ea-41f7-ac53-bec752956c3c (non-flash)
Nov 29 16:48:08 user nova-compute[75245]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40e23f96-5baa-4fad-bf3e-55735e63c106 (non-flash)
Nov 29 16:48:08 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:48:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-2f957dad-f738-4efb-9020-ef3b2d300a1d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40e23f96-5baa-4fad-bf3e-55735e63c106" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.398s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:48:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f957dad-f738-4efb-9020-ef3b2d300a1d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Connected to 172.16.0.220:3260 {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 16:48:08 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-2f957dad-f738-4efb-9020-ef3b2d300a1d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] HCTL ('34', '-', '-', 0) found on session 47 with lun 0 {{(pid=75245) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 16:48:08 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-2f957dad-f738-4efb-9020-ef3b2d300a1d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75245) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 16:48:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:48:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:48:08 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[b18daf3b-a948-45aa-9d7f-0822d1780038]: (4, ('- - 0', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:48:08 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-2f957dad-f738-4efb-9020-ef3b2d300a1d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75245) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 16:48:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f957dad-f738-4efb-9020-ef3b2d300a1d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:40e23f96-5baa-4fad-bf3e-55735e63c106', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AHZNKzVE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 16:48:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:48:09 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-2f957dad-f738-4efb-9020-ef3b2d300a1d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.430s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:48:09 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f957dad-f738-4efb-9020-ef3b2d300a1d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] <== connect_volume: return (1431ms) {'type': 'block', 'scsi_wwn': '23534326131663233', 'path': '/dev/sdc'} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:48:09 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f957dad-f738-4efb-9020-ef3b2d300a1d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: f987507f-708e-4218-a49c-2a94bc5edc3c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23534326131663233', 'path': '/dev/sdc'} {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 16:48:09 user nova-compute[75245]: DEBUG nova.objects.instance [None req-2f957dad-f738-4efb-9020-ef3b2d300a1d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lazy-loading 'flavor' on Instance uuid f987507f-708e-4218-a49c-2a94bc5edc3c {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:48:09 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-2f957dad-f738-4efb-9020-ef3b2d300a1d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 16:48:09 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:48:09 user nova-compute[75245]:   <source dev="/dev/sdc"/>
Nov 29 16:48:09 user nova-compute[75245]:   <target dev="vdb" bus="virtio"/>
Nov 29 16:48:09 user nova-compute[75245]:   <serial>40e23f96-5baa-4fad-bf3e-55735e63c106</serial>
Nov 29 16:48:09 user nova-compute[75245]: </disk>
Nov 29 16:48:09 user nova-compute[75245]:  {{(pid=75245) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 16:48:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:48:09 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-2f957dad-f738-4efb-9020-ef3b2d300a1d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:48:09 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-2f957dad-f738-4efb-9020-ef3b2d300a1d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:48:09 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-2f957dad-f738-4efb-9020-ef3b2d300a1d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] No VIF found with MAC fa:16:3e:7c:42:39, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:48:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2f957dad-f738-4efb-9020-ef3b2d300a1d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "f987507f-708e-4218-a49c-2a94bc5edc3c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.396s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:48:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-01613813-957b-480d-8223-65f2249da575 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Acquiring lock "f987507f-708e-4218-a49c-2a94bc5edc3c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:48:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-01613813-957b-480d-8223-65f2249da575 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "f987507f-708e-4218-a49c-2a94bc5edc3c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:48:10 user nova-compute[75245]: INFO nova.compute.manager [None req-01613813-957b-480d-8223-65f2249da575 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: f987507f-708e-4218-a49c-2a94bc5edc3c] Detaching volume 40e23f96-5baa-4fad-bf3e-55735e63c106
Nov 29 16:48:10 user nova-compute[75245]: INFO nova.virt.block_device [None req-01613813-957b-480d-8223-65f2249da575 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: f987507f-708e-4218-a49c-2a94bc5edc3c] Attempting to driver detach volume 40e23f96-5baa-4fad-bf3e-55735e63c106 from mountpoint /dev/vdb
Nov 29 16:48:10 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-01613813-957b-480d-8223-65f2249da575 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Attempting to detach device vdb from instance f987507f-708e-4218-a49c-2a94bc5edc3c from the persistent domain config. {{(pid=75245) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 16:48:10 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-01613813-957b-480d-8223-65f2249da575 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 16:48:10 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:48:10 user nova-compute[75245]:   <source dev="/dev/sdc"/>
Nov 29 16:48:10 user nova-compute[75245]:   <target dev="vdb" bus="virtio"/>
Nov 29 16:48:10 user nova-compute[75245]:   <serial>40e23f96-5baa-4fad-bf3e-55735e63c106</serial>
Nov 29 16:48:10 user nova-compute[75245]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 16:48:10 user nova-compute[75245]: </disk>
Nov 29 16:48:10 user nova-compute[75245]:  {{(pid=75245) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 16:48:10 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-01613813-957b-480d-8223-65f2249da575 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Successfully detached device vdb from instance f987507f-708e-4218-a49c-2a94bc5edc3c from the persistent domain config.
Nov 29 16:48:10 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-01613813-957b-480d-8223-65f2249da575 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f987507f-708e-4218-a49c-2a94bc5edc3c from the live domain config. {{(pid=75245) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 16:48:10 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-01613813-957b-480d-8223-65f2249da575 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 16:48:10 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:48:10 user nova-compute[75245]:   <source dev="/dev/sdc"/>
Nov 29 16:48:10 user nova-compute[75245]:   <target dev="vdb" bus="virtio"/>
Nov 29 16:48:10 user nova-compute[75245]:   <serial>40e23f96-5baa-4fad-bf3e-55735e63c106</serial>
Nov 29 16:48:10 user nova-compute[75245]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 16:48:10 user nova-compute[75245]: </disk>
Nov 29 16:48:10 user nova-compute[75245]:  {{(pid=75245) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 16:48:11 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-01613813-957b-480d-8223-65f2249da575 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f987507f-708e-4218-a49c-2a94bc5edc3c {{(pid=75245) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 16:48:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:48:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:48:19 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:48:19 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:48:19 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75245) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 16:48:19 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:48:19 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:48:19 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:48:20 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:48:20 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:48:20 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:48:20 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:48:20 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75245) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 16:48:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25a0a73c-ed89-4530-aabb-a6a85e030482/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:48:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25a0a73c-ed89-4530-aabb-a6a85e030482/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:48:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25a0a73c-ed89-4530-aabb-a6a85e030482/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:48:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25a0a73c-ed89-4530-aabb-a6a85e030482/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:48:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b03f1f3-2061-4962-ba07-3a4f9da2ea90/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:48:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b03f1f3-2061-4962-ba07-3a4f9da2ea90/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:48:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b03f1f3-2061-4962-ba07-3a4f9da2ea90/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:48:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b03f1f3-2061-4962-ba07-3a4f9da2ea90/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:48:21 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:48:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f987507f-708e-4218-a49c-2a94bc5edc3c/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:48:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f987507f-708e-4218-a49c-2a94bc5edc3c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:48:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f987507f-708e-4218-a49c-2a94bc5edc3c/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:48:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f987507f-708e-4218-a49c-2a94bc5edc3c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:48:22 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:48:22 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:48:22 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Hypervisor/Node resource view: name=user free_ram=8634MB free_disk=25.078304290771484GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75245) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 16:48:22 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:48:22 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:48:22 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 7b03f1f3-2061-4962-ba07-3a4f9da2ea90 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:48:22 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance f987507f-708e-4218-a49c-2a94bc5edc3c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:48:22 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 25a0a73c-ed89-4530-aabb-a6a85e030482 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:48:22 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 16:48:22 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 16:48:22 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:48:22 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:48:22 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Compute_service record updated for user:user {{(pid=75245) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 16:48:22 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.294s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:48:23 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:48:23 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Starting heal instance info cache {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 16:48:23 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "refresh_cache-f987507f-708e-4218-a49c-2a94bc5edc3c" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:48:23 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquired lock "refresh_cache-f987507f-708e-4218-a49c-2a94bc5edc3c" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:48:23 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: f987507f-708e-4218-a49c-2a94bc5edc3c] Forcefully refreshing network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 16:48:24 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: f987507f-708e-4218-a49c-2a94bc5edc3c] Updating instance_info_cache with network_info: [{"id": "d47f72a3-e0ce-4368-ad36-f8a7d20e221b", "address": "fa:16:3e:7c:42:39", "network": {"id": "55744af1-3291-4de1-9bf4-554f9ee4f057", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1570836437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01e269dbe30d46ccb81d58e2590004db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd47f72a3-e0", "ovs_interfaceid": "d47f72a3-e0ce-4368-ad36-f8a7d20e221b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:48:24 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Releasing lock "refresh_cache-f987507f-708e-4218-a49c-2a94bc5edc3c" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:48:24 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: f987507f-708e-4218-a49c-2a94bc5edc3c] Updated the network info_cache for instance {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 16:48:24 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:48:24 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:48:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:48:25 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:48:25 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75245) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 16:48:25 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:48:25 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:48:25 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:48:26 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:48:29 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:48:30 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:48:30 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:48:31 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-01613813-957b-480d-8223-65f2249da575 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f987507f-708e-4218-a49c-2a94bc5edc3c is timed out.
Nov 29 16:48:31 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-01613813-957b-480d-8223-65f2249da575 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Successfully detached device vdb from instance f987507f-708e-4218-a49c-2a94bc5edc3c from the live domain config.
Nov 29 16:48:31 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01613813-957b-480d-8223-65f2249da575 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: f987507f-708e-4218-a49c-2a94bc5edc3c] calling os-brick to detach iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 16:48:31 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-01613813-957b-480d-8223-65f2249da575 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, {'target_iqn': 'iqn.2010-10.org.openstack:40e23f96-5baa-4fad-bf3e-55735e63c106', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AHZNKzVE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:48:31 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-01613813-957b-480d-8223-65f2249da575 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:48:31 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-01613813-957b-480d-8223-65f2249da575 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:48:31 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-01613813-957b-480d-8223-65f2249da575 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:48:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:48:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:48:31 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[3323bc44-06dd-4136-9582-7e88b58c6318]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:adf000a4-d2ea-41f7-ac53-bec752956c3c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:40e23f96-5baa-4fad-bf3e-55735e63c106\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:48:31 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-01613813-957b-480d-8223-65f2249da575 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 16:48:31 user nova-compute[75245]: No targets found.
Nov 29 16:48:31 user nova-compute[75245]: iSNS:
Nov 29 16:48:31 user nova-compute[75245]: No targets found.
Nov 29 16:48:31 user nova-compute[75245]: STATIC:
Nov 29 16:48:31 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:adf000a4-d2ea-41f7-ac53-bec752956c3c
Nov 29 16:48:31 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:48:31 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:48:31 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:40e23f96-5baa-4fad-bf3e-55735e63c106
Nov 29 16:48:31 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:48:31 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:48:31 user nova-compute[75245]: FIRMWARE:
Nov 29 16:48:31 user nova-compute[75245]: No targets found.
Nov 29 16:48:31 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:48:31 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-01613813-957b-480d-8223-65f2249da575 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 16:48:31 user nova-compute[75245]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 16:48:31 user nova-compute[75245]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75245) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 16:48:31 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-01613813-957b-480d-8223-65f2249da575 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40e23f96-5baa-4fad-bf3e-55735e63c106', 0)] {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 16:48:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:48:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:48:31 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb813f1f-a4fe-4bb9-81e3-8e2b80702a82]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40e23f96-5baa-4fad-bf3e-55735e63c106\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:adf000a4-d2ea-41f7-ac53-bec752956c3c\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:48:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:48:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:48:31 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c64599b-c313-4b8a-8434-cfc7f38457d4]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adf000a4-d2ea-41f7-ac53-bec752956c3c (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40e23f96-5baa-4fad-bf3e-55735e63c106 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:48:31 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-01613813-957b-480d-8223-65f2249da575 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adf000a4-d2ea-41f7-ac53-bec752956c3c (non-flash)
Nov 29 16:48:31 user nova-compute[75245]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40e23f96-5baa-4fad-bf3e-55735e63c106 (non-flash)
Nov 29 16:48:31 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:48:31 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-01613813-957b-480d-8223-65f2249da575 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adf000a4-d2ea-41f7-ac53-bec752956c3c (non-flash)
Nov 29 16:48:31 user nova-compute[75245]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40e23f96-5baa-4fad-bf3e-55735e63c106 (non-flash)
Nov 29 16:48:31 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:48:31 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-01613813-957b-480d-8223-65f2249da575 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0d441c1000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40e23f96-5baa-4fad-bf3e-55735e63c106'): ({'sdc'}, set())}) {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 16:48:31 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-01613813-957b-480d-8223-65f2249da575 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Removing single pathed devices sdc {{(pid=75245) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 16:48:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:48:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:48:31 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0d7214-ee48-45a9-bfd5-6857455e382c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:48:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:48:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:48:31 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaaa8b06-7ffd-4cac-93d4-b30a3f448d5d]: (4, ('ok\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:48:31 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-01613813-957b-480d-8223-65f2249da575 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Flushing IO for device /dev/sdc {{(pid=75245) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 16:48:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:48:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:48:31 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82f5268-535a-4160-91db-5c79b099cb31]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:48:31 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-01613813-957b-480d-8223-65f2249da575 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75245) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 16:48:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:48:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:48:31 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1786adc-be96-4766-873b-ac52c48b50ed]: (4, ('1', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:48:31 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-01613813-957b-480d-8223-65f2249da575 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 16:48:31 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-01613813-957b-480d-8223-65f2249da575 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] SCSI volumes sdc have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 16:48:31 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-01613813-957b-480d-8223-65f2249da575 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40e23f96-5baa-4fad-bf3e-55735e63c106')] {{(pid=75245) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 16:48:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40e23f96-5baa-4fad-bf3e-55735e63c106 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:48:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40e23f96-5baa-4fad-bf3e-55735e63c106 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:48:31 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[17842791-dd54-4a3c-bbdc-7d7c2e3d5c81]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:48:31 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-01613813-957b-480d-8223-65f2249da575 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:48:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40e23f96-5baa-4fad-bf3e-55735e63c106 -p 172.16.0.220:3260 --logout {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:48:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40e23f96-5baa-4fad-bf3e-55735e63c106 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:48:31 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a7c3e7-89ce-48e0-b58a-407ba07fe327]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:40e23f96-5baa-4fad-bf3e-55735e63c106, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:40e23f96-5baa-4fad-bf3e-55735e63c106, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:48:31 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-01613813-957b-480d-8223-65f2249da575 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:40e23f96-5baa-4fad-bf3e-55735e63c106, portal: 172.16.0.220,3260]
Nov 29 16:48:31 user nova-compute[75245]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:40e23f96-5baa-4fad-bf3e-55735e63c106, portal: 172.16.0.220,3260] successful.
Nov 29 16:48:31 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:48:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40e23f96-5baa-4fad-bf3e-55735e63c106 -p 172.16.0.220:3260 --op delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:48:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40e23f96-5baa-4fad-bf3e-55735e63c106 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:48:31 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d171d1-2659-4b6a-8856-0ad1cb262337]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:48:31 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-01613813-957b-480d-8223-65f2249da575 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:48:31 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-01613813-957b-480d-8223-65f2249da575 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:48:31 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-01613813-957b-480d-8223-65f2249da575 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] <== disconnect_volume: return (278ms) None {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:48:31 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01613813-957b-480d-8223-65f2249da575 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: f987507f-708e-4218-a49c-2a94bc5edc3c] Disconnected iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 16:48:32 user nova-compute[75245]: DEBUG nova.objects.instance [None req-01613813-957b-480d-8223-65f2249da575 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lazy-loading 'flavor' on Instance uuid f987507f-708e-4218-a49c-2a94bc5edc3c {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:48:32 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-01613813-957b-480d-8223-65f2249da575 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "f987507f-708e-4218-a49c-2a94bc5edc3c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.640s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:48:32 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:48:32 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:48:32 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75245) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 16:48:35 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:48:39 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:48:39 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:48:40 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:48:40 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:48:40 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75245) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 16:48:40 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:48:40 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:48:40 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:48:45 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:48:45 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:48:45 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75245) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 16:48:45 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:48:45 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:48:45 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:48:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:48:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:48:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75245) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 16:48:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:48:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:48:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:48:55 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:48:55 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:48:55 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75245) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 16:48:55 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:48:55 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:48:55 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:49:00 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:49:00 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:49:00 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75245) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 16:49:00 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:49:00 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:49:00 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:49:01 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4838716f-4317-4ed4-8282-a7349c4dc690 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Acquiring lock "f987507f-708e-4218-a49c-2a94bc5edc3c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:49:01 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4838716f-4317-4ed4-8282-a7349c4dc690 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "f987507f-708e-4218-a49c-2a94bc5edc3c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:49:01 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4838716f-4317-4ed4-8282-a7349c4dc690 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Acquiring lock "f987507f-708e-4218-a49c-2a94bc5edc3c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:49:01 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4838716f-4317-4ed4-8282-a7349c4dc690 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "f987507f-708e-4218-a49c-2a94bc5edc3c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:49:01 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4838716f-4317-4ed4-8282-a7349c4dc690 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "f987507f-708e-4218-a49c-2a94bc5edc3c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:49:01 user nova-compute[75245]: INFO nova.compute.manager [None req-4838716f-4317-4ed4-8282-a7349c4dc690 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: f987507f-708e-4218-a49c-2a94bc5edc3c] Terminating instance
Nov 29 16:49:01 user nova-compute[75245]: DEBUG nova.compute.manager [None req-4838716f-4317-4ed4-8282-a7349c4dc690 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: f987507f-708e-4218-a49c-2a94bc5edc3c] Start destroying the instance on the hypervisor. {{(pid=75245) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 16:49:01 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:49:01 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:49:01 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:49:01 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:49:01 user nova-compute[75245]: DEBUG nova.compute.manager [req-b3e953a0-8077-46f4-93e7-1b12828d1b1d req-9e6f6deb-f0b2-4fde-8523-bf6fc416aea4 service nova] [instance: f987507f-708e-4218-a49c-2a94bc5edc3c] Received event network-vif-unplugged-d47f72a3-e0ce-4368-ad36-f8a7d20e221b {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:49:01 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b3e953a0-8077-46f4-93e7-1b12828d1b1d req-9e6f6deb-f0b2-4fde-8523-bf6fc416aea4 service nova] Acquiring lock "f987507f-708e-4218-a49c-2a94bc5edc3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:49:01 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b3e953a0-8077-46f4-93e7-1b12828d1b1d req-9e6f6deb-f0b2-4fde-8523-bf6fc416aea4 service nova] Lock "f987507f-708e-4218-a49c-2a94bc5edc3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:49:01 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b3e953a0-8077-46f4-93e7-1b12828d1b1d req-9e6f6deb-f0b2-4fde-8523-bf6fc416aea4 service nova] Lock "f987507f-708e-4218-a49c-2a94bc5edc3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:49:01 user nova-compute[75245]: DEBUG nova.compute.manager [req-b3e953a0-8077-46f4-93e7-1b12828d1b1d req-9e6f6deb-f0b2-4fde-8523-bf6fc416aea4 service nova] [instance: f987507f-708e-4218-a49c-2a94bc5edc3c] No waiting events found dispatching network-vif-unplugged-d47f72a3-e0ce-4368-ad36-f8a7d20e221b {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:49:01 user nova-compute[75245]: DEBUG nova.compute.manager [req-b3e953a0-8077-46f4-93e7-1b12828d1b1d req-9e6f6deb-f0b2-4fde-8523-bf6fc416aea4 service nova] [instance: f987507f-708e-4218-a49c-2a94bc5edc3c] Received event network-vif-unplugged-d47f72a3-e0ce-4368-ad36-f8a7d20e221b for instance with task_state deleting. {{(pid=75245) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 16:49:01 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:49:01 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: f987507f-708e-4218-a49c-2a94bc5edc3c] Instance destroyed successfully.
Nov 29 16:49:01 user nova-compute[75245]: DEBUG nova.objects.instance [None req-4838716f-4317-4ed4-8282-a7349c4dc690 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lazy-loading 'resources' on Instance uuid f987507f-708e-4218-a49c-2a94bc5edc3c {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:49:01 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-4838716f-4317-4ed4-8282-a7349c4dc690 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:46:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1671404722',display_name='tempest-AttachVolumeNegativeTest-server-1671404722',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1671404722',id=40,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEPM+0da/lwksF0WBr+VnTGMTdw9NrT+clgPyKb/QglYIhltShJMc/SAcKzE6mTkrIVzPoiwlJZj6kKG23ngMKQA0YNNTmkHVqEUadceXLqy6vHZ7+efaUAtSYYBE1cOQ==',key_name='tempest-keypair-281181805',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:46:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='01e269dbe30d46ccb81d58e2590004db',ramdisk_id='',reservation_id='r-ndyyd9sq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-44169219',owner_user_name='tempest-AttachVolumeNegativeTest-44169219-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:46:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb4c94298bf14753bb9530633e766dee',uuid=f987507f-708e-4218-a49c-2a94bc5edc3c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d47f72a3-e0ce-4368-ad36-f8a7d20e221b", "address": "fa:16:3e:7c:42:39", "network": {"id": "55744af1-3291-4de1-9bf4-554f9ee4f057", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1570836437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01e269dbe30d46ccb81d58e2590004db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd47f72a3-e0", "ovs_interfaceid": "d47f72a3-e0ce-4368-ad36-f8a7d20e221b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 16:49:01 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-4838716f-4317-4ed4-8282-a7349c4dc690 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Converting VIF {"id": "d47f72a3-e0ce-4368-ad36-f8a7d20e221b", "address": "fa:16:3e:7c:42:39", "network": {"id": "55744af1-3291-4de1-9bf4-554f9ee4f057", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1570836437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01e269dbe30d46ccb81d58e2590004db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd47f72a3-e0", "ovs_interfaceid": "d47f72a3-e0ce-4368-ad36-f8a7d20e221b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:49:01 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-4838716f-4317-4ed4-8282-a7349c4dc690 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7c:42:39,bridge_name='br-int',has_traffic_filtering=True,id=d47f72a3-e0ce-4368-ad36-f8a7d20e221b,network=Network(55744af1-3291-4de1-9bf4-554f9ee4f057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd47f72a3-e0') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:49:01 user nova-compute[75245]: DEBUG os_vif [None req-4838716f-4317-4ed4-8282-a7349c4dc690 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:42:39,bridge_name='br-int',has_traffic_filtering=True,id=d47f72a3-e0ce-4368-ad36-f8a7d20e221b,network=Network(55744af1-3291-4de1-9bf4-554f9ee4f057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd47f72a3-e0') {{(pid=75245) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 16:49:01 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:49:01 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd47f72a3-e0, bridge=br-int, if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:49:01 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:49:01 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:49:01 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:49:01 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=becb4964-860d-4b97-be2f-8d1f65f26243) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:49:01 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:49:01 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:49:01 user nova-compute[75245]: INFO os_vif [None req-4838716f-4317-4ed4-8282-a7349c4dc690 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:42:39,bridge_name='br-int',has_traffic_filtering=True,id=d47f72a3-e0ce-4368-ad36-f8a7d20e221b,network=Network(55744af1-3291-4de1-9bf4-554f9ee4f057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd47f72a3-e0')
Nov 29 16:49:01 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-4838716f-4317-4ed4-8282-a7349c4dc690 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: f987507f-708e-4218-a49c-2a94bc5edc3c] Deleting instance files /opt/stack/data/nova/instances/f987507f-708e-4218-a49c-2a94bc5edc3c_del
Nov 29 16:49:01 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-4838716f-4317-4ed4-8282-a7349c4dc690 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: f987507f-708e-4218-a49c-2a94bc5edc3c] Deletion of /opt/stack/data/nova/instances/f987507f-708e-4218-a49c-2a94bc5edc3c_del complete
Nov 29 16:49:01 user nova-compute[75245]: INFO nova.compute.manager [None req-4838716f-4317-4ed4-8282-a7349c4dc690 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: f987507f-708e-4218-a49c-2a94bc5edc3c] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 29 16:49:01 user nova-compute[75245]: DEBUG oslo.service.loopingcall [None req-4838716f-4317-4ed4-8282-a7349c4dc690 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75245) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 16:49:01 user nova-compute[75245]: DEBUG nova.compute.manager [-] [instance: f987507f-708e-4218-a49c-2a94bc5edc3c] Deallocating network for instance {{(pid=75245) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 16:49:01 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: f987507f-708e-4218-a49c-2a94bc5edc3c] deallocate_for_instance() {{(pid=75245) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 16:49:02 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: f987507f-708e-4218-a49c-2a94bc5edc3c] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:49:02 user nova-compute[75245]: INFO nova.compute.manager [-] [instance: f987507f-708e-4218-a49c-2a94bc5edc3c] Took 0.99 seconds to deallocate network for instance.
Nov 29 16:49:02 user nova-compute[75245]: DEBUG nova.compute.manager [req-0e833717-fd00-48ed-955a-e70044a605fd req-882b714b-b875-4748-a7fa-d41e587221d3 service nova] [instance: f987507f-708e-4218-a49c-2a94bc5edc3c] Received event network-vif-deleted-d47f72a3-e0ce-4368-ad36-f8a7d20e221b {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:49:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4838716f-4317-4ed4-8282-a7349c4dc690 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:49:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4838716f-4317-4ed4-8282-a7349c4dc690 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:49:03 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-4838716f-4317-4ed4-8282-a7349c4dc690 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:49:03 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-4838716f-4317-4ed4-8282-a7349c4dc690 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:49:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4838716f-4317-4ed4-8282-a7349c4dc690 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.205s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:49:03 user nova-compute[75245]: INFO nova.scheduler.client.report [None req-4838716f-4317-4ed4-8282-a7349c4dc690 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Deleted allocations for instance f987507f-708e-4218-a49c-2a94bc5edc3c
Nov 29 16:49:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-4838716f-4317-4ed4-8282-a7349c4dc690 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "f987507f-708e-4218-a49c-2a94bc5edc3c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.278s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:49:03 user nova-compute[75245]: DEBUG nova.compute.manager [req-bce1e841-564a-4dae-b879-c21437645470 req-28ff6392-272a-4d72-bcf3-44d0a2bf3288 service nova] [instance: f987507f-708e-4218-a49c-2a94bc5edc3c] Received event network-vif-plugged-d47f72a3-e0ce-4368-ad36-f8a7d20e221b {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:49:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-bce1e841-564a-4dae-b879-c21437645470 req-28ff6392-272a-4d72-bcf3-44d0a2bf3288 service nova] Acquiring lock "f987507f-708e-4218-a49c-2a94bc5edc3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:49:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-bce1e841-564a-4dae-b879-c21437645470 req-28ff6392-272a-4d72-bcf3-44d0a2bf3288 service nova] Lock "f987507f-708e-4218-a49c-2a94bc5edc3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:49:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-bce1e841-564a-4dae-b879-c21437645470 req-28ff6392-272a-4d72-bcf3-44d0a2bf3288 service nova] Lock "f987507f-708e-4218-a49c-2a94bc5edc3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:49:03 user nova-compute[75245]: DEBUG nova.compute.manager [req-bce1e841-564a-4dae-b879-c21437645470 req-28ff6392-272a-4d72-bcf3-44d0a2bf3288 service nova] [instance: f987507f-708e-4218-a49c-2a94bc5edc3c] No waiting events found dispatching network-vif-plugged-d47f72a3-e0ce-4368-ad36-f8a7d20e221b {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:49:03 user nova-compute[75245]: WARNING nova.compute.manager [req-bce1e841-564a-4dae-b879-c21437645470 req-28ff6392-272a-4d72-bcf3-44d0a2bf3288 service nova] [instance: f987507f-708e-4218-a49c-2a94bc5edc3c] Received unexpected event network-vif-plugged-d47f72a3-e0ce-4368-ad36-f8a7d20e221b for instance with vm_state deleted and task_state None.
Nov 29 16:49:06 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:49:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:49:09 user nova-compute[75245]: DEBUG nova.compute.manager [req-c5344beb-a839-4be7-9cde-5441f7e1cbd4 req-ceedc6a3-717c-4719-87da-266c935b7ec6 service nova] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Received event network-changed-0599b1d1-85cd-4003-9d3d-c343f09a5b2b {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:49:09 user nova-compute[75245]: DEBUG nova.compute.manager [req-c5344beb-a839-4be7-9cde-5441f7e1cbd4 req-ceedc6a3-717c-4719-87da-266c935b7ec6 service nova] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Refreshing instance network info cache due to event network-changed-0599b1d1-85cd-4003-9d3d-c343f09a5b2b. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:49:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-c5344beb-a839-4be7-9cde-5441f7e1cbd4 req-ceedc6a3-717c-4719-87da-266c935b7ec6 service nova] Acquiring lock "refresh_cache-7b03f1f3-2061-4962-ba07-3a4f9da2ea90" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:49:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-c5344beb-a839-4be7-9cde-5441f7e1cbd4 req-ceedc6a3-717c-4719-87da-266c935b7ec6 service nova] Acquired lock "refresh_cache-7b03f1f3-2061-4962-ba07-3a4f9da2ea90" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:49:09 user nova-compute[75245]: DEBUG nova.network.neutron [req-c5344beb-a839-4be7-9cde-5441f7e1cbd4 req-ceedc6a3-717c-4719-87da-266c935b7ec6 service nova] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Refreshing network info cache for port 0599b1d1-85cd-4003-9d3d-c343f09a5b2b {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:49:10 user nova-compute[75245]: DEBUG nova.network.neutron [req-c5344beb-a839-4be7-9cde-5441f7e1cbd4 req-ceedc6a3-717c-4719-87da-266c935b7ec6 service nova] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Updated VIF entry in instance network info cache for port 0599b1d1-85cd-4003-9d3d-c343f09a5b2b. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:49:10 user nova-compute[75245]: DEBUG nova.network.neutron [req-c5344beb-a839-4be7-9cde-5441f7e1cbd4 req-ceedc6a3-717c-4719-87da-266c935b7ec6 service nova] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Updating instance_info_cache with network_info: [{"id": "0599b1d1-85cd-4003-9d3d-c343f09a5b2b", "address": "fa:16:3e:61:06:fc", "network": {"id": "b0e81786-47f3-4a13-90c7-788cb53a4df5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1382922826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebd1ea36980641739f2bdd856a65d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0599b1d1-85", "ovs_interfaceid": "0599b1d1-85cd-4003-9d3d-c343f09a5b2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:49:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-c5344beb-a839-4be7-9cde-5441f7e1cbd4 req-ceedc6a3-717c-4719-87da-266c935b7ec6 service nova] Releasing lock "refresh_cache-7b03f1f3-2061-4962-ba07-3a4f9da2ea90" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:49:10 user nova-compute[75245]: DEBUG nova.compute.manager [req-376de2e5-d4a6-4260-aa7a-6d2461bea80c req-4d075b30-7333-4e07-a349-fb5eb102a4c0 service nova] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Received event network-changed-0599b1d1-85cd-4003-9d3d-c343f09a5b2b {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:49:10 user nova-compute[75245]: DEBUG nova.compute.manager [req-376de2e5-d4a6-4260-aa7a-6d2461bea80c req-4d075b30-7333-4e07-a349-fb5eb102a4c0 service nova] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Refreshing instance network info cache due to event network-changed-0599b1d1-85cd-4003-9d3d-c343f09a5b2b. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:49:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-376de2e5-d4a6-4260-aa7a-6d2461bea80c req-4d075b30-7333-4e07-a349-fb5eb102a4c0 service nova] Acquiring lock "refresh_cache-7b03f1f3-2061-4962-ba07-3a4f9da2ea90" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:49:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-376de2e5-d4a6-4260-aa7a-6d2461bea80c req-4d075b30-7333-4e07-a349-fb5eb102a4c0 service nova] Acquired lock "refresh_cache-7b03f1f3-2061-4962-ba07-3a4f9da2ea90" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:49:10 user nova-compute[75245]: DEBUG nova.network.neutron [req-376de2e5-d4a6-4260-aa7a-6d2461bea80c req-4d075b30-7333-4e07-a349-fb5eb102a4c0 service nova] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Refreshing network info cache for port 0599b1d1-85cd-4003-9d3d-c343f09a5b2b {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:49:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2456d177-e009-4d41-bae4-e964eaf35920 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Acquiring lock "7b03f1f3-2061-4962-ba07-3a4f9da2ea90" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:49:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2456d177-e009-4d41-bae4-e964eaf35920 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lock "7b03f1f3-2061-4962-ba07-3a4f9da2ea90" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:49:10 user nova-compute[75245]: INFO nova.compute.manager [None req-2456d177-e009-4d41-bae4-e964eaf35920 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Detaching volume adf000a4-d2ea-41f7-ac53-bec752956c3c
Nov 29 16:49:10 user nova-compute[75245]: INFO nova.virt.block_device [None req-2456d177-e009-4d41-bae4-e964eaf35920 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Attempting to driver detach volume adf000a4-d2ea-41f7-ac53-bec752956c3c from mountpoint /dev/vdb
Nov 29 16:49:10 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-2456d177-e009-4d41-bae4-e964eaf35920 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Attempting to detach device vdb from instance 7b03f1f3-2061-4962-ba07-3a4f9da2ea90 from the persistent domain config. {{(pid=75245) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 16:49:10 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-2456d177-e009-4d41-bae4-e964eaf35920 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 16:49:10 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:49:10 user nova-compute[75245]:   <source dev="/dev/sdb"/>
Nov 29 16:49:10 user nova-compute[75245]:   <target dev="vdb" bus="virtio"/>
Nov 29 16:49:10 user nova-compute[75245]:   <serial>adf000a4-d2ea-41f7-ac53-bec752956c3c</serial>
Nov 29 16:49:10 user nova-compute[75245]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 16:49:10 user nova-compute[75245]: </disk>
Nov 29 16:49:10 user nova-compute[75245]:  {{(pid=75245) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 16:49:10 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-2456d177-e009-4d41-bae4-e964eaf35920 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Successfully detached device vdb from instance 7b03f1f3-2061-4962-ba07-3a4f9da2ea90 from the persistent domain config.
Nov 29 16:49:10 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-2456d177-e009-4d41-bae4-e964eaf35920 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7b03f1f3-2061-4962-ba07-3a4f9da2ea90 from the live domain config. {{(pid=75245) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 16:49:10 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-2456d177-e009-4d41-bae4-e964eaf35920 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 16:49:10 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:49:10 user nova-compute[75245]:   <source dev="/dev/sdb"/>
Nov 29 16:49:10 user nova-compute[75245]:   <target dev="vdb" bus="virtio"/>
Nov 29 16:49:10 user nova-compute[75245]:   <serial>adf000a4-d2ea-41f7-ac53-bec752956c3c</serial>
Nov 29 16:49:10 user nova-compute[75245]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 16:49:10 user nova-compute[75245]: </disk>
Nov 29 16:49:10 user nova-compute[75245]:  {{(pid=75245) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 16:49:11 user nova-compute[75245]: DEBUG nova.network.neutron [req-376de2e5-d4a6-4260-aa7a-6d2461bea80c req-4d075b30-7333-4e07-a349-fb5eb102a4c0 service nova] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Updated VIF entry in instance network info cache for port 0599b1d1-85cd-4003-9d3d-c343f09a5b2b. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:49:11 user nova-compute[75245]: DEBUG nova.network.neutron [req-376de2e5-d4a6-4260-aa7a-6d2461bea80c req-4d075b30-7333-4e07-a349-fb5eb102a4c0 service nova] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Updating instance_info_cache with network_info: [{"id": "0599b1d1-85cd-4003-9d3d-c343f09a5b2b", "address": "fa:16:3e:61:06:fc", "network": {"id": "b0e81786-47f3-4a13-90c7-788cb53a4df5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1382922826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebd1ea36980641739f2bdd856a65d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0599b1d1-85", "ovs_interfaceid": "0599b1d1-85cd-4003-9d3d-c343f09a5b2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:49:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-376de2e5-d4a6-4260-aa7a-6d2461bea80c req-4d075b30-7333-4e07-a349-fb5eb102a4c0 service nova] Releasing lock "refresh_cache-7b03f1f3-2061-4962-ba07-3a4f9da2ea90" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:49:11 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-2456d177-e009-4d41-bae4-e964eaf35920 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7b03f1f3-2061-4962-ba07-3a4f9da2ea90 {{(pid=75245) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 16:49:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:49:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:49:16 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:49:20 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:49:20 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:49:20 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:49:20 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:49:20 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75245) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 16:49:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25a0a73c-ed89-4530-aabb-a6a85e030482/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:49:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25a0a73c-ed89-4530-aabb-a6a85e030482/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:49:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25a0a73c-ed89-4530-aabb-a6a85e030482/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:49:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25a0a73c-ed89-4530-aabb-a6a85e030482/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:49:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b03f1f3-2061-4962-ba07-3a4f9da2ea90/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:49:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b03f1f3-2061-4962-ba07-3a4f9da2ea90/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:49:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b03f1f3-2061-4962-ba07-3a4f9da2ea90/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:49:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b03f1f3-2061-4962-ba07-3a4f9da2ea90/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:49:21 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:49:21 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:49:21 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Hypervisor/Node resource view: name=user free_ram=8812MB free_disk=25.097511291503906GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75245) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 16:49:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:49:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:49:21 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 7b03f1f3-2061-4962-ba07-3a4f9da2ea90 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:49:21 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 25a0a73c-ed89-4530-aabb-a6a85e030482 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:49:21 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 16:49:21 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 16:49:21 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:49:21 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:49:21 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:49:21 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Compute_service record updated for user:user {{(pid=75245) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 16:49:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.239s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:49:23 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:49:23 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Starting heal instance info cache {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 16:49:23 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Rebuilding the list of instances to heal {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 16:49:23 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "refresh_cache-7b03f1f3-2061-4962-ba07-3a4f9da2ea90" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:49:23 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquired lock "refresh_cache-7b03f1f3-2061-4962-ba07-3a4f9da2ea90" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:49:23 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Forcefully refreshing network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 16:49:23 user nova-compute[75245]: DEBUG nova.objects.instance [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lazy-loading 'info_cache' on Instance uuid 7b03f1f3-2061-4962-ba07-3a4f9da2ea90 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:49:24 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Updating instance_info_cache with network_info: [{"id": "0599b1d1-85cd-4003-9d3d-c343f09a5b2b", "address": "fa:16:3e:61:06:fc", "network": {"id": "b0e81786-47f3-4a13-90c7-788cb53a4df5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1382922826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebd1ea36980641739f2bdd856a65d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0599b1d1-85", "ovs_interfaceid": "0599b1d1-85cd-4003-9d3d-c343f09a5b2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:49:24 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Releasing lock "refresh_cache-7b03f1f3-2061-4962-ba07-3a4f9da2ea90" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:49:24 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Updated the network info_cache for instance {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 16:49:24 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:49:25 user nova-compute[75245]: DEBUG nova.compute.manager [req-2ea73773-c176-4ca1-9fe4-50b13d1139dd req-1bead1b0-8578-4726-9b0e-4a8a93622a35 service nova] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Received event network-changed-8f62d901-5ef0-4879-9f19-8a51f55fde1f {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:49:25 user nova-compute[75245]: DEBUG nova.compute.manager [req-2ea73773-c176-4ca1-9fe4-50b13d1139dd req-1bead1b0-8578-4726-9b0e-4a8a93622a35 service nova] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Refreshing instance network info cache due to event network-changed-8f62d901-5ef0-4879-9f19-8a51f55fde1f. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:49:25 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-2ea73773-c176-4ca1-9fe4-50b13d1139dd req-1bead1b0-8578-4726-9b0e-4a8a93622a35 service nova] Acquiring lock "refresh_cache-25a0a73c-ed89-4530-aabb-a6a85e030482" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:49:25 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-2ea73773-c176-4ca1-9fe4-50b13d1139dd req-1bead1b0-8578-4726-9b0e-4a8a93622a35 service nova] Acquired lock "refresh_cache-25a0a73c-ed89-4530-aabb-a6a85e030482" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:49:25 user nova-compute[75245]: DEBUG nova.network.neutron [req-2ea73773-c176-4ca1-9fe4-50b13d1139dd req-1bead1b0-8578-4726-9b0e-4a8a93622a35 service nova] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Refreshing network info cache for port 8f62d901-5ef0-4879-9f19-8a51f55fde1f {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:49:25 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:49:25 user nova-compute[75245]: DEBUG nova.network.neutron [req-2ea73773-c176-4ca1-9fe4-50b13d1139dd req-1bead1b0-8578-4726-9b0e-4a8a93622a35 service nova] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Updated VIF entry in instance network info cache for port 8f62d901-5ef0-4879-9f19-8a51f55fde1f. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:49:25 user nova-compute[75245]: DEBUG nova.network.neutron [req-2ea73773-c176-4ca1-9fe4-50b13d1139dd req-1bead1b0-8578-4726-9b0e-4a8a93622a35 service nova] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Updating instance_info_cache with network_info: [{"id": "8f62d901-5ef0-4879-9f19-8a51f55fde1f", "address": "fa:16:3e:8b:42:60", "network": {"id": "2eac25a6-c643-4348-98eb-91d044f1714c", "bridge": "br-int", "label": "tempest-TestStampPattern-1438802163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d056f7dae1d94936bd1fed295f0eba16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f62d901-5e", "ovs_interfaceid": "8f62d901-5ef0-4879-9f19-8a51f55fde1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:49:25 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-2ea73773-c176-4ca1-9fe4-50b13d1139dd req-1bead1b0-8578-4726-9b0e-4a8a93622a35 service nova] Releasing lock "refresh_cache-25a0a73c-ed89-4530-aabb-a6a85e030482" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:49:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-ddf25843-f022-41db-895e-25cba96c7944 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Acquiring lock "25a0a73c-ed89-4530-aabb-a6a85e030482" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:49:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-ddf25843-f022-41db-895e-25cba96c7944 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Lock "25a0a73c-ed89-4530-aabb-a6a85e030482" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:49:26 user nova-compute[75245]: DEBUG nova.objects.instance [None req-ddf25843-f022-41db-895e-25cba96c7944 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Lazy-loading 'flavor' on Instance uuid 25a0a73c-ed89-4530-aabb-a6a85e030482 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:49:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-ddf25843-f022-41db-895e-25cba96c7944 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Lock "25a0a73c-ed89-4530-aabb-a6a85e030482" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:49:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-ddf25843-f022-41db-895e-25cba96c7944 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Acquiring lock "25a0a73c-ed89-4530-aabb-a6a85e030482" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:49:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-ddf25843-f022-41db-895e-25cba96c7944 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Lock "25a0a73c-ed89-4530-aabb-a6a85e030482" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:49:26 user nova-compute[75245]: INFO nova.compute.manager [None req-ddf25843-f022-41db-895e-25cba96c7944 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Attaching volume 2a9e65a1-3e5c-45d0-b332-ee090fffbee4 to /dev/vdb
Nov 29 16:49:26 user nova-compute[75245]: DEBUG os_brick.utils [None req-ddf25843-f022-41db-895e-25cba96c7944 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:49:26 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:49:26 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:49:26 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2191613-e90a-42f2-8596-3b5bfa316dc9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:69ed8ed87091\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:49:26 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:49:26 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:49:26 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dcd31fa-d976-4ff0-9d68-0a9ac785baa9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:49:26 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:49:26 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:49:26 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a06503-e7be-4ceb-b943-a7d6fc402370]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:49:26 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[92220b32-f00a-4aba-b2d1-e72e0a6c5e20]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:49:26 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-ddf25843-f022-41db-895e-25cba96c7944 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Running cmd (subprocess): nvme version {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:49:26 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-ddf25843-f022-41db-895e-25cba96c7944 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] 'nvme version' failed. Not Retrying. {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:49:26 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ddf25843-f022-41db-895e-25cba96c7944 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] nvme not present on system {{(pid=75245) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 16:49:26 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:49:26 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:49:26 user nova-compute[75245]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 16:49:26 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[5257cbf1-7c29-4f66-89e0-8315a39135db]: (4, '') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:49:26 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-ddf25843-f022-41db-895e-25cba96c7944 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75245) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 16:49:26 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-ddf25843-f022-41db-895e-25cba96c7944 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 16:49:26 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-ddf25843-f022-41db-895e-25cba96c7944 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] LIGHTOS: no hostnqn found. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 16:49:26 user nova-compute[75245]: DEBUG os_brick.utils [None req-ddf25843-f022-41db-895e-25cba96c7944 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:69ed8ed87091', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:49:26 user nova-compute[75245]: DEBUG nova.virt.block_device [None req-ddf25843-f022-41db-895e-25cba96c7944 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Updating existing volume attachment record: bd8f9e2b-a42d-4e7d-a14f-e6ec751f6686 {{(pid=75245) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 16:49:26 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:49:27 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:49:29 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:49:31 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-2456d177-e009-4d41-bae4-e964eaf35920 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7b03f1f3-2061-4962-ba07-3a4f9da2ea90 is timed out.
Nov 29 16:49:31 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-2456d177-e009-4d41-bae4-e964eaf35920 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Successfully detached device vdb from instance 7b03f1f3-2061-4962-ba07-3a4f9da2ea90 from the live domain config.
Nov 29 16:49:31 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2456d177-e009-4d41-bae4-e964eaf35920 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] calling os-brick to detach iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 16:49:31 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2456d177-e009-4d41-bae4-e964eaf35920 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, {'target_iqn': 'iqn.2010-10.org.openstack:adf000a4-d2ea-41f7-ac53-bec752956c3c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XvxBNTop', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:49:31 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-2456d177-e009-4d41-bae4-e964eaf35920 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:49:31 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-2456d177-e009-4d41-bae4-e964eaf35920 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:49:31 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-2456d177-e009-4d41-bae4-e964eaf35920 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:49:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:49:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:49:31 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[a218401a-964a-4e67-95a7-177f5e417946]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:adf000a4-d2ea-41f7-ac53-bec752956c3c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:49:31 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2456d177-e009-4d41-bae4-e964eaf35920 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 16:49:31 user nova-compute[75245]: No targets found.
Nov 29 16:49:31 user nova-compute[75245]: iSNS:
Nov 29 16:49:31 user nova-compute[75245]: No targets found.
Nov 29 16:49:31 user nova-compute[75245]: STATIC:
Nov 29 16:49:31 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:adf000a4-d2ea-41f7-ac53-bec752956c3c
Nov 29 16:49:31 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:49:31 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:49:31 user nova-compute[75245]: FIRMWARE:
Nov 29 16:49:31 user nova-compute[75245]: No targets found.
Nov 29 16:49:31 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:49:31 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2456d177-e009-4d41-bae4-e964eaf35920 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 16:49:31 user nova-compute[75245]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 16:49:31 user nova-compute[75245]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75245) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 16:49:31 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2456d177-e009-4d41-bae4-e964eaf35920 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:adf000a4-d2ea-41f7-ac53-bec752956c3c', 0)] {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 16:49:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:49:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:49:31 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3927ddc-4b3b-497a-8ed0-a111784bdc4b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:adf000a4-d2ea-41f7-ac53-bec752956c3c\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:49:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:49:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:49:31 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[16bf3a74-44a3-464a-8775-b62da4db84d8]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adf000a4-d2ea-41f7-ac53-bec752956c3c (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:49:31 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2456d177-e009-4d41-bae4-e964eaf35920 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adf000a4-d2ea-41f7-ac53-bec752956c3c (non-flash)
Nov 29 16:49:31 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:49:31 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2456d177-e009-4d41-bae4-e964eaf35920 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adf000a4-d2ea-41f7-ac53-bec752956c3c (non-flash)
Nov 29 16:49:31 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:49:31 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2456d177-e009-4d41-bae4-e964eaf35920 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0d4c386b00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:adf000a4-d2ea-41f7-ac53-bec752956c3c'): ({'sdb'}, set())}) {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 16:49:31 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-2456d177-e009-4d41-bae4-e964eaf35920 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Removing single pathed devices sdb {{(pid=75245) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 16:49:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:49:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:49:31 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b9d14b4-6345-42bb-9ace-7578c5fbec91]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:49:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:49:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:49:31 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d394408-9a39-40b4-bb17-a7bc6e3ac8b4]: (4, ('ok\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:49:31 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-2456d177-e009-4d41-bae4-e964eaf35920 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Flushing IO for device /dev/sdb {{(pid=75245) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 16:49:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:49:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:49:31 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[e053e83a-b2e0-40a2-8cff-e0325c838a1f]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:49:31 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-2456d177-e009-4d41-bae4-e964eaf35920 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75245) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 16:49:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:49:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:49:31 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa9a8fba-13fa-4726-a454-64dec9892757]: (4, ('1', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:49:31 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-2456d177-e009-4d41-bae4-e964eaf35920 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 16:49:31 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-2456d177-e009-4d41-bae4-e964eaf35920 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] SCSI volumes sdb have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 16:49:31 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2456d177-e009-4d41-bae4-e964eaf35920 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:adf000a4-d2ea-41f7-ac53-bec752956c3c')] {{(pid=75245) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 16:49:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adf000a4-d2ea-41f7-ac53-bec752956c3c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:49:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adf000a4-d2ea-41f7-ac53-bec752956c3c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:49:31 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b6ba108-26c2-4393-bbb4-5c6e70cde4d5]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:49:31 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2456d177-e009-4d41-bae4-e964eaf35920 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:49:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adf000a4-d2ea-41f7-ac53-bec752956c3c -p 172.16.0.220:3260 --logout {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:49:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adf000a4-d2ea-41f7-ac53-bec752956c3c -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:49:31 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[067d2a87-981a-4e67-a396-298b4bba1751]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:adf000a4-d2ea-41f7-ac53-bec752956c3c, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:adf000a4-d2ea-41f7-ac53-bec752956c3c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:49:31 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2456d177-e009-4d41-bae4-e964eaf35920 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:adf000a4-d2ea-41f7-ac53-bec752956c3c, portal: 172.16.0.220,3260]
Nov 29 16:49:31 user nova-compute[75245]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:adf000a4-d2ea-41f7-ac53-bec752956c3c, portal: 172.16.0.220,3260] successful.
Nov 29 16:49:31 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:49:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adf000a4-d2ea-41f7-ac53-bec752956c3c -p 172.16.0.220:3260 --op delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:49:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adf000a4-d2ea-41f7-ac53-bec752956c3c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:49:31 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf680aa-17bb-4f07-8d4e-6ad5f3bed888]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:49:31 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2456d177-e009-4d41-bae4-e964eaf35920 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:49:31 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-2456d177-e009-4d41-bae4-e964eaf35920 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.272s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:49:31 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2456d177-e009-4d41-bae4-e964eaf35920 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] <== disconnect_volume: return (274ms) None {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:49:31 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2456d177-e009-4d41-bae4-e964eaf35920 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Disconnected iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 16:49:31 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:49:32 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:49:32 user nova-compute[75245]: DEBUG nova.objects.instance [None req-2456d177-e009-4d41-bae4-e964eaf35920 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lazy-loading 'flavor' on Instance uuid 7b03f1f3-2061-4962-ba07-3a4f9da2ea90 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:49:32 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2456d177-e009-4d41-bae4-e964eaf35920 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lock "7b03f1f3-2061-4962-ba07-3a4f9da2ea90" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.726s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:49:34 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddf25843-f022-41db-895e-25cba96c7944 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Calling os-brick to attach iSCSI Volume {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 16:49:34 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf25843-f022-41db-895e-25cba96c7944 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2a9e65a1-3e5c-45d0-b332-ee090fffbee4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LjlAgCOi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:49:34 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-ddf25843-f022-41db-895e-25cba96c7944 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:49:34 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-ddf25843-f022-41db-895e-25cba96c7944 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:49:34 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-ddf25843-f022-41db-895e-25cba96c7944 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:49:34 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-ddf25843-f022-41db-895e-25cba96c7944 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:49:34 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-ddf25843-f022-41db-895e-25cba96c7944 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a9e65a1-3e5c-45d0-b332-ee090fffbee4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:49:34 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-ddf25843-f022-41db-895e-25cba96c7944 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a9e65a1-3e5c-45d0-b332-ee090fffbee4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:49:34 user nova-compute[75245]: INFO os_brick.initiator.connectors.iscsi [None req-ddf25843-f022-41db-895e-25cba96c7944 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 16:49:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a9e65a1-3e5c-45d0-b332-ee090fffbee4 -p 172.16.0.220:3260 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:49:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a9e65a1-3e5c-45d0-b332-ee090fffbee4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:49:34 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[393df0cb-ec2c-47b3-ba6d-0d8659593776]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:49:34 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf25843-f022-41db-895e-25cba96c7944 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 16:49:34 user nova-compute[75245]:  {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:49:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a9e65a1-3e5c-45d0-b332-ee090fffbee4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:49:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a9e65a1-3e5c-45d0-b332-ee090fffbee4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:49:34 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[70759f24-b097-44fd-ad04-69d3267774a9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a9e65a1-3e5c-45d0-b332-ee090fffbee4] added\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:49:34 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf25843-f022-41db-895e-25cba96c7944 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a9e65a1-3e5c-45d0-b332-ee090fffbee4] added
Nov 29 16:49:34 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:49:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a9e65a1-3e5c-45d0-b332-ee090fffbee4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:49:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a9e65a1-3e5c-45d0-b332-ee090fffbee4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:49:34 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a52d140-1fc7-491e-8714-06ed44531d5f]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:49:34 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf25843-f022-41db-895e-25cba96c7944 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:49:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a9e65a1-3e5c-45d0-b332-ee090fffbee4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:49:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a9e65a1-3e5c-45d0-b332-ee090fffbee4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:49:34 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[30fcf9cf-fd50-4e46-99d9-8e62e3ca39b6]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:49:34 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf25843-f022-41db-895e-25cba96c7944 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:49:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a9e65a1-3e5c-45d0-b332-ee090fffbee4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LjlAgCOi {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:49:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a9e65a1-3e5c-45d0-b332-ee090fffbee4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LjlAgCOi" returned: 0 in 0.022s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:49:34 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77871d4-5ce1-4e1c-b994-4a00fad5d61f]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:49:34 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf25843-f022-41db-895e-25cba96c7944 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LjlAgCOi'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:49:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a9e65a1-3e5c-45d0-b332-ee090fffbee4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:49:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:49:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a9e65a1-3e5c-45d0-b332-ee090fffbee4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:49:34 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[5866752d-d8c0-48e1-8a2b-6ca7922389b1]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:49:34 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf25843-f022-41db-895e-25cba96c7944 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:49:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:49:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:49:34 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[195080da-14dc-4d69-b743-761460fa1e6e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:49:34 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf25843-f022-41db-895e-25cba96c7944 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 16:49:34 user nova-compute[75245]:  {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:49:34 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf25843-f022-41db-895e-25cba96c7944 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 16:49:34 user nova-compute[75245]:  {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:49:34 user nova-compute[75245]: WARNING os_brick.initiator.connectors.iscsi [None req-ddf25843-f022-41db-895e-25cba96c7944 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 16:49:34 user nova-compute[75245]: 
Nov 29 16:49:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a9e65a1-3e5c-45d0-b332-ee090fffbee4 -p 172.16.0.220:3260 --login {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:49:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a9e65a1-3e5c-45d0-b332-ee090fffbee4 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:49:34 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f56fc7-e059-4c9a-80aa-71eb64e02a88]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a9e65a1-3e5c-45d0-b332-ee090fffbee4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2a9e65a1-3e5c-45d0-b332-ee090fffbee4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:49:34 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf25843-f022-41db-895e-25cba96c7944 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a9e65a1-3e5c-45d0-b332-ee090fffbee4, portal: 172.16.0.220,3260]
Nov 29 16:49:34 user nova-compute[75245]: Login to [iface: default, target: iqn.2010-10.org.openstack:2a9e65a1-3e5c-45d0-b332-ee090fffbee4, portal: 172.16.0.220,3260] successful.
Nov 29 16:49:34 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:49:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a9e65a1-3e5c-45d0-b332-ee090fffbee4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:49:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a9e65a1-3e5c-45d0-b332-ee090fffbee4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:49:34 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd507fa-1c78-4d6e-a6e9-e4ed1f5306c5]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:49:34 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf25843-f022-41db-895e-25cba96c7944 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:49:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:49:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:49:34 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad8b684-b23b-4cab-b572-0232dcda5e56]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a9e65a1-3e5c-45d0-b332-ee090fffbee4 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:49:34 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf25843-f022-41db-895e-25cba96c7944 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a9e65a1-3e5c-45d0-b332-ee090fffbee4 (non-flash)
Nov 29 16:49:34 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:49:34 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf25843-f022-41db-895e-25cba96c7944 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a9e65a1-3e5c-45d0-b332-ee090fffbee4 (non-flash)
Nov 29 16:49:34 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:49:34 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-ddf25843-f022-41db-895e-25cba96c7944 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a9e65a1-3e5c-45d0-b332-ee090fffbee4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:49:34 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf25843-f022-41db-895e-25cba96c7944 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Connected to 172.16.0.220:3260 {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 16:49:34 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-ddf25843-f022-41db-895e-25cba96c7944 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=75245) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 16:49:34 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-ddf25843-f022-41db-895e-25cba96c7944 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75245) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 16:49:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:49:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:49:34 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[305a44fd-0363-4f79-ab12-16547b3b9462]: (4, ('- - 0', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:49:34 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-ddf25843-f022-41db-895e-25cba96c7944 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75245) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 16:49:34 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf25843-f022-41db-895e-25cba96c7944 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2a9e65a1-3e5c-45d0-b332-ee090fffbee4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LjlAgCOi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 16:49:34 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:49:34 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:49:34 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75245) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 16:49:35 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-ddf25843-f022-41db-895e-25cba96c7944 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:49:35 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf25843-f022-41db-895e-25cba96c7944 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '26433373133383333', 'path': '/dev/sdb'} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:49:35 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddf25843-f022-41db-895e-25cba96c7944 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26433373133383333', 'path': '/dev/sdb'} {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 16:49:35 user nova-compute[75245]: DEBUG nova.objects.instance [None req-ddf25843-f022-41db-895e-25cba96c7944 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Lazy-loading 'flavor' on Instance uuid 25a0a73c-ed89-4530-aabb-a6a85e030482 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:49:35 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-ddf25843-f022-41db-895e-25cba96c7944 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 16:49:35 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:49:35 user nova-compute[75245]:   <source dev="/dev/sdb"/>
Nov 29 16:49:35 user nova-compute[75245]:   <target dev="vdb" bus="virtio"/>
Nov 29 16:49:35 user nova-compute[75245]:   <serial>2a9e65a1-3e5c-45d0-b332-ee090fffbee4</serial>
Nov 29 16:49:35 user nova-compute[75245]: </disk>
Nov 29 16:49:35 user nova-compute[75245]:  {{(pid=75245) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 16:49:35 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-ddf25843-f022-41db-895e-25cba96c7944 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:49:35 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-ddf25843-f022-41db-895e-25cba96c7944 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:49:35 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-ddf25843-f022-41db-895e-25cba96c7944 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] No VIF found with MAC fa:16:3e:8b:42:60, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:49:36 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-ddf25843-f022-41db-895e-25cba96c7944 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Lock "25a0a73c-ed89-4530-aabb-a6a85e030482" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.470s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:49:36 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:49:38 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-6d2207c8-27cf-4c26-b393-9b592b6c3cd0 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Acquiring lock "25a0a73c-ed89-4530-aabb-a6a85e030482" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:49:38 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-6d2207c8-27cf-4c26-b393-9b592b6c3cd0 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Lock "25a0a73c-ed89-4530-aabb-a6a85e030482" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:49:38 user nova-compute[75245]: INFO nova.compute.manager [None req-6d2207c8-27cf-4c26-b393-9b592b6c3cd0 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Detaching volume 2a9e65a1-3e5c-45d0-b332-ee090fffbee4
Nov 29 16:49:38 user nova-compute[75245]: INFO nova.virt.block_device [None req-6d2207c8-27cf-4c26-b393-9b592b6c3cd0 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Attempting to driver detach volume 2a9e65a1-3e5c-45d0-b332-ee090fffbee4 from mountpoint /dev/vdb
Nov 29 16:49:38 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-6d2207c8-27cf-4c26-b393-9b592b6c3cd0 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Attempting to detach device vdb from instance 25a0a73c-ed89-4530-aabb-a6a85e030482 from the persistent domain config. {{(pid=75245) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 16:49:38 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-6d2207c8-27cf-4c26-b393-9b592b6c3cd0 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 16:49:38 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:49:38 user nova-compute[75245]:   <source dev="/dev/sdb"/>
Nov 29 16:49:38 user nova-compute[75245]:   <target dev="vdb" bus="virtio"/>
Nov 29 16:49:38 user nova-compute[75245]:   <serial>2a9e65a1-3e5c-45d0-b332-ee090fffbee4</serial>
Nov 29 16:49:38 user nova-compute[75245]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 16:49:38 user nova-compute[75245]: </disk>
Nov 29 16:49:38 user nova-compute[75245]:  {{(pid=75245) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 16:49:38 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-6d2207c8-27cf-4c26-b393-9b592b6c3cd0 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Successfully detached device vdb from instance 25a0a73c-ed89-4530-aabb-a6a85e030482 from the persistent domain config.
Nov 29 16:49:38 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-6d2207c8-27cf-4c26-b393-9b592b6c3cd0 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 25a0a73c-ed89-4530-aabb-a6a85e030482 from the live domain config. {{(pid=75245) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 16:49:38 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-6d2207c8-27cf-4c26-b393-9b592b6c3cd0 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 16:49:38 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:49:38 user nova-compute[75245]:   <source dev="/dev/sdb"/>
Nov 29 16:49:38 user nova-compute[75245]:   <target dev="vdb" bus="virtio"/>
Nov 29 16:49:38 user nova-compute[75245]:   <serial>2a9e65a1-3e5c-45d0-b332-ee090fffbee4</serial>
Nov 29 16:49:38 user nova-compute[75245]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 16:49:38 user nova-compute[75245]: </disk>
Nov 29 16:49:38 user nova-compute[75245]:  {{(pid=75245) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 16:49:38 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-6d2207c8-27cf-4c26-b393-9b592b6c3cd0 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 25a0a73c-ed89-4530-aabb-a6a85e030482 {{(pid=75245) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 16:49:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:49:40 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:49:41 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:49:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:49:46 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:49:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:49:54 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Acquiring lock "24999298-349a-4837-ba75-22192166c5a1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:49:54 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "24999298-349a-4837-ba75-22192166c5a1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:49:54 user nova-compute[75245]: DEBUG nova.compute.manager [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: 24999298-349a-4837-ba75-22192166c5a1] Starting instance... {{(pid=75245) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 16:49:54 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:49:54 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:49:54 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75245) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 16:49:54 user nova-compute[75245]: INFO nova.compute.claims [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: 24999298-349a-4837-ba75-22192166c5a1] Claim successful on node user
Nov 29 16:49:54 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:49:54 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:49:55 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.231s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:49:55 user nova-compute[75245]: DEBUG nova.compute.manager [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: 24999298-349a-4837-ba75-22192166c5a1] Start building networks asynchronously for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 16:49:55 user nova-compute[75245]: DEBUG nova.compute.manager [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: 24999298-349a-4837-ba75-22192166c5a1] Allocating IP information in the background. {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 16:49:55 user nova-compute[75245]: DEBUG nova.network.neutron [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: 24999298-349a-4837-ba75-22192166c5a1] allocate_for_instance() {{(pid=75245) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 16:49:55 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: 24999298-349a-4837-ba75-22192166c5a1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 16:49:55 user nova-compute[75245]: DEBUG nova.compute.manager [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: 24999298-349a-4837-ba75-22192166c5a1] Start building block device mappings for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 16:49:55 user nova-compute[75245]: DEBUG nova.policy [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fb4c94298bf14753bb9530633e766dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e269dbe30d46ccb81d58e2590004db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75245) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 16:49:55 user nova-compute[75245]: DEBUG nova.compute.manager [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: 24999298-349a-4837-ba75-22192166c5a1] Start spawning the instance on the hypervisor. {{(pid=75245) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 16:49:55 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: 24999298-349a-4837-ba75-22192166c5a1] Creating instance directory {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 16:49:55 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: 24999298-349a-4837-ba75-22192166c5a1] Creating image(s)
Nov 29 16:49:55 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Acquiring lock "/opt/stack/data/nova/instances/24999298-349a-4837-ba75-22192166c5a1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:49:55 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "/opt/stack/data/nova/instances/24999298-349a-4837-ba75-22192166c5a1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:49:55 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "/opt/stack/data/nova/instances/24999298-349a-4837-ba75-22192166c5a1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:49:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:49:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.179s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:49:55 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Acquiring lock "d654f7206043e05d3525550b0fc885556eb999f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:49:55 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:49:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:49:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.182s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:49:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/24999298-349a-4837-ba75-22192166c5a1/disk 1073741824 {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:49:55 user nova-compute[75245]: DEBUG nova.network.neutron [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: 24999298-349a-4837-ba75-22192166c5a1] Successfully created port: 01bba9cb-1eaf-4586-9abd-9a2b24a49a95 {{(pid=75245) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 16:49:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/24999298-349a-4837-ba75-22192166c5a1/disk 1073741824" returned: 0 in 0.060s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:49:55 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:49:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:49:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.179s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:49:55 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Checking if we can resize image /opt/stack/data/nova/instances/24999298-349a-4837-ba75-22192166c5a1/disk. size=1073741824 {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 16:49:55 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24999298-349a-4837-ba75-22192166c5a1/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:49:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24999298-349a-4837-ba75-22192166c5a1/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:49:56 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Cannot resize image /opt/stack/data/nova/instances/24999298-349a-4837-ba75-22192166c5a1/disk to a smaller size. {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 16:49:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: 24999298-349a-4837-ba75-22192166c5a1] Created local disks {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 16:49:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: 24999298-349a-4837-ba75-22192166c5a1] Ensure instance console log exists: /opt/stack/data/nova/instances/24999298-349a-4837-ba75-22192166c5a1/console.log {{(pid=75245) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 16:49:56 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:49:56 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:49:56 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:49:56 user nova-compute[75245]: DEBUG nova.network.neutron [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: 24999298-349a-4837-ba75-22192166c5a1] Successfully updated port: 01bba9cb-1eaf-4586-9abd-9a2b24a49a95 {{(pid=75245) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 16:49:56 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Acquiring lock "refresh_cache-24999298-349a-4837-ba75-22192166c5a1" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:49:56 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Acquired lock "refresh_cache-24999298-349a-4837-ba75-22192166c5a1" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:49:56 user nova-compute[75245]: DEBUG nova.network.neutron [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: 24999298-349a-4837-ba75-22192166c5a1] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 16:49:56 user nova-compute[75245]: DEBUG nova.compute.manager [req-92a9ce1e-c7f1-4158-b75d-7e073eacb782 req-f574284f-1ac8-41f5-acb2-c9b7c3cdb292 service nova] [instance: 24999298-349a-4837-ba75-22192166c5a1] Received event network-changed-01bba9cb-1eaf-4586-9abd-9a2b24a49a95 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:49:56 user nova-compute[75245]: DEBUG nova.compute.manager [req-92a9ce1e-c7f1-4158-b75d-7e073eacb782 req-f574284f-1ac8-41f5-acb2-c9b7c3cdb292 service nova] [instance: 24999298-349a-4837-ba75-22192166c5a1] Refreshing instance network info cache due to event network-changed-01bba9cb-1eaf-4586-9abd-9a2b24a49a95. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:49:56 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-92a9ce1e-c7f1-4158-b75d-7e073eacb782 req-f574284f-1ac8-41f5-acb2-c9b7c3cdb292 service nova] Acquiring lock "refresh_cache-24999298-349a-4837-ba75-22192166c5a1" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:49:56 user nova-compute[75245]: DEBUG nova.network.neutron [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: 24999298-349a-4837-ba75-22192166c5a1] Instance cache missing network info. {{(pid=75245) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 16:49:56 user nova-compute[75245]: DEBUG nova.network.neutron [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: 24999298-349a-4837-ba75-22192166c5a1] Updating instance_info_cache with network_info: [{"id": "01bba9cb-1eaf-4586-9abd-9a2b24a49a95", "address": "fa:16:3e:fb:17:6c", "network": {"id": "55744af1-3291-4de1-9bf4-554f9ee4f057", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1570836437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01e269dbe30d46ccb81d58e2590004db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01bba9cb-1e", "ovs_interfaceid": "01bba9cb-1eaf-4586-9abd-9a2b24a49a95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:49:56 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Releasing lock "refresh_cache-24999298-349a-4837-ba75-22192166c5a1" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:49:56 user nova-compute[75245]: DEBUG nova.compute.manager [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: 24999298-349a-4837-ba75-22192166c5a1] Instance network_info: |[{"id": "01bba9cb-1eaf-4586-9abd-9a2b24a49a95", "address": "fa:16:3e:fb:17:6c", "network": {"id": "55744af1-3291-4de1-9bf4-554f9ee4f057", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1570836437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01e269dbe30d46ccb81d58e2590004db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01bba9cb-1e", "ovs_interfaceid": "01bba9cb-1eaf-4586-9abd-9a2b24a49a95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 16:49:56 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-92a9ce1e-c7f1-4158-b75d-7e073eacb782 req-f574284f-1ac8-41f5-acb2-c9b7c3cdb292 service nova] Acquired lock "refresh_cache-24999298-349a-4837-ba75-22192166c5a1" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:49:56 user nova-compute[75245]: DEBUG nova.network.neutron [req-92a9ce1e-c7f1-4158-b75d-7e073eacb782 req-f574284f-1ac8-41f5-acb2-c9b7c3cdb292 service nova] [instance: 24999298-349a-4837-ba75-22192166c5a1] Refreshing network info cache for port 01bba9cb-1eaf-4586-9abd-9a2b24a49a95 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:49:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: 24999298-349a-4837-ba75-22192166c5a1] Start _get_guest_xml network_info=[{"id": "01bba9cb-1eaf-4586-9abd-9a2b24a49a95", "address": "fa:16:3e:fb:17:6c", "network": {"id": "55744af1-3291-4de1-9bf4-554f9ee4f057", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1570836437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01e269dbe30d46ccb81d58e2590004db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01bba9cb-1e", "ovs_interfaceid": "01bba9cb-1eaf-4586-9abd-9a2b24a49a95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'a291d9c3-be02-4c6c-9649-4b45c5b7f487'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 16:49:56 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:49:56 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:49:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 16:49:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] CPU controller missing on host. {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 16:49:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 16:49:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] CPU controller found on host. {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 16:49:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75245) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 16:49:56 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T16:06:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 16:49:56 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Flavor limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 16:49:56 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Image limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 16:49:56 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Flavor pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 16:49:56 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Image pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 16:49:56 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 16:49:56 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 16:49:56 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 16:49:56 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Got 1 possible topologies {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 16:49:56 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 16:49:56 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 16:49:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:49:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1519020680',display_name='tempest-AttachVolumeNegativeTest-server-1519020680',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1519020680',id=42,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCy5fpeG5p0olDyutsXx3FoPQoXSTWYLYAm1DAhocFyIVaYrpUWHMYuivi6WZweFTIOgMQueUyMronz2lA/VbcTqekWYgJ2WOGME+S9d6Boy/VclREVXvVQDViK6Wu97tA==',key_name='tempest-keypair-395098351',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='01e269dbe30d46ccb81d58e2590004db',ramdisk_id='',reservation_id='r-e99av8ms',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-44169219',owner_user_name='tempest-AttachVolumeNegativeTest-44169219-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:49:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb4c94298bf14753bb9530633e766dee',uuid=24999298-349a-4837-ba75-22192166c5a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01bba9cb-1eaf-4586-9abd-9a2b24a49a95", "address": "fa:16:3e:fb:17:6c", "network": {"id": "55744af1-3291-4de1-9bf4-554f9ee4f057", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1570836437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01e269dbe30d46ccb81d58e2590004db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01bba9cb-1e", "ovs_interfaceid": "01bba9cb-1eaf-4586-9abd-9a2b24a49a95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:49:56 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Converting VIF {"id": "01bba9cb-1eaf-4586-9abd-9a2b24a49a95", "address": "fa:16:3e:fb:17:6c", "network": {"id": "55744af1-3291-4de1-9bf4-554f9ee4f057", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1570836437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01e269dbe30d46ccb81d58e2590004db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01bba9cb-1e", "ovs_interfaceid": "01bba9cb-1eaf-4586-9abd-9a2b24a49a95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:49:56 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:17:6c,bridge_name='br-int',has_traffic_filtering=True,id=01bba9cb-1eaf-4586-9abd-9a2b24a49a95,network=Network(55744af1-3291-4de1-9bf4-554f9ee4f057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01bba9cb-1e') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:49:56 user nova-compute[75245]: DEBUG nova.objects.instance [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lazy-loading 'pci_devices' on Instance uuid 24999298-349a-4837-ba75-22192166c5a1 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:49:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: 24999298-349a-4837-ba75-22192166c5a1] End _get_guest_xml xml=<domain type="kvm">
Nov 29 16:49:56 user nova-compute[75245]:   <uuid>24999298-349a-4837-ba75-22192166c5a1</uuid>
Nov 29 16:49:56 user nova-compute[75245]:   <name>instance-0000002a</name>
Nov 29 16:49:56 user nova-compute[75245]:   <memory>524288</memory>
Nov 29 16:49:56 user nova-compute[75245]:   <vcpu>1</vcpu>
Nov 29 16:49:56 user nova-compute[75245]:   <metadata>
Nov 29 16:49:56 user nova-compute[75245]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 16:49:56 user nova-compute[75245]:       <nova:package version="0.0.0"/>
Nov 29 16:49:56 user nova-compute[75245]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1519020680</nova:name>
Nov 29 16:49:56 user nova-compute[75245]:       <nova:creationTime>2023-11-29 16:49:56</nova:creationTime>
Nov 29 16:49:56 user nova-compute[75245]:       <nova:flavor name="m1.tiny">
Nov 29 16:49:56 user nova-compute[75245]:         <nova:memory>512</nova:memory>
Nov 29 16:49:56 user nova-compute[75245]:         <nova:disk>1</nova:disk>
Nov 29 16:49:56 user nova-compute[75245]:         <nova:swap>0</nova:swap>
Nov 29 16:49:56 user nova-compute[75245]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 16:49:56 user nova-compute[75245]:         <nova:vcpus>1</nova:vcpus>
Nov 29 16:49:56 user nova-compute[75245]:       </nova:flavor>
Nov 29 16:49:56 user nova-compute[75245]:       <nova:owner>
Nov 29 16:49:56 user nova-compute[75245]:         <nova:user uuid="fb4c94298bf14753bb9530633e766dee">tempest-AttachVolumeNegativeTest-44169219-project-member</nova:user>
Nov 29 16:49:56 user nova-compute[75245]:         <nova:project uuid="01e269dbe30d46ccb81d58e2590004db">tempest-AttachVolumeNegativeTest-44169219</nova:project>
Nov 29 16:49:56 user nova-compute[75245]:       </nova:owner>
Nov 29 16:49:56 user nova-compute[75245]:       <nova:root type="image" uuid="a291d9c3-be02-4c6c-9649-4b45c5b7f487"/>
Nov 29 16:49:56 user nova-compute[75245]:       <nova:ports>
Nov 29 16:49:56 user nova-compute[75245]:         <nova:port uuid="01bba9cb-1eaf-4586-9abd-9a2b24a49a95">
Nov 29 16:49:56 user nova-compute[75245]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 29 16:49:56 user nova-compute[75245]:         </nova:port>
Nov 29 16:49:56 user nova-compute[75245]:       </nova:ports>
Nov 29 16:49:56 user nova-compute[75245]:     </nova:instance>
Nov 29 16:49:56 user nova-compute[75245]:   </metadata>
Nov 29 16:49:56 user nova-compute[75245]:   <sysinfo type="smbios">
Nov 29 16:49:56 user nova-compute[75245]:     <system>
Nov 29 16:49:56 user nova-compute[75245]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 16:49:56 user nova-compute[75245]:       <entry name="product">OpenStack Nova</entry>
Nov 29 16:49:56 user nova-compute[75245]:       <entry name="version">0.0.0</entry>
Nov 29 16:49:56 user nova-compute[75245]:       <entry name="serial">24999298-349a-4837-ba75-22192166c5a1</entry>
Nov 29 16:49:56 user nova-compute[75245]:       <entry name="uuid">24999298-349a-4837-ba75-22192166c5a1</entry>
Nov 29 16:49:56 user nova-compute[75245]:       <entry name="family">Virtual Machine</entry>
Nov 29 16:49:56 user nova-compute[75245]:     </system>
Nov 29 16:49:56 user nova-compute[75245]:   </sysinfo>
Nov 29 16:49:56 user nova-compute[75245]:   <os>
Nov 29 16:49:56 user nova-compute[75245]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 16:49:56 user nova-compute[75245]:     <boot dev="hd"/>
Nov 29 16:49:56 user nova-compute[75245]:     <smbios mode="sysinfo"/>
Nov 29 16:49:56 user nova-compute[75245]:   </os>
Nov 29 16:49:56 user nova-compute[75245]:   <features>
Nov 29 16:49:56 user nova-compute[75245]:     <acpi/>
Nov 29 16:49:56 user nova-compute[75245]:     <apic/>
Nov 29 16:49:56 user nova-compute[75245]:     <vmcoreinfo/>
Nov 29 16:49:56 user nova-compute[75245]:   </features>
Nov 29 16:49:56 user nova-compute[75245]:   <clock offset="utc">
Nov 29 16:49:56 user nova-compute[75245]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 16:49:56 user nova-compute[75245]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 16:49:56 user nova-compute[75245]:     <timer name="hpet" present="no"/>
Nov 29 16:49:56 user nova-compute[75245]:   </clock>
Nov 29 16:49:56 user nova-compute[75245]:   <cpu mode="custom" match="exact">
Nov 29 16:49:56 user nova-compute[75245]:     <model>Nehalem</model>
Nov 29 16:49:56 user nova-compute[75245]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 16:49:56 user nova-compute[75245]:   </cpu>
Nov 29 16:49:56 user nova-compute[75245]:   <devices>
Nov 29 16:49:56 user nova-compute[75245]:     <disk type="file" device="disk">
Nov 29 16:49:56 user nova-compute[75245]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 16:49:56 user nova-compute[75245]:       <source file="/opt/stack/data/nova/instances/24999298-349a-4837-ba75-22192166c5a1/disk"/>
Nov 29 16:49:56 user nova-compute[75245]:       <target dev="vda" bus="virtio"/>
Nov 29 16:49:56 user nova-compute[75245]:     </disk>
Nov 29 16:49:56 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 16:49:56 user nova-compute[75245]:       <mac address="fa:16:3e:fb:17:6c"/>
Nov 29 16:49:56 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:49:56 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 16:49:56 user nova-compute[75245]:       <target dev="tap01bba9cb-1e"/>
Nov 29 16:49:56 user nova-compute[75245]:     </interface>
Nov 29 16:49:56 user nova-compute[75245]:     <serial type="pty">
Nov 29 16:49:56 user nova-compute[75245]:       <log file="/opt/stack/data/nova/instances/24999298-349a-4837-ba75-22192166c5a1/console.log" append="off"/>
Nov 29 16:49:56 user nova-compute[75245]:     </serial>
Nov 29 16:49:56 user nova-compute[75245]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 16:49:56 user nova-compute[75245]:     <video>
Nov 29 16:49:56 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:49:56 user nova-compute[75245]:     </video>
Nov 29 16:49:56 user nova-compute[75245]:     <rng model="virtio">
Nov 29 16:49:56 user nova-compute[75245]:       <backend model="random">/dev/urandom</backend>
Nov 29 16:49:56 user nova-compute[75245]:     </rng>
Nov 29 16:49:56 user nova-compute[75245]:     <controller type="usb" index="0" model="none"/>
Nov 29 16:49:56 user nova-compute[75245]:     <memballoon model="virtio">
Nov 29 16:49:56 user nova-compute[75245]:       <stats period="10"/>
Nov 29 16:49:56 user nova-compute[75245]:     </memballoon>
Nov 29 16:49:56 user nova-compute[75245]:   </devices>
Nov 29 16:49:56 user nova-compute[75245]: </domain>
Nov 29 16:49:56 user nova-compute[75245]:  {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 16:49:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:49:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1519020680',display_name='tempest-AttachVolumeNegativeTest-server-1519020680',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1519020680',id=42,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCy5fpeG5p0olDyutsXx3FoPQoXSTWYLYAm1DAhocFyIVaYrpUWHMYuivi6WZweFTIOgMQueUyMronz2lA/VbcTqekWYgJ2WOGME+S9d6Boy/VclREVXvVQDViK6Wu97tA==',key_name='tempest-keypair-395098351',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='01e269dbe30d46ccb81d58e2590004db',ramdisk_id='',reservation_id='r-e99av8ms',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-44169219',owner_user_name='tempest-AttachVolumeNegativeTest-44169219-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:49:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb4c94298bf14753bb9530633e766dee',uuid=24999298-349a-4837-ba75-22192166c5a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01bba9cb-1eaf-4586-9abd-9a2b24a49a95", "address": "fa:16:3e:fb:17:6c", "network": {"id": "55744af1-3291-4de1-9bf4-554f9ee4f057", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1570836437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01e269dbe30d46ccb81d58e2590004db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01bba9cb-1e", "ovs_interfaceid": "01bba9cb-1eaf-4586-9abd-9a2b24a49a95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 16:49:56 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Converting VIF {"id": "01bba9cb-1eaf-4586-9abd-9a2b24a49a95", "address": "fa:16:3e:fb:17:6c", "network": {"id": "55744af1-3291-4de1-9bf4-554f9ee4f057", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1570836437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01e269dbe30d46ccb81d58e2590004db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01bba9cb-1e", "ovs_interfaceid": "01bba9cb-1eaf-4586-9abd-9a2b24a49a95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:49:56 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:17:6c,bridge_name='br-int',has_traffic_filtering=True,id=01bba9cb-1eaf-4586-9abd-9a2b24a49a95,network=Network(55744af1-3291-4de1-9bf4-554f9ee4f057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01bba9cb-1e') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:49:56 user nova-compute[75245]: DEBUG os_vif [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:17:6c,bridge_name='br-int',has_traffic_filtering=True,id=01bba9cb-1eaf-4586-9abd-9a2b24a49a95,network=Network(55744af1-3291-4de1-9bf4-554f9ee4f057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01bba9cb-1e') {{(pid=75245) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 16:49:56 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:49:56 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:49:56 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 16:49:56 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:49:56 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '159d5c0e-d8c6-50e5-b336-8a8a43c303db', '_type': 'linux-noop'}}, row=False) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:49:56 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:49:56 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:49:56 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:49:56 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap01bba9cb-1e, may_exist=True, interface_attrs={}) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:49:56 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap01bba9cb-1e, col_values=(('qos', UUID('72d6d4d4-7f30-4bc3-ac10-a4eb8d7fb6cf')),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:49:56 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap01bba9cb-1e, col_values=(('external_ids', {'iface-id': '01bba9cb-1eaf-4586-9abd-9a2b24a49a95', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:17:6c', 'vm-uuid': '24999298-349a-4837-ba75-22192166c5a1'}),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:49:56 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:49:56 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:49:56 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:49:56 user nova-compute[75245]: INFO os_vif [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:17:6c,bridge_name='br-int',has_traffic_filtering=True,id=01bba9cb-1eaf-4586-9abd-9a2b24a49a95,network=Network(55744af1-3291-4de1-9bf4-554f9ee4f057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01bba9cb-1e')
Nov 29 16:49:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:49:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] No VIF found with MAC fa:16:3e:fb:17:6c, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:49:57 user nova-compute[75245]: DEBUG nova.network.neutron [req-92a9ce1e-c7f1-4158-b75d-7e073eacb782 req-f574284f-1ac8-41f5-acb2-c9b7c3cdb292 service nova] [instance: 24999298-349a-4837-ba75-22192166c5a1] Updated VIF entry in instance network info cache for port 01bba9cb-1eaf-4586-9abd-9a2b24a49a95. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:49:57 user nova-compute[75245]: DEBUG nova.network.neutron [req-92a9ce1e-c7f1-4158-b75d-7e073eacb782 req-f574284f-1ac8-41f5-acb2-c9b7c3cdb292 service nova] [instance: 24999298-349a-4837-ba75-22192166c5a1] Updating instance_info_cache with network_info: [{"id": "01bba9cb-1eaf-4586-9abd-9a2b24a49a95", "address": "fa:16:3e:fb:17:6c", "network": {"id": "55744af1-3291-4de1-9bf4-554f9ee4f057", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1570836437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01e269dbe30d46ccb81d58e2590004db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01bba9cb-1e", "ovs_interfaceid": "01bba9cb-1eaf-4586-9abd-9a2b24a49a95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:49:57 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-92a9ce1e-c7f1-4158-b75d-7e073eacb782 req-f574284f-1ac8-41f5-acb2-c9b7c3cdb292 service nova] Releasing lock "refresh_cache-24999298-349a-4837-ba75-22192166c5a1" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:49:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:49:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:49:58 user nova-compute[75245]: DEBUG nova.compute.manager [req-8180ee85-353b-42c8-adcf-5699588f4c72 req-2c754bf4-ffff-4823-9889-23838dcb00c2 service nova] [instance: 24999298-349a-4837-ba75-22192166c5a1] Received event network-vif-plugged-01bba9cb-1eaf-4586-9abd-9a2b24a49a95 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:49:58 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-8180ee85-353b-42c8-adcf-5699588f4c72 req-2c754bf4-ffff-4823-9889-23838dcb00c2 service nova] Acquiring lock "24999298-349a-4837-ba75-22192166c5a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:49:58 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-8180ee85-353b-42c8-adcf-5699588f4c72 req-2c754bf4-ffff-4823-9889-23838dcb00c2 service nova] Lock "24999298-349a-4837-ba75-22192166c5a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:49:58 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-8180ee85-353b-42c8-adcf-5699588f4c72 req-2c754bf4-ffff-4823-9889-23838dcb00c2 service nova] Lock "24999298-349a-4837-ba75-22192166c5a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:49:58 user nova-compute[75245]: DEBUG nova.compute.manager [req-8180ee85-353b-42c8-adcf-5699588f4c72 req-2c754bf4-ffff-4823-9889-23838dcb00c2 service nova] [instance: 24999298-349a-4837-ba75-22192166c5a1] No waiting events found dispatching network-vif-plugged-01bba9cb-1eaf-4586-9abd-9a2b24a49a95 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:49:58 user nova-compute[75245]: WARNING nova.compute.manager [req-8180ee85-353b-42c8-adcf-5699588f4c72 req-2c754bf4-ffff-4823-9889-23838dcb00c2 service nova] [instance: 24999298-349a-4837-ba75-22192166c5a1] Received unexpected event network-vif-plugged-01bba9cb-1eaf-4586-9abd-9a2b24a49a95 for instance with vm_state building and task_state spawning.
Nov 29 16:49:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:49:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:49:58 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-6d2207c8-27cf-4c26-b393-9b592b6c3cd0 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 25a0a73c-ed89-4530-aabb-a6a85e030482 is timed out.
Nov 29 16:49:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:49:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:49:58 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-6d2207c8-27cf-4c26-b393-9b592b6c3cd0 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Successfully detached device vdb from instance 25a0a73c-ed89-4530-aabb-a6a85e030482 from the live domain config.
Nov 29 16:49:58 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d2207c8-27cf-4c26-b393-9b592b6c3cd0 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] calling os-brick to detach iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 16:49:58 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2207c8-27cf-4c26-b393-9b592b6c3cd0 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, {'target_iqn': 'iqn.2010-10.org.openstack:2a9e65a1-3e5c-45d0-b332-ee090fffbee4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LjlAgCOi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:49:58 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-6d2207c8-27cf-4c26-b393-9b592b6c3cd0 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:49:58 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-6d2207c8-27cf-4c26-b393-9b592b6c3cd0 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:49:58 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-6d2207c8-27cf-4c26-b393-9b592b6c3cd0 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:49:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:49:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:49:58 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee83ecd-56a2-4339-8fee-f358e2d3e7ba]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2a9e65a1-3e5c-45d0-b332-ee090fffbee4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:49:58 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2207c8-27cf-4c26-b393-9b592b6c3cd0 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 16:49:58 user nova-compute[75245]: No targets found.
Nov 29 16:49:58 user nova-compute[75245]: iSNS:
Nov 29 16:49:58 user nova-compute[75245]: No targets found.
Nov 29 16:49:58 user nova-compute[75245]: STATIC:
Nov 29 16:49:58 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:2a9e65a1-3e5c-45d0-b332-ee090fffbee4
Nov 29 16:49:58 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:49:58 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:49:58 user nova-compute[75245]: FIRMWARE:
Nov 29 16:49:58 user nova-compute[75245]: No targets found.
Nov 29 16:49:58 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:49:58 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2207c8-27cf-4c26-b393-9b592b6c3cd0 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 16:49:58 user nova-compute[75245]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 16:49:58 user nova-compute[75245]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75245) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 16:49:58 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2207c8-27cf-4c26-b393-9b592b6c3cd0 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a9e65a1-3e5c-45d0-b332-ee090fffbee4', 0)] {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 16:49:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:49:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:49:58 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[b23d7057-2048-4200-b93c-150447e77625]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a9e65a1-3e5c-45d0-b332-ee090fffbee4\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:49:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:49:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:49:58 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[37071fa4-07c3-45f6-bd15-001568477990]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a9e65a1-3e5c-45d0-b332-ee090fffbee4 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:49:58 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2207c8-27cf-4c26-b393-9b592b6c3cd0 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a9e65a1-3e5c-45d0-b332-ee090fffbee4 (non-flash)
Nov 29 16:49:58 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:49:58 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2207c8-27cf-4c26-b393-9b592b6c3cd0 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a9e65a1-3e5c-45d0-b332-ee090fffbee4 (non-flash)
Nov 29 16:49:58 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:49:58 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2207c8-27cf-4c26-b393-9b592b6c3cd0 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0d441c08b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a9e65a1-3e5c-45d0-b332-ee090fffbee4'): ({'sdb'}, set())}) {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 16:49:58 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-6d2207c8-27cf-4c26-b393-9b592b6c3cd0 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Removing single pathed devices sdb {{(pid=75245) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 16:49:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:49:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:49:58 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7d395b-be92-421b-8bd6-23213ffcfe3e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:49:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:49:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:49:58 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[23295d00-c26e-4d5f-b4fc-91b646f89f6c]: (4, ('ok\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:49:58 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-6d2207c8-27cf-4c26-b393-9b592b6c3cd0 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Flushing IO for device /dev/sdb {{(pid=75245) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 16:49:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:49:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:49:58 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2865b85-84bd-4935-a1fe-389db23e495e]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:49:58 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-6d2207c8-27cf-4c26-b393-9b592b6c3cd0 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75245) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 16:49:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:49:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:49:58 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1bdd4e2-24ae-41fd-ac2f-5567323a9106]: (4, ('1', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:49:58 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-6d2207c8-27cf-4c26-b393-9b592b6c3cd0 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 16:49:58 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-6d2207c8-27cf-4c26-b393-9b592b6c3cd0 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] SCSI volumes sdb have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 16:49:58 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2207c8-27cf-4c26-b393-9b592b6c3cd0 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a9e65a1-3e5c-45d0-b332-ee090fffbee4')] {{(pid=75245) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 16:49:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a9e65a1-3e5c-45d0-b332-ee090fffbee4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:49:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a9e65a1-3e5c-45d0-b332-ee090fffbee4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:49:58 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d9e4ba-a2fa-4ca8-b344-8f66e4b21ef4]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:49:58 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2207c8-27cf-4c26-b393-9b592b6c3cd0 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:49:58 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a9e65a1-3e5c-45d0-b332-ee090fffbee4 -p 172.16.0.220:3260 --logout {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:49:59 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a9e65a1-3e5c-45d0-b332-ee090fffbee4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:49:59 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c3af004-269a-4fce-add6-e133960ab5e3]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:2a9e65a1-3e5c-45d0-b332-ee090fffbee4, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:2a9e65a1-3e5c-45d0-b332-ee090fffbee4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:49:59 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2207c8-27cf-4c26-b393-9b592b6c3cd0 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:2a9e65a1-3e5c-45d0-b332-ee090fffbee4, portal: 172.16.0.220,3260]
Nov 29 16:49:59 user nova-compute[75245]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:2a9e65a1-3e5c-45d0-b332-ee090fffbee4, portal: 172.16.0.220,3260] successful.
Nov 29 16:49:59 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:49:59 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a9e65a1-3e5c-45d0-b332-ee090fffbee4 -p 172.16.0.220:3260 --op delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:49:59 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a9e65a1-3e5c-45d0-b332-ee090fffbee4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:49:59 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[65068b40-eef6-415c-ae4e-19581ab4a30c]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:49:59 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2207c8-27cf-4c26-b393-9b592b6c3cd0 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:49:59 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-6d2207c8-27cf-4c26-b393-9b592b6c3cd0 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:49:59 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2207c8-27cf-4c26-b393-9b592b6c3cd0 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] <== disconnect_volume: return (278ms) None {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:49:59 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d2207c8-27cf-4c26-b393-9b592b6c3cd0 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Disconnected iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 16:49:59 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:49:59 user nova-compute[75245]: DEBUG nova.objects.instance [None req-6d2207c8-27cf-4c26-b393-9b592b6c3cd0 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Lazy-loading 'flavor' on Instance uuid 25a0a73c-ed89-4530-aabb-a6a85e030482 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:49:59 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-6d2207c8-27cf-4c26-b393-9b592b6c3cd0 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Lock "25a0a73c-ed89-4530-aabb-a6a85e030482" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.660s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:50:00 user nova-compute[75245]: DEBUG nova.compute.manager [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: 24999298-349a-4837-ba75-22192166c5a1] Instance event wait completed in 0 seconds for  {{(pid=75245) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 16:50:00 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: 24999298-349a-4837-ba75-22192166c5a1] Guest created on hypervisor {{(pid=75245) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 16:50:00 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 24999298-349a-4837-ba75-22192166c5a1] Instance spawned successfully.
Nov 29 16:50:00 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: 24999298-349a-4837-ba75-22192166c5a1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 16:50:00 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: 24999298-349a-4837-ba75-22192166c5a1] Found default for hw_cdrom_bus of ide {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:50:00 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: 24999298-349a-4837-ba75-22192166c5a1] Found default for hw_disk_bus of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:50:00 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: 24999298-349a-4837-ba75-22192166c5a1] Found default for hw_input_bus of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:50:00 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: 24999298-349a-4837-ba75-22192166c5a1] Found default for hw_pointer_model of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:50:00 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: 24999298-349a-4837-ba75-22192166c5a1] Found default for hw_video_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:50:00 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: 24999298-349a-4837-ba75-22192166c5a1] Found default for hw_vif_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:50:00 user nova-compute[75245]: DEBUG nova.compute.manager [req-6e678667-6745-4173-bde8-111dcbef136b req-ff3a92cc-94eb-4da7-8067-80faefdd60d2 service nova] [instance: 24999298-349a-4837-ba75-22192166c5a1] Received event network-vif-plugged-01bba9cb-1eaf-4586-9abd-9a2b24a49a95 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:50:00 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-6e678667-6745-4173-bde8-111dcbef136b req-ff3a92cc-94eb-4da7-8067-80faefdd60d2 service nova] Acquiring lock "24999298-349a-4837-ba75-22192166c5a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:50:00 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-6e678667-6745-4173-bde8-111dcbef136b req-ff3a92cc-94eb-4da7-8067-80faefdd60d2 service nova] Lock "24999298-349a-4837-ba75-22192166c5a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:50:00 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-6e678667-6745-4173-bde8-111dcbef136b req-ff3a92cc-94eb-4da7-8067-80faefdd60d2 service nova] Lock "24999298-349a-4837-ba75-22192166c5a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:50:00 user nova-compute[75245]: DEBUG nova.compute.manager [req-6e678667-6745-4173-bde8-111dcbef136b req-ff3a92cc-94eb-4da7-8067-80faefdd60d2 service nova] [instance: 24999298-349a-4837-ba75-22192166c5a1] No waiting events found dispatching network-vif-plugged-01bba9cb-1eaf-4586-9abd-9a2b24a49a95 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:50:00 user nova-compute[75245]: WARNING nova.compute.manager [req-6e678667-6745-4173-bde8-111dcbef136b req-ff3a92cc-94eb-4da7-8067-80faefdd60d2 service nova] [instance: 24999298-349a-4837-ba75-22192166c5a1] Received unexpected event network-vif-plugged-01bba9cb-1eaf-4586-9abd-9a2b24a49a95 for instance with vm_state building and task_state spawning.
Nov 29 16:50:00 user nova-compute[75245]: INFO nova.compute.manager [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: 24999298-349a-4837-ba75-22192166c5a1] Took 5.07 seconds to spawn the instance on the hypervisor.
Nov 29 16:50:00 user nova-compute[75245]: DEBUG nova.compute.manager [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: 24999298-349a-4837-ba75-22192166c5a1] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:50:00 user nova-compute[75245]: INFO nova.compute.manager [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: 24999298-349a-4837-ba75-22192166c5a1] Took 5.70 seconds to build instance.
Nov 29 16:50:00 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-ffe4cc55-062e-43c2-97ab-ff1c45eb733e tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "24999298-349a-4837-ba75-22192166c5a1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.790s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:50:01 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:50:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:50:05 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-6f8eabca-8131-4109-9ae2-b11d310a4187 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Acquiring lock "7b03f1f3-2061-4962-ba07-3a4f9da2ea90" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:50:05 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-6f8eabca-8131-4109-9ae2-b11d310a4187 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lock "7b03f1f3-2061-4962-ba07-3a4f9da2ea90" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:50:05 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-6f8eabca-8131-4109-9ae2-b11d310a4187 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Acquiring lock "7b03f1f3-2061-4962-ba07-3a4f9da2ea90-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:50:05 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-6f8eabca-8131-4109-9ae2-b11d310a4187 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lock "7b03f1f3-2061-4962-ba07-3a4f9da2ea90-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:50:05 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-6f8eabca-8131-4109-9ae2-b11d310a4187 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lock "7b03f1f3-2061-4962-ba07-3a4f9da2ea90-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:50:05 user nova-compute[75245]: INFO nova.compute.manager [None req-6f8eabca-8131-4109-9ae2-b11d310a4187 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Terminating instance
Nov 29 16:50:05 user nova-compute[75245]: DEBUG nova.compute.manager [None req-6f8eabca-8131-4109-9ae2-b11d310a4187 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Start destroying the instance on the hypervisor. {{(pid=75245) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 16:50:05 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:50:05 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:50:05 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:50:05 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:50:05 user nova-compute[75245]: DEBUG nova.compute.manager [req-59b13e27-f6c4-4172-9a97-0c4aeea05989 req-e871e49c-c468-46c3-9d02-344428b06629 service nova] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Received event network-vif-unplugged-0599b1d1-85cd-4003-9d3d-c343f09a5b2b {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:50:05 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-59b13e27-f6c4-4172-9a97-0c4aeea05989 req-e871e49c-c468-46c3-9d02-344428b06629 service nova] Acquiring lock "7b03f1f3-2061-4962-ba07-3a4f9da2ea90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:50:05 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-59b13e27-f6c4-4172-9a97-0c4aeea05989 req-e871e49c-c468-46c3-9d02-344428b06629 service nova] Lock "7b03f1f3-2061-4962-ba07-3a4f9da2ea90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:50:05 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-59b13e27-f6c4-4172-9a97-0c4aeea05989 req-e871e49c-c468-46c3-9d02-344428b06629 service nova] Lock "7b03f1f3-2061-4962-ba07-3a4f9da2ea90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:50:05 user nova-compute[75245]: DEBUG nova.compute.manager [req-59b13e27-f6c4-4172-9a97-0c4aeea05989 req-e871e49c-c468-46c3-9d02-344428b06629 service nova] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] No waiting events found dispatching network-vif-unplugged-0599b1d1-85cd-4003-9d3d-c343f09a5b2b {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:50:05 user nova-compute[75245]: DEBUG nova.compute.manager [req-59b13e27-f6c4-4172-9a97-0c4aeea05989 req-e871e49c-c468-46c3-9d02-344428b06629 service nova] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Received event network-vif-unplugged-0599b1d1-85cd-4003-9d3d-c343f09a5b2b for instance with task_state deleting. {{(pid=75245) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 16:50:06 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:50:06 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:50:06 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:50:06 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:50:06 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Instance destroyed successfully.
Nov 29 16:50:06 user nova-compute[75245]: DEBUG nova.objects.instance [None req-6f8eabca-8131-4109-9ae2-b11d310a4187 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lazy-loading 'resources' on Instance uuid 7b03f1f3-2061-4962-ba07-3a4f9da2ea90 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:50:06 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-6f8eabca-8131-4109-9ae2-b11d310a4187 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:45:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1350917926',display_name='tempest-TestMinimumBasicScenario-server-1350917926',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1350917926',id=39,image_ref='aa336f1d-5522-4fcf-aa9f-bc3836a74f50',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHP13/JpyOWEDU+dgL481xjMctfPgIML/fqfOBy5OZ6z/LH/hCzAWTp3cxr55EL0QZxguh2kFAfXYAS8ygu5fz5rxfCAv4GQG5MpKSZCl4Mn2mxPQGCAJLRKIp/mt8ziJA==',key_name='tempest-TestMinimumBasicScenario-828675410',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:45:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ebd1ea36980641739f2bdd856a65d68a',ramdisk_id='',reservation_id='r-1rea6njd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa336f1d-5522-4fcf-aa9f-bc3836a74f50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1366540792',owner_user_name='tempest-TestMinimumBasicScenario-1366540792-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:47:26Z,user_data=None,user_id='a219fd71b6cc40d88b161ba5ba82f4a7',uuid=7b03f1f3-2061-4962-ba07-3a4f9da2ea90,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0599b1d1-85cd-4003-9d3d-c343f09a5b2b", "address": "fa:16:3e:61:06:fc", "network": {"id": "b0e81786-47f3-4a13-90c7-788cb53a4df5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1382922826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebd1ea36980641739f2bdd856a65d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0599b1d1-85", "ovs_interfaceid": "0599b1d1-85cd-4003-9d3d-c343f09a5b2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 16:50:06 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-6f8eabca-8131-4109-9ae2-b11d310a4187 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Converting VIF {"id": "0599b1d1-85cd-4003-9d3d-c343f09a5b2b", "address": "fa:16:3e:61:06:fc", "network": {"id": "b0e81786-47f3-4a13-90c7-788cb53a4df5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1382922826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebd1ea36980641739f2bdd856a65d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0599b1d1-85", "ovs_interfaceid": "0599b1d1-85cd-4003-9d3d-c343f09a5b2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:50:06 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-6f8eabca-8131-4109-9ae2-b11d310a4187 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:61:06:fc,bridge_name='br-int',has_traffic_filtering=True,id=0599b1d1-85cd-4003-9d3d-c343f09a5b2b,network=Network(b0e81786-47f3-4a13-90c7-788cb53a4df5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0599b1d1-85') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:50:06 user nova-compute[75245]: DEBUG os_vif [None req-6f8eabca-8131-4109-9ae2-b11d310a4187 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:06:fc,bridge_name='br-int',has_traffic_filtering=True,id=0599b1d1-85cd-4003-9d3d-c343f09a5b2b,network=Network(b0e81786-47f3-4a13-90c7-788cb53a4df5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0599b1d1-85') {{(pid=75245) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 16:50:06 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:50:06 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0599b1d1-85, bridge=br-int, if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:50:06 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:50:06 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:50:06 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:50:06 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1d8427be-52b2-441d-898c-2c4532e6242f) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:50:06 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:50:06 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:50:06 user nova-compute[75245]: INFO os_vif [None req-6f8eabca-8131-4109-9ae2-b11d310a4187 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:06:fc,bridge_name='br-int',has_traffic_filtering=True,id=0599b1d1-85cd-4003-9d3d-c343f09a5b2b,network=Network(b0e81786-47f3-4a13-90c7-788cb53a4df5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0599b1d1-85')
Nov 29 16:50:06 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-6f8eabca-8131-4109-9ae2-b11d310a4187 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Deleting instance files /opt/stack/data/nova/instances/7b03f1f3-2061-4962-ba07-3a4f9da2ea90_del
Nov 29 16:50:06 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-6f8eabca-8131-4109-9ae2-b11d310a4187 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Deletion of /opt/stack/data/nova/instances/7b03f1f3-2061-4962-ba07-3a4f9da2ea90_del complete
Nov 29 16:50:06 user nova-compute[75245]: INFO nova.compute.manager [None req-6f8eabca-8131-4109-9ae2-b11d310a4187 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 29 16:50:06 user nova-compute[75245]: DEBUG oslo.service.loopingcall [None req-6f8eabca-8131-4109-9ae2-b11d310a4187 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75245) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 16:50:06 user nova-compute[75245]: DEBUG nova.compute.manager [-] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Deallocating network for instance {{(pid=75245) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 16:50:06 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] deallocate_for_instance() {{(pid=75245) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 16:50:07 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:50:07 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:50:07 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:50:07 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:50:07 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:50:07 user nova-compute[75245]: INFO nova.compute.manager [-] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Took 0.72 seconds to deallocate network for instance.
Nov 29 16:50:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-6f8eabca-8131-4109-9ae2-b11d310a4187 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:50:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-6f8eabca-8131-4109-9ae2-b11d310a4187 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:50:07 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-6f8eabca-8131-4109-9ae2-b11d310a4187 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:50:07 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-6f8eabca-8131-4109-9ae2-b11d310a4187 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:50:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-6f8eabca-8131-4109-9ae2-b11d310a4187 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.176s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:50:07 user nova-compute[75245]: INFO nova.scheduler.client.report [None req-6f8eabca-8131-4109-9ae2-b11d310a4187 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Deleted allocations for instance 7b03f1f3-2061-4962-ba07-3a4f9da2ea90
Nov 29 16:50:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-6f8eabca-8131-4109-9ae2-b11d310a4187 tempest-TestMinimumBasicScenario-1366540792 tempest-TestMinimumBasicScenario-1366540792-project-member] Lock "7b03f1f3-2061-4962-ba07-3a4f9da2ea90" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.975s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:50:08 user nova-compute[75245]: DEBUG nova.compute.manager [req-ecf73ef7-bb25-4564-9582-eb1734e84e04 req-6486b1e2-8248-413d-a719-735e4c5a9d4c service nova] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Received event network-vif-plugged-0599b1d1-85cd-4003-9d3d-c343f09a5b2b {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:50:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-ecf73ef7-bb25-4564-9582-eb1734e84e04 req-6486b1e2-8248-413d-a719-735e4c5a9d4c service nova] Acquiring lock "7b03f1f3-2061-4962-ba07-3a4f9da2ea90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:50:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-ecf73ef7-bb25-4564-9582-eb1734e84e04 req-6486b1e2-8248-413d-a719-735e4c5a9d4c service nova] Lock "7b03f1f3-2061-4962-ba07-3a4f9da2ea90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:50:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-ecf73ef7-bb25-4564-9582-eb1734e84e04 req-6486b1e2-8248-413d-a719-735e4c5a9d4c service nova] Lock "7b03f1f3-2061-4962-ba07-3a4f9da2ea90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:50:08 user nova-compute[75245]: DEBUG nova.compute.manager [req-ecf73ef7-bb25-4564-9582-eb1734e84e04 req-6486b1e2-8248-413d-a719-735e4c5a9d4c service nova] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] No waiting events found dispatching network-vif-plugged-0599b1d1-85cd-4003-9d3d-c343f09a5b2b {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:50:08 user nova-compute[75245]: WARNING nova.compute.manager [req-ecf73ef7-bb25-4564-9582-eb1734e84e04 req-6486b1e2-8248-413d-a719-735e4c5a9d4c service nova] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Received unexpected event network-vif-plugged-0599b1d1-85cd-4003-9d3d-c343f09a5b2b for instance with vm_state deleted and task_state None.
Nov 29 16:50:08 user nova-compute[75245]: DEBUG nova.compute.manager [req-ecf73ef7-bb25-4564-9582-eb1734e84e04 req-6486b1e2-8248-413d-a719-735e4c5a9d4c service nova] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Received event network-vif-plugged-0599b1d1-85cd-4003-9d3d-c343f09a5b2b {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:50:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-ecf73ef7-bb25-4564-9582-eb1734e84e04 req-6486b1e2-8248-413d-a719-735e4c5a9d4c service nova] Acquiring lock "7b03f1f3-2061-4962-ba07-3a4f9da2ea90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:50:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-ecf73ef7-bb25-4564-9582-eb1734e84e04 req-6486b1e2-8248-413d-a719-735e4c5a9d4c service nova] Lock "7b03f1f3-2061-4962-ba07-3a4f9da2ea90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:50:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-ecf73ef7-bb25-4564-9582-eb1734e84e04 req-6486b1e2-8248-413d-a719-735e4c5a9d4c service nova] Lock "7b03f1f3-2061-4962-ba07-3a4f9da2ea90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:50:08 user nova-compute[75245]: DEBUG nova.compute.manager [req-ecf73ef7-bb25-4564-9582-eb1734e84e04 req-6486b1e2-8248-413d-a719-735e4c5a9d4c service nova] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] No waiting events found dispatching network-vif-plugged-0599b1d1-85cd-4003-9d3d-c343f09a5b2b {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:50:08 user nova-compute[75245]: WARNING nova.compute.manager [req-ecf73ef7-bb25-4564-9582-eb1734e84e04 req-6486b1e2-8248-413d-a719-735e4c5a9d4c service nova] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Received unexpected event network-vif-plugged-0599b1d1-85cd-4003-9d3d-c343f09a5b2b for instance with vm_state deleted and task_state None.
Nov 29 16:50:08 user nova-compute[75245]: DEBUG nova.compute.manager [req-ecf73ef7-bb25-4564-9582-eb1734e84e04 req-6486b1e2-8248-413d-a719-735e4c5a9d4c service nova] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Received event network-vif-plugged-0599b1d1-85cd-4003-9d3d-c343f09a5b2b {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:50:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-ecf73ef7-bb25-4564-9582-eb1734e84e04 req-6486b1e2-8248-413d-a719-735e4c5a9d4c service nova] Acquiring lock "7b03f1f3-2061-4962-ba07-3a4f9da2ea90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:50:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-ecf73ef7-bb25-4564-9582-eb1734e84e04 req-6486b1e2-8248-413d-a719-735e4c5a9d4c service nova] Lock "7b03f1f3-2061-4962-ba07-3a4f9da2ea90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:50:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-ecf73ef7-bb25-4564-9582-eb1734e84e04 req-6486b1e2-8248-413d-a719-735e4c5a9d4c service nova] Lock "7b03f1f3-2061-4962-ba07-3a4f9da2ea90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:50:08 user nova-compute[75245]: DEBUG nova.compute.manager [req-ecf73ef7-bb25-4564-9582-eb1734e84e04 req-6486b1e2-8248-413d-a719-735e4c5a9d4c service nova] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] No waiting events found dispatching network-vif-plugged-0599b1d1-85cd-4003-9d3d-c343f09a5b2b {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:50:08 user nova-compute[75245]: WARNING nova.compute.manager [req-ecf73ef7-bb25-4564-9582-eb1734e84e04 req-6486b1e2-8248-413d-a719-735e4c5a9d4c service nova] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Received unexpected event network-vif-plugged-0599b1d1-85cd-4003-9d3d-c343f09a5b2b for instance with vm_state deleted and task_state None.
Nov 29 16:50:08 user nova-compute[75245]: DEBUG nova.compute.manager [req-ecf73ef7-bb25-4564-9582-eb1734e84e04 req-6486b1e2-8248-413d-a719-735e4c5a9d4c service nova] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Received event network-vif-plugged-0599b1d1-85cd-4003-9d3d-c343f09a5b2b {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:50:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-ecf73ef7-bb25-4564-9582-eb1734e84e04 req-6486b1e2-8248-413d-a719-735e4c5a9d4c service nova] Acquiring lock "7b03f1f3-2061-4962-ba07-3a4f9da2ea90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:50:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-ecf73ef7-bb25-4564-9582-eb1734e84e04 req-6486b1e2-8248-413d-a719-735e4c5a9d4c service nova] Lock "7b03f1f3-2061-4962-ba07-3a4f9da2ea90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:50:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-ecf73ef7-bb25-4564-9582-eb1734e84e04 req-6486b1e2-8248-413d-a719-735e4c5a9d4c service nova] Lock "7b03f1f3-2061-4962-ba07-3a4f9da2ea90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:50:08 user nova-compute[75245]: DEBUG nova.compute.manager [req-ecf73ef7-bb25-4564-9582-eb1734e84e04 req-6486b1e2-8248-413d-a719-735e4c5a9d4c service nova] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] No waiting events found dispatching network-vif-plugged-0599b1d1-85cd-4003-9d3d-c343f09a5b2b {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:50:08 user nova-compute[75245]: WARNING nova.compute.manager [req-ecf73ef7-bb25-4564-9582-eb1734e84e04 req-6486b1e2-8248-413d-a719-735e4c5a9d4c service nova] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Received unexpected event network-vif-plugged-0599b1d1-85cd-4003-9d3d-c343f09a5b2b for instance with vm_state deleted and task_state None.
Nov 29 16:50:08 user nova-compute[75245]: DEBUG nova.compute.manager [req-ecf73ef7-bb25-4564-9582-eb1734e84e04 req-6486b1e2-8248-413d-a719-735e4c5a9d4c service nova] [instance: 7b03f1f3-2061-4962-ba07-3a4f9da2ea90] Received event network-vif-deleted-0599b1d1-85cd-4003-9d3d-c343f09a5b2b {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:50:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:50:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:50:16 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:50:19 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:50:20 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:50:20 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:50:20 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:50:20 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:50:20 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75245) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 16:50:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25a0a73c-ed89-4530-aabb-a6a85e030482/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:50:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25a0a73c-ed89-4530-aabb-a6a85e030482/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:50:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25a0a73c-ed89-4530-aabb-a6a85e030482/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:50:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25a0a73c-ed89-4530-aabb-a6a85e030482/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:50:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24999298-349a-4837-ba75-22192166c5a1/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:50:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24999298-349a-4837-ba75-22192166c5a1/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:50:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24999298-349a-4837-ba75-22192166c5a1/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:50:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24999298-349a-4837-ba75-22192166c5a1/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:50:21 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:50:21 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:50:21 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:50:21 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Hypervisor/Node resource view: name=user free_ram=8787MB free_disk=25.096454620361328GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75245) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 16:50:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:50:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:50:21 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 25a0a73c-ed89-4530-aabb-a6a85e030482 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:50:21 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 24999298-349a-4837-ba75-22192166c5a1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:50:21 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 16:50:21 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 16:50:21 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:50:21 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:50:21 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Compute_service record updated for user:user {{(pid=75245) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 16:50:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.246s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:50:23 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:50:23 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Starting heal instance info cache {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 16:50:24 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "refresh_cache-25a0a73c-ed89-4530-aabb-a6a85e030482" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:50:24 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquired lock "refresh_cache-25a0a73c-ed89-4530-aabb-a6a85e030482" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:50:24 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Forcefully refreshing network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 16:50:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:50:24 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Updating instance_info_cache with network_info: [{"id": "8f62d901-5ef0-4879-9f19-8a51f55fde1f", "address": "fa:16:3e:8b:42:60", "network": {"id": "2eac25a6-c643-4348-98eb-91d044f1714c", "bridge": "br-int", "label": "tempest-TestStampPattern-1438802163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d056f7dae1d94936bd1fed295f0eba16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f62d901-5e", "ovs_interfaceid": "8f62d901-5ef0-4879-9f19-8a51f55fde1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:50:24 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Releasing lock "refresh_cache-25a0a73c-ed89-4530-aabb-a6a85e030482" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:50:24 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Updated the network info_cache for instance {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 16:50:24 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:50:26 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:50:27 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:50:29 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:50:29 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:50:31 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:50:32 user nova-compute[75245]: DEBUG nova.compute.manager [None req-83eea4cd-25da-4bdb-b449-0ce78005367c tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:50:32 user nova-compute[75245]: INFO nova.compute.manager [None req-83eea4cd-25da-4bdb-b449-0ce78005367c tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] instance snapshotting
Nov 29 16:50:32 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-83eea4cd-25da-4bdb-b449-0ce78005367c tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Beginning live snapshot process
Nov 29 16:50:32 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-83eea4cd-25da-4bdb-b449-0ce78005367c tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25a0a73c-ed89-4530-aabb-a6a85e030482/disk --force-share --output=json -f qcow2 {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:50:33 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-83eea4cd-25da-4bdb-b449-0ce78005367c tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25a0a73c-ed89-4530-aabb-a6a85e030482/disk --force-share --output=json -f qcow2" returned: 0 in 0.182s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:50:33 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-83eea4cd-25da-4bdb-b449-0ce78005367c tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25a0a73c-ed89-4530-aabb-a6a85e030482/disk --force-share --output=json -f qcow2 {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:50:33 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-83eea4cd-25da-4bdb-b449-0ce78005367c tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25a0a73c-ed89-4530-aabb-a6a85e030482/disk --force-share --output=json -f qcow2" returned: 0 in 0.173s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:50:33 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-83eea4cd-25da-4bdb-b449-0ce78005367c tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:50:33 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-83eea4cd-25da-4bdb-b449-0ce78005367c tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.171s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:50:33 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-83eea4cd-25da-4bdb-b449-0ce78005367c tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp5_ys2tea/e2628c131bf44a718e09a1484ed26b3f.delta 1073741824 {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:50:33 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-83eea4cd-25da-4bdb-b449-0ce78005367c tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp5_ys2tea/e2628c131bf44a718e09a1484ed26b3f.delta 1073741824" returned: 0 in 0.052s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:50:33 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-83eea4cd-25da-4bdb-b449-0ce78005367c tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 29 16:50:34 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-83eea4cd-25da-4bdb-b449-0ce78005367c tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75245) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 16:50:34 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:50:34 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-83eea4cd-25da-4bdb-b449-0ce78005367c tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75245) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 16:50:34 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-83eea4cd-25da-4bdb-b449-0ce78005367c tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 29 16:50:34 user nova-compute[75245]: DEBUG nova.privsep.utils [None req-83eea4cd-25da-4bdb-b449-0ce78005367c tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75245) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 16:50:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-83eea4cd-25da-4bdb-b449-0ce78005367c tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp5_ys2tea/e2628c131bf44a718e09a1484ed26b3f.delta /opt/stack/data/nova/instances/snapshots/tmp5_ys2tea/e2628c131bf44a718e09a1484ed26b3f {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:50:35 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-83eea4cd-25da-4bdb-b449-0ce78005367c tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp5_ys2tea/e2628c131bf44a718e09a1484ed26b3f.delta /opt/stack/data/nova/instances/snapshots/tmp5_ys2tea/e2628c131bf44a718e09a1484ed26b3f" returned: 0 in 0.312s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:50:35 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-83eea4cd-25da-4bdb-b449-0ce78005367c tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Snapshot extracted, beginning image upload
Nov 29 16:50:35 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:50:35 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75245) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 16:50:36 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:50:36 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:50:37 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-83eea4cd-25da-4bdb-b449-0ce78005367c tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Snapshot image upload complete
Nov 29 16:50:37 user nova-compute[75245]: INFO nova.compute.manager [None req-83eea4cd-25da-4bdb-b449-0ce78005367c tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Took 5.07 seconds to snapshot the instance on the hypervisor.
Nov 29 16:50:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Acquiring lock "fcbd317f-c56f-4b4b-8572-c112f778410d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:50:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Lock "fcbd317f-c56f-4b4b-8572-c112f778410d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:50:39 user nova-compute[75245]: DEBUG nova.compute.manager [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: fcbd317f-c56f-4b4b-8572-c112f778410d] Starting instance... {{(pid=75245) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 16:50:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:50:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:50:39 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75245) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 16:50:39 user nova-compute[75245]: INFO nova.compute.claims [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: fcbd317f-c56f-4b4b-8572-c112f778410d] Claim successful on node user
Nov 29 16:50:39 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:50:39 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:50:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.264s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:50:39 user nova-compute[75245]: DEBUG nova.compute.manager [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: fcbd317f-c56f-4b4b-8572-c112f778410d] Start building networks asynchronously for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 16:50:39 user nova-compute[75245]: DEBUG nova.compute.manager [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: fcbd317f-c56f-4b4b-8572-c112f778410d] Allocating IP information in the background. {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 16:50:39 user nova-compute[75245]: DEBUG nova.network.neutron [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: fcbd317f-c56f-4b4b-8572-c112f778410d] allocate_for_instance() {{(pid=75245) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 16:50:39 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: fcbd317f-c56f-4b4b-8572-c112f778410d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 16:50:39 user nova-compute[75245]: DEBUG nova.compute.manager [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: fcbd317f-c56f-4b4b-8572-c112f778410d] Start building block device mappings for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 16:50:39 user nova-compute[75245]: DEBUG nova.policy [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0acde563960c46268a890ac370800146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd056f7dae1d94936bd1fed295f0eba16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75245) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 16:50:39 user nova-compute[75245]: DEBUG nova.compute.manager [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: fcbd317f-c56f-4b4b-8572-c112f778410d] Start spawning the instance on the hypervisor. {{(pid=75245) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 16:50:39 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: fcbd317f-c56f-4b4b-8572-c112f778410d] Creating instance directory {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 16:50:39 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: fcbd317f-c56f-4b4b-8572-c112f778410d] Creating image(s)
Nov 29 16:50:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Acquiring lock "/opt/stack/data/nova/instances/fcbd317f-c56f-4b4b-8572-c112f778410d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:50:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Lock "/opt/stack/data/nova/instances/fcbd317f-c56f-4b4b-8572-c112f778410d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:50:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Lock "/opt/stack/data/nova/instances/fcbd317f-c56f-4b4b-8572-c112f778410d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:50:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Acquiring lock "34e8741313b6d8a4f5704a5a46586cc7fc6f1267" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:50:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Lock "34e8741313b6d8a4f5704a5a46586cc7fc6f1267" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:50:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34e8741313b6d8a4f5704a5a46586cc7fc6f1267.part --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:50:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34e8741313b6d8a4f5704a5a46586cc7fc6f1267.part --force-share --output=json" returned: 0 in 0.188s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:50:40 user nova-compute[75245]: DEBUG nova.virt.images [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] 5edd3565-468b-4ff8-b9b4-2eba8d411b64 was qcow2, converting to raw {{(pid=75245) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 16:50:40 user nova-compute[75245]: DEBUG nova.privsep.utils [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75245) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 16:50:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/34e8741313b6d8a4f5704a5a46586cc7fc6f1267.part /opt/stack/data/nova/instances/_base/34e8741313b6d8a4f5704a5a46586cc7fc6f1267.converted {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:50:40 user nova-compute[75245]: DEBUG nova.network.neutron [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: fcbd317f-c56f-4b4b-8572-c112f778410d] Successfully created port: 28570b91-bccd-4af6-8a83-680316f91520 {{(pid=75245) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 16:50:41 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/34e8741313b6d8a4f5704a5a46586cc7fc6f1267.part /opt/stack/data/nova/instances/_base/34e8741313b6d8a4f5704a5a46586cc7fc6f1267.converted" returned: 0 in 0.255s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:50:41 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34e8741313b6d8a4f5704a5a46586cc7fc6f1267.converted --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:50:41 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34e8741313b6d8a4f5704a5a46586cc7fc6f1267.converted --force-share --output=json" returned: 0 in 0.180s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:50:41 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Lock "34e8741313b6d8a4f5704a5a46586cc7fc6f1267" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.371s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:50:41 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34e8741313b6d8a4f5704a5a46586cc7fc6f1267 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:50:41 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34e8741313b6d8a4f5704a5a46586cc7fc6f1267 --force-share --output=json" returned: 0 in 0.178s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:50:41 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Acquiring lock "34e8741313b6d8a4f5704a5a46586cc7fc6f1267" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:50:41 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Lock "34e8741313b6d8a4f5704a5a46586cc7fc6f1267" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:50:41 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34e8741313b6d8a4f5704a5a46586cc7fc6f1267 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:50:41 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:50:41 user nova-compute[75245]: DEBUG nova.network.neutron [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: fcbd317f-c56f-4b4b-8572-c112f778410d] Successfully updated port: 28570b91-bccd-4af6-8a83-680316f91520 {{(pid=75245) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 16:50:41 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Acquiring lock "refresh_cache-fcbd317f-c56f-4b4b-8572-c112f778410d" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:50:41 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Acquired lock "refresh_cache-fcbd317f-c56f-4b4b-8572-c112f778410d" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:50:41 user nova-compute[75245]: DEBUG nova.network.neutron [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: fcbd317f-c56f-4b4b-8572-c112f778410d] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 16:50:41 user nova-compute[75245]: DEBUG nova.compute.manager [req-d5bd8c8b-2ea7-48fa-91d8-d0f137972cd2 req-ad6b539c-1b3d-4103-8e38-b12fd385d7b5 service nova] [instance: fcbd317f-c56f-4b4b-8572-c112f778410d] Received event network-changed-28570b91-bccd-4af6-8a83-680316f91520 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:50:41 user nova-compute[75245]: DEBUG nova.compute.manager [req-d5bd8c8b-2ea7-48fa-91d8-d0f137972cd2 req-ad6b539c-1b3d-4103-8e38-b12fd385d7b5 service nova] [instance: fcbd317f-c56f-4b4b-8572-c112f778410d] Refreshing instance network info cache due to event network-changed-28570b91-bccd-4af6-8a83-680316f91520. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:50:41 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d5bd8c8b-2ea7-48fa-91d8-d0f137972cd2 req-ad6b539c-1b3d-4103-8e38-b12fd385d7b5 service nova] Acquiring lock "refresh_cache-fcbd317f-c56f-4b4b-8572-c112f778410d" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:50:41 user nova-compute[75245]: DEBUG nova.network.neutron [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: fcbd317f-c56f-4b4b-8572-c112f778410d] Instance cache missing network info. {{(pid=75245) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 16:50:41 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34e8741313b6d8a4f5704a5a46586cc7fc6f1267 --force-share --output=json" returned: 0 in 0.185s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:50:41 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/34e8741313b6d8a4f5704a5a46586cc7fc6f1267,backing_fmt=raw /opt/stack/data/nova/instances/fcbd317f-c56f-4b4b-8572-c112f778410d/disk 1073741824 {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:50:41 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/34e8741313b6d8a4f5704a5a46586cc7fc6f1267,backing_fmt=raw /opt/stack/data/nova/instances/fcbd317f-c56f-4b4b-8572-c112f778410d/disk 1073741824" returned: 0 in 0.048s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:50:41 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Lock "34e8741313b6d8a4f5704a5a46586cc7fc6f1267" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:50:41 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34e8741313b6d8a4f5704a5a46586cc7fc6f1267 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:50:41 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:50:41 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34e8741313b6d8a4f5704a5a46586cc7fc6f1267 --force-share --output=json" returned: 0 in 0.182s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:50:41 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: fcbd317f-c56f-4b4b-8572-c112f778410d] Created local disks {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 16:50:41 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: fcbd317f-c56f-4b4b-8572-c112f778410d] Ensure instance console log exists: /opt/stack/data/nova/instances/fcbd317f-c56f-4b4b-8572-c112f778410d/console.log {{(pid=75245) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 16:50:41 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:50:41 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:50:41 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:50:41 user nova-compute[75245]: DEBUG nova.network.neutron [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: fcbd317f-c56f-4b4b-8572-c112f778410d] Updating instance_info_cache with network_info: [{"id": "28570b91-bccd-4af6-8a83-680316f91520", "address": "fa:16:3e:22:83:df", "network": {"id": "2eac25a6-c643-4348-98eb-91d044f1714c", "bridge": "br-int", "label": "tempest-TestStampPattern-1438802163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d056f7dae1d94936bd1fed295f0eba16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28570b91-bc", "ovs_interfaceid": "28570b91-bccd-4af6-8a83-680316f91520", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:50:41 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Releasing lock "refresh_cache-fcbd317f-c56f-4b4b-8572-c112f778410d" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:50:41 user nova-compute[75245]: DEBUG nova.compute.manager [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: fcbd317f-c56f-4b4b-8572-c112f778410d] Instance network_info: |[{"id": "28570b91-bccd-4af6-8a83-680316f91520", "address": "fa:16:3e:22:83:df", "network": {"id": "2eac25a6-c643-4348-98eb-91d044f1714c", "bridge": "br-int", "label": "tempest-TestStampPattern-1438802163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d056f7dae1d94936bd1fed295f0eba16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28570b91-bc", "ovs_interfaceid": "28570b91-bccd-4af6-8a83-680316f91520", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 16:50:41 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d5bd8c8b-2ea7-48fa-91d8-d0f137972cd2 req-ad6b539c-1b3d-4103-8e38-b12fd385d7b5 service nova] Acquired lock "refresh_cache-fcbd317f-c56f-4b4b-8572-c112f778410d" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:50:41 user nova-compute[75245]: DEBUG nova.network.neutron [req-d5bd8c8b-2ea7-48fa-91d8-d0f137972cd2 req-ad6b539c-1b3d-4103-8e38-b12fd385d7b5 service nova] [instance: fcbd317f-c56f-4b4b-8572-c112f778410d] Refreshing network info cache for port 28570b91-bccd-4af6-8a83-680316f91520 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:50:41 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: fcbd317f-c56f-4b4b-8572-c112f778410d] Start _get_guest_xml network_info=[{"id": "28570b91-bccd-4af6-8a83-680316f91520", "address": "fa:16:3e:22:83:df", "network": {"id": "2eac25a6-c643-4348-98eb-91d044f1714c", "bridge": "br-int", "label": "tempest-TestStampPattern-1438802163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d056f7dae1d94936bd1fed295f0eba16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28570b91-bc", "ovs_interfaceid": "28570b91-bccd-4af6-8a83-680316f91520", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='07c05fa9c76c4b0c22c51ce6020dee52',container_format='bare',created_at=2023-11-29T16:50:32Z,direct_url=<?>,disk_format='qcow2',id=5edd3565-468b-4ff8-b9b4-2eba8d411b64,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1554925568',owner='d056f7dae1d94936bd1fed295f0eba16',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-29T16:50:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '5edd3565-468b-4ff8-b9b4-2eba8d411b64'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 16:50:41 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:50:41 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:50:41 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 16:50:41 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] CPU controller missing on host. {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 16:50:41 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 16:50:41 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] CPU controller found on host. {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 16:50:41 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75245) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 16:50:41 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T16:06:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='07c05fa9c76c4b0c22c51ce6020dee52',container_format='bare',created_at=2023-11-29T16:50:32Z,direct_url=<?>,disk_format='qcow2',id=5edd3565-468b-4ff8-b9b4-2eba8d411b64,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1554925568',owner='d056f7dae1d94936bd1fed295f0eba16',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-29T16:50:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 16:50:41 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Flavor limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 16:50:41 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Image limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 16:50:41 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Flavor pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 16:50:41 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Image pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 16:50:41 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 16:50:41 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 16:50:41 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 16:50:41 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Got 1 possible topologies {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 16:50:41 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 16:50:41 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 16:50:42 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:50:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1616863509',display_name='tempest-TestStampPattern-server-1616863509',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1616863509',id=43,image_ref='5edd3565-468b-4ff8-b9b4-2eba8d411b64',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImoWxFDnu4c8KDr10Q6Ubx68e8gn5RNIGqBgLtWDemy3wpgxbiBAYLS+wfSKYPtQ2DWWp70/Ts0kN1P7Ewenibb2M76FreHbG7l7wWc3VZE00W0BrocAjgoRPqW16wYoQ==',key_name='tempest-TestStampPattern-428472352',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d056f7dae1d94936bd1fed295f0eba16',ramdisk_id='',reservation_id='r-f99kh067',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='25a0a73c-ed89-4530-aabb-a6a85e030482',image_min_disk='1',image_min_ram='0',image_owner_id='d056f7dae1d94936bd1fed295f0eba16',image_owner_project_name='tempest-TestStampPattern-1627008304',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1627008304-project-member',image_user_id='0acde563960c46268a890ac370800146',network_allocated='True',owner_project_name='tempest-TestStampPattern-1627008304',owner_user_name='tempest-TestStampPattern-1627008304-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:50:40Z,user_data=None,user_id='0acde563960c46268a890ac370800146',uuid=fcbd317f-c56f-4b4b-8572-c112f778410d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28570b91-bccd-4af6-8a83-680316f91520", "address": "fa:16:3e:22:83:df", "network": {"id": "2eac25a6-c643-4348-98eb-91d044f1714c", "bridge": "br-int", "label": "tempest-TestStampPattern-1438802163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d056f7dae1d94936bd1fed295f0eba16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28570b91-bc", "ovs_interfaceid": "28570b91-bccd-4af6-8a83-680316f91520", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:50:42 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Converting VIF {"id": "28570b91-bccd-4af6-8a83-680316f91520", "address": "fa:16:3e:22:83:df", "network": {"id": "2eac25a6-c643-4348-98eb-91d044f1714c", "bridge": "br-int", "label": "tempest-TestStampPattern-1438802163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d056f7dae1d94936bd1fed295f0eba16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28570b91-bc", "ovs_interfaceid": "28570b91-bccd-4af6-8a83-680316f91520", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:50:42 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:83:df,bridge_name='br-int',has_traffic_filtering=True,id=28570b91-bccd-4af6-8a83-680316f91520,network=Network(2eac25a6-c643-4348-98eb-91d044f1714c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28570b91-bc') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:50:42 user nova-compute[75245]: DEBUG nova.objects.instance [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Lazy-loading 'pci_devices' on Instance uuid fcbd317f-c56f-4b4b-8572-c112f778410d {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:50:42 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: fcbd317f-c56f-4b4b-8572-c112f778410d] End _get_guest_xml xml=<domain type="kvm">
Nov 29 16:50:42 user nova-compute[75245]:   <uuid>fcbd317f-c56f-4b4b-8572-c112f778410d</uuid>
Nov 29 16:50:42 user nova-compute[75245]:   <name>instance-0000002b</name>
Nov 29 16:50:42 user nova-compute[75245]:   <memory>524288</memory>
Nov 29 16:50:42 user nova-compute[75245]:   <vcpu>1</vcpu>
Nov 29 16:50:42 user nova-compute[75245]:   <metadata>
Nov 29 16:50:42 user nova-compute[75245]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 16:50:42 user nova-compute[75245]:       <nova:package version="0.0.0"/>
Nov 29 16:50:42 user nova-compute[75245]:       <nova:name>tempest-TestStampPattern-server-1616863509</nova:name>
Nov 29 16:50:42 user nova-compute[75245]:       <nova:creationTime>2023-11-29 16:50:41</nova:creationTime>
Nov 29 16:50:42 user nova-compute[75245]:       <nova:flavor name="m1.tiny">
Nov 29 16:50:42 user nova-compute[75245]:         <nova:memory>512</nova:memory>
Nov 29 16:50:42 user nova-compute[75245]:         <nova:disk>1</nova:disk>
Nov 29 16:50:42 user nova-compute[75245]:         <nova:swap>0</nova:swap>
Nov 29 16:50:42 user nova-compute[75245]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 16:50:42 user nova-compute[75245]:         <nova:vcpus>1</nova:vcpus>
Nov 29 16:50:42 user nova-compute[75245]:       </nova:flavor>
Nov 29 16:50:42 user nova-compute[75245]:       <nova:owner>
Nov 29 16:50:42 user nova-compute[75245]:         <nova:user uuid="0acde563960c46268a890ac370800146">tempest-TestStampPattern-1627008304-project-member</nova:user>
Nov 29 16:50:42 user nova-compute[75245]:         <nova:project uuid="d056f7dae1d94936bd1fed295f0eba16">tempest-TestStampPattern-1627008304</nova:project>
Nov 29 16:50:42 user nova-compute[75245]:       </nova:owner>
Nov 29 16:50:42 user nova-compute[75245]:       <nova:root type="image" uuid="5edd3565-468b-4ff8-b9b4-2eba8d411b64"/>
Nov 29 16:50:42 user nova-compute[75245]:       <nova:ports>
Nov 29 16:50:42 user nova-compute[75245]:         <nova:port uuid="28570b91-bccd-4af6-8a83-680316f91520">
Nov 29 16:50:42 user nova-compute[75245]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 29 16:50:42 user nova-compute[75245]:         </nova:port>
Nov 29 16:50:42 user nova-compute[75245]:       </nova:ports>
Nov 29 16:50:42 user nova-compute[75245]:     </nova:instance>
Nov 29 16:50:42 user nova-compute[75245]:   </metadata>
Nov 29 16:50:42 user nova-compute[75245]:   <sysinfo type="smbios">
Nov 29 16:50:42 user nova-compute[75245]:     <system>
Nov 29 16:50:42 user nova-compute[75245]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 16:50:42 user nova-compute[75245]:       <entry name="product">OpenStack Nova</entry>
Nov 29 16:50:42 user nova-compute[75245]:       <entry name="version">0.0.0</entry>
Nov 29 16:50:42 user nova-compute[75245]:       <entry name="serial">fcbd317f-c56f-4b4b-8572-c112f778410d</entry>
Nov 29 16:50:42 user nova-compute[75245]:       <entry name="uuid">fcbd317f-c56f-4b4b-8572-c112f778410d</entry>
Nov 29 16:50:42 user nova-compute[75245]:       <entry name="family">Virtual Machine</entry>
Nov 29 16:50:42 user nova-compute[75245]:     </system>
Nov 29 16:50:42 user nova-compute[75245]:   </sysinfo>
Nov 29 16:50:42 user nova-compute[75245]:   <os>
Nov 29 16:50:42 user nova-compute[75245]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 16:50:42 user nova-compute[75245]:     <boot dev="hd"/>
Nov 29 16:50:42 user nova-compute[75245]:     <smbios mode="sysinfo"/>
Nov 29 16:50:42 user nova-compute[75245]:   </os>
Nov 29 16:50:42 user nova-compute[75245]:   <features>
Nov 29 16:50:42 user nova-compute[75245]:     <acpi/>
Nov 29 16:50:42 user nova-compute[75245]:     <apic/>
Nov 29 16:50:42 user nova-compute[75245]:     <vmcoreinfo/>
Nov 29 16:50:42 user nova-compute[75245]:   </features>
Nov 29 16:50:42 user nova-compute[75245]:   <clock offset="utc">
Nov 29 16:50:42 user nova-compute[75245]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 16:50:42 user nova-compute[75245]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 16:50:42 user nova-compute[75245]:     <timer name="hpet" present="no"/>
Nov 29 16:50:42 user nova-compute[75245]:   </clock>
Nov 29 16:50:42 user nova-compute[75245]:   <cpu mode="custom" match="exact">
Nov 29 16:50:42 user nova-compute[75245]:     <model>Nehalem</model>
Nov 29 16:50:42 user nova-compute[75245]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 16:50:42 user nova-compute[75245]:   </cpu>
Nov 29 16:50:42 user nova-compute[75245]:   <devices>
Nov 29 16:50:42 user nova-compute[75245]:     <disk type="file" device="disk">
Nov 29 16:50:42 user nova-compute[75245]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 16:50:42 user nova-compute[75245]:       <source file="/opt/stack/data/nova/instances/fcbd317f-c56f-4b4b-8572-c112f778410d/disk"/>
Nov 29 16:50:42 user nova-compute[75245]:       <target dev="vda" bus="virtio"/>
Nov 29 16:50:42 user nova-compute[75245]:     </disk>
Nov 29 16:50:42 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 16:50:42 user nova-compute[75245]:       <mac address="fa:16:3e:22:83:df"/>
Nov 29 16:50:42 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:50:42 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 16:50:42 user nova-compute[75245]:       <target dev="tap28570b91-bc"/>
Nov 29 16:50:42 user nova-compute[75245]:     </interface>
Nov 29 16:50:42 user nova-compute[75245]:     <serial type="pty">
Nov 29 16:50:42 user nova-compute[75245]:       <log file="/opt/stack/data/nova/instances/fcbd317f-c56f-4b4b-8572-c112f778410d/console.log" append="off"/>
Nov 29 16:50:42 user nova-compute[75245]:     </serial>
Nov 29 16:50:42 user nova-compute[75245]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 16:50:42 user nova-compute[75245]:     <video>
Nov 29 16:50:42 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:50:42 user nova-compute[75245]:     </video>
Nov 29 16:50:42 user nova-compute[75245]:     <rng model="virtio">
Nov 29 16:50:42 user nova-compute[75245]:       <backend model="random">/dev/urandom</backend>
Nov 29 16:50:42 user nova-compute[75245]:     </rng>
Nov 29 16:50:42 user nova-compute[75245]:     <controller type="usb" index="0" model="none"/>
Nov 29 16:50:42 user nova-compute[75245]:     <memballoon model="virtio">
Nov 29 16:50:42 user nova-compute[75245]:       <stats period="10"/>
Nov 29 16:50:42 user nova-compute[75245]:     </memballoon>
Nov 29 16:50:42 user nova-compute[75245]:   </devices>
Nov 29 16:50:42 user nova-compute[75245]: </domain>
Nov 29 16:50:42 user nova-compute[75245]:  {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 16:50:42 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:50:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1616863509',display_name='tempest-TestStampPattern-server-1616863509',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1616863509',id=43,image_ref='5edd3565-468b-4ff8-b9b4-2eba8d411b64',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImoWxFDnu4c8KDr10Q6Ubx68e8gn5RNIGqBgLtWDemy3wpgxbiBAYLS+wfSKYPtQ2DWWp70/Ts0kN1P7Ewenibb2M76FreHbG7l7wWc3VZE00W0BrocAjgoRPqW16wYoQ==',key_name='tempest-TestStampPattern-428472352',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d056f7dae1d94936bd1fed295f0eba16',ramdisk_id='',reservation_id='r-f99kh067',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='25a0a73c-ed89-4530-aabb-a6a85e030482',image_min_disk='1',image_min_ram='0',image_owner_id='d056f7dae1d94936bd1fed295f0eba16',image_owner_project_name='tempest-TestStampPattern-1627008304',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1627008304-project-member',image_user_id='0acde563960c46268a890ac370800146',network_allocated='True',owner_project_name='tempest-TestStampPattern-1627008304',owner_user_name='tempest-TestStampPattern-1627008304-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:50:40Z,user_data=None,user_id='0acde563960c46268a890ac370800146',uuid=fcbd317f-c56f-4b4b-8572-c112f778410d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28570b91-bccd-4af6-8a83-680316f91520", "address": "fa:16:3e:22:83:df", "network": {"id": "2eac25a6-c643-4348-98eb-91d044f1714c", "bridge": "br-int", "label": "tempest-TestStampPattern-1438802163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d056f7dae1d94936bd1fed295f0eba16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28570b91-bc", "ovs_interfaceid": "28570b91-bccd-4af6-8a83-680316f91520", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 16:50:42 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Converting VIF {"id": "28570b91-bccd-4af6-8a83-680316f91520", "address": "fa:16:3e:22:83:df", "network": {"id": "2eac25a6-c643-4348-98eb-91d044f1714c", "bridge": "br-int", "label": "tempest-TestStampPattern-1438802163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d056f7dae1d94936bd1fed295f0eba16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28570b91-bc", "ovs_interfaceid": "28570b91-bccd-4af6-8a83-680316f91520", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:50:42 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:83:df,bridge_name='br-int',has_traffic_filtering=True,id=28570b91-bccd-4af6-8a83-680316f91520,network=Network(2eac25a6-c643-4348-98eb-91d044f1714c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28570b91-bc') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:50:42 user nova-compute[75245]: DEBUG os_vif [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:83:df,bridge_name='br-int',has_traffic_filtering=True,id=28570b91-bccd-4af6-8a83-680316f91520,network=Network(2eac25a6-c643-4348-98eb-91d044f1714c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28570b91-bc') {{(pid=75245) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 16:50:42 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:50:42 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:50:42 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 16:50:42 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:50:42 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6ea9c35c-fcd5-5160-ad99-f18c8f846903', '_type': 'linux-noop'}}, row=False) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:50:42 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:50:42 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:50:42 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:50:42 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap28570b91-bc, may_exist=True, interface_attrs={}) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:50:42 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap28570b91-bc, col_values=(('qos', UUID('8d08d3b9-9ded-405f-a5cf-7414887427c9')),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:50:42 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap28570b91-bc, col_values=(('external_ids', {'iface-id': '28570b91-bccd-4af6-8a83-680316f91520', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:83:df', 'vm-uuid': 'fcbd317f-c56f-4b4b-8572-c112f778410d'}),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:50:42 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:50:42 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:50:42 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:50:42 user nova-compute[75245]: INFO os_vif [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:83:df,bridge_name='br-int',has_traffic_filtering=True,id=28570b91-bccd-4af6-8a83-680316f91520,network=Network(2eac25a6-c643-4348-98eb-91d044f1714c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28570b91-bc')
Nov 29 16:50:42 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:50:42 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] No VIF found with MAC fa:16:3e:22:83:df, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:50:42 user nova-compute[75245]: DEBUG nova.network.neutron [req-d5bd8c8b-2ea7-48fa-91d8-d0f137972cd2 req-ad6b539c-1b3d-4103-8e38-b12fd385d7b5 service nova] [instance: fcbd317f-c56f-4b4b-8572-c112f778410d] Updated VIF entry in instance network info cache for port 28570b91-bccd-4af6-8a83-680316f91520. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:50:42 user nova-compute[75245]: DEBUG nova.network.neutron [req-d5bd8c8b-2ea7-48fa-91d8-d0f137972cd2 req-ad6b539c-1b3d-4103-8e38-b12fd385d7b5 service nova] [instance: fcbd317f-c56f-4b4b-8572-c112f778410d] Updating instance_info_cache with network_info: [{"id": "28570b91-bccd-4af6-8a83-680316f91520", "address": "fa:16:3e:22:83:df", "network": {"id": "2eac25a6-c643-4348-98eb-91d044f1714c", "bridge": "br-int", "label": "tempest-TestStampPattern-1438802163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d056f7dae1d94936bd1fed295f0eba16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28570b91-bc", "ovs_interfaceid": "28570b91-bccd-4af6-8a83-680316f91520", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:50:42 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d5bd8c8b-2ea7-48fa-91d8-d0f137972cd2 req-ad6b539c-1b3d-4103-8e38-b12fd385d7b5 service nova] Releasing lock "refresh_cache-fcbd317f-c56f-4b4b-8572-c112f778410d" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:50:43 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:50:43 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:50:43 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:50:43 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:50:43 user nova-compute[75245]: DEBUG nova.compute.manager [req-e600f52c-6ee2-4750-bff9-b1f059eeefcf req-a31444c0-bc98-4abe-9338-ad0376fbdfcd service nova] [instance: fcbd317f-c56f-4b4b-8572-c112f778410d] Received event network-vif-plugged-28570b91-bccd-4af6-8a83-680316f91520 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:50:43 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-e600f52c-6ee2-4750-bff9-b1f059eeefcf req-a31444c0-bc98-4abe-9338-ad0376fbdfcd service nova] Acquiring lock "fcbd317f-c56f-4b4b-8572-c112f778410d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:50:43 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-e600f52c-6ee2-4750-bff9-b1f059eeefcf req-a31444c0-bc98-4abe-9338-ad0376fbdfcd service nova] Lock "fcbd317f-c56f-4b4b-8572-c112f778410d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:50:43 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-e600f52c-6ee2-4750-bff9-b1f059eeefcf req-a31444c0-bc98-4abe-9338-ad0376fbdfcd service nova] Lock "fcbd317f-c56f-4b4b-8572-c112f778410d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:50:43 user nova-compute[75245]: DEBUG nova.compute.manager [req-e600f52c-6ee2-4750-bff9-b1f059eeefcf req-a31444c0-bc98-4abe-9338-ad0376fbdfcd service nova] [instance: fcbd317f-c56f-4b4b-8572-c112f778410d] No waiting events found dispatching network-vif-plugged-28570b91-bccd-4af6-8a83-680316f91520 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:50:43 user nova-compute[75245]: WARNING nova.compute.manager [req-e600f52c-6ee2-4750-bff9-b1f059eeefcf req-a31444c0-bc98-4abe-9338-ad0376fbdfcd service nova] [instance: fcbd317f-c56f-4b4b-8572-c112f778410d] Received unexpected event network-vif-plugged-28570b91-bccd-4af6-8a83-680316f91520 for instance with vm_state building and task_state spawning.
Nov 29 16:50:43 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:50:43 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:50:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:50:45 user nova-compute[75245]: DEBUG nova.compute.manager [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: fcbd317f-c56f-4b4b-8572-c112f778410d] Instance event wait completed in 0 seconds for  {{(pid=75245) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 16:50:45 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: fcbd317f-c56f-4b4b-8572-c112f778410d] Guest created on hypervisor {{(pid=75245) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 16:50:45 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: fcbd317f-c56f-4b4b-8572-c112f778410d] Instance spawned successfully.
Nov 29 16:50:45 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: fcbd317f-c56f-4b4b-8572-c112f778410d] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 16:50:45 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: fcbd317f-c56f-4b4b-8572-c112f778410d] Found default for hw_input_bus of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:50:45 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: fcbd317f-c56f-4b4b-8572-c112f778410d] Found default for hw_pointer_model of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:50:45 user nova-compute[75245]: INFO nova.compute.manager [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: fcbd317f-c56f-4b4b-8572-c112f778410d] Took 5.74 seconds to spawn the instance on the hypervisor.
Nov 29 16:50:45 user nova-compute[75245]: DEBUG nova.compute.manager [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: fcbd317f-c56f-4b4b-8572-c112f778410d] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:50:45 user nova-compute[75245]: DEBUG nova.compute.manager [req-002c1ce5-44b9-4d9f-99d8-a0bd0f554fd0 req-baf576d2-055b-4b14-8100-778fd8f5dddf service nova] [instance: fcbd317f-c56f-4b4b-8572-c112f778410d] Received event network-vif-plugged-28570b91-bccd-4af6-8a83-680316f91520 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:50:45 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-002c1ce5-44b9-4d9f-99d8-a0bd0f554fd0 req-baf576d2-055b-4b14-8100-778fd8f5dddf service nova] Acquiring lock "fcbd317f-c56f-4b4b-8572-c112f778410d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:50:45 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-002c1ce5-44b9-4d9f-99d8-a0bd0f554fd0 req-baf576d2-055b-4b14-8100-778fd8f5dddf service nova] Lock "fcbd317f-c56f-4b4b-8572-c112f778410d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:50:45 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-002c1ce5-44b9-4d9f-99d8-a0bd0f554fd0 req-baf576d2-055b-4b14-8100-778fd8f5dddf service nova] Lock "fcbd317f-c56f-4b4b-8572-c112f778410d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:50:45 user nova-compute[75245]: DEBUG nova.compute.manager [req-002c1ce5-44b9-4d9f-99d8-a0bd0f554fd0 req-baf576d2-055b-4b14-8100-778fd8f5dddf service nova] [instance: fcbd317f-c56f-4b4b-8572-c112f778410d] No waiting events found dispatching network-vif-plugged-28570b91-bccd-4af6-8a83-680316f91520 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:50:45 user nova-compute[75245]: WARNING nova.compute.manager [req-002c1ce5-44b9-4d9f-99d8-a0bd0f554fd0 req-baf576d2-055b-4b14-8100-778fd8f5dddf service nova] [instance: fcbd317f-c56f-4b4b-8572-c112f778410d] Received unexpected event network-vif-plugged-28570b91-bccd-4af6-8a83-680316f91520 for instance with vm_state building and task_state spawning.
Nov 29 16:50:45 user nova-compute[75245]: INFO nova.compute.manager [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: fcbd317f-c56f-4b4b-8572-c112f778410d] Took 6.32 seconds to build instance.
Nov 29 16:50:45 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-b2b78804-f96d-42c5-8b13-523c906e34e4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Lock "fcbd317f-c56f-4b4b-8572-c112f778410d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.427s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:50:47 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:50:52 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:50:52 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:50:52 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75245) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 16:50:52 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:50:52 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:50:52 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:50:56 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:50:57 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:50:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:50:59 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:51:01 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:51:02 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:51:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:51:06 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:51:07 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:51:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:51:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:51:12 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:51:12 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:51:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:51:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:51:17 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:51:19 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:51:21 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:51:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:51:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:51:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:51:21 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75245) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 16:51:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25a0a73c-ed89-4530-aabb-a6a85e030482/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:51:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25a0a73c-ed89-4530-aabb-a6a85e030482/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:51:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25a0a73c-ed89-4530-aabb-a6a85e030482/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:51:22 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25a0a73c-ed89-4530-aabb-a6a85e030482/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:51:22 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcbd317f-c56f-4b4b-8572-c112f778410d/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:51:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:51:22 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcbd317f-c56f-4b4b-8572-c112f778410d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:51:22 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcbd317f-c56f-4b4b-8572-c112f778410d/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:51:22 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcbd317f-c56f-4b4b-8572-c112f778410d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:51:22 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24999298-349a-4837-ba75-22192166c5a1/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:51:22 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24999298-349a-4837-ba75-22192166c5a1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:51:22 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24999298-349a-4837-ba75-22192166c5a1/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:51:22 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24999298-349a-4837-ba75-22192166c5a1/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:51:23 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:51:23 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:51:23 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Hypervisor/Node resource view: name=user free_ram=8687MB free_disk=24.987350463867188GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75245) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 16:51:23 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:51:23 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:51:23 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 25a0a73c-ed89-4530-aabb-a6a85e030482 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:51:23 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 24999298-349a-4837-ba75-22192166c5a1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:51:23 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance fcbd317f-c56f-4b4b-8572-c112f778410d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:51:23 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 16:51:23 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 16:51:23 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Refreshing inventories for resource provider dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 16:51:23 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Updating ProviderTree inventory for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 16:51:23 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Updating inventory in ProviderTree for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 16:51:23 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Refreshing aggregate associations for resource provider dcc0ed27-167e-4f3a-a0de-183bb144a50c, aggregates: None {{(pid=75245) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 16:51:23 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Refreshing trait associations for resource provider dcc0ed27-167e-4f3a-a0de-183bb144a50c, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG {{(pid=75245) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 16:51:23 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:51:23 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:51:23 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Compute_service record updated for user:user {{(pid=75245) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 16:51:23 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.515s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:51:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:51:25 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:51:25 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Starting heal instance info cache {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 16:51:25 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Rebuilding the list of instances to heal {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 16:51:25 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "refresh_cache-25a0a73c-ed89-4530-aabb-a6a85e030482" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:51:25 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquired lock "refresh_cache-25a0a73c-ed89-4530-aabb-a6a85e030482" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:51:25 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Forcefully refreshing network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 16:51:25 user nova-compute[75245]: DEBUG nova.objects.instance [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lazy-loading 'info_cache' on Instance uuid 25a0a73c-ed89-4530-aabb-a6a85e030482 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:51:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Acquiring lock "131579c4-4b5e-455b-9fbe-6fcda74aa48c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:51:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "131579c4-4b5e-455b-9fbe-6fcda74aa48c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:51:26 user nova-compute[75245]: DEBUG nova.compute.manager [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 131579c4-4b5e-455b-9fbe-6fcda74aa48c] Starting instance... {{(pid=75245) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 16:51:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:51:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:51:26 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75245) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 16:51:26 user nova-compute[75245]: INFO nova.compute.claims [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 131579c4-4b5e-455b-9fbe-6fcda74aa48c] Claim successful on node user
Nov 29 16:51:26 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Updating instance_info_cache with network_info: [{"id": "8f62d901-5ef0-4879-9f19-8a51f55fde1f", "address": "fa:16:3e:8b:42:60", "network": {"id": "2eac25a6-c643-4348-98eb-91d044f1714c", "bridge": "br-int", "label": "tempest-TestStampPattern-1438802163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d056f7dae1d94936bd1fed295f0eba16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f62d901-5e", "ovs_interfaceid": "8f62d901-5ef0-4879-9f19-8a51f55fde1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:51:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Releasing lock "refresh_cache-25a0a73c-ed89-4530-aabb-a6a85e030482" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:51:26 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Updated the network info_cache for instance {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 16:51:26 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:51:26 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:51:26 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:51:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.275s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:51:26 user nova-compute[75245]: DEBUG nova.compute.manager [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 131579c4-4b5e-455b-9fbe-6fcda74aa48c] Start building networks asynchronously for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 16:51:26 user nova-compute[75245]: DEBUG nova.compute.manager [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 131579c4-4b5e-455b-9fbe-6fcda74aa48c] Allocating IP information in the background. {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 16:51:26 user nova-compute[75245]: DEBUG nova.network.neutron [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 131579c4-4b5e-455b-9fbe-6fcda74aa48c] allocate_for_instance() {{(pid=75245) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 16:51:26 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 131579c4-4b5e-455b-9fbe-6fcda74aa48c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 16:51:26 user nova-compute[75245]: DEBUG nova.compute.manager [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 131579c4-4b5e-455b-9fbe-6fcda74aa48c] Start building block device mappings for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 16:51:26 user nova-compute[75245]: DEBUG nova.policy [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2870721a7fff4cf19291f0cbfaedae81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907dff4e054429fa10392b730363eb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75245) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 16:51:26 user nova-compute[75245]: INFO nova.virt.block_device [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 131579c4-4b5e-455b-9fbe-6fcda74aa48c] Booting with volume snapshot 7e908285-df86-45c2-8c6a-c29a9f04a8c1 at /dev/vda
Nov 29 16:51:27 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:51:27 user nova-compute[75245]: DEBUG nova.network.neutron [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 131579c4-4b5e-455b-9fbe-6fcda74aa48c] Successfully created port: 1c98b19f-4dc4-4149-95e0-600e8dadcad5 {{(pid=75245) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 16:51:27 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:51:27 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Cleaning up deleted instances {{(pid=75245) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 16:51:27 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] There are 0 instances to clean {{(pid=75245) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 16:51:27 user nova-compute[75245]: DEBUG nova.network.neutron [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 131579c4-4b5e-455b-9fbe-6fcda74aa48c] Successfully updated port: 1c98b19f-4dc4-4149-95e0-600e8dadcad5 {{(pid=75245) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 16:51:27 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Acquiring lock "refresh_cache-131579c4-4b5e-455b-9fbe-6fcda74aa48c" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:51:27 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Acquired lock "refresh_cache-131579c4-4b5e-455b-9fbe-6fcda74aa48c" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:51:27 user nova-compute[75245]: DEBUG nova.network.neutron [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 131579c4-4b5e-455b-9fbe-6fcda74aa48c] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 16:51:27 user nova-compute[75245]: DEBUG nova.compute.manager [req-a38f7473-10d0-4990-a767-cf399bcef46e req-ef00d43c-0be5-4546-a7cd-feadb42db7f2 service nova] [instance: 131579c4-4b5e-455b-9fbe-6fcda74aa48c] Received event network-changed-1c98b19f-4dc4-4149-95e0-600e8dadcad5 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:51:27 user nova-compute[75245]: DEBUG nova.compute.manager [req-a38f7473-10d0-4990-a767-cf399bcef46e req-ef00d43c-0be5-4546-a7cd-feadb42db7f2 service nova] [instance: 131579c4-4b5e-455b-9fbe-6fcda74aa48c] Refreshing instance network info cache due to event network-changed-1c98b19f-4dc4-4149-95e0-600e8dadcad5. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:51:27 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a38f7473-10d0-4990-a767-cf399bcef46e req-ef00d43c-0be5-4546-a7cd-feadb42db7f2 service nova] Acquiring lock "refresh_cache-131579c4-4b5e-455b-9fbe-6fcda74aa48c" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:51:27 user nova-compute[75245]: DEBUG nova.network.neutron [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 131579c4-4b5e-455b-9fbe-6fcda74aa48c] Instance cache missing network info. {{(pid=75245) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 16:51:28 user nova-compute[75245]: DEBUG nova.network.neutron [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 131579c4-4b5e-455b-9fbe-6fcda74aa48c] Updating instance_info_cache with network_info: [{"id": "1c98b19f-4dc4-4149-95e0-600e8dadcad5", "address": "fa:16:3e:ce:07:de", "network": {"id": "316cb9af-807d-4a69-874e-2054520f0e5f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1421560477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0907dff4e054429fa10392b730363eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c98b19f-4d", "ovs_interfaceid": "1c98b19f-4dc4-4149-95e0-600e8dadcad5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:51:28 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Releasing lock "refresh_cache-131579c4-4b5e-455b-9fbe-6fcda74aa48c" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:51:28 user nova-compute[75245]: DEBUG nova.compute.manager [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 131579c4-4b5e-455b-9fbe-6fcda74aa48c] Instance network_info: |[{"id": "1c98b19f-4dc4-4149-95e0-600e8dadcad5", "address": "fa:16:3e:ce:07:de", "network": {"id": "316cb9af-807d-4a69-874e-2054520f0e5f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1421560477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0907dff4e054429fa10392b730363eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c98b19f-4d", "ovs_interfaceid": "1c98b19f-4dc4-4149-95e0-600e8dadcad5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 16:51:28 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a38f7473-10d0-4990-a767-cf399bcef46e req-ef00d43c-0be5-4546-a7cd-feadb42db7f2 service nova] Acquired lock "refresh_cache-131579c4-4b5e-455b-9fbe-6fcda74aa48c" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:51:28 user nova-compute[75245]: DEBUG nova.network.neutron [req-a38f7473-10d0-4990-a767-cf399bcef46e req-ef00d43c-0be5-4546-a7cd-feadb42db7f2 service nova] [instance: 131579c4-4b5e-455b-9fbe-6fcda74aa48c] Refreshing network info cache for port 1c98b19f-4dc4-4149-95e0-600e8dadcad5 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:51:28 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:51:28 user nova-compute[75245]: DEBUG nova.network.neutron [req-a38f7473-10d0-4990-a767-cf399bcef46e req-ef00d43c-0be5-4546-a7cd-feadb42db7f2 service nova] [instance: 131579c4-4b5e-455b-9fbe-6fcda74aa48c] Updated VIF entry in instance network info cache for port 1c98b19f-4dc4-4149-95e0-600e8dadcad5. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:51:28 user nova-compute[75245]: DEBUG nova.network.neutron [req-a38f7473-10d0-4990-a767-cf399bcef46e req-ef00d43c-0be5-4546-a7cd-feadb42db7f2 service nova] [instance: 131579c4-4b5e-455b-9fbe-6fcda74aa48c] Updating instance_info_cache with network_info: [{"id": "1c98b19f-4dc4-4149-95e0-600e8dadcad5", "address": "fa:16:3e:ce:07:de", "network": {"id": "316cb9af-807d-4a69-874e-2054520f0e5f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1421560477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0907dff4e054429fa10392b730363eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c98b19f-4d", "ovs_interfaceid": "1c98b19f-4dc4-4149-95e0-600e8dadcad5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:51:28 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a38f7473-10d0-4990-a767-cf399bcef46e req-ef00d43c-0be5-4546-a7cd-feadb42db7f2 service nova] Releasing lock "refresh_cache-131579c4-4b5e-455b-9fbe-6fcda74aa48c" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:51:29 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:51:29 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:51:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:51:32 user nova-compute[75245]: DEBUG os_brick.utils [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:51:32 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:51:32 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:51:32 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a5dd06a-24ce-4eeb-af65-bb958fc30fdb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:69ed8ed87091\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:51:32 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:51:32 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:51:32 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e76ebeb-6891-48e4-8d0c-d58d8f836179]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:51:32 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:51:32 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:51:32 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc1d590-062a-4204-9f76-8879860ab066]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:51:32 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[e871aa39-4015-4b13-a61a-20fb31aa92e3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:51:32 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Running cmd (subprocess): nvme version {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:51:32 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] 'nvme version' failed. Not Retrying. {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:51:32 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] nvme not present on system {{(pid=75245) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 16:51:32 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:51:32 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:51:32 user nova-compute[75245]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 16:51:32 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[b487a4bf-f70b-4bd3-bf3c-220747f51fe0]: (4, '') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:51:32 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75245) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 16:51:32 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 16:51:32 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] LIGHTOS: no hostnqn found. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 16:51:32 user nova-compute[75245]: DEBUG os_brick.utils [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:69ed8ed87091', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:51:32 user nova-compute[75245]: DEBUG nova.virt.block_device [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 131579c4-4b5e-455b-9fbe-6fcda74aa48c] Updating existing volume attachment record: 77183c30-af4f-4cad-8282-f90652d83693 {{(pid=75245) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 16:51:32 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:51:32 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75245) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 16:51:35 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:51:37 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:51:37 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:51:37 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75245) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 16:51:37 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:51:37 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:51:37 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:51:37 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:51:37 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75245) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 16:51:38 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:51:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:51:40 user nova-compute[75245]: DEBUG nova.compute.manager [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 131579c4-4b5e-455b-9fbe-6fcda74aa48c] Start spawning the instance on the hypervisor. {{(pid=75245) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 16:51:40 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 131579c4-4b5e-455b-9fbe-6fcda74aa48c] Creating instance directory {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 16:51:40 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 131579c4-4b5e-455b-9fbe-6fcda74aa48c] Creating image(s)
Nov 29 16:51:40 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 131579c4-4b5e-455b-9fbe-6fcda74aa48c] Did not create local disks {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 16:51:40 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 131579c4-4b5e-455b-9fbe-6fcda74aa48c] Ensure instance console log exists: /opt/stack/data/nova/instances/131579c4-4b5e-455b-9fbe-6fcda74aa48c/console.log {{(pid=75245) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 16:51:40 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:51:40 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:51:40 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:51:40 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 131579c4-4b5e-455b-9fbe-6fcda74aa48c] Start _get_guest_xml network_info=[{"id": "1c98b19f-4dc4-4149-95e0-600e8dadcad5", "address": "fa:16:3e:ce:07:de", "network": {"id": "316cb9af-807d-4a69-874e-2054520f0e5f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1421560477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0907dff4e054429fa10392b730363eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c98b19f-4d", "ovs_interfaceid": "1c98b19f-4dc4-4149-95e0-600e8dadcad5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '77183c30-af4f-4cad-8282-f90652d83693', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ade63d7a-75e8-49bc-b211-554a246995a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XVsLFRvk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '131579c4-4b5e-455b-9fbe-6fcda74aa48c', 'attached_at': '', 'detached_at': '', 'volume_id': 'ade63d7a-75e8-49bc-b211-554a246995a8', 'serial': 'ade63d7a-75e8-49bc-b211-554a246995a8'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'guest_format': None, 'volume_type': None} {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 16:51:40 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:51:40 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:51:40 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 16:51:40 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] CPU controller missing on host. {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 16:51:40 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 16:51:40 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] CPU controller found on host. {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 16:51:40 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75245) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 16:51:40 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T16:06:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 16:51:40 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Flavor limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 16:51:40 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Image limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 16:51:40 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Flavor pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 16:51:40 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Image pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 16:51:40 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 16:51:40 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 16:51:40 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 16:51:40 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Got 1 possible topologies {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 16:51:40 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 16:51:40 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 16:51:40 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 131579c4-4b5e-455b-9fbe-6fcda74aa48c] Calling os-brick to attach iSCSI Volume {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 16:51:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ade63d7a-75e8-49bc-b211-554a246995a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XVsLFRvk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:51:40 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:51:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:51:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:51:40 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:51:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ade63d7a-75e8-49bc-b211-554a246995a8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:51:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ade63d7a-75e8-49bc-b211-554a246995a8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:51:40 user nova-compute[75245]: INFO os_brick.initiator.connectors.iscsi [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 16:51:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ade63d7a-75e8-49bc-b211-554a246995a8 -p 172.16.0.220:3260 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:51:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ade63d7a-75e8-49bc-b211-554a246995a8 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:51:40 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[a35491aa-0364-47ea-91cf-f7231e18c07b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:51:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 16:51:40 user nova-compute[75245]:  {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:51:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ade63d7a-75e8-49bc-b211-554a246995a8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:51:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ade63d7a-75e8-49bc-b211-554a246995a8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:51:40 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[b46170b9-b8d0-4ca5-9577-52e4172cd1d2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ade63d7a-75e8-49bc-b211-554a246995a8] added\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:51:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ade63d7a-75e8-49bc-b211-554a246995a8] added
Nov 29 16:51:40 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:51:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ade63d7a-75e8-49bc-b211-554a246995a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:51:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ade63d7a-75e8-49bc-b211-554a246995a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:51:40 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[196e258e-e425-445d-a463-daf74d471733]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:51:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:51:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ade63d7a-75e8-49bc-b211-554a246995a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:51:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ade63d7a-75e8-49bc-b211-554a246995a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:51:40 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c779e9-b3a0-4b69-a0e0-2d7a09aad6a7]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:51:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:51:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ade63d7a-75e8-49bc-b211-554a246995a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XVsLFRvk {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:51:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ade63d7a-75e8-49bc-b211-554a246995a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XVsLFRvk" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:51:40 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1877c9c-a0b7-4571-b491-d865ca4392dc]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:51:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XVsLFRvk'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:51:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ade63d7a-75e8-49bc-b211-554a246995a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:51:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ade63d7a-75e8-49bc-b211-554a246995a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.159s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:51:40 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[706818c8-6c98-4e37-a2e8-f314fa0ed54d]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:51:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:51:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:51:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:51:40 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c19c8e-9dc9-4064-ba50-24e90bc32a5f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:51:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 16:51:40 user nova-compute[75245]:  {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:51:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 16:51:40 user nova-compute[75245]:  {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:51:40 user nova-compute[75245]: WARNING os_brick.initiator.connectors.iscsi [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 16:51:40 user nova-compute[75245]: 
Nov 29 16:51:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ade63d7a-75e8-49bc-b211-554a246995a8 -p 172.16.0.220:3260 --login {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:51:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ade63d7a-75e8-49bc-b211-554a246995a8 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:51:40 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c5282e1-31ae-46f6-85b8-8b1d1cde361d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ade63d7a-75e8-49bc-b211-554a246995a8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ade63d7a-75e8-49bc-b211-554a246995a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:51:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ade63d7a-75e8-49bc-b211-554a246995a8, portal: 172.16.0.220,3260]
Nov 29 16:51:40 user nova-compute[75245]: Login to [iface: default, target: iqn.2010-10.org.openstack:ade63d7a-75e8-49bc-b211-554a246995a8, portal: 172.16.0.220,3260] successful.
Nov 29 16:51:40 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:51:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ade63d7a-75e8-49bc-b211-554a246995a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:51:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ade63d7a-75e8-49bc-b211-554a246995a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:51:40 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b002e40-2da4-4536-8a7f-10a6b04ba21e]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:51:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:51:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:51:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:51:40 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ced0495-cc8e-4499-95da-90f153f7ba27]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade63d7a-75e8-49bc-b211-554a246995a8 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:51:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade63d7a-75e8-49bc-b211-554a246995a8 (non-flash)
Nov 29 16:51:40 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:51:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade63d7a-75e8-49bc-b211-554a246995a8 (non-flash)
Nov 29 16:51:40 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:51:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ade63d7a-75e8-49bc-b211-554a246995a8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.387s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:51:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Connected to 172.16.0.220:3260 {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 16:51:40 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=75245) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 16:51:40 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75245) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 16:51:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:51:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:51:40 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a75a8f-bdea-490b-87ab-7c92e26272dc]: (4, ('- - 0', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:51:40 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75245) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 16:51:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ade63d7a-75e8-49bc-b211-554a246995a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XVsLFRvk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 16:51:41 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.415s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:51:41 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] <== connect_volume: return (1417ms) {'type': 'block', 'scsi_wwn': '26266373961643166', 'path': '/dev/sdb'} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:51:41 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 131579c4-4b5e-455b-9fbe-6fcda74aa48c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266373961643166', 'path': '/dev/sdb'} {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 16:51:41 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:51:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-373468800',display_name='tempest-TestVolumeBootPattern-server-373468800',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-373468800',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0907dff4e054429fa10392b730363eb2',ramdisk_id='',reservation_id='r-gb60mo0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-181783012',owner_user_name='tempest-TestVolumeBootPattern-181783012-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:51:27Z,user_data=None,user_id='2870721a7fff4cf19291f0cbfaedae81',uuid=131579c4-4b5e-455b-9fbe-6fcda74aa48c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c98b19f-4dc4-4149-95e0-600e8dadcad5", "address": "fa:16:3e:ce:07:de", "network": {"id": "316cb9af-807d-4a69-874e-2054520f0e5f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1421560477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0907dff4e054429fa10392b730363eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c98b19f-4d", "ovs_interfaceid": "1c98b19f-4dc4-4149-95e0-600e8dadcad5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:51:41 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Converting VIF {"id": "1c98b19f-4dc4-4149-95e0-600e8dadcad5", "address": "fa:16:3e:ce:07:de", "network": {"id": "316cb9af-807d-4a69-874e-2054520f0e5f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1421560477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0907dff4e054429fa10392b730363eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c98b19f-4d", "ovs_interfaceid": "1c98b19f-4dc4-4149-95e0-600e8dadcad5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:51:41 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:07:de,bridge_name='br-int',has_traffic_filtering=True,id=1c98b19f-4dc4-4149-95e0-600e8dadcad5,network=Network(316cb9af-807d-4a69-874e-2054520f0e5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c98b19f-4d') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:51:41 user nova-compute[75245]: DEBUG nova.objects.instance [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lazy-loading 'pci_devices' on Instance uuid 131579c4-4b5e-455b-9fbe-6fcda74aa48c {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:51:41 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 131579c4-4b5e-455b-9fbe-6fcda74aa48c] End _get_guest_xml xml=<domain type="kvm">
Nov 29 16:51:41 user nova-compute[75245]:   <uuid>131579c4-4b5e-455b-9fbe-6fcda74aa48c</uuid>
Nov 29 16:51:41 user nova-compute[75245]:   <name>instance-0000002c</name>
Nov 29 16:51:41 user nova-compute[75245]:   <memory>524288</memory>
Nov 29 16:51:41 user nova-compute[75245]:   <vcpu>1</vcpu>
Nov 29 16:51:41 user nova-compute[75245]:   <metadata>
Nov 29 16:51:41 user nova-compute[75245]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 16:51:41 user nova-compute[75245]:       <nova:package version="0.0.0"/>
Nov 29 16:51:41 user nova-compute[75245]:       <nova:name>tempest-TestVolumeBootPattern-server-373468800</nova:name>
Nov 29 16:51:41 user nova-compute[75245]:       <nova:creationTime>2023-11-29 16:51:40</nova:creationTime>
Nov 29 16:51:41 user nova-compute[75245]:       <nova:flavor name="m1.tiny">
Nov 29 16:51:41 user nova-compute[75245]:         <nova:memory>512</nova:memory>
Nov 29 16:51:41 user nova-compute[75245]:         <nova:disk>1</nova:disk>
Nov 29 16:51:41 user nova-compute[75245]:         <nova:swap>0</nova:swap>
Nov 29 16:51:41 user nova-compute[75245]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 16:51:41 user nova-compute[75245]:         <nova:vcpus>1</nova:vcpus>
Nov 29 16:51:41 user nova-compute[75245]:       </nova:flavor>
Nov 29 16:51:41 user nova-compute[75245]:       <nova:owner>
Nov 29 16:51:41 user nova-compute[75245]:         <nova:user uuid="2870721a7fff4cf19291f0cbfaedae81">tempest-TestVolumeBootPattern-181783012-project-member</nova:user>
Nov 29 16:51:41 user nova-compute[75245]:         <nova:project uuid="0907dff4e054429fa10392b730363eb2">tempest-TestVolumeBootPattern-181783012</nova:project>
Nov 29 16:51:41 user nova-compute[75245]:       </nova:owner>
Nov 29 16:51:41 user nova-compute[75245]:       <nova:ports>
Nov 29 16:51:41 user nova-compute[75245]:         <nova:port uuid="1c98b19f-4dc4-4149-95e0-600e8dadcad5">
Nov 29 16:51:41 user nova-compute[75245]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 29 16:51:41 user nova-compute[75245]:         </nova:port>
Nov 29 16:51:41 user nova-compute[75245]:       </nova:ports>
Nov 29 16:51:41 user nova-compute[75245]:     </nova:instance>
Nov 29 16:51:41 user nova-compute[75245]:   </metadata>
Nov 29 16:51:41 user nova-compute[75245]:   <sysinfo type="smbios">
Nov 29 16:51:41 user nova-compute[75245]:     <system>
Nov 29 16:51:41 user nova-compute[75245]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 16:51:41 user nova-compute[75245]:       <entry name="product">OpenStack Nova</entry>
Nov 29 16:51:41 user nova-compute[75245]:       <entry name="version">0.0.0</entry>
Nov 29 16:51:41 user nova-compute[75245]:       <entry name="serial">131579c4-4b5e-455b-9fbe-6fcda74aa48c</entry>
Nov 29 16:51:41 user nova-compute[75245]:       <entry name="uuid">131579c4-4b5e-455b-9fbe-6fcda74aa48c</entry>
Nov 29 16:51:41 user nova-compute[75245]:       <entry name="family">Virtual Machine</entry>
Nov 29 16:51:41 user nova-compute[75245]:     </system>
Nov 29 16:51:41 user nova-compute[75245]:   </sysinfo>
Nov 29 16:51:41 user nova-compute[75245]:   <os>
Nov 29 16:51:41 user nova-compute[75245]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 16:51:41 user nova-compute[75245]:     <boot dev="hd"/>
Nov 29 16:51:41 user nova-compute[75245]:     <smbios mode="sysinfo"/>
Nov 29 16:51:41 user nova-compute[75245]:   </os>
Nov 29 16:51:41 user nova-compute[75245]:   <features>
Nov 29 16:51:41 user nova-compute[75245]:     <acpi/>
Nov 29 16:51:41 user nova-compute[75245]:     <apic/>
Nov 29 16:51:41 user nova-compute[75245]:     <vmcoreinfo/>
Nov 29 16:51:41 user nova-compute[75245]:   </features>
Nov 29 16:51:41 user nova-compute[75245]:   <clock offset="utc">
Nov 29 16:51:41 user nova-compute[75245]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 16:51:41 user nova-compute[75245]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 16:51:41 user nova-compute[75245]:     <timer name="hpet" present="no"/>
Nov 29 16:51:41 user nova-compute[75245]:   </clock>
Nov 29 16:51:41 user nova-compute[75245]:   <cpu mode="custom" match="exact">
Nov 29 16:51:41 user nova-compute[75245]:     <model>Nehalem</model>
Nov 29 16:51:41 user nova-compute[75245]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 16:51:41 user nova-compute[75245]:   </cpu>
Nov 29 16:51:41 user nova-compute[75245]:   <devices>
Nov 29 16:51:41 user nova-compute[75245]:     <disk type="block" device="disk">
Nov 29 16:51:41 user nova-compute[75245]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:51:41 user nova-compute[75245]:       <source dev="/dev/sdb"/>
Nov 29 16:51:41 user nova-compute[75245]:       <target dev="vda" bus="virtio"/>
Nov 29 16:51:41 user nova-compute[75245]:       <serial>ade63d7a-75e8-49bc-b211-554a246995a8</serial>
Nov 29 16:51:41 user nova-compute[75245]:     </disk>
Nov 29 16:51:41 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 16:51:41 user nova-compute[75245]:       <mac address="fa:16:3e:ce:07:de"/>
Nov 29 16:51:41 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:51:41 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 16:51:41 user nova-compute[75245]:       <target dev="tap1c98b19f-4d"/>
Nov 29 16:51:41 user nova-compute[75245]:     </interface>
Nov 29 16:51:41 user nova-compute[75245]:     <serial type="pty">
Nov 29 16:51:41 user nova-compute[75245]:       <log file="/opt/stack/data/nova/instances/131579c4-4b5e-455b-9fbe-6fcda74aa48c/console.log" append="off"/>
Nov 29 16:51:41 user nova-compute[75245]:     </serial>
Nov 29 16:51:41 user nova-compute[75245]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 16:51:41 user nova-compute[75245]:     <video>
Nov 29 16:51:41 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:51:41 user nova-compute[75245]:     </video>
Nov 29 16:51:41 user nova-compute[75245]:     <rng model="virtio">
Nov 29 16:51:41 user nova-compute[75245]:       <backend model="random">/dev/urandom</backend>
Nov 29 16:51:41 user nova-compute[75245]:     </rng>
Nov 29 16:51:41 user nova-compute[75245]:     <controller type="usb" index="0" model="none"/>
Nov 29 16:51:41 user nova-compute[75245]:     <memballoon model="virtio">
Nov 29 16:51:41 user nova-compute[75245]:       <stats period="10"/>
Nov 29 16:51:41 user nova-compute[75245]:     </memballoon>
Nov 29 16:51:41 user nova-compute[75245]:   </devices>
Nov 29 16:51:41 user nova-compute[75245]: </domain>
Nov 29 16:51:41 user nova-compute[75245]:  {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 16:51:41 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:51:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-373468800',display_name='tempest-TestVolumeBootPattern-server-373468800',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-373468800',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0907dff4e054429fa10392b730363eb2',ramdisk_id='',reservation_id='r-gb60mo0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-181783012',owner_user_name='tempest-TestVolumeBootPattern-181783012-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:51:27Z,user_data=None,user_id='2870721a7fff4cf19291f0cbfaedae81',uuid=131579c4-4b5e-455b-9fbe-6fcda74aa48c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c98b19f-4dc4-4149-95e0-600e8dadcad5", "address": "fa:16:3e:ce:07:de", "network": {"id": "316cb9af-807d-4a69-874e-2054520f0e5f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1421560477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0907dff4e054429fa10392b730363eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c98b19f-4d", "ovs_interfaceid": "1c98b19f-4dc4-4149-95e0-600e8dadcad5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 16:51:41 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Converting VIF {"id": "1c98b19f-4dc4-4149-95e0-600e8dadcad5", "address": "fa:16:3e:ce:07:de", "network": {"id": "316cb9af-807d-4a69-874e-2054520f0e5f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1421560477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0907dff4e054429fa10392b730363eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c98b19f-4d", "ovs_interfaceid": "1c98b19f-4dc4-4149-95e0-600e8dadcad5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:51:41 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:07:de,bridge_name='br-int',has_traffic_filtering=True,id=1c98b19f-4dc4-4149-95e0-600e8dadcad5,network=Network(316cb9af-807d-4a69-874e-2054520f0e5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c98b19f-4d') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:51:41 user nova-compute[75245]: DEBUG os_vif [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:07:de,bridge_name='br-int',has_traffic_filtering=True,id=1c98b19f-4dc4-4149-95e0-600e8dadcad5,network=Network(316cb9af-807d-4a69-874e-2054520f0e5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c98b19f-4d') {{(pid=75245) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 16:51:41 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:51:41 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:51:41 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 16:51:41 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:51:41 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dcb20c6c-4b0d-5e4d-b5c8-480fcaff67f5', '_type': 'linux-noop'}}, row=False) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:51:41 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:51:41 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:51:41 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:51:41 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1c98b19f-4d, may_exist=True, interface_attrs={}) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:51:41 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1c98b19f-4d, col_values=(('qos', UUID('a2d7eccb-0335-4faa-b8f6-09a71ff1de15')),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:51:41 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1c98b19f-4d, col_values=(('external_ids', {'iface-id': '1c98b19f-4dc4-4149-95e0-600e8dadcad5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:07:de', 'vm-uuid': '131579c4-4b5e-455b-9fbe-6fcda74aa48c'}),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:51:41 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:51:41 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:51:41 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:51:41 user nova-compute[75245]: INFO os_vif [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:07:de,bridge_name='br-int',has_traffic_filtering=True,id=1c98b19f-4dc4-4149-95e0-600e8dadcad5,network=Network(316cb9af-807d-4a69-874e-2054520f0e5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c98b19f-4d')
Nov 29 16:51:41 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:51:41 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] No VIF found with MAC fa:16:3e:ce:07:de, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:51:42 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:51:42 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:51:42 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:51:43 user nova-compute[75245]: DEBUG nova.compute.manager [req-6968376c-7b22-4d72-9f86-1312877a8427 req-5e690476-b9a8-4fc4-ab23-8cc2a3d4fe2d service nova] [instance: 131579c4-4b5e-455b-9fbe-6fcda74aa48c] Received event network-vif-plugged-1c98b19f-4dc4-4149-95e0-600e8dadcad5 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:51:43 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-6968376c-7b22-4d72-9f86-1312877a8427 req-5e690476-b9a8-4fc4-ab23-8cc2a3d4fe2d service nova] Acquiring lock "131579c4-4b5e-455b-9fbe-6fcda74aa48c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:51:43 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-6968376c-7b22-4d72-9f86-1312877a8427 req-5e690476-b9a8-4fc4-ab23-8cc2a3d4fe2d service nova] Lock "131579c4-4b5e-455b-9fbe-6fcda74aa48c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:51:43 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-6968376c-7b22-4d72-9f86-1312877a8427 req-5e690476-b9a8-4fc4-ab23-8cc2a3d4fe2d service nova] Lock "131579c4-4b5e-455b-9fbe-6fcda74aa48c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:51:43 user nova-compute[75245]: DEBUG nova.compute.manager [req-6968376c-7b22-4d72-9f86-1312877a8427 req-5e690476-b9a8-4fc4-ab23-8cc2a3d4fe2d service nova] [instance: 131579c4-4b5e-455b-9fbe-6fcda74aa48c] No waiting events found dispatching network-vif-plugged-1c98b19f-4dc4-4149-95e0-600e8dadcad5 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:51:43 user nova-compute[75245]: WARNING nova.compute.manager [req-6968376c-7b22-4d72-9f86-1312877a8427 req-5e690476-b9a8-4fc4-ab23-8cc2a3d4fe2d service nova] [instance: 131579c4-4b5e-455b-9fbe-6fcda74aa48c] Received unexpected event network-vif-plugged-1c98b19f-4dc4-4149-95e0-600e8dadcad5 for instance with vm_state building and task_state spawning.
Nov 29 16:51:43 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:51:43 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:51:43 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:51:43 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:51:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:51:44 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:51:45 user nova-compute[75245]: DEBUG nova.compute.manager [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 131579c4-4b5e-455b-9fbe-6fcda74aa48c] Instance event wait completed in 0 seconds for  {{(pid=75245) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 16:51:45 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 131579c4-4b5e-455b-9fbe-6fcda74aa48c] Guest created on hypervisor {{(pid=75245) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 16:51:45 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 131579c4-4b5e-455b-9fbe-6fcda74aa48c] Instance spawned successfully.
Nov 29 16:51:45 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 131579c4-4b5e-455b-9fbe-6fcda74aa48c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 16:51:45 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 131579c4-4b5e-455b-9fbe-6fcda74aa48c] Found default for hw_cdrom_bus of ide {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:51:45 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 131579c4-4b5e-455b-9fbe-6fcda74aa48c] Found default for hw_disk_bus of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:51:45 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 131579c4-4b5e-455b-9fbe-6fcda74aa48c] Found default for hw_input_bus of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:51:45 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 131579c4-4b5e-455b-9fbe-6fcda74aa48c] Found default for hw_pointer_model of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:51:45 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 131579c4-4b5e-455b-9fbe-6fcda74aa48c] Found default for hw_video_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:51:45 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 131579c4-4b5e-455b-9fbe-6fcda74aa48c] Found default for hw_vif_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:51:45 user nova-compute[75245]: INFO nova.compute.manager [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 131579c4-4b5e-455b-9fbe-6fcda74aa48c] Took 5.09 seconds to spawn the instance on the hypervisor.
Nov 29 16:51:45 user nova-compute[75245]: DEBUG nova.compute.manager [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 131579c4-4b5e-455b-9fbe-6fcda74aa48c] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:51:45 user nova-compute[75245]: DEBUG nova.compute.manager [req-94833c7b-08e4-4218-91ae-c0a13af1176e req-7a84994c-06cb-4ea7-a58f-87ec5924ca2b service nova] [instance: 131579c4-4b5e-455b-9fbe-6fcda74aa48c] Received event network-vif-plugged-1c98b19f-4dc4-4149-95e0-600e8dadcad5 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:51:45 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-94833c7b-08e4-4218-91ae-c0a13af1176e req-7a84994c-06cb-4ea7-a58f-87ec5924ca2b service nova] Acquiring lock "131579c4-4b5e-455b-9fbe-6fcda74aa48c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:51:45 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-94833c7b-08e4-4218-91ae-c0a13af1176e req-7a84994c-06cb-4ea7-a58f-87ec5924ca2b service nova] Lock "131579c4-4b5e-455b-9fbe-6fcda74aa48c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:51:45 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-94833c7b-08e4-4218-91ae-c0a13af1176e req-7a84994c-06cb-4ea7-a58f-87ec5924ca2b service nova] Lock "131579c4-4b5e-455b-9fbe-6fcda74aa48c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:51:45 user nova-compute[75245]: DEBUG nova.compute.manager [req-94833c7b-08e4-4218-91ae-c0a13af1176e req-7a84994c-06cb-4ea7-a58f-87ec5924ca2b service nova] [instance: 131579c4-4b5e-455b-9fbe-6fcda74aa48c] No waiting events found dispatching network-vif-plugged-1c98b19f-4dc4-4149-95e0-600e8dadcad5 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:51:45 user nova-compute[75245]: WARNING nova.compute.manager [req-94833c7b-08e4-4218-91ae-c0a13af1176e req-7a84994c-06cb-4ea7-a58f-87ec5924ca2b service nova] [instance: 131579c4-4b5e-455b-9fbe-6fcda74aa48c] Received unexpected event network-vif-plugged-1c98b19f-4dc4-4149-95e0-600e8dadcad5 for instance with vm_state building and task_state spawning.
Nov 29 16:51:45 user nova-compute[75245]: INFO nova.compute.manager [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 131579c4-4b5e-455b-9fbe-6fcda74aa48c] Took 18.95 seconds to build instance.
Nov 29 16:51:45 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-c8a5fc53-30c0-4249-aaae-37f035d2a073 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "131579c4-4b5e-455b-9fbe-6fcda74aa48c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.055s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:51:45 user nova-compute[75245]: DEBUG nova.compute.manager [req-91fce931-bd0f-4d0b-9e3b-2bdae758cd1f req-e78d0a0e-5be2-4e94-a45b-e96534800101 service nova] [instance: 24999298-349a-4837-ba75-22192166c5a1] Received event network-changed-01bba9cb-1eaf-4586-9abd-9a2b24a49a95 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:51:45 user nova-compute[75245]: DEBUG nova.compute.manager [req-91fce931-bd0f-4d0b-9e3b-2bdae758cd1f req-e78d0a0e-5be2-4e94-a45b-e96534800101 service nova] [instance: 24999298-349a-4837-ba75-22192166c5a1] Refreshing instance network info cache due to event network-changed-01bba9cb-1eaf-4586-9abd-9a2b24a49a95. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:51:45 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-91fce931-bd0f-4d0b-9e3b-2bdae758cd1f req-e78d0a0e-5be2-4e94-a45b-e96534800101 service nova] Acquiring lock "refresh_cache-24999298-349a-4837-ba75-22192166c5a1" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:51:45 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-91fce931-bd0f-4d0b-9e3b-2bdae758cd1f req-e78d0a0e-5be2-4e94-a45b-e96534800101 service nova] Acquired lock "refresh_cache-24999298-349a-4837-ba75-22192166c5a1" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:51:45 user nova-compute[75245]: DEBUG nova.network.neutron [req-91fce931-bd0f-4d0b-9e3b-2bdae758cd1f req-e78d0a0e-5be2-4e94-a45b-e96534800101 service nova] [instance: 24999298-349a-4837-ba75-22192166c5a1] Refreshing network info cache for port 01bba9cb-1eaf-4586-9abd-9a2b24a49a95 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:51:46 user nova-compute[75245]: DEBUG nova.network.neutron [req-91fce931-bd0f-4d0b-9e3b-2bdae758cd1f req-e78d0a0e-5be2-4e94-a45b-e96534800101 service nova] [instance: 24999298-349a-4837-ba75-22192166c5a1] Updated VIF entry in instance network info cache for port 01bba9cb-1eaf-4586-9abd-9a2b24a49a95. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:51:46 user nova-compute[75245]: DEBUG nova.network.neutron [req-91fce931-bd0f-4d0b-9e3b-2bdae758cd1f req-e78d0a0e-5be2-4e94-a45b-e96534800101 service nova] [instance: 24999298-349a-4837-ba75-22192166c5a1] Updating instance_info_cache with network_info: [{"id": "01bba9cb-1eaf-4586-9abd-9a2b24a49a95", "address": "fa:16:3e:fb:17:6c", "network": {"id": "55744af1-3291-4de1-9bf4-554f9ee4f057", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1570836437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01e269dbe30d46ccb81d58e2590004db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01bba9cb-1e", "ovs_interfaceid": "01bba9cb-1eaf-4586-9abd-9a2b24a49a95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:51:46 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-91fce931-bd0f-4d0b-9e3b-2bdae758cd1f req-e78d0a0e-5be2-4e94-a45b-e96534800101 service nova] Releasing lock "refresh_cache-24999298-349a-4837-ba75-22192166c5a1" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:51:46 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:51:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-6661ac59-8d28-4a73-b7df-a9b634b47a15 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Acquiring lock "24999298-349a-4837-ba75-22192166c5a1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:51:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-6661ac59-8d28-4a73-b7df-a9b634b47a15 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "24999298-349a-4837-ba75-22192166c5a1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:51:48 user nova-compute[75245]: DEBUG nova.objects.instance [None req-6661ac59-8d28-4a73-b7df-a9b634b47a15 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lazy-loading 'flavor' on Instance uuid 24999298-349a-4837-ba75-22192166c5a1 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:51:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-6661ac59-8d28-4a73-b7df-a9b634b47a15 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "24999298-349a-4837-ba75-22192166c5a1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:51:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-6661ac59-8d28-4a73-b7df-a9b634b47a15 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Acquiring lock "24999298-349a-4837-ba75-22192166c5a1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:51:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-6661ac59-8d28-4a73-b7df-a9b634b47a15 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "24999298-349a-4837-ba75-22192166c5a1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:51:48 user nova-compute[75245]: INFO nova.compute.manager [None req-6661ac59-8d28-4a73-b7df-a9b634b47a15 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: 24999298-349a-4837-ba75-22192166c5a1] Attaching volume 79b69122-7621-4cd0-ace9-dfca5ae15c27 to /dev/vdb
Nov 29 16:51:48 user nova-compute[75245]: DEBUG os_brick.utils [None req-6661ac59-8d28-4a73-b7df-a9b634b47a15 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:51:48 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:51:48 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:51:48 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[6668a341-ae08-43a1-9fbf-1171dcbbbc89]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:69ed8ed87091\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:51:48 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:51:48 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:51:48 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8627f0b-5daf-4148-99c5-e6fd89cf4cc6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:51:48 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:51:48 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:51:48 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb9e2ad-32a9-4516-8675-adca696cd4f7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:51:48 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6cf659-843a-4f48-a821-41fb0aa9cd2e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:51:48 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-6661ac59-8d28-4a73-b7df-a9b634b47a15 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Running cmd (subprocess): nvme version {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:51:48 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-6661ac59-8d28-4a73-b7df-a9b634b47a15 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] 'nvme version' failed. Not Retrying. {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:51:48 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6661ac59-8d28-4a73-b7df-a9b634b47a15 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] nvme not present on system {{(pid=75245) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 16:51:48 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:51:48 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:51:48 user nova-compute[75245]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 16:51:48 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[34626cef-7938-4ada-a68c-14fbf44a8769]: (4, '') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:51:48 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-6661ac59-8d28-4a73-b7df-a9b634b47a15 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75245) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 16:51:48 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-6661ac59-8d28-4a73-b7df-a9b634b47a15 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 16:51:48 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-6661ac59-8d28-4a73-b7df-a9b634b47a15 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] LIGHTOS: no hostnqn found. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 16:51:48 user nova-compute[75245]: DEBUG os_brick.utils [None req-6661ac59-8d28-4a73-b7df-a9b634b47a15 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:69ed8ed87091', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:51:48 user nova-compute[75245]: DEBUG nova.virt.block_device [None req-6661ac59-8d28-4a73-b7df-a9b634b47a15 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: 24999298-349a-4837-ba75-22192166c5a1] Updating existing volume attachment record: b9678d4c-9e94-4ec2-a837-e731b00082fa {{(pid=75245) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 16:51:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:51:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:51:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:51:56 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6661ac59-8d28-4a73-b7df-a9b634b47a15 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: 24999298-349a-4837-ba75-22192166c5a1] Calling os-brick to attach iSCSI Volume {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 16:51:56 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-6661ac59-8d28-4a73-b7df-a9b634b47a15 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:79b69122-7621-4cd0-ace9-dfca5ae15c27', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wZHtAWRG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:51:56 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-6661ac59-8d28-4a73-b7df-a9b634b47a15 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:51:56 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-6661ac59-8d28-4a73-b7df-a9b634b47a15 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:51:56 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-6661ac59-8d28-4a73-b7df-a9b634b47a15 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:51:56 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-6661ac59-8d28-4a73-b7df-a9b634b47a15 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:51:56 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-6661ac59-8d28-4a73-b7df-a9b634b47a15 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79b69122-7621-4cd0-ace9-dfca5ae15c27" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:51:56 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-6661ac59-8d28-4a73-b7df-a9b634b47a15 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79b69122-7621-4cd0-ace9-dfca5ae15c27" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:51:56 user nova-compute[75245]: INFO os_brick.initiator.connectors.iscsi [None req-6661ac59-8d28-4a73-b7df-a9b634b47a15 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 16:51:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79b69122-7621-4cd0-ace9-dfca5ae15c27 -p 172.16.0.220:3260 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:51:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79b69122-7621-4cd0-ace9-dfca5ae15c27 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:51:56 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fea5aaa-750c-46d9-a2f9-6b3ac8f527d0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:51:56 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-6661ac59-8d28-4a73-b7df-a9b634b47a15 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 16:51:56 user nova-compute[75245]:  {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:51:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79b69122-7621-4cd0-ace9-dfca5ae15c27 -p 172.16.0.220:3260 --interface default --op new {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:51:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79b69122-7621-4cd0-ace9-dfca5ae15c27 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:51:56 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc0a49d-f8ab-4713-9200-7f3ec4eadf50]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:79b69122-7621-4cd0-ace9-dfca5ae15c27] added\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:51:56 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-6661ac59-8d28-4a73-b7df-a9b634b47a15 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:79b69122-7621-4cd0-ace9-dfca5ae15c27] added
Nov 29 16:51:56 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:51:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79b69122-7621-4cd0-ace9-dfca5ae15c27 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:51:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79b69122-7621-4cd0-ace9-dfca5ae15c27 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:51:56 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac63339-357f-444d-93fd-5c392ab8e993]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:51:56 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-6661ac59-8d28-4a73-b7df-a9b634b47a15 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:51:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79b69122-7621-4cd0-ace9-dfca5ae15c27 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:51:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79b69122-7621-4cd0-ace9-dfca5ae15c27 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:51:56 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c5d6ca-a71f-4cb1-a726-3270b3c7942a]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:51:56 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-6661ac59-8d28-4a73-b7df-a9b634b47a15 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:51:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79b69122-7621-4cd0-ace9-dfca5ae15c27 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wZHtAWRG {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:51:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79b69122-7621-4cd0-ace9-dfca5ae15c27 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wZHtAWRG" returned: 0 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:51:56 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[277223b6-2235-452c-93f9-6573d28be75c]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:51:56 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-6661ac59-8d28-4a73-b7df-a9b634b47a15 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wZHtAWRG'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:51:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79b69122-7621-4cd0-ace9-dfca5ae15c27 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:51:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79b69122-7621-4cd0-ace9-dfca5ae15c27 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:51:56 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[175a4760-b797-4479-872e-7babbdba3498]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:51:56 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-6661ac59-8d28-4a73-b7df-a9b634b47a15 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:51:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:51:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:51:56 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a9d194-99c7-448c-9ef8-a52577666c53]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade63d7a-75e8-49bc-b211-554a246995a8 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:51:56 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-6661ac59-8d28-4a73-b7df-a9b634b47a15 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade63d7a-75e8-49bc-b211-554a246995a8 (non-flash)
Nov 29 16:51:56 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:51:56 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-6661ac59-8d28-4a73-b7df-a9b634b47a15 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade63d7a-75e8-49bc-b211-554a246995a8 (non-flash)
Nov 29 16:51:56 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:51:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79b69122-7621-4cd0-ace9-dfca5ae15c27 -p 172.16.0.220:3260 --login {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:51:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79b69122-7621-4cd0-ace9-dfca5ae15c27 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:51:56 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e0a801-c09b-4c35-937c-ade69f529d3d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:79b69122-7621-4cd0-ace9-dfca5ae15c27, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:79b69122-7621-4cd0-ace9-dfca5ae15c27, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:51:56 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-6661ac59-8d28-4a73-b7df-a9b634b47a15 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:79b69122-7621-4cd0-ace9-dfca5ae15c27, portal: 172.16.0.220,3260]
Nov 29 16:51:56 user nova-compute[75245]: Login to [iface: default, target: iqn.2010-10.org.openstack:79b69122-7621-4cd0-ace9-dfca5ae15c27, portal: 172.16.0.220,3260] successful.
Nov 29 16:51:56 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:51:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79b69122-7621-4cd0-ace9-dfca5ae15c27 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:51:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79b69122-7621-4cd0-ace9-dfca5ae15c27 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:51:56 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d060dd-0b19-4585-9ef2-9ddbda414d8a]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:51:56 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-6661ac59-8d28-4a73-b7df-a9b634b47a15 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:51:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:51:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:51:56 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[e643e950-6ee7-47f6-9551-6fae0dfc421f]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade63d7a-75e8-49bc-b211-554a246995a8 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79b69122-7621-4cd0-ace9-dfca5ae15c27 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:51:56 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-6661ac59-8d28-4a73-b7df-a9b634b47a15 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade63d7a-75e8-49bc-b211-554a246995a8 (non-flash)
Nov 29 16:51:56 user nova-compute[75245]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79b69122-7621-4cd0-ace9-dfca5ae15c27 (non-flash)
Nov 29 16:51:56 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:51:56 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-6661ac59-8d28-4a73-b7df-a9b634b47a15 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade63d7a-75e8-49bc-b211-554a246995a8 (non-flash)
Nov 29 16:51:56 user nova-compute[75245]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79b69122-7621-4cd0-ace9-dfca5ae15c27 (non-flash)
Nov 29 16:51:56 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:51:56 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-6661ac59-8d28-4a73-b7df-a9b634b47a15 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79b69122-7621-4cd0-ace9-dfca5ae15c27" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:51:56 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-6661ac59-8d28-4a73-b7df-a9b634b47a15 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Connected to 172.16.0.220:3260 {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 16:51:56 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-6661ac59-8d28-4a73-b7df-a9b634b47a15 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] HCTL ('34', '-', '-', 0) found on session 50 with lun 0 {{(pid=75245) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 16:51:56 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-6661ac59-8d28-4a73-b7df-a9b634b47a15 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75245) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 16:51:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:51:56 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:51:56 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddca26f9-e025-4d57-aef3-71da2dc9949b]: (4, ('- - 0', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:51:56 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-6661ac59-8d28-4a73-b7df-a9b634b47a15 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75245) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 16:51:56 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-6661ac59-8d28-4a73-b7df-a9b634b47a15 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:79b69122-7621-4cd0-ace9-dfca5ae15c27', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wZHtAWRG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 16:51:56 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:51:57 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-6661ac59-8d28-4a73-b7df-a9b634b47a15 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:51:57 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-6661ac59-8d28-4a73-b7df-a9b634b47a15 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '23039353631653632', 'path': '/dev/sdc'} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:51:57 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6661ac59-8d28-4a73-b7df-a9b634b47a15 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: 24999298-349a-4837-ba75-22192166c5a1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23039353631653632', 'path': '/dev/sdc'} {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 16:51:57 user nova-compute[75245]: DEBUG nova.objects.instance [None req-6661ac59-8d28-4a73-b7df-a9b634b47a15 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lazy-loading 'flavor' on Instance uuid 24999298-349a-4837-ba75-22192166c5a1 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:51:57 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-6661ac59-8d28-4a73-b7df-a9b634b47a15 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 16:51:57 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:51:57 user nova-compute[75245]:   <source dev="/dev/sdc"/>
Nov 29 16:51:57 user nova-compute[75245]:   <target dev="vdb" bus="virtio"/>
Nov 29 16:51:57 user nova-compute[75245]:   <serial>79b69122-7621-4cd0-ace9-dfca5ae15c27</serial>
Nov 29 16:51:57 user nova-compute[75245]: </disk>
Nov 29 16:51:57 user nova-compute[75245]:  {{(pid=75245) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 16:51:58 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-6661ac59-8d28-4a73-b7df-a9b634b47a15 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:51:58 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-6661ac59-8d28-4a73-b7df-a9b634b47a15 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:51:58 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-6661ac59-8d28-4a73-b7df-a9b634b47a15 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] No VIF found with MAC fa:16:3e:fb:17:6c, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:51:58 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-6661ac59-8d28-4a73-b7df-a9b634b47a15 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "24999298-349a-4837-ba75-22192166c5a1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.747s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:51:59 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:51:59 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-360a5834-f611-4841-a76a-e7d20999ad0d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Acquiring lock "24999298-349a-4837-ba75-22192166c5a1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:51:59 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-360a5834-f611-4841-a76a-e7d20999ad0d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "24999298-349a-4837-ba75-22192166c5a1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:51:59 user nova-compute[75245]: INFO nova.compute.manager [None req-360a5834-f611-4841-a76a-e7d20999ad0d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: 24999298-349a-4837-ba75-22192166c5a1] Detaching volume 79b69122-7621-4cd0-ace9-dfca5ae15c27
Nov 29 16:51:59 user nova-compute[75245]: INFO nova.virt.block_device [None req-360a5834-f611-4841-a76a-e7d20999ad0d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: 24999298-349a-4837-ba75-22192166c5a1] Attempting to driver detach volume 79b69122-7621-4cd0-ace9-dfca5ae15c27 from mountpoint /dev/vdb
Nov 29 16:51:59 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-360a5834-f611-4841-a76a-e7d20999ad0d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Attempting to detach device vdb from instance 24999298-349a-4837-ba75-22192166c5a1 from the persistent domain config. {{(pid=75245) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 16:51:59 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-360a5834-f611-4841-a76a-e7d20999ad0d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 16:51:59 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:51:59 user nova-compute[75245]:   <source dev="/dev/sdc"/>
Nov 29 16:51:59 user nova-compute[75245]:   <target dev="vdb" bus="virtio"/>
Nov 29 16:51:59 user nova-compute[75245]:   <serial>79b69122-7621-4cd0-ace9-dfca5ae15c27</serial>
Nov 29 16:51:59 user nova-compute[75245]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 16:51:59 user nova-compute[75245]: </disk>
Nov 29 16:51:59 user nova-compute[75245]:  {{(pid=75245) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 16:51:59 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-360a5834-f611-4841-a76a-e7d20999ad0d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Successfully detached device vdb from instance 24999298-349a-4837-ba75-22192166c5a1 from the persistent domain config.
Nov 29 16:51:59 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-360a5834-f611-4841-a76a-e7d20999ad0d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 24999298-349a-4837-ba75-22192166c5a1 from the live domain config. {{(pid=75245) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 16:51:59 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-360a5834-f611-4841-a76a-e7d20999ad0d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 16:51:59 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:51:59 user nova-compute[75245]:   <source dev="/dev/sdc"/>
Nov 29 16:51:59 user nova-compute[75245]:   <target dev="vdb" bus="virtio"/>
Nov 29 16:51:59 user nova-compute[75245]:   <serial>79b69122-7621-4cd0-ace9-dfca5ae15c27</serial>
Nov 29 16:51:59 user nova-compute[75245]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 16:51:59 user nova-compute[75245]: </disk>
Nov 29 16:51:59 user nova-compute[75245]:  {{(pid=75245) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 16:52:00 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-360a5834-f611-4841-a76a-e7d20999ad0d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 24999298-349a-4837-ba75-22192166c5a1 {{(pid=75245) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 16:52:01 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:52:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:52:06 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:52:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:52:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:52:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:52:16 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:52:19 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:52:20 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-360a5834-f611-4841-a76a-e7d20999ad0d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 24999298-349a-4837-ba75-22192166c5a1 is timed out.
Nov 29 16:52:20 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-360a5834-f611-4841-a76a-e7d20999ad0d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Successfully detached device vdb from instance 24999298-349a-4837-ba75-22192166c5a1 from the live domain config.
Nov 29 16:52:20 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-360a5834-f611-4841-a76a-e7d20999ad0d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: 24999298-349a-4837-ba75-22192166c5a1] calling os-brick to detach iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 16:52:20 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-360a5834-f611-4841-a76a-e7d20999ad0d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, {'target_iqn': 'iqn.2010-10.org.openstack:79b69122-7621-4cd0-ace9-dfca5ae15c27', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wZHtAWRG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:52:20 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-360a5834-f611-4841-a76a-e7d20999ad0d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:52:20 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-360a5834-f611-4841-a76a-e7d20999ad0d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:52:20 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-360a5834-f611-4841-a76a-e7d20999ad0d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:52:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:52:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:52:20 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d9baf62-655c-4920-af30-bc8fe6fba00a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:79b69122-7621-4cd0-ace9-dfca5ae15c27\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ade63d7a-75e8-49bc-b211-554a246995a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:52:20 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-360a5834-f611-4841-a76a-e7d20999ad0d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 16:52:20 user nova-compute[75245]: No targets found.
Nov 29 16:52:20 user nova-compute[75245]: iSNS:
Nov 29 16:52:20 user nova-compute[75245]: No targets found.
Nov 29 16:52:20 user nova-compute[75245]: STATIC:
Nov 29 16:52:20 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:79b69122-7621-4cd0-ace9-dfca5ae15c27
Nov 29 16:52:20 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:52:20 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:52:20 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:ade63d7a-75e8-49bc-b211-554a246995a8
Nov 29 16:52:20 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:52:20 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:52:20 user nova-compute[75245]: FIRMWARE:
Nov 29 16:52:20 user nova-compute[75245]: No targets found.
Nov 29 16:52:20 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:52:20 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-360a5834-f611-4841-a76a-e7d20999ad0d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 16:52:20 user nova-compute[75245]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 16:52:20 user nova-compute[75245]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75245) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 16:52:20 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-360a5834-f611-4841-a76a-e7d20999ad0d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79b69122-7621-4cd0-ace9-dfca5ae15c27', 0)] {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 16:52:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:52:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:52:20 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[49874373-73f5-4abe-8abf-a2a6b17f5c56]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79b69122-7621-4cd0-ace9-dfca5ae15c27\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ade63d7a-75e8-49bc-b211-554a246995a8\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:52:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:52:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:52:20 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d22a27b-2594-40d9-b5da-5949d91565fa]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade63d7a-75e8-49bc-b211-554a246995a8 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79b69122-7621-4cd0-ace9-dfca5ae15c27 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:52:20 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-360a5834-f611-4841-a76a-e7d20999ad0d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade63d7a-75e8-49bc-b211-554a246995a8 (non-flash)
Nov 29 16:52:20 user nova-compute[75245]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79b69122-7621-4cd0-ace9-dfca5ae15c27 (non-flash)
Nov 29 16:52:20 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:52:20 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-360a5834-f611-4841-a76a-e7d20999ad0d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade63d7a-75e8-49bc-b211-554a246995a8 (non-flash)
Nov 29 16:52:20 user nova-compute[75245]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79b69122-7621-4cd0-ace9-dfca5ae15c27 (non-flash)
Nov 29 16:52:20 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:52:20 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-360a5834-f611-4841-a76a-e7d20999ad0d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0d44194a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79b69122-7621-4cd0-ace9-dfca5ae15c27'): ({'sdc'}, set())}) {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 16:52:20 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-360a5834-f611-4841-a76a-e7d20999ad0d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Removing single pathed devices sdc {{(pid=75245) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 16:52:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:52:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:52:20 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dac80dd-5770-4485-84cc-35d44901aa14]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:52:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:52:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:52:20 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[a887ff64-2bbe-40dd-906b-e1204b06b7c7]: (4, ('ok\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:52:20 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-360a5834-f611-4841-a76a-e7d20999ad0d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Flushing IO for device /dev/sdc {{(pid=75245) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 16:52:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:52:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:52:20 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[a69d3138-af22-404c-ade5-cf7422d8e63d]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:52:20 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-360a5834-f611-4841-a76a-e7d20999ad0d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75245) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 16:52:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:52:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:52:20 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[53114573-a7f1-4153-b258-efe3b5637f71]: (4, ('1', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:52:20 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-360a5834-f611-4841-a76a-e7d20999ad0d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 16:52:20 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-360a5834-f611-4841-a76a-e7d20999ad0d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] SCSI volumes sdc have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 16:52:20 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-360a5834-f611-4841-a76a-e7d20999ad0d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79b69122-7621-4cd0-ace9-dfca5ae15c27')] {{(pid=75245) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 16:52:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79b69122-7621-4cd0-ace9-dfca5ae15c27 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:52:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79b69122-7621-4cd0-ace9-dfca5ae15c27 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:52:20 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[57cba7da-8ffc-4458-bfa5-21f1cd89c788]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:52:20 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-360a5834-f611-4841-a76a-e7d20999ad0d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:52:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79b69122-7621-4cd0-ace9-dfca5ae15c27 -p 172.16.0.220:3260 --logout {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:52:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79b69122-7621-4cd0-ace9-dfca5ae15c27 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:52:20 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e1ca5f-714d-4760-bda0-fe10f99f93fe]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:79b69122-7621-4cd0-ace9-dfca5ae15c27, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:79b69122-7621-4cd0-ace9-dfca5ae15c27, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:52:20 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-360a5834-f611-4841-a76a-e7d20999ad0d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:79b69122-7621-4cd0-ace9-dfca5ae15c27, portal: 172.16.0.220,3260]
Nov 29 16:52:20 user nova-compute[75245]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:79b69122-7621-4cd0-ace9-dfca5ae15c27, portal: 172.16.0.220,3260] successful.
Nov 29 16:52:20 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:52:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79b69122-7621-4cd0-ace9-dfca5ae15c27 -p 172.16.0.220:3260 --op delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:52:20 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79b69122-7621-4cd0-ace9-dfca5ae15c27 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:52:20 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4bf74e4-cb1b-4498-b9e3-9e2cdefc4c44]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:52:20 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-360a5834-f611-4841-a76a-e7d20999ad0d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:52:20 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-360a5834-f611-4841-a76a-e7d20999ad0d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:52:20 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-360a5834-f611-4841-a76a-e7d20999ad0d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] <== disconnect_volume: return (303ms) None {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:52:20 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-360a5834-f611-4841-a76a-e7d20999ad0d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: 24999298-349a-4837-ba75-22192166c5a1] Disconnected iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 16:52:21 user nova-compute[75245]: DEBUG nova.objects.instance [None req-360a5834-f611-4841-a76a-e7d20999ad0d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lazy-loading 'flavor' on Instance uuid 24999298-349a-4837-ba75-22192166c5a1 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:52:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-360a5834-f611-4841-a76a-e7d20999ad0d tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "24999298-349a-4837-ba75-22192166c5a1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.644s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:52:21 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:52:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:52:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:52:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:52:21 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75245) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 16:52:21 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:52:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25a0a73c-ed89-4530-aabb-a6a85e030482/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:52:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25a0a73c-ed89-4530-aabb-a6a85e030482/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:52:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25a0a73c-ed89-4530-aabb-a6a85e030482/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:52:22 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25a0a73c-ed89-4530-aabb-a6a85e030482/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:52:22 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcbd317f-c56f-4b4b-8572-c112f778410d/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:52:22 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcbd317f-c56f-4b4b-8572-c112f778410d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:52:22 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcbd317f-c56f-4b4b-8572-c112f778410d/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:52:22 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcbd317f-c56f-4b4b-8572-c112f778410d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:52:22 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24999298-349a-4837-ba75-22192166c5a1/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:52:22 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24999298-349a-4837-ba75-22192166c5a1/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:52:22 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24999298-349a-4837-ba75-22192166c5a1/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:52:22 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24999298-349a-4837-ba75-22192166c5a1/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:52:22 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:52:23 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:52:23 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:52:23 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Hypervisor/Node resource view: name=user free_ram=8557MB free_disk=24.977008819580078GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75245) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 16:52:23 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:52:23 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:52:23 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 25a0a73c-ed89-4530-aabb-a6a85e030482 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:52:23 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 24999298-349a-4837-ba75-22192166c5a1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:52:23 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance fcbd317f-c56f-4b4b-8572-c112f778410d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:52:23 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 131579c4-4b5e-455b-9fbe-6fcda74aa48c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:52:23 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 16:52:23 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 16:52:23 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:52:23 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:52:23 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Compute_service record updated for user:user {{(pid=75245) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 16:52:23 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.331s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:52:26 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:52:26 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Starting heal instance info cache {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 16:52:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "refresh_cache-24999298-349a-4837-ba75-22192166c5a1" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:52:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquired lock "refresh_cache-24999298-349a-4837-ba75-22192166c5a1" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:52:26 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 24999298-349a-4837-ba75-22192166c5a1] Forcefully refreshing network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 16:52:26 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:52:27 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 24999298-349a-4837-ba75-22192166c5a1] Updating instance_info_cache with network_info: [{"id": "01bba9cb-1eaf-4586-9abd-9a2b24a49a95", "address": "fa:16:3e:fb:17:6c", "network": {"id": "55744af1-3291-4de1-9bf4-554f9ee4f057", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1570836437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01e269dbe30d46ccb81d58e2590004db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01bba9cb-1e", "ovs_interfaceid": "01bba9cb-1eaf-4586-9abd-9a2b24a49a95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:52:27 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Releasing lock "refresh_cache-24999298-349a-4837-ba75-22192166c5a1" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:52:27 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 24999298-349a-4837-ba75-22192166c5a1] Updated the network info_cache for instance {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 16:52:27 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:52:29 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:52:30 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:52:30 user nova-compute[75245]: DEBUG nova.compute.manager [req-f4ad66ed-ba7e-47ba-ba05-afe2e477307e req-2ed8b366-cd5f-4e4e-84d3-f65b153ce8cf service nova] [instance: fcbd317f-c56f-4b4b-8572-c112f778410d] Received event network-changed-28570b91-bccd-4af6-8a83-680316f91520 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:52:30 user nova-compute[75245]: DEBUG nova.compute.manager [req-f4ad66ed-ba7e-47ba-ba05-afe2e477307e req-2ed8b366-cd5f-4e4e-84d3-f65b153ce8cf service nova] [instance: fcbd317f-c56f-4b4b-8572-c112f778410d] Refreshing instance network info cache due to event network-changed-28570b91-bccd-4af6-8a83-680316f91520. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:52:30 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-f4ad66ed-ba7e-47ba-ba05-afe2e477307e req-2ed8b366-cd5f-4e4e-84d3-f65b153ce8cf service nova] Acquiring lock "refresh_cache-fcbd317f-c56f-4b4b-8572-c112f778410d" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:52:30 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-f4ad66ed-ba7e-47ba-ba05-afe2e477307e req-2ed8b366-cd5f-4e4e-84d3-f65b153ce8cf service nova] Acquired lock "refresh_cache-fcbd317f-c56f-4b4b-8572-c112f778410d" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:52:30 user nova-compute[75245]: DEBUG nova.network.neutron [req-f4ad66ed-ba7e-47ba-ba05-afe2e477307e req-2ed8b366-cd5f-4e4e-84d3-f65b153ce8cf service nova] [instance: fcbd317f-c56f-4b4b-8572-c112f778410d] Refreshing network info cache for port 28570b91-bccd-4af6-8a83-680316f91520 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:52:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-ba0ac040-6242-4f07-aba5-429d49ba06c3 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Acquiring lock "fcbd317f-c56f-4b4b-8572-c112f778410d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:52:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-ba0ac040-6242-4f07-aba5-429d49ba06c3 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Lock "fcbd317f-c56f-4b4b-8572-c112f778410d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:52:31 user nova-compute[75245]: DEBUG nova.network.neutron [req-f4ad66ed-ba7e-47ba-ba05-afe2e477307e req-2ed8b366-cd5f-4e4e-84d3-f65b153ce8cf service nova] [instance: fcbd317f-c56f-4b4b-8572-c112f778410d] Updated VIF entry in instance network info cache for port 28570b91-bccd-4af6-8a83-680316f91520. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:52:31 user nova-compute[75245]: DEBUG nova.network.neutron [req-f4ad66ed-ba7e-47ba-ba05-afe2e477307e req-2ed8b366-cd5f-4e4e-84d3-f65b153ce8cf service nova] [instance: fcbd317f-c56f-4b4b-8572-c112f778410d] Updating instance_info_cache with network_info: [{"id": "28570b91-bccd-4af6-8a83-680316f91520", "address": "fa:16:3e:22:83:df", "network": {"id": "2eac25a6-c643-4348-98eb-91d044f1714c", "bridge": "br-int", "label": "tempest-TestStampPattern-1438802163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d056f7dae1d94936bd1fed295f0eba16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28570b91-bc", "ovs_interfaceid": "28570b91-bccd-4af6-8a83-680316f91520", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:52:31 user nova-compute[75245]: DEBUG nova.objects.instance [None req-ba0ac040-6242-4f07-aba5-429d49ba06c3 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Lazy-loading 'flavor' on Instance uuid fcbd317f-c56f-4b4b-8572-c112f778410d {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:52:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-f4ad66ed-ba7e-47ba-ba05-afe2e477307e req-2ed8b366-cd5f-4e4e-84d3-f65b153ce8cf service nova] Releasing lock "refresh_cache-fcbd317f-c56f-4b4b-8572-c112f778410d" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:52:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-ba0ac040-6242-4f07-aba5-429d49ba06c3 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Lock "fcbd317f-c56f-4b4b-8572-c112f778410d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:52:31 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:52:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-ba0ac040-6242-4f07-aba5-429d49ba06c3 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Acquiring lock "fcbd317f-c56f-4b4b-8572-c112f778410d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:52:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-ba0ac040-6242-4f07-aba5-429d49ba06c3 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Lock "fcbd317f-c56f-4b4b-8572-c112f778410d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:52:31 user nova-compute[75245]: INFO nova.compute.manager [None req-ba0ac040-6242-4f07-aba5-429d49ba06c3 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: fcbd317f-c56f-4b4b-8572-c112f778410d] Attaching volume 548a01d1-d9f9-4576-9add-bf06ca6cfc13 to /dev/vdb
Nov 29 16:52:31 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:52:31 user nova-compute[75245]: DEBUG os_brick.utils [None req-ba0ac040-6242-4f07-aba5-429d49ba06c3 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:52:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:52:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:52:31 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[744020b6-52d1-4ac5-9181-7ad33115052c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:69ed8ed87091\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:52:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:52:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:52:31 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b6d4fa-0623-4b97-8cdf-634f19600fa6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:52:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:52:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:52:31 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ab2473-7708-4d3a-adbd-0a6beab89dee]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:52:31 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[a42d5e09-b83b-40db-89ff-edb880cc670f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:52:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-ba0ac040-6242-4f07-aba5-429d49ba06c3 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Running cmd (subprocess): nvme version {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:52:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-ba0ac040-6242-4f07-aba5-429d49ba06c3 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] 'nvme version' failed. Not Retrying. {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:52:31 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ba0ac040-6242-4f07-aba5-429d49ba06c3 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] nvme not present on system {{(pid=75245) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 16:52:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:52:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:52:31 user nova-compute[75245]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 16:52:31 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f25a7e-a506-480b-874e-23e38ae6099f]: (4, '') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:52:31 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-ba0ac040-6242-4f07-aba5-429d49ba06c3 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75245) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 16:52:31 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-ba0ac040-6242-4f07-aba5-429d49ba06c3 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 16:52:31 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-ba0ac040-6242-4f07-aba5-429d49ba06c3 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] LIGHTOS: no hostnqn found. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 16:52:31 user nova-compute[75245]: DEBUG os_brick.utils [None req-ba0ac040-6242-4f07-aba5-429d49ba06c3 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:69ed8ed87091', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:52:31 user nova-compute[75245]: DEBUG nova.virt.block_device [None req-ba0ac040-6242-4f07-aba5-429d49ba06c3 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: fcbd317f-c56f-4b4b-8572-c112f778410d] Updating existing volume attachment record: aad801d8-6443-498c-a64f-bc9c8e167f2e {{(pid=75245) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 16:52:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:52:36 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:52:36 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:52:38 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:52:38 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba0ac040-6242-4f07-aba5-429d49ba06c3 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: fcbd317f-c56f-4b4b-8572-c112f778410d] Calling os-brick to attach iSCSI Volume {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 16:52:38 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba0ac040-6242-4f07-aba5-429d49ba06c3 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:548a01d1-d9f9-4576-9add-bf06ca6cfc13', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'psXLkQEC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:52:38 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-ba0ac040-6242-4f07-aba5-429d49ba06c3 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:52:38 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-ba0ac040-6242-4f07-aba5-429d49ba06c3 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:52:38 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-ba0ac040-6242-4f07-aba5-429d49ba06c3 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:52:38 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-ba0ac040-6242-4f07-aba5-429d49ba06c3 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:52:38 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-ba0ac040-6242-4f07-aba5-429d49ba06c3 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:548a01d1-d9f9-4576-9add-bf06ca6cfc13" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:52:38 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-ba0ac040-6242-4f07-aba5-429d49ba06c3 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:548a01d1-d9f9-4576-9add-bf06ca6cfc13" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:52:38 user nova-compute[75245]: INFO os_brick.initiator.connectors.iscsi [None req-ba0ac040-6242-4f07-aba5-429d49ba06c3 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 16:52:38 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:548a01d1-d9f9-4576-9add-bf06ca6cfc13 -p 172.16.0.220:3260 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:52:38 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:548a01d1-d9f9-4576-9add-bf06ca6cfc13 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:52:38 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eafdbdb-560e-4941-a477-4e8e8a6a863c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:52:38 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba0ac040-6242-4f07-aba5-429d49ba06c3 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 16:52:38 user nova-compute[75245]:  {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:52:39 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:548a01d1-d9f9-4576-9add-bf06ca6cfc13 -p 172.16.0.220:3260 --interface default --op new {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:52:39 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:548a01d1-d9f9-4576-9add-bf06ca6cfc13 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:52:39 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[c68c7060-10ec-43c7-98c6-282827c91936]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:548a01d1-d9f9-4576-9add-bf06ca6cfc13] added\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:52:39 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba0ac040-6242-4f07-aba5-429d49ba06c3 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:548a01d1-d9f9-4576-9add-bf06ca6cfc13] added
Nov 29 16:52:39 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:52:39 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:548a01d1-d9f9-4576-9add-bf06ca6cfc13 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:52:39 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:548a01d1-d9f9-4576-9add-bf06ca6cfc13 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:52:39 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[348c2623-2ef6-47c6-afbd-7d460e653150]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:52:39 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba0ac040-6242-4f07-aba5-429d49ba06c3 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:52:39 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:548a01d1-d9f9-4576-9add-bf06ca6cfc13 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:52:39 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:548a01d1-d9f9-4576-9add-bf06ca6cfc13 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:52:39 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[98fc97d0-4ea6-4a3f-8e39-06d0eeb47450]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:52:39 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba0ac040-6242-4f07-aba5-429d49ba06c3 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:52:39 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:548a01d1-d9f9-4576-9add-bf06ca6cfc13 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v psXLkQEC {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:52:39 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:548a01d1-d9f9-4576-9add-bf06ca6cfc13 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v psXLkQEC" returned: 0 in 0.022s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:52:39 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a65d0a-5d7b-4666-8ff0-f4324a327d72]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:52:39 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba0ac040-6242-4f07-aba5-429d49ba06c3 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'psXLkQEC'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:52:39 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:548a01d1-d9f9-4576-9add-bf06ca6cfc13 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:52:39 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:548a01d1-d9f9-4576-9add-bf06ca6cfc13 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:52:39 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[b013a07b-6273-461b-a942-aba28f6789a7]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:52:39 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba0ac040-6242-4f07-aba5-429d49ba06c3 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:52:39 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:52:39 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:52:39 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[6149e6f0-ace3-4a11-93e0-ee9824e732fb]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade63d7a-75e8-49bc-b211-554a246995a8 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:52:39 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba0ac040-6242-4f07-aba5-429d49ba06c3 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade63d7a-75e8-49bc-b211-554a246995a8 (non-flash)
Nov 29 16:52:39 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:52:39 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba0ac040-6242-4f07-aba5-429d49ba06c3 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade63d7a-75e8-49bc-b211-554a246995a8 (non-flash)
Nov 29 16:52:39 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:52:39 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:548a01d1-d9f9-4576-9add-bf06ca6cfc13 -p 172.16.0.220:3260 --login {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:52:39 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:548a01d1-d9f9-4576-9add-bf06ca6cfc13 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:52:39 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e32ca63-9330-4c25-884c-f17ff4a0c56f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:548a01d1-d9f9-4576-9add-bf06ca6cfc13, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:548a01d1-d9f9-4576-9add-bf06ca6cfc13, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:52:39 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba0ac040-6242-4f07-aba5-429d49ba06c3 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:548a01d1-d9f9-4576-9add-bf06ca6cfc13, portal: 172.16.0.220,3260]
Nov 29 16:52:39 user nova-compute[75245]: Login to [iface: default, target: iqn.2010-10.org.openstack:548a01d1-d9f9-4576-9add-bf06ca6cfc13, portal: 172.16.0.220,3260] successful.
Nov 29 16:52:39 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:52:39 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:548a01d1-d9f9-4576-9add-bf06ca6cfc13 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:52:39 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:548a01d1-d9f9-4576-9add-bf06ca6cfc13 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:52:39 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea097319-7175-4716-a796-5d3bc0da292e]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:52:39 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba0ac040-6242-4f07-aba5-429d49ba06c3 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:52:39 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:52:39 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:52:39 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9dd8c75-2c9b-4211-8fe2-7dea9870efd7]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade63d7a-75e8-49bc-b211-554a246995a8 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:548a01d1-d9f9-4576-9add-bf06ca6cfc13 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:52:39 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba0ac040-6242-4f07-aba5-429d49ba06c3 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade63d7a-75e8-49bc-b211-554a246995a8 (non-flash)
Nov 29 16:52:39 user nova-compute[75245]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:548a01d1-d9f9-4576-9add-bf06ca6cfc13 (non-flash)
Nov 29 16:52:39 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:52:39 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba0ac040-6242-4f07-aba5-429d49ba06c3 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade63d7a-75e8-49bc-b211-554a246995a8 (non-flash)
Nov 29 16:52:39 user nova-compute[75245]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:548a01d1-d9f9-4576-9add-bf06ca6cfc13 (non-flash)
Nov 29 16:52:39 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:52:39 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-ba0ac040-6242-4f07-aba5-429d49ba06c3 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:548a01d1-d9f9-4576-9add-bf06ca6cfc13" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:52:39 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba0ac040-6242-4f07-aba5-429d49ba06c3 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Connected to 172.16.0.220:3260 {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 16:52:39 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-ba0ac040-6242-4f07-aba5-429d49ba06c3 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] HCTL ('34', '-', '-', 0) found on session 51 with lun 0 {{(pid=75245) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 16:52:39 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-ba0ac040-6242-4f07-aba5-429d49ba06c3 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75245) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 16:52:39 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:52:39 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:52:39 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[f460ef0c-7cc5-4721-881c-f0cafdf09e68]: (4, ('- - 0', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:52:39 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-ba0ac040-6242-4f07-aba5-429d49ba06c3 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75245) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 16:52:39 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba0ac040-6242-4f07-aba5-429d49ba06c3 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:548a01d1-d9f9-4576-9add-bf06ca6cfc13', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'psXLkQEC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 16:52:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:52:39 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:52:39 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75245) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 16:52:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-ba0ac040-6242-4f07-aba5-429d49ba06c3 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:52:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba0ac040-6242-4f07-aba5-429d49ba06c3 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '23231393135626238', 'path': '/dev/sdc'} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:52:40 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba0ac040-6242-4f07-aba5-429d49ba06c3 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: fcbd317f-c56f-4b4b-8572-c112f778410d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23231393135626238', 'path': '/dev/sdc'} {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 16:52:40 user nova-compute[75245]: DEBUG nova.objects.instance [None req-ba0ac040-6242-4f07-aba5-429d49ba06c3 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Lazy-loading 'flavor' on Instance uuid fcbd317f-c56f-4b4b-8572-c112f778410d {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:52:40 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-ba0ac040-6242-4f07-aba5-429d49ba06c3 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 16:52:40 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:52:40 user nova-compute[75245]:   <source dev="/dev/sdc"/>
Nov 29 16:52:40 user nova-compute[75245]:   <target dev="vdb" bus="virtio"/>
Nov 29 16:52:40 user nova-compute[75245]:   <serial>548a01d1-d9f9-4576-9add-bf06ca6cfc13</serial>
Nov 29 16:52:40 user nova-compute[75245]: </disk>
Nov 29 16:52:40 user nova-compute[75245]:  {{(pid=75245) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 16:52:40 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-ba0ac040-6242-4f07-aba5-429d49ba06c3 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:52:40 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-ba0ac040-6242-4f07-aba5-429d49ba06c3 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:52:40 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-ba0ac040-6242-4f07-aba5-429d49ba06c3 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] No VIF found with MAC fa:16:3e:22:83:df, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:52:40 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-ba0ac040-6242-4f07-aba5-429d49ba06c3 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Lock "fcbd317f-c56f-4b4b-8572-c112f778410d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.265s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:52:41 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:52:42 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-a243cd9e-a16f-42dd-b3fe-344fd28fdff8 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Acquiring lock "fcbd317f-c56f-4b4b-8572-c112f778410d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:52:42 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-a243cd9e-a16f-42dd-b3fe-344fd28fdff8 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Lock "fcbd317f-c56f-4b4b-8572-c112f778410d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:52:42 user nova-compute[75245]: INFO nova.compute.manager [None req-a243cd9e-a16f-42dd-b3fe-344fd28fdff8 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: fcbd317f-c56f-4b4b-8572-c112f778410d] Detaching volume 548a01d1-d9f9-4576-9add-bf06ca6cfc13
Nov 29 16:52:42 user nova-compute[75245]: INFO nova.virt.block_device [None req-a243cd9e-a16f-42dd-b3fe-344fd28fdff8 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: fcbd317f-c56f-4b4b-8572-c112f778410d] Attempting to driver detach volume 548a01d1-d9f9-4576-9add-bf06ca6cfc13 from mountpoint /dev/vdb
Nov 29 16:52:42 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-a243cd9e-a16f-42dd-b3fe-344fd28fdff8 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Attempting to detach device vdb from instance fcbd317f-c56f-4b4b-8572-c112f778410d from the persistent domain config. {{(pid=75245) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 16:52:42 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-a243cd9e-a16f-42dd-b3fe-344fd28fdff8 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 16:52:42 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:52:42 user nova-compute[75245]:   <source dev="/dev/sdc"/>
Nov 29 16:52:42 user nova-compute[75245]:   <target dev="vdb" bus="virtio"/>
Nov 29 16:52:42 user nova-compute[75245]:   <serial>548a01d1-d9f9-4576-9add-bf06ca6cfc13</serial>
Nov 29 16:52:42 user nova-compute[75245]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 16:52:42 user nova-compute[75245]: </disk>
Nov 29 16:52:42 user nova-compute[75245]:  {{(pid=75245) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 16:52:42 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-a243cd9e-a16f-42dd-b3fe-344fd28fdff8 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Successfully detached device vdb from instance fcbd317f-c56f-4b4b-8572-c112f778410d from the persistent domain config.
Nov 29 16:52:42 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-a243cd9e-a16f-42dd-b3fe-344fd28fdff8 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fcbd317f-c56f-4b4b-8572-c112f778410d from the live domain config. {{(pid=75245) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 16:52:42 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-a243cd9e-a16f-42dd-b3fe-344fd28fdff8 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 16:52:42 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:52:42 user nova-compute[75245]:   <source dev="/dev/sdc"/>
Nov 29 16:52:42 user nova-compute[75245]:   <target dev="vdb" bus="virtio"/>
Nov 29 16:52:42 user nova-compute[75245]:   <serial>548a01d1-d9f9-4576-9add-bf06ca6cfc13</serial>
Nov 29 16:52:42 user nova-compute[75245]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 16:52:42 user nova-compute[75245]: </disk>
Nov 29 16:52:42 user nova-compute[75245]:  {{(pid=75245) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 16:52:43 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-a243cd9e-a16f-42dd-b3fe-344fd28fdff8 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fcbd317f-c56f-4b4b-8572-c112f778410d {{(pid=75245) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 16:52:43 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:52:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:52:44 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:52:46 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:52:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:52:49 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d6d9887e-3346-4edc-9597-a5e0614e0a68 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Acquiring lock "24999298-349a-4837-ba75-22192166c5a1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:52:49 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d6d9887e-3346-4edc-9597-a5e0614e0a68 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "24999298-349a-4837-ba75-22192166c5a1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:52:49 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d6d9887e-3346-4edc-9597-a5e0614e0a68 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Acquiring lock "24999298-349a-4837-ba75-22192166c5a1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:52:49 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d6d9887e-3346-4edc-9597-a5e0614e0a68 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "24999298-349a-4837-ba75-22192166c5a1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:52:49 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d6d9887e-3346-4edc-9597-a5e0614e0a68 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "24999298-349a-4837-ba75-22192166c5a1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:52:49 user nova-compute[75245]: INFO nova.compute.manager [None req-d6d9887e-3346-4edc-9597-a5e0614e0a68 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: 24999298-349a-4837-ba75-22192166c5a1] Terminating instance
Nov 29 16:52:49 user nova-compute[75245]: DEBUG nova.compute.manager [None req-d6d9887e-3346-4edc-9597-a5e0614e0a68 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: 24999298-349a-4837-ba75-22192166c5a1] Start destroying the instance on the hypervisor. {{(pid=75245) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 16:52:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:52:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:52:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:52:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:52:50 user nova-compute[75245]: DEBUG nova.compute.manager [req-d065f55a-33f7-465c-9ba2-945caaca7cee req-b09154bb-8332-42d9-8a4b-af88a3089e62 service nova] [instance: 24999298-349a-4837-ba75-22192166c5a1] Received event network-vif-unplugged-01bba9cb-1eaf-4586-9abd-9a2b24a49a95 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:52:50 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d065f55a-33f7-465c-9ba2-945caaca7cee req-b09154bb-8332-42d9-8a4b-af88a3089e62 service nova] Acquiring lock "24999298-349a-4837-ba75-22192166c5a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:52:50 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d065f55a-33f7-465c-9ba2-945caaca7cee req-b09154bb-8332-42d9-8a4b-af88a3089e62 service nova] Lock "24999298-349a-4837-ba75-22192166c5a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:52:50 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d065f55a-33f7-465c-9ba2-945caaca7cee req-b09154bb-8332-42d9-8a4b-af88a3089e62 service nova] Lock "24999298-349a-4837-ba75-22192166c5a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:52:50 user nova-compute[75245]: DEBUG nova.compute.manager [req-d065f55a-33f7-465c-9ba2-945caaca7cee req-b09154bb-8332-42d9-8a4b-af88a3089e62 service nova] [instance: 24999298-349a-4837-ba75-22192166c5a1] No waiting events found dispatching network-vif-unplugged-01bba9cb-1eaf-4586-9abd-9a2b24a49a95 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:52:50 user nova-compute[75245]: DEBUG nova.compute.manager [req-d065f55a-33f7-465c-9ba2-945caaca7cee req-b09154bb-8332-42d9-8a4b-af88a3089e62 service nova] [instance: 24999298-349a-4837-ba75-22192166c5a1] Received event network-vif-unplugged-01bba9cb-1eaf-4586-9abd-9a2b24a49a95 for instance with task_state deleting. {{(pid=75245) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 16:52:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:52:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:52:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:52:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:52:50 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 24999298-349a-4837-ba75-22192166c5a1] Instance destroyed successfully.
Nov 29 16:52:50 user nova-compute[75245]: DEBUG nova.objects.instance [None req-d6d9887e-3346-4edc-9597-a5e0614e0a68 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lazy-loading 'resources' on Instance uuid 24999298-349a-4837-ba75-22192166c5a1 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:52:50 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-d6d9887e-3346-4edc-9597-a5e0614e0a68 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:49:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1519020680',display_name='tempest-AttachVolumeNegativeTest-server-1519020680',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1519020680',id=42,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCy5fpeG5p0olDyutsXx3FoPQoXSTWYLYAm1DAhocFyIVaYrpUWHMYuivi6WZweFTIOgMQueUyMronz2lA/VbcTqekWYgJ2WOGME+S9d6Boy/VclREVXvVQDViK6Wu97tA==',key_name='tempest-keypair-395098351',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:50:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='01e269dbe30d46ccb81d58e2590004db',ramdisk_id='',reservation_id='r-e99av8ms',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-44169219',owner_user_name='tempest-AttachVolumeNegativeTest-44169219-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:50:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb4c94298bf14753bb9530633e766dee',uuid=24999298-349a-4837-ba75-22192166c5a1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "01bba9cb-1eaf-4586-9abd-9a2b24a49a95", "address": "fa:16:3e:fb:17:6c", "network": {"id": "55744af1-3291-4de1-9bf4-554f9ee4f057", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1570836437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01e269dbe30d46ccb81d58e2590004db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01bba9cb-1e", "ovs_interfaceid": "01bba9cb-1eaf-4586-9abd-9a2b24a49a95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 16:52:50 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-d6d9887e-3346-4edc-9597-a5e0614e0a68 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Converting VIF {"id": "01bba9cb-1eaf-4586-9abd-9a2b24a49a95", "address": "fa:16:3e:fb:17:6c", "network": {"id": "55744af1-3291-4de1-9bf4-554f9ee4f057", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1570836437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01e269dbe30d46ccb81d58e2590004db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01bba9cb-1e", "ovs_interfaceid": "01bba9cb-1eaf-4586-9abd-9a2b24a49a95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:52:50 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-d6d9887e-3346-4edc-9597-a5e0614e0a68 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fb:17:6c,bridge_name='br-int',has_traffic_filtering=True,id=01bba9cb-1eaf-4586-9abd-9a2b24a49a95,network=Network(55744af1-3291-4de1-9bf4-554f9ee4f057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01bba9cb-1e') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:52:50 user nova-compute[75245]: DEBUG os_vif [None req-d6d9887e-3346-4edc-9597-a5e0614e0a68 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:17:6c,bridge_name='br-int',has_traffic_filtering=True,id=01bba9cb-1eaf-4586-9abd-9a2b24a49a95,network=Network(55744af1-3291-4de1-9bf4-554f9ee4f057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01bba9cb-1e') {{(pid=75245) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 16:52:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:52:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:52:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap01bba9cb-1e, bridge=br-int, if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:52:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:52:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:52:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:52:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=72d6d4d4-7f30-4bc3-ac10-a4eb8d7fb6cf) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:52:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:52:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:52:50 user nova-compute[75245]: INFO os_vif [None req-d6d9887e-3346-4edc-9597-a5e0614e0a68 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:17:6c,bridge_name='br-int',has_traffic_filtering=True,id=01bba9cb-1eaf-4586-9abd-9a2b24a49a95,network=Network(55744af1-3291-4de1-9bf4-554f9ee4f057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01bba9cb-1e')
Nov 29 16:52:50 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-d6d9887e-3346-4edc-9597-a5e0614e0a68 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: 24999298-349a-4837-ba75-22192166c5a1] Deleting instance files /opt/stack/data/nova/instances/24999298-349a-4837-ba75-22192166c5a1_del
Nov 29 16:52:50 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-d6d9887e-3346-4edc-9597-a5e0614e0a68 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: 24999298-349a-4837-ba75-22192166c5a1] Deletion of /opt/stack/data/nova/instances/24999298-349a-4837-ba75-22192166c5a1_del complete
Nov 29 16:52:50 user nova-compute[75245]: INFO nova.compute.manager [None req-d6d9887e-3346-4edc-9597-a5e0614e0a68 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] [instance: 24999298-349a-4837-ba75-22192166c5a1] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 29 16:52:50 user nova-compute[75245]: DEBUG oslo.service.loopingcall [None req-d6d9887e-3346-4edc-9597-a5e0614e0a68 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75245) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 16:52:50 user nova-compute[75245]: DEBUG nova.compute.manager [-] [instance: 24999298-349a-4837-ba75-22192166c5a1] Deallocating network for instance {{(pid=75245) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 16:52:50 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: 24999298-349a-4837-ba75-22192166c5a1] deallocate_for_instance() {{(pid=75245) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 16:52:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:52:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:52:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:52:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:52:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:52:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:52:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:52:51 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: 24999298-349a-4837-ba75-22192166c5a1] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:52:51 user nova-compute[75245]: INFO nova.compute.manager [-] [instance: 24999298-349a-4837-ba75-22192166c5a1] Took 0.94 seconds to deallocate network for instance.
Nov 29 16:52:51 user nova-compute[75245]: DEBUG nova.compute.manager [req-71c1eb98-4445-4b6d-9386-d8f77f67f763 req-e25c5d08-91e0-4439-9eba-0cb2826cd18e service nova] [instance: 24999298-349a-4837-ba75-22192166c5a1] Received event network-vif-deleted-01bba9cb-1eaf-4586-9abd-9a2b24a49a95 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:52:51 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d6d9887e-3346-4edc-9597-a5e0614e0a68 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:52:51 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d6d9887e-3346-4edc-9597-a5e0614e0a68 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:52:52 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-d6d9887e-3346-4edc-9597-a5e0614e0a68 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:52:52 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-d6d9887e-3346-4edc-9597-a5e0614e0a68 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:52:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d6d9887e-3346-4edc-9597-a5e0614e0a68 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.177s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:52:52 user nova-compute[75245]: INFO nova.scheduler.client.report [None req-d6d9887e-3346-4edc-9597-a5e0614e0a68 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Deleted allocations for instance 24999298-349a-4837-ba75-22192166c5a1
Nov 29 16:52:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d6d9887e-3346-4edc-9597-a5e0614e0a68 tempest-AttachVolumeNegativeTest-44169219 tempest-AttachVolumeNegativeTest-44169219-project-member] Lock "24999298-349a-4837-ba75-22192166c5a1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.213s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:52:52 user nova-compute[75245]: DEBUG nova.compute.manager [req-a5e8ec80-9301-4b2a-8aa2-2832cea87ee0 req-6209a0a1-aa1e-4ed7-b128-58e693c21fdd service nova] [instance: 24999298-349a-4837-ba75-22192166c5a1] Received event network-vif-plugged-01bba9cb-1eaf-4586-9abd-9a2b24a49a95 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:52:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a5e8ec80-9301-4b2a-8aa2-2832cea87ee0 req-6209a0a1-aa1e-4ed7-b128-58e693c21fdd service nova] Acquiring lock "24999298-349a-4837-ba75-22192166c5a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:52:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a5e8ec80-9301-4b2a-8aa2-2832cea87ee0 req-6209a0a1-aa1e-4ed7-b128-58e693c21fdd service nova] Lock "24999298-349a-4837-ba75-22192166c5a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:52:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a5e8ec80-9301-4b2a-8aa2-2832cea87ee0 req-6209a0a1-aa1e-4ed7-b128-58e693c21fdd service nova] Lock "24999298-349a-4837-ba75-22192166c5a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:52:52 user nova-compute[75245]: DEBUG nova.compute.manager [req-a5e8ec80-9301-4b2a-8aa2-2832cea87ee0 req-6209a0a1-aa1e-4ed7-b128-58e693c21fdd service nova] [instance: 24999298-349a-4837-ba75-22192166c5a1] No waiting events found dispatching network-vif-plugged-01bba9cb-1eaf-4586-9abd-9a2b24a49a95 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:52:52 user nova-compute[75245]: WARNING nova.compute.manager [req-a5e8ec80-9301-4b2a-8aa2-2832cea87ee0 req-6209a0a1-aa1e-4ed7-b128-58e693c21fdd service nova] [instance: 24999298-349a-4837-ba75-22192166c5a1] Received unexpected event network-vif-plugged-01bba9cb-1eaf-4586-9abd-9a2b24a49a95 for instance with vm_state deleted and task_state None.
Nov 29 16:52:52 user nova-compute[75245]: DEBUG nova.compute.manager [req-a5e8ec80-9301-4b2a-8aa2-2832cea87ee0 req-6209a0a1-aa1e-4ed7-b128-58e693c21fdd service nova] [instance: 24999298-349a-4837-ba75-22192166c5a1] Received event network-vif-plugged-01bba9cb-1eaf-4586-9abd-9a2b24a49a95 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:52:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a5e8ec80-9301-4b2a-8aa2-2832cea87ee0 req-6209a0a1-aa1e-4ed7-b128-58e693c21fdd service nova] Acquiring lock "24999298-349a-4837-ba75-22192166c5a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:52:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a5e8ec80-9301-4b2a-8aa2-2832cea87ee0 req-6209a0a1-aa1e-4ed7-b128-58e693c21fdd service nova] Lock "24999298-349a-4837-ba75-22192166c5a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:52:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a5e8ec80-9301-4b2a-8aa2-2832cea87ee0 req-6209a0a1-aa1e-4ed7-b128-58e693c21fdd service nova] Lock "24999298-349a-4837-ba75-22192166c5a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:52:52 user nova-compute[75245]: DEBUG nova.compute.manager [req-a5e8ec80-9301-4b2a-8aa2-2832cea87ee0 req-6209a0a1-aa1e-4ed7-b128-58e693c21fdd service nova] [instance: 24999298-349a-4837-ba75-22192166c5a1] No waiting events found dispatching network-vif-plugged-01bba9cb-1eaf-4586-9abd-9a2b24a49a95 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:52:52 user nova-compute[75245]: WARNING nova.compute.manager [req-a5e8ec80-9301-4b2a-8aa2-2832cea87ee0 req-6209a0a1-aa1e-4ed7-b128-58e693c21fdd service nova] [instance: 24999298-349a-4837-ba75-22192166c5a1] Received unexpected event network-vif-plugged-01bba9cb-1eaf-4586-9abd-9a2b24a49a95 for instance with vm_state deleted and task_state None.
Nov 29 16:52:52 user nova-compute[75245]: DEBUG nova.compute.manager [req-a5e8ec80-9301-4b2a-8aa2-2832cea87ee0 req-6209a0a1-aa1e-4ed7-b128-58e693c21fdd service nova] [instance: 24999298-349a-4837-ba75-22192166c5a1] Received event network-vif-plugged-01bba9cb-1eaf-4586-9abd-9a2b24a49a95 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:52:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a5e8ec80-9301-4b2a-8aa2-2832cea87ee0 req-6209a0a1-aa1e-4ed7-b128-58e693c21fdd service nova] Acquiring lock "24999298-349a-4837-ba75-22192166c5a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:52:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a5e8ec80-9301-4b2a-8aa2-2832cea87ee0 req-6209a0a1-aa1e-4ed7-b128-58e693c21fdd service nova] Lock "24999298-349a-4837-ba75-22192166c5a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:52:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a5e8ec80-9301-4b2a-8aa2-2832cea87ee0 req-6209a0a1-aa1e-4ed7-b128-58e693c21fdd service nova] Lock "24999298-349a-4837-ba75-22192166c5a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:52:52 user nova-compute[75245]: DEBUG nova.compute.manager [req-a5e8ec80-9301-4b2a-8aa2-2832cea87ee0 req-6209a0a1-aa1e-4ed7-b128-58e693c21fdd service nova] [instance: 24999298-349a-4837-ba75-22192166c5a1] No waiting events found dispatching network-vif-plugged-01bba9cb-1eaf-4586-9abd-9a2b24a49a95 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:52:52 user nova-compute[75245]: WARNING nova.compute.manager [req-a5e8ec80-9301-4b2a-8aa2-2832cea87ee0 req-6209a0a1-aa1e-4ed7-b128-58e693c21fdd service nova] [instance: 24999298-349a-4837-ba75-22192166c5a1] Received unexpected event network-vif-plugged-01bba9cb-1eaf-4586-9abd-9a2b24a49a95 for instance with vm_state deleted and task_state None.
Nov 29 16:52:52 user nova-compute[75245]: DEBUG nova.compute.manager [req-a5e8ec80-9301-4b2a-8aa2-2832cea87ee0 req-6209a0a1-aa1e-4ed7-b128-58e693c21fdd service nova] [instance: 24999298-349a-4837-ba75-22192166c5a1] Received event network-vif-unplugged-01bba9cb-1eaf-4586-9abd-9a2b24a49a95 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:52:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a5e8ec80-9301-4b2a-8aa2-2832cea87ee0 req-6209a0a1-aa1e-4ed7-b128-58e693c21fdd service nova] Acquiring lock "24999298-349a-4837-ba75-22192166c5a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:52:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a5e8ec80-9301-4b2a-8aa2-2832cea87ee0 req-6209a0a1-aa1e-4ed7-b128-58e693c21fdd service nova] Lock "24999298-349a-4837-ba75-22192166c5a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:52:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a5e8ec80-9301-4b2a-8aa2-2832cea87ee0 req-6209a0a1-aa1e-4ed7-b128-58e693c21fdd service nova] Lock "24999298-349a-4837-ba75-22192166c5a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:52:52 user nova-compute[75245]: DEBUG nova.compute.manager [req-a5e8ec80-9301-4b2a-8aa2-2832cea87ee0 req-6209a0a1-aa1e-4ed7-b128-58e693c21fdd service nova] [instance: 24999298-349a-4837-ba75-22192166c5a1] No waiting events found dispatching network-vif-unplugged-01bba9cb-1eaf-4586-9abd-9a2b24a49a95 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:52:52 user nova-compute[75245]: WARNING nova.compute.manager [req-a5e8ec80-9301-4b2a-8aa2-2832cea87ee0 req-6209a0a1-aa1e-4ed7-b128-58e693c21fdd service nova] [instance: 24999298-349a-4837-ba75-22192166c5a1] Received unexpected event network-vif-unplugged-01bba9cb-1eaf-4586-9abd-9a2b24a49a95 for instance with vm_state deleted and task_state None.
Nov 29 16:52:52 user nova-compute[75245]: DEBUG nova.compute.manager [req-a5e8ec80-9301-4b2a-8aa2-2832cea87ee0 req-6209a0a1-aa1e-4ed7-b128-58e693c21fdd service nova] [instance: 24999298-349a-4837-ba75-22192166c5a1] Received event network-vif-plugged-01bba9cb-1eaf-4586-9abd-9a2b24a49a95 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:52:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a5e8ec80-9301-4b2a-8aa2-2832cea87ee0 req-6209a0a1-aa1e-4ed7-b128-58e693c21fdd service nova] Acquiring lock "24999298-349a-4837-ba75-22192166c5a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:52:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a5e8ec80-9301-4b2a-8aa2-2832cea87ee0 req-6209a0a1-aa1e-4ed7-b128-58e693c21fdd service nova] Lock "24999298-349a-4837-ba75-22192166c5a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:52:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-a5e8ec80-9301-4b2a-8aa2-2832cea87ee0 req-6209a0a1-aa1e-4ed7-b128-58e693c21fdd service nova] Lock "24999298-349a-4837-ba75-22192166c5a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:52:52 user nova-compute[75245]: DEBUG nova.compute.manager [req-a5e8ec80-9301-4b2a-8aa2-2832cea87ee0 req-6209a0a1-aa1e-4ed7-b128-58e693c21fdd service nova] [instance: 24999298-349a-4837-ba75-22192166c5a1] No waiting events found dispatching network-vif-plugged-01bba9cb-1eaf-4586-9abd-9a2b24a49a95 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:52:52 user nova-compute[75245]: WARNING nova.compute.manager [req-a5e8ec80-9301-4b2a-8aa2-2832cea87ee0 req-6209a0a1-aa1e-4ed7-b128-58e693c21fdd service nova] [instance: 24999298-349a-4837-ba75-22192166c5a1] Received unexpected event network-vif-plugged-01bba9cb-1eaf-4586-9abd-9a2b24a49a95 for instance with vm_state deleted and task_state None.
Nov 29 16:52:55 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:53:00 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:53:03 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-a243cd9e-a16f-42dd-b3fe-344fd28fdff8 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fcbd317f-c56f-4b4b-8572-c112f778410d is timed out.
Nov 29 16:53:03 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-a243cd9e-a16f-42dd-b3fe-344fd28fdff8 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Successfully detached device vdb from instance fcbd317f-c56f-4b4b-8572-c112f778410d from the live domain config.
Nov 29 16:53:03 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a243cd9e-a16f-42dd-b3fe-344fd28fdff8 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: fcbd317f-c56f-4b4b-8572-c112f778410d] calling os-brick to detach iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 16:53:03 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-a243cd9e-a16f-42dd-b3fe-344fd28fdff8 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, {'target_iqn': 'iqn.2010-10.org.openstack:548a01d1-d9f9-4576-9add-bf06ca6cfc13', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'psXLkQEC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:53:03 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-a243cd9e-a16f-42dd-b3fe-344fd28fdff8 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:53:03 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-a243cd9e-a16f-42dd-b3fe-344fd28fdff8 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:53:03 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-a243cd9e-a16f-42dd-b3fe-344fd28fdff8 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:53:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:53:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:53:03 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd66008-bd01-45f5-a6e3-0ad9eb5546eb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ade63d7a-75e8-49bc-b211-554a246995a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:548a01d1-d9f9-4576-9add-bf06ca6cfc13\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:53:03 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-a243cd9e-a16f-42dd-b3fe-344fd28fdff8 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 16:53:03 user nova-compute[75245]: No targets found.
Nov 29 16:53:03 user nova-compute[75245]: iSNS:
Nov 29 16:53:03 user nova-compute[75245]: No targets found.
Nov 29 16:53:03 user nova-compute[75245]: STATIC:
Nov 29 16:53:03 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:ade63d7a-75e8-49bc-b211-554a246995a8
Nov 29 16:53:03 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:53:03 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:53:03 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:548a01d1-d9f9-4576-9add-bf06ca6cfc13
Nov 29 16:53:03 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:53:03 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:53:03 user nova-compute[75245]: FIRMWARE:
Nov 29 16:53:03 user nova-compute[75245]: No targets found.
Nov 29 16:53:03 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:53:03 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-a243cd9e-a16f-42dd-b3fe-344fd28fdff8 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 16:53:03 user nova-compute[75245]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 16:53:03 user nova-compute[75245]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75245) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 16:53:03 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-a243cd9e-a16f-42dd-b3fe-344fd28fdff8 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:548a01d1-d9f9-4576-9add-bf06ca6cfc13', 0)] {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 16:53:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:53:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:53:03 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d8b8473-ecb4-4807-8cb9-06896c44f60c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:548a01d1-d9f9-4576-9add-bf06ca6cfc13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ade63d7a-75e8-49bc-b211-554a246995a8\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:53:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:53:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:53:03 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bda46c7-bf26-49ca-a021-3715b146e2c9]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade63d7a-75e8-49bc-b211-554a246995a8 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:548a01d1-d9f9-4576-9add-bf06ca6cfc13 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:53:03 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-a243cd9e-a16f-42dd-b3fe-344fd28fdff8 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade63d7a-75e8-49bc-b211-554a246995a8 (non-flash)
Nov 29 16:53:03 user nova-compute[75245]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:548a01d1-d9f9-4576-9add-bf06ca6cfc13 (non-flash)
Nov 29 16:53:03 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:53:03 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-a243cd9e-a16f-42dd-b3fe-344fd28fdff8 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade63d7a-75e8-49bc-b211-554a246995a8 (non-flash)
Nov 29 16:53:03 user nova-compute[75245]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:548a01d1-d9f9-4576-9add-bf06ca6cfc13 (non-flash)
Nov 29 16:53:03 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:53:03 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-a243cd9e-a16f-42dd-b3fe-344fd28fdff8 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0d4c1c0f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:548a01d1-d9f9-4576-9add-bf06ca6cfc13'): ({'sdc'}, set())}) {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 16:53:03 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-a243cd9e-a16f-42dd-b3fe-344fd28fdff8 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Removing single pathed devices sdc {{(pid=75245) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 16:53:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:53:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:53:03 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[db196258-20a0-4f5b-b9a3-15035f452c2b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:53:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:53:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:53:03 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b4cb77-85ce-4302-8325-0934a3990c6b]: (4, ('ok\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:53:03 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-a243cd9e-a16f-42dd-b3fe-344fd28fdff8 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Flushing IO for device /dev/sdc {{(pid=75245) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 16:53:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:53:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:53:03 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda7a05d-6e25-4060-ad4a-5b4768755a15]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:53:03 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-a243cd9e-a16f-42dd-b3fe-344fd28fdff8 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75245) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 16:53:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:53:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:53:03 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[93cb3d20-0790-4778-9c96-c0334cfff4b3]: (4, ('1', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:53:03 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-a243cd9e-a16f-42dd-b3fe-344fd28fdff8 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 16:53:03 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-a243cd9e-a16f-42dd-b3fe-344fd28fdff8 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] SCSI volumes sdc have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 16:53:03 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-a243cd9e-a16f-42dd-b3fe-344fd28fdff8 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:548a01d1-d9f9-4576-9add-bf06ca6cfc13')] {{(pid=75245) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 16:53:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:548a01d1-d9f9-4576-9add-bf06ca6cfc13 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:53:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:548a01d1-d9f9-4576-9add-bf06ca6cfc13 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:53:03 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[386931f8-46c7-4349-ad44-2331e86ca5bc]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:53:03 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-a243cd9e-a16f-42dd-b3fe-344fd28fdff8 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:53:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:548a01d1-d9f9-4576-9add-bf06ca6cfc13 -p 172.16.0.220:3260 --logout {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:53:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:548a01d1-d9f9-4576-9add-bf06ca6cfc13 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:53:03 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[4132a3fb-7d18-4577-adbd-30dbaa2242cd]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:548a01d1-d9f9-4576-9add-bf06ca6cfc13, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:548a01d1-d9f9-4576-9add-bf06ca6cfc13, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:53:03 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-a243cd9e-a16f-42dd-b3fe-344fd28fdff8 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:548a01d1-d9f9-4576-9add-bf06ca6cfc13, portal: 172.16.0.220,3260]
Nov 29 16:53:03 user nova-compute[75245]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:548a01d1-d9f9-4576-9add-bf06ca6cfc13, portal: 172.16.0.220,3260] successful.
Nov 29 16:53:03 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:53:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:548a01d1-d9f9-4576-9add-bf06ca6cfc13 -p 172.16.0.220:3260 --op delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:53:03 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:548a01d1-d9f9-4576-9add-bf06ca6cfc13 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:53:03 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed8e529-9f25-4fde-a26f-1d5618d88847]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:53:03 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-a243cd9e-a16f-42dd-b3fe-344fd28fdff8 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:53:03 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-a243cd9e-a16f-42dd-b3fe-344fd28fdff8 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:53:03 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-a243cd9e-a16f-42dd-b3fe-344fd28fdff8 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] <== disconnect_volume: return (283ms) None {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:53:03 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a243cd9e-a16f-42dd-b3fe-344fd28fdff8 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: fcbd317f-c56f-4b4b-8572-c112f778410d] Disconnected iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 16:53:04 user nova-compute[75245]: DEBUG nova.objects.instance [None req-a243cd9e-a16f-42dd-b3fe-344fd28fdff8 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Lazy-loading 'flavor' on Instance uuid fcbd317f-c56f-4b4b-8572-c112f778410d {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:53:04 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-a243cd9e-a16f-42dd-b3fe-344fd28fdff8 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Lock "fcbd317f-c56f-4b4b-8572-c112f778410d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.608s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:53:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:53:05 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:53:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:53:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:53:17 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2f770745-f0ef-4d2e-bd5d-5d1fe84cfeb4 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Acquiring lock "131579c4-4b5e-455b-9fbe-6fcda74aa48c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:53:17 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2f770745-f0ef-4d2e-bd5d-5d1fe84cfeb4 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "131579c4-4b5e-455b-9fbe-6fcda74aa48c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:53:17 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2f770745-f0ef-4d2e-bd5d-5d1fe84cfeb4 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Acquiring lock "131579c4-4b5e-455b-9fbe-6fcda74aa48c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:53:17 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2f770745-f0ef-4d2e-bd5d-5d1fe84cfeb4 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "131579c4-4b5e-455b-9fbe-6fcda74aa48c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:53:17 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2f770745-f0ef-4d2e-bd5d-5d1fe84cfeb4 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "131579c4-4b5e-455b-9fbe-6fcda74aa48c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:53:17 user nova-compute[75245]: INFO nova.compute.manager [None req-2f770745-f0ef-4d2e-bd5d-5d1fe84cfeb4 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 131579c4-4b5e-455b-9fbe-6fcda74aa48c] Terminating instance
Nov 29 16:53:17 user nova-compute[75245]: DEBUG nova.compute.manager [None req-2f770745-f0ef-4d2e-bd5d-5d1fe84cfeb4 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 131579c4-4b5e-455b-9fbe-6fcda74aa48c] Start destroying the instance on the hypervisor. {{(pid=75245) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 16:53:17 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:53:17 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:53:17 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:53:17 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:53:17 user nova-compute[75245]: DEBUG nova.compute.manager [req-9ee7e04a-d580-484b-b722-5f11670105c1 req-39770a70-7d8e-4fa2-a818-b707e9a997b7 service nova] [instance: 131579c4-4b5e-455b-9fbe-6fcda74aa48c] Received event network-vif-unplugged-1c98b19f-4dc4-4149-95e0-600e8dadcad5 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:53:17 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-9ee7e04a-d580-484b-b722-5f11670105c1 req-39770a70-7d8e-4fa2-a818-b707e9a997b7 service nova] Acquiring lock "131579c4-4b5e-455b-9fbe-6fcda74aa48c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:53:17 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-9ee7e04a-d580-484b-b722-5f11670105c1 req-39770a70-7d8e-4fa2-a818-b707e9a997b7 service nova] Lock "131579c4-4b5e-455b-9fbe-6fcda74aa48c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:53:17 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-9ee7e04a-d580-484b-b722-5f11670105c1 req-39770a70-7d8e-4fa2-a818-b707e9a997b7 service nova] Lock "131579c4-4b5e-455b-9fbe-6fcda74aa48c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:53:17 user nova-compute[75245]: DEBUG nova.compute.manager [req-9ee7e04a-d580-484b-b722-5f11670105c1 req-39770a70-7d8e-4fa2-a818-b707e9a997b7 service nova] [instance: 131579c4-4b5e-455b-9fbe-6fcda74aa48c] No waiting events found dispatching network-vif-unplugged-1c98b19f-4dc4-4149-95e0-600e8dadcad5 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:53:17 user nova-compute[75245]: DEBUG nova.compute.manager [req-9ee7e04a-d580-484b-b722-5f11670105c1 req-39770a70-7d8e-4fa2-a818-b707e9a997b7 service nova] [instance: 131579c4-4b5e-455b-9fbe-6fcda74aa48c] Received event network-vif-unplugged-1c98b19f-4dc4-4149-95e0-600e8dadcad5 for instance with task_state deleting. {{(pid=75245) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 16:53:18 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 131579c4-4b5e-455b-9fbe-6fcda74aa48c] Instance destroyed successfully.
Nov 29 16:53:18 user nova-compute[75245]: DEBUG nova.objects.instance [None req-2f770745-f0ef-4d2e-bd5d-5d1fe84cfeb4 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lazy-loading 'resources' on Instance uuid 131579c4-4b5e-455b-9fbe-6fcda74aa48c {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:53:18 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-2f770745-f0ef-4d2e-bd5d-5d1fe84cfeb4 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:51:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-373468800',display_name='tempest-TestVolumeBootPattern-server-373468800',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-373468800',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:51:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0907dff4e054429fa10392b730363eb2',ramdisk_id='',reservation_id='r-gb60mo0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-181783012',owner_user_name='tempest-TestVolumeBootPattern-181783012-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:51:45Z,user_data=None,user_id='2870721a7fff4cf19291f0cbfaedae81',uuid=131579c4-4b5e-455b-9fbe-6fcda74aa48c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1c98b19f-4dc4-4149-95e0-600e8dadcad5", "address": "fa:16:3e:ce:07:de", "network": {"id": "316cb9af-807d-4a69-874e-2054520f0e5f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1421560477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0907dff4e054429fa10392b730363eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c98b19f-4d", "ovs_interfaceid": "1c98b19f-4dc4-4149-95e0-600e8dadcad5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 16:53:18 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-2f770745-f0ef-4d2e-bd5d-5d1fe84cfeb4 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Converting VIF {"id": "1c98b19f-4dc4-4149-95e0-600e8dadcad5", "address": "fa:16:3e:ce:07:de", "network": {"id": "316cb9af-807d-4a69-874e-2054520f0e5f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1421560477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0907dff4e054429fa10392b730363eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c98b19f-4d", "ovs_interfaceid": "1c98b19f-4dc4-4149-95e0-600e8dadcad5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:53:18 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-2f770745-f0ef-4d2e-bd5d-5d1fe84cfeb4 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:07:de,bridge_name='br-int',has_traffic_filtering=True,id=1c98b19f-4dc4-4149-95e0-600e8dadcad5,network=Network(316cb9af-807d-4a69-874e-2054520f0e5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c98b19f-4d') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:53:18 user nova-compute[75245]: DEBUG os_vif [None req-2f770745-f0ef-4d2e-bd5d-5d1fe84cfeb4 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:07:de,bridge_name='br-int',has_traffic_filtering=True,id=1c98b19f-4dc4-4149-95e0-600e8dadcad5,network=Network(316cb9af-807d-4a69-874e-2054520f0e5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c98b19f-4d') {{(pid=75245) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 16:53:18 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:53:18 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1c98b19f-4d, bridge=br-int, if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:53:18 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:53:18 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:53:18 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:53:18 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a2d7eccb-0335-4faa-b8f6-09a71ff1de15) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:53:18 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:53:18 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:53:18 user nova-compute[75245]: INFO os_vif [None req-2f770745-f0ef-4d2e-bd5d-5d1fe84cfeb4 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:07:de,bridge_name='br-int',has_traffic_filtering=True,id=1c98b19f-4dc4-4149-95e0-600e8dadcad5,network=Network(316cb9af-807d-4a69-874e-2054520f0e5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c98b19f-4d')
Nov 29 16:53:18 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f770745-f0ef-4d2e-bd5d-5d1fe84cfeb4 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 131579c4-4b5e-455b-9fbe-6fcda74aa48c] calling os-brick to detach iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 16:53:18 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f770745-f0ef-4d2e-bd5d-5d1fe84cfeb4 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, {'target_iqn': 'iqn.2010-10.org.openstack:ade63d7a-75e8-49bc-b211-554a246995a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XVsLFRvk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:53:18 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-2f770745-f0ef-4d2e-bd5d-5d1fe84cfeb4 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:53:18 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-2f770745-f0ef-4d2e-bd5d-5d1fe84cfeb4 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:53:18 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-2f770745-f0ef-4d2e-bd5d-5d1fe84cfeb4 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:53:18 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:53:18 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:53:18 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a41b7d-436d-4f86-97f9-005029d402e4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ade63d7a-75e8-49bc-b211-554a246995a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:53:18 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f770745-f0ef-4d2e-bd5d-5d1fe84cfeb4 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 16:53:18 user nova-compute[75245]: No targets found.
Nov 29 16:53:18 user nova-compute[75245]: iSNS:
Nov 29 16:53:18 user nova-compute[75245]: No targets found.
Nov 29 16:53:18 user nova-compute[75245]: STATIC:
Nov 29 16:53:18 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:ade63d7a-75e8-49bc-b211-554a246995a8
Nov 29 16:53:18 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:53:18 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:53:18 user nova-compute[75245]: FIRMWARE:
Nov 29 16:53:18 user nova-compute[75245]: No targets found.
Nov 29 16:53:18 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:53:18 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f770745-f0ef-4d2e-bd5d-5d1fe84cfeb4 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 16:53:18 user nova-compute[75245]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 16:53:18 user nova-compute[75245]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75245) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 16:53:18 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f770745-f0ef-4d2e-bd5d-5d1fe84cfeb4 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ade63d7a-75e8-49bc-b211-554a246995a8', 0)] {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 16:53:18 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:53:18 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:53:18 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd130618-ff18-456b-aff8-9972a81c1d20]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ade63d7a-75e8-49bc-b211-554a246995a8\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:53:18 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:53:18 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:53:18 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[001d2e18-123c-443a-aca9-74df278bb248]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade63d7a-75e8-49bc-b211-554a246995a8 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:53:18 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f770745-f0ef-4d2e-bd5d-5d1fe84cfeb4 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade63d7a-75e8-49bc-b211-554a246995a8 (non-flash)
Nov 29 16:53:18 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:53:18 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f770745-f0ef-4d2e-bd5d-5d1fe84cfeb4 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade63d7a-75e8-49bc-b211-554a246995a8 (non-flash)
Nov 29 16:53:18 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:53:18 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f770745-f0ef-4d2e-bd5d-5d1fe84cfeb4 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0d443cd120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ade63d7a-75e8-49bc-b211-554a246995a8'): ({'sdb'}, set())}) {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 16:53:18 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-2f770745-f0ef-4d2e-bd5d-5d1fe84cfeb4 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Removing single pathed devices sdb {{(pid=75245) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 16:53:18 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:53:18 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:53:18 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d471b0-dfb6-4266-bdfe-4e10740b4d5b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:53:18 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:53:18 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:53:18 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e8c742-ae0f-490e-8abc-09306b4165a4]: (4, ('ok\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:53:18 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-2f770745-f0ef-4d2e-bd5d-5d1fe84cfeb4 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Flushing IO for device /dev/sdb {{(pid=75245) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 16:53:18 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:53:18 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:53:18 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa8a022a-3f0b-4d9d-9bcb-3c442af75aef]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:53:18 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-2f770745-f0ef-4d2e-bd5d-5d1fe84cfeb4 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75245) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 16:53:18 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:53:18 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:53:18 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[82483106-9918-453c-bafb-ea0b6846446b]: (4, ('1', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:53:18 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-2f770745-f0ef-4d2e-bd5d-5d1fe84cfeb4 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 16:53:18 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-2f770745-f0ef-4d2e-bd5d-5d1fe84cfeb4 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] SCSI volumes sdb have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 16:53:18 user nova-compute[75245]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26266373961643166', '/dev/disk/by-id/scsi-1SCST_BIOd1b5f3e7-bf79ad1f70030015', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_d1b5f3e7') {{(pid=86166) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 29 16:53:18 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff53c7d-5afe-4888-8f98-4eab4386b5af]: (4, None) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:53:18 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f770745-f0ef-4d2e-bd5d-5d1fe84cfeb4 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ade63d7a-75e8-49bc-b211-554a246995a8')] {{(pid=75245) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 16:53:18 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ade63d7a-75e8-49bc-b211-554a246995a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:53:18 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ade63d7a-75e8-49bc-b211-554a246995a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:53:18 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d1f4fc-6a66-4e91-b1d4-9894690778a0]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:53:18 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f770745-f0ef-4d2e-bd5d-5d1fe84cfeb4 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:53:18 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ade63d7a-75e8-49bc-b211-554a246995a8 -p 172.16.0.220:3260 --logout {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:53:18 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ade63d7a-75e8-49bc-b211-554a246995a8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:53:18 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d20ca6-89e6-4a6c-883d-d74361daa8ea]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:ade63d7a-75e8-49bc-b211-554a246995a8, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:ade63d7a-75e8-49bc-b211-554a246995a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:53:18 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f770745-f0ef-4d2e-bd5d-5d1fe84cfeb4 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:ade63d7a-75e8-49bc-b211-554a246995a8, portal: 172.16.0.220,3260]
Nov 29 16:53:18 user nova-compute[75245]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:ade63d7a-75e8-49bc-b211-554a246995a8, portal: 172.16.0.220,3260] successful.
Nov 29 16:53:18 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:53:18 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ade63d7a-75e8-49bc-b211-554a246995a8 -p 172.16.0.220:3260 --op delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:53:18 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ade63d7a-75e8-49bc-b211-554a246995a8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:53:18 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[220ac8fb-e239-4649-bcf4-f76698dc0610]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:53:18 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f770745-f0ef-4d2e-bd5d-5d1fe84cfeb4 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:53:18 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-2f770745-f0ef-4d2e-bd5d-5d1fe84cfeb4 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:53:18 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f770745-f0ef-4d2e-bd5d-5d1fe84cfeb4 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] <== disconnect_volume: return (305ms) None {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:53:18 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f770745-f0ef-4d2e-bd5d-5d1fe84cfeb4 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 131579c4-4b5e-455b-9fbe-6fcda74aa48c] Disconnected iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 16:53:18 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-2f770745-f0ef-4d2e-bd5d-5d1fe84cfeb4 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 131579c4-4b5e-455b-9fbe-6fcda74aa48c] Deleting instance files /opt/stack/data/nova/instances/131579c4-4b5e-455b-9fbe-6fcda74aa48c_del
Nov 29 16:53:18 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-2f770745-f0ef-4d2e-bd5d-5d1fe84cfeb4 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 131579c4-4b5e-455b-9fbe-6fcda74aa48c] Deletion of /opt/stack/data/nova/instances/131579c4-4b5e-455b-9fbe-6fcda74aa48c_del complete
Nov 29 16:53:18 user nova-compute[75245]: INFO nova.compute.manager [None req-2f770745-f0ef-4d2e-bd5d-5d1fe84cfeb4 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 131579c4-4b5e-455b-9fbe-6fcda74aa48c] Took 1.12 seconds to destroy the instance on the hypervisor.
Nov 29 16:53:18 user nova-compute[75245]: DEBUG oslo.service.loopingcall [None req-2f770745-f0ef-4d2e-bd5d-5d1fe84cfeb4 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75245) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 16:53:18 user nova-compute[75245]: DEBUG nova.compute.manager [-] [instance: 131579c4-4b5e-455b-9fbe-6fcda74aa48c] Deallocating network for instance {{(pid=75245) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 16:53:18 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: 131579c4-4b5e-455b-9fbe-6fcda74aa48c] deallocate_for_instance() {{(pid=75245) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 16:53:19 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: 131579c4-4b5e-455b-9fbe-6fcda74aa48c] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:53:19 user nova-compute[75245]: INFO nova.compute.manager [-] [instance: 131579c4-4b5e-455b-9fbe-6fcda74aa48c] Took 0.47 seconds to deallocate network for instance.
Nov 29 16:53:19 user nova-compute[75245]: DEBUG nova.compute.manager [req-8ec17a69-4b0e-47f9-9c75-484505810b9b req-e2a56d1d-faca-47c3-83c2-c15cbf4016c7 service nova] [instance: 131579c4-4b5e-455b-9fbe-6fcda74aa48c] Received event network-vif-deleted-1c98b19f-4dc4-4149-95e0-600e8dadcad5 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:53:19 user nova-compute[75245]: INFO nova.compute.manager [req-8ec17a69-4b0e-47f9-9c75-484505810b9b req-e2a56d1d-faca-47c3-83c2-c15cbf4016c7 service nova] [instance: 131579c4-4b5e-455b-9fbe-6fcda74aa48c] Neutron deleted interface 1c98b19f-4dc4-4149-95e0-600e8dadcad5; detaching it from the instance and deleting it from the info cache
Nov 29 16:53:19 user nova-compute[75245]: DEBUG nova.network.neutron [req-8ec17a69-4b0e-47f9-9c75-484505810b9b req-e2a56d1d-faca-47c3-83c2-c15cbf4016c7 service nova] [instance: 131579c4-4b5e-455b-9fbe-6fcda74aa48c] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:53:19 user nova-compute[75245]: DEBUG nova.compute.manager [req-8ec17a69-4b0e-47f9-9c75-484505810b9b req-e2a56d1d-faca-47c3-83c2-c15cbf4016c7 service nova] [instance: 131579c4-4b5e-455b-9fbe-6fcda74aa48c] Detach interface failed, port_id=1c98b19f-4dc4-4149-95e0-600e8dadcad5, reason: Instance 131579c4-4b5e-455b-9fbe-6fcda74aa48c could not be found. {{(pid=75245) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 16:53:19 user nova-compute[75245]: DEBUG nova.compute.manager [req-b5119e2b-b6f0-4e8c-8bb4-033212f0511d req-040b7f02-f698-4116-b899-dec2b20d302e service nova] [instance: 131579c4-4b5e-455b-9fbe-6fcda74aa48c] Received event network-vif-plugged-1c98b19f-4dc4-4149-95e0-600e8dadcad5 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:53:19 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b5119e2b-b6f0-4e8c-8bb4-033212f0511d req-040b7f02-f698-4116-b899-dec2b20d302e service nova] Acquiring lock "131579c4-4b5e-455b-9fbe-6fcda74aa48c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:53:19 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b5119e2b-b6f0-4e8c-8bb4-033212f0511d req-040b7f02-f698-4116-b899-dec2b20d302e service nova] Lock "131579c4-4b5e-455b-9fbe-6fcda74aa48c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:53:19 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b5119e2b-b6f0-4e8c-8bb4-033212f0511d req-040b7f02-f698-4116-b899-dec2b20d302e service nova] Lock "131579c4-4b5e-455b-9fbe-6fcda74aa48c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:53:19 user nova-compute[75245]: DEBUG nova.compute.manager [req-b5119e2b-b6f0-4e8c-8bb4-033212f0511d req-040b7f02-f698-4116-b899-dec2b20d302e service nova] [instance: 131579c4-4b5e-455b-9fbe-6fcda74aa48c] No waiting events found dispatching network-vif-plugged-1c98b19f-4dc4-4149-95e0-600e8dadcad5 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:53:19 user nova-compute[75245]: WARNING nova.compute.manager [req-b5119e2b-b6f0-4e8c-8bb4-033212f0511d req-040b7f02-f698-4116-b899-dec2b20d302e service nova] [instance: 131579c4-4b5e-455b-9fbe-6fcda74aa48c] Received unexpected event network-vif-plugged-1c98b19f-4dc4-4149-95e0-600e8dadcad5 for instance with vm_state active and task_state deleting.
Nov 29 16:53:19 user nova-compute[75245]: INFO nova.compute.manager [None req-2f770745-f0ef-4d2e-bd5d-5d1fe84cfeb4 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 131579c4-4b5e-455b-9fbe-6fcda74aa48c] Took 0.79 seconds to detach 1 volumes for instance.
Nov 29 16:53:19 user nova-compute[75245]: DEBUG nova.compute.manager [None req-2f770745-f0ef-4d2e-bd5d-5d1fe84cfeb4 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 131579c4-4b5e-455b-9fbe-6fcda74aa48c] Deleting volume: ade63d7a-75e8-49bc-b211-554a246995a8 {{(pid=75245) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 29 16:53:19 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2f770745-f0ef-4d2e-bd5d-5d1fe84cfeb4 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:53:19 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2f770745-f0ef-4d2e-bd5d-5d1fe84cfeb4 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:53:20 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-2f770745-f0ef-4d2e-bd5d-5d1fe84cfeb4 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:53:20 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-2f770745-f0ef-4d2e-bd5d-5d1fe84cfeb4 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:53:20 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2f770745-f0ef-4d2e-bd5d-5d1fe84cfeb4 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.186s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:53:20 user nova-compute[75245]: INFO nova.scheduler.client.report [None req-2f770745-f0ef-4d2e-bd5d-5d1fe84cfeb4 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Deleted allocations for instance 131579c4-4b5e-455b-9fbe-6fcda74aa48c
Nov 29 16:53:20 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-2f770745-f0ef-4d2e-bd5d-5d1fe84cfeb4 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "131579c4-4b5e-455b-9fbe-6fcda74aa48c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.854s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:53:21 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:53:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:53:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:53:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:53:21 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75245) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 16:53:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25a0a73c-ed89-4530-aabb-a6a85e030482/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:53:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25a0a73c-ed89-4530-aabb-a6a85e030482/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:53:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25a0a73c-ed89-4530-aabb-a6a85e030482/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:53:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25a0a73c-ed89-4530-aabb-a6a85e030482/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:53:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcbd317f-c56f-4b4b-8572-c112f778410d/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:53:22 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcbd317f-c56f-4b4b-8572-c112f778410d/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:53:22 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcbd317f-c56f-4b4b-8572-c112f778410d/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:53:22 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcbd317f-c56f-4b4b-8572-c112f778410d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:53:22 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:53:22 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:53:22 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Hypervisor/Node resource view: name=user free_ram=8812MB free_disk=25.003353118896484GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75245) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 16:53:22 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:53:22 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:53:22 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 25a0a73c-ed89-4530-aabb-a6a85e030482 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:53:22 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance fcbd317f-c56f-4b4b-8572-c112f778410d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:53:22 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 16:53:22 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 16:53:22 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:53:22 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:53:22 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Compute_service record updated for user:user {{(pid=75245) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 16:53:22 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.237s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:53:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:53:25 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:53:25 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Starting heal instance info cache {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 16:53:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "refresh_cache-fcbd317f-c56f-4b4b-8572-c112f778410d" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:53:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquired lock "refresh_cache-fcbd317f-c56f-4b4b-8572-c112f778410d" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:53:26 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: fcbd317f-c56f-4b4b-8572-c112f778410d] Forcefully refreshing network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 16:53:26 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: fcbd317f-c56f-4b4b-8572-c112f778410d] Updating instance_info_cache with network_info: [{"id": "28570b91-bccd-4af6-8a83-680316f91520", "address": "fa:16:3e:22:83:df", "network": {"id": "2eac25a6-c643-4348-98eb-91d044f1714c", "bridge": "br-int", "label": "tempest-TestStampPattern-1438802163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d056f7dae1d94936bd1fed295f0eba16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28570b91-bc", "ovs_interfaceid": "28570b91-bccd-4af6-8a83-680316f91520", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:53:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Releasing lock "refresh_cache-fcbd317f-c56f-4b4b-8572-c112f778410d" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:53:26 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: fcbd317f-c56f-4b4b-8572-c112f778410d] Updated the network info_cache for instance {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 16:53:26 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:53:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:53:30 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:53:31 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:53:33 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:53:33 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:53:33 user nova-compute[75245]: DEBUG nova.compute.manager [req-3cc0416f-e7bc-4f12-bd2e-d6828581f526 req-dedddc66-a577-424c-ae8a-70f8998b0675 service nova] [instance: fcbd317f-c56f-4b4b-8572-c112f778410d] Received event network-changed-28570b91-bccd-4af6-8a83-680316f91520 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:53:33 user nova-compute[75245]: DEBUG nova.compute.manager [req-3cc0416f-e7bc-4f12-bd2e-d6828581f526 req-dedddc66-a577-424c-ae8a-70f8998b0675 service nova] [instance: fcbd317f-c56f-4b4b-8572-c112f778410d] Refreshing instance network info cache due to event network-changed-28570b91-bccd-4af6-8a83-680316f91520. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:53:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-3cc0416f-e7bc-4f12-bd2e-d6828581f526 req-dedddc66-a577-424c-ae8a-70f8998b0675 service nova] Acquiring lock "refresh_cache-fcbd317f-c56f-4b4b-8572-c112f778410d" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:53:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-3cc0416f-e7bc-4f12-bd2e-d6828581f526 req-dedddc66-a577-424c-ae8a-70f8998b0675 service nova] Acquired lock "refresh_cache-fcbd317f-c56f-4b4b-8572-c112f778410d" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:53:33 user nova-compute[75245]: DEBUG nova.network.neutron [req-3cc0416f-e7bc-4f12-bd2e-d6828581f526 req-dedddc66-a577-424c-ae8a-70f8998b0675 service nova] [instance: fcbd317f-c56f-4b4b-8572-c112f778410d] Refreshing network info cache for port 28570b91-bccd-4af6-8a83-680316f91520 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:53:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-8eea0ccb-3a2a-4771-85e8-dd61b76a0e5b tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Acquiring lock "fcbd317f-c56f-4b4b-8572-c112f778410d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:53:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-8eea0ccb-3a2a-4771-85e8-dd61b76a0e5b tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Lock "fcbd317f-c56f-4b4b-8572-c112f778410d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:53:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-8eea0ccb-3a2a-4771-85e8-dd61b76a0e5b tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Acquiring lock "fcbd317f-c56f-4b4b-8572-c112f778410d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:53:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-8eea0ccb-3a2a-4771-85e8-dd61b76a0e5b tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Lock "fcbd317f-c56f-4b4b-8572-c112f778410d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:53:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-8eea0ccb-3a2a-4771-85e8-dd61b76a0e5b tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Lock "fcbd317f-c56f-4b4b-8572-c112f778410d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:53:33 user nova-compute[75245]: INFO nova.compute.manager [None req-8eea0ccb-3a2a-4771-85e8-dd61b76a0e5b tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: fcbd317f-c56f-4b4b-8572-c112f778410d] Terminating instance
Nov 29 16:53:33 user nova-compute[75245]: DEBUG nova.compute.manager [None req-8eea0ccb-3a2a-4771-85e8-dd61b76a0e5b tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: fcbd317f-c56f-4b4b-8572-c112f778410d] Start destroying the instance on the hypervisor. {{(pid=75245) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 16:53:33 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:53:33 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:53:33 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:53:33 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:53:33 user nova-compute[75245]: DEBUG nova.compute.manager [req-26f97608-bc9b-4465-9114-397327068afa req-563135e8-88b1-43f4-a681-736bc8dd599d service nova] [instance: fcbd317f-c56f-4b4b-8572-c112f778410d] Received event network-vif-unplugged-28570b91-bccd-4af6-8a83-680316f91520 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:53:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-26f97608-bc9b-4465-9114-397327068afa req-563135e8-88b1-43f4-a681-736bc8dd599d service nova] Acquiring lock "fcbd317f-c56f-4b4b-8572-c112f778410d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:53:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-26f97608-bc9b-4465-9114-397327068afa req-563135e8-88b1-43f4-a681-736bc8dd599d service nova] Lock "fcbd317f-c56f-4b4b-8572-c112f778410d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:53:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-26f97608-bc9b-4465-9114-397327068afa req-563135e8-88b1-43f4-a681-736bc8dd599d service nova] Lock "fcbd317f-c56f-4b4b-8572-c112f778410d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:53:33 user nova-compute[75245]: DEBUG nova.compute.manager [req-26f97608-bc9b-4465-9114-397327068afa req-563135e8-88b1-43f4-a681-736bc8dd599d service nova] [instance: fcbd317f-c56f-4b4b-8572-c112f778410d] No waiting events found dispatching network-vif-unplugged-28570b91-bccd-4af6-8a83-680316f91520 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:53:33 user nova-compute[75245]: DEBUG nova.compute.manager [req-26f97608-bc9b-4465-9114-397327068afa req-563135e8-88b1-43f4-a681-736bc8dd599d service nova] [instance: fcbd317f-c56f-4b4b-8572-c112f778410d] Received event network-vif-unplugged-28570b91-bccd-4af6-8a83-680316f91520 for instance with task_state deleting. {{(pid=75245) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 16:53:33 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:53:33 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:53:34 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: fcbd317f-c56f-4b4b-8572-c112f778410d] Instance destroyed successfully.
Nov 29 16:53:34 user nova-compute[75245]: DEBUG nova.objects.instance [None req-8eea0ccb-3a2a-4771-85e8-dd61b76a0e5b tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Lazy-loading 'resources' on Instance uuid fcbd317f-c56f-4b4b-8572-c112f778410d {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:53:34 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-8eea0ccb-3a2a-4771-85e8-dd61b76a0e5b tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:50:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1616863509',display_name='tempest-TestStampPattern-server-1616863509',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1616863509',id=43,image_ref='5edd3565-468b-4ff8-b9b4-2eba8d411b64',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImoWxFDnu4c8KDr10Q6Ubx68e8gn5RNIGqBgLtWDemy3wpgxbiBAYLS+wfSKYPtQ2DWWp70/Ts0kN1P7Ewenibb2M76FreHbG7l7wWc3VZE00W0BrocAjgoRPqW16wYoQ==',key_name='tempest-TestStampPattern-428472352',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:50:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d056f7dae1d94936bd1fed295f0eba16',ramdisk_id='',reservation_id='r-f99kh067',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='25a0a73c-ed89-4530-aabb-a6a85e030482',image_min_disk='1',image_min_ram='0',image_owner_id='d056f7dae1d94936bd1fed295f0eba16',image_owner_project_name='tempest-TestStampPattern-1627008304',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1627008304-project-member',image_user_id='0acde563960c46268a890ac370800146',owner_project_name='tempest-TestStampPattern-1627008304',owner_user_name='tempest-TestStampPattern-1627008304-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:50:46Z,user_data=None,user_id='0acde563960c46268a890ac370800146',uuid=fcbd317f-c56f-4b4b-8572-c112f778410d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "28570b91-bccd-4af6-8a83-680316f91520", "address": "fa:16:3e:22:83:df", "network": {"id": "2eac25a6-c643-4348-98eb-91d044f1714c", "bridge": "br-int", "label": "tempest-TestStampPattern-1438802163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d056f7dae1d94936bd1fed295f0eba16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28570b91-bc", "ovs_interfaceid": "28570b91-bccd-4af6-8a83-680316f91520", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 16:53:34 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-8eea0ccb-3a2a-4771-85e8-dd61b76a0e5b tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Converting VIF {"id": "28570b91-bccd-4af6-8a83-680316f91520", "address": "fa:16:3e:22:83:df", "network": {"id": "2eac25a6-c643-4348-98eb-91d044f1714c", "bridge": "br-int", "label": "tempest-TestStampPattern-1438802163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d056f7dae1d94936bd1fed295f0eba16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28570b91-bc", "ovs_interfaceid": "28570b91-bccd-4af6-8a83-680316f91520", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:53:34 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-8eea0ccb-3a2a-4771-85e8-dd61b76a0e5b tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:83:df,bridge_name='br-int',has_traffic_filtering=True,id=28570b91-bccd-4af6-8a83-680316f91520,network=Network(2eac25a6-c643-4348-98eb-91d044f1714c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28570b91-bc') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:53:34 user nova-compute[75245]: DEBUG os_vif [None req-8eea0ccb-3a2a-4771-85e8-dd61b76a0e5b tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:83:df,bridge_name='br-int',has_traffic_filtering=True,id=28570b91-bccd-4af6-8a83-680316f91520,network=Network(2eac25a6-c643-4348-98eb-91d044f1714c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28570b91-bc') {{(pid=75245) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 16:53:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:53:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap28570b91-bc, bridge=br-int, if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:53:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:53:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:53:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:53:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8d08d3b9-9ded-405f-a5cf-7414887427c9) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:53:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:53:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:53:34 user nova-compute[75245]: INFO os_vif [None req-8eea0ccb-3a2a-4771-85e8-dd61b76a0e5b tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:83:df,bridge_name='br-int',has_traffic_filtering=True,id=28570b91-bccd-4af6-8a83-680316f91520,network=Network(2eac25a6-c643-4348-98eb-91d044f1714c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28570b91-bc')
Nov 29 16:53:34 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-8eea0ccb-3a2a-4771-85e8-dd61b76a0e5b tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: fcbd317f-c56f-4b4b-8572-c112f778410d] Deleting instance files /opt/stack/data/nova/instances/fcbd317f-c56f-4b4b-8572-c112f778410d_del
Nov 29 16:53:34 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-8eea0ccb-3a2a-4771-85e8-dd61b76a0e5b tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: fcbd317f-c56f-4b4b-8572-c112f778410d] Deletion of /opt/stack/data/nova/instances/fcbd317f-c56f-4b4b-8572-c112f778410d_del complete
Nov 29 16:53:34 user nova-compute[75245]: INFO nova.compute.manager [None req-8eea0ccb-3a2a-4771-85e8-dd61b76a0e5b tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: fcbd317f-c56f-4b4b-8572-c112f778410d] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 29 16:53:34 user nova-compute[75245]: DEBUG oslo.service.loopingcall [None req-8eea0ccb-3a2a-4771-85e8-dd61b76a0e5b tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75245) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 16:53:34 user nova-compute[75245]: DEBUG nova.compute.manager [-] [instance: fcbd317f-c56f-4b4b-8572-c112f778410d] Deallocating network for instance {{(pid=75245) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 16:53:34 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: fcbd317f-c56f-4b4b-8572-c112f778410d] deallocate_for_instance() {{(pid=75245) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 16:53:34 user nova-compute[75245]: DEBUG nova.network.neutron [req-3cc0416f-e7bc-4f12-bd2e-d6828581f526 req-dedddc66-a577-424c-ae8a-70f8998b0675 service nova] [instance: fcbd317f-c56f-4b4b-8572-c112f778410d] Updated VIF entry in instance network info cache for port 28570b91-bccd-4af6-8a83-680316f91520. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:53:34 user nova-compute[75245]: DEBUG nova.network.neutron [req-3cc0416f-e7bc-4f12-bd2e-d6828581f526 req-dedddc66-a577-424c-ae8a-70f8998b0675 service nova] [instance: fcbd317f-c56f-4b4b-8572-c112f778410d] Updating instance_info_cache with network_info: [{"id": "28570b91-bccd-4af6-8a83-680316f91520", "address": "fa:16:3e:22:83:df", "network": {"id": "2eac25a6-c643-4348-98eb-91d044f1714c", "bridge": "br-int", "label": "tempest-TestStampPattern-1438802163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d056f7dae1d94936bd1fed295f0eba16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28570b91-bc", "ovs_interfaceid": "28570b91-bccd-4af6-8a83-680316f91520", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:53:34 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-3cc0416f-e7bc-4f12-bd2e-d6828581f526 req-dedddc66-a577-424c-ae8a-70f8998b0675 service nova] Releasing lock "refresh_cache-fcbd317f-c56f-4b4b-8572-c112f778410d" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:53:34 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: fcbd317f-c56f-4b4b-8572-c112f778410d] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:53:34 user nova-compute[75245]: INFO nova.compute.manager [-] [instance: fcbd317f-c56f-4b4b-8572-c112f778410d] Took 0.73 seconds to deallocate network for instance.
Nov 29 16:53:34 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-8eea0ccb-3a2a-4771-85e8-dd61b76a0e5b tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:53:34 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-8eea0ccb-3a2a-4771-85e8-dd61b76a0e5b tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:53:35 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-8eea0ccb-3a2a-4771-85e8-dd61b76a0e5b tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:53:35 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-8eea0ccb-3a2a-4771-85e8-dd61b76a0e5b tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:53:35 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-8eea0ccb-3a2a-4771-85e8-dd61b76a0e5b tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.253s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:53:35 user nova-compute[75245]: INFO nova.scheduler.client.report [None req-8eea0ccb-3a2a-4771-85e8-dd61b76a0e5b tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Deleted allocations for instance fcbd317f-c56f-4b4b-8572-c112f778410d
Nov 29 16:53:35 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-8eea0ccb-3a2a-4771-85e8-dd61b76a0e5b tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Lock "fcbd317f-c56f-4b4b-8572-c112f778410d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.022s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:53:35 user nova-compute[75245]: DEBUG nova.compute.manager [req-0cf2deb7-b4d9-420d-83ff-cffb313b5eb6 req-b14c17b3-8ee2-44a1-be15-84d8dfc3845d service nova] [instance: fcbd317f-c56f-4b4b-8572-c112f778410d] Received event network-vif-plugged-28570b91-bccd-4af6-8a83-680316f91520 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:53:35 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-0cf2deb7-b4d9-420d-83ff-cffb313b5eb6 req-b14c17b3-8ee2-44a1-be15-84d8dfc3845d service nova] Acquiring lock "fcbd317f-c56f-4b4b-8572-c112f778410d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:53:35 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-0cf2deb7-b4d9-420d-83ff-cffb313b5eb6 req-b14c17b3-8ee2-44a1-be15-84d8dfc3845d service nova] Lock "fcbd317f-c56f-4b4b-8572-c112f778410d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:53:35 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-0cf2deb7-b4d9-420d-83ff-cffb313b5eb6 req-b14c17b3-8ee2-44a1-be15-84d8dfc3845d service nova] Lock "fcbd317f-c56f-4b4b-8572-c112f778410d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:53:35 user nova-compute[75245]: DEBUG nova.compute.manager [req-0cf2deb7-b4d9-420d-83ff-cffb313b5eb6 req-b14c17b3-8ee2-44a1-be15-84d8dfc3845d service nova] [instance: fcbd317f-c56f-4b4b-8572-c112f778410d] No waiting events found dispatching network-vif-plugged-28570b91-bccd-4af6-8a83-680316f91520 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:53:35 user nova-compute[75245]: WARNING nova.compute.manager [req-0cf2deb7-b4d9-420d-83ff-cffb313b5eb6 req-b14c17b3-8ee2-44a1-be15-84d8dfc3845d service nova] [instance: fcbd317f-c56f-4b4b-8572-c112f778410d] Received unexpected event network-vif-plugged-28570b91-bccd-4af6-8a83-680316f91520 for instance with vm_state deleted and task_state None.
Nov 29 16:53:35 user nova-compute[75245]: DEBUG nova.compute.manager [req-0cf2deb7-b4d9-420d-83ff-cffb313b5eb6 req-b14c17b3-8ee2-44a1-be15-84d8dfc3845d service nova] [instance: fcbd317f-c56f-4b4b-8572-c112f778410d] Received event network-vif-deleted-28570b91-bccd-4af6-8a83-680316f91520 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:53:36 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:53:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:53:39 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:53:39 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:53:39 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75245) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 16:53:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:53:44 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:53:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:53:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:53:56 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:53:59 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:54:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:54:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:54:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:54:17 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:54:19 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:54:23 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:54:23 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:54:23 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:54:23 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:54:23 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75245) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 16:54:23 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25a0a73c-ed89-4530-aabb-a6a85e030482/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:54:23 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25a0a73c-ed89-4530-aabb-a6a85e030482/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:54:23 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25a0a73c-ed89-4530-aabb-a6a85e030482/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:54:24 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25a0a73c-ed89-4530-aabb-a6a85e030482/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:54:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:54:24 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:54:24 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:54:24 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Hypervisor/Node resource view: name=user free_ram=8912MB free_disk=25.002243041992188GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75245) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 16:54:24 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:54:24 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:54:24 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 25a0a73c-ed89-4530-aabb-a6a85e030482 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:54:24 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 16:54:24 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 16:54:24 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:54:24 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:54:24 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Compute_service record updated for user:user {{(pid=75245) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 16:54:24 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.212s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:54:26 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:54:26 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Starting heal instance info cache {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 16:54:26 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Rebuilding the list of instances to heal {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 16:54:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "refresh_cache-25a0a73c-ed89-4530-aabb-a6a85e030482" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:54:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquired lock "refresh_cache-25a0a73c-ed89-4530-aabb-a6a85e030482" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:54:26 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Forcefully refreshing network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 16:54:26 user nova-compute[75245]: DEBUG nova.objects.instance [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lazy-loading 'info_cache' on Instance uuid 25a0a73c-ed89-4530-aabb-a6a85e030482 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:54:27 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Updating instance_info_cache with network_info: [{"id": "8f62d901-5ef0-4879-9f19-8a51f55fde1f", "address": "fa:16:3e:8b:42:60", "network": {"id": "2eac25a6-c643-4348-98eb-91d044f1714c", "bridge": "br-int", "label": "tempest-TestStampPattern-1438802163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d056f7dae1d94936bd1fed295f0eba16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f62d901-5e", "ovs_interfaceid": "8f62d901-5ef0-4879-9f19-8a51f55fde1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:54:27 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Releasing lock "refresh_cache-25a0a73c-ed89-4530-aabb-a6a85e030482" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:54:27 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Updated the network info_cache for instance {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 16:54:27 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:54:29 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:54:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Acquiring lock "f9419b01-cd53-472d-90d1-c18f6d77660a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:54:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "f9419b01-cd53-472d-90d1-c18f6d77660a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:54:31 user nova-compute[75245]: DEBUG nova.compute.manager [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] Starting instance... {{(pid=75245) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 16:54:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:54:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:54:31 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75245) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 16:54:31 user nova-compute[75245]: INFO nova.compute.claims [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] Claim successful on node user
Nov 29 16:54:31 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:54:31 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:54:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.227s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:54:31 user nova-compute[75245]: DEBUG nova.compute.manager [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] Start building networks asynchronously for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 16:54:31 user nova-compute[75245]: DEBUG nova.compute.manager [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] Allocating IP information in the background. {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 16:54:31 user nova-compute[75245]: DEBUG nova.network.neutron [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] allocate_for_instance() {{(pid=75245) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 16:54:31 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 16:54:31 user nova-compute[75245]: DEBUG nova.compute.manager [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] Start building block device mappings for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 16:54:31 user nova-compute[75245]: INFO nova.virt.block_device [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] Booting with volume e93a66be-6371-430a-9c89-115f7750abc7 at /dev/vda
Nov 29 16:54:31 user nova-compute[75245]: DEBUG nova.policy [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2870721a7fff4cf19291f0cbfaedae81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907dff4e054429fa10392b730363eb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75245) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 16:54:31 user nova-compute[75245]: DEBUG os_brick.utils [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:54:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:54:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:54:31 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8921249-57a9-4d1a-ad2c-03400f2830fc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:69ed8ed87091\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:54:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:54:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:54:31 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e38b623-14a8-482d-8c84-16a5f1faf8a3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:54:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:54:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:54:31 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcdcda2b-47f8-436b-81eb-1e76187ce2d3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:54:31 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd85e09c-dce4-4866-a847-ba3444da0337]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:54:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Running cmd (subprocess): nvme version {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:54:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] 'nvme version' failed. Not Retrying. {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:54:31 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] nvme not present on system {{(pid=75245) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 16:54:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:54:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:54:31 user nova-compute[75245]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 16:54:31 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[690bdcce-1bc8-4b55-a847-938f12f0d24c]: (4, '') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:54:31 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75245) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 16:54:31 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 16:54:31 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] LIGHTOS: no hostnqn found. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 16:54:31 user nova-compute[75245]: DEBUG os_brick.utils [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:69ed8ed87091', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:54:31 user nova-compute[75245]: DEBUG nova.virt.block_device [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] Updating existing volume attachment record: 1bd3e8a5-c5a1-434b-b8a2-28889e6f6d78 {{(pid=75245) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 16:54:32 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:54:32 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:54:33 user nova-compute[75245]: DEBUG nova.compute.manager [req-4aea58fa-a4a7-4865-b480-ace2c3db63fd req-fcf78771-8599-409f-ab40-0f14b3d3953c service nova] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Received event network-changed-8f62d901-5ef0-4879-9f19-8a51f55fde1f {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:54:33 user nova-compute[75245]: DEBUG nova.compute.manager [req-4aea58fa-a4a7-4865-b480-ace2c3db63fd req-fcf78771-8599-409f-ab40-0f14b3d3953c service nova] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Refreshing instance network info cache due to event network-changed-8f62d901-5ef0-4879-9f19-8a51f55fde1f. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:54:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-4aea58fa-a4a7-4865-b480-ace2c3db63fd req-fcf78771-8599-409f-ab40-0f14b3d3953c service nova] Acquiring lock "refresh_cache-25a0a73c-ed89-4530-aabb-a6a85e030482" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:54:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-4aea58fa-a4a7-4865-b480-ace2c3db63fd req-fcf78771-8599-409f-ab40-0f14b3d3953c service nova] Acquired lock "refresh_cache-25a0a73c-ed89-4530-aabb-a6a85e030482" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:54:33 user nova-compute[75245]: DEBUG nova.network.neutron [req-4aea58fa-a4a7-4865-b480-ace2c3db63fd req-fcf78771-8599-409f-ab40-0f14b3d3953c service nova] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Refreshing network info cache for port 8f62d901-5ef0-4879-9f19-8a51f55fde1f {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:54:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-239ce0f0-747e-4c7b-b3f3-e012c902a7b4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Acquiring lock "25a0a73c-ed89-4530-aabb-a6a85e030482" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:54:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-239ce0f0-747e-4c7b-b3f3-e012c902a7b4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Lock "25a0a73c-ed89-4530-aabb-a6a85e030482" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:54:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-239ce0f0-747e-4c7b-b3f3-e012c902a7b4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Acquiring lock "25a0a73c-ed89-4530-aabb-a6a85e030482-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:54:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-239ce0f0-747e-4c7b-b3f3-e012c902a7b4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Lock "25a0a73c-ed89-4530-aabb-a6a85e030482-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:54:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-239ce0f0-747e-4c7b-b3f3-e012c902a7b4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Lock "25a0a73c-ed89-4530-aabb-a6a85e030482-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:54:33 user nova-compute[75245]: INFO nova.compute.manager [None req-239ce0f0-747e-4c7b-b3f3-e012c902a7b4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Terminating instance
Nov 29 16:54:33 user nova-compute[75245]: DEBUG nova.compute.manager [None req-239ce0f0-747e-4c7b-b3f3-e012c902a7b4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Start destroying the instance on the hypervisor. {{(pid=75245) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 16:54:33 user nova-compute[75245]: DEBUG nova.network.neutron [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] Successfully created port: 1fdc121e-0b9d-43ca-8bf8-9a245f0fd242 {{(pid=75245) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 16:54:33 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:54:33 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:54:33 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:54:33 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:54:33 user nova-compute[75245]: DEBUG nova.network.neutron [req-4aea58fa-a4a7-4865-b480-ace2c3db63fd req-fcf78771-8599-409f-ab40-0f14b3d3953c service nova] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Updated VIF entry in instance network info cache for port 8f62d901-5ef0-4879-9f19-8a51f55fde1f. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:54:33 user nova-compute[75245]: DEBUG nova.network.neutron [req-4aea58fa-a4a7-4865-b480-ace2c3db63fd req-fcf78771-8599-409f-ab40-0f14b3d3953c service nova] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Updating instance_info_cache with network_info: [{"id": "8f62d901-5ef0-4879-9f19-8a51f55fde1f", "address": "fa:16:3e:8b:42:60", "network": {"id": "2eac25a6-c643-4348-98eb-91d044f1714c", "bridge": "br-int", "label": "tempest-TestStampPattern-1438802163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d056f7dae1d94936bd1fed295f0eba16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f62d901-5e", "ovs_interfaceid": "8f62d901-5ef0-4879-9f19-8a51f55fde1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:54:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-4aea58fa-a4a7-4865-b480-ace2c3db63fd req-fcf78771-8599-409f-ab40-0f14b3d3953c service nova] Releasing lock "refresh_cache-25a0a73c-ed89-4530-aabb-a6a85e030482" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:54:33 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Instance destroyed successfully.
Nov 29 16:54:33 user nova-compute[75245]: DEBUG nova.objects.instance [None req-239ce0f0-747e-4c7b-b3f3-e012c902a7b4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Lazy-loading 'resources' on Instance uuid 25a0a73c-ed89-4530-aabb-a6a85e030482 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:54:33 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-239ce0f0-747e-4c7b-b3f3-e012c902a7b4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:47:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-403547569',display_name='tempest-TestStampPattern-server-403547569',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-403547569',id=41,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImoWxFDnu4c8KDr10Q6Ubx68e8gn5RNIGqBgLtWDemy3wpgxbiBAYLS+wfSKYPtQ2DWWp70/Ts0kN1P7Ewenibb2M76FreHbG7l7wWc3VZE00W0BrocAjgoRPqW16wYoQ==',key_name='tempest-TestStampPattern-428472352',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:47:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d056f7dae1d94936bd1fed295f0eba16',ramdisk_id='',reservation_id='r-3xydtuhr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1627008304',owner_user_name='tempest-TestStampPattern-1627008304-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:50:38Z,user_data=None,user_id='0acde563960c46268a890ac370800146',uuid=25a0a73c-ed89-4530-aabb-a6a85e030482,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f62d901-5ef0-4879-9f19-8a51f55fde1f", "address": "fa:16:3e:8b:42:60", "network": {"id": "2eac25a6-c643-4348-98eb-91d044f1714c", "bridge": "br-int", "label": "tempest-TestStampPattern-1438802163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d056f7dae1d94936bd1fed295f0eba16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f62d901-5e", "ovs_interfaceid": "8f62d901-5ef0-4879-9f19-8a51f55fde1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 16:54:33 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-239ce0f0-747e-4c7b-b3f3-e012c902a7b4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Converting VIF {"id": "8f62d901-5ef0-4879-9f19-8a51f55fde1f", "address": "fa:16:3e:8b:42:60", "network": {"id": "2eac25a6-c643-4348-98eb-91d044f1714c", "bridge": "br-int", "label": "tempest-TestStampPattern-1438802163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d056f7dae1d94936bd1fed295f0eba16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f62d901-5e", "ovs_interfaceid": "8f62d901-5ef0-4879-9f19-8a51f55fde1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:54:33 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-239ce0f0-747e-4c7b-b3f3-e012c902a7b4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8b:42:60,bridge_name='br-int',has_traffic_filtering=True,id=8f62d901-5ef0-4879-9f19-8a51f55fde1f,network=Network(2eac25a6-c643-4348-98eb-91d044f1714c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f62d901-5e') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:54:33 user nova-compute[75245]: DEBUG os_vif [None req-239ce0f0-747e-4c7b-b3f3-e012c902a7b4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:42:60,bridge_name='br-int',has_traffic_filtering=True,id=8f62d901-5ef0-4879-9f19-8a51f55fde1f,network=Network(2eac25a6-c643-4348-98eb-91d044f1714c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f62d901-5e') {{(pid=75245) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 16:54:33 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:54:33 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8f62d901-5e, bridge=br-int, if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:54:33 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:54:33 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:54:33 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:54:33 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f2a47f9e-9379-4d61-b5c0-f22a446cdb57) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:54:33 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:54:33 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:54:33 user nova-compute[75245]: INFO os_vif [None req-239ce0f0-747e-4c7b-b3f3-e012c902a7b4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:42:60,bridge_name='br-int',has_traffic_filtering=True,id=8f62d901-5ef0-4879-9f19-8a51f55fde1f,network=Network(2eac25a6-c643-4348-98eb-91d044f1714c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f62d901-5e')
Nov 29 16:54:33 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-239ce0f0-747e-4c7b-b3f3-e012c902a7b4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Deleting instance files /opt/stack/data/nova/instances/25a0a73c-ed89-4530-aabb-a6a85e030482_del
Nov 29 16:54:33 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-239ce0f0-747e-4c7b-b3f3-e012c902a7b4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Deletion of /opt/stack/data/nova/instances/25a0a73c-ed89-4530-aabb-a6a85e030482_del complete
Nov 29 16:54:33 user nova-compute[75245]: INFO nova.compute.manager [None req-239ce0f0-747e-4c7b-b3f3-e012c902a7b4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 29 16:54:33 user nova-compute[75245]: DEBUG oslo.service.loopingcall [None req-239ce0f0-747e-4c7b-b3f3-e012c902a7b4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75245) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 16:54:33 user nova-compute[75245]: DEBUG nova.compute.manager [-] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Deallocating network for instance {{(pid=75245) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 16:54:33 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] deallocate_for_instance() {{(pid=75245) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 16:54:34 user nova-compute[75245]: DEBUG nova.network.neutron [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] Successfully updated port: 1fdc121e-0b9d-43ca-8bf8-9a245f0fd242 {{(pid=75245) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 16:54:34 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Acquiring lock "refresh_cache-f9419b01-cd53-472d-90d1-c18f6d77660a" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:54:34 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Acquired lock "refresh_cache-f9419b01-cd53-472d-90d1-c18f6d77660a" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:54:34 user nova-compute[75245]: DEBUG nova.network.neutron [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 16:54:34 user nova-compute[75245]: DEBUG nova.network.neutron [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] Instance cache missing network info. {{(pid=75245) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 16:54:34 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:54:34 user nova-compute[75245]: INFO nova.compute.manager [-] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Took 0.70 seconds to deallocate network for instance.
Nov 29 16:54:34 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-239ce0f0-747e-4c7b-b3f3-e012c902a7b4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:54:34 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-239ce0f0-747e-4c7b-b3f3-e012c902a7b4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:54:34 user nova-compute[75245]: DEBUG nova.network.neutron [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] Updating instance_info_cache with network_info: [{"id": "1fdc121e-0b9d-43ca-8bf8-9a245f0fd242", "address": "fa:16:3e:18:2e:2f", "network": {"id": "316cb9af-807d-4a69-874e-2054520f0e5f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1421560477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0907dff4e054429fa10392b730363eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fdc121e-0b", "ovs_interfaceid": "1fdc121e-0b9d-43ca-8bf8-9a245f0fd242", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:54:34 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-239ce0f0-747e-4c7b-b3f3-e012c902a7b4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:54:34 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Releasing lock "refresh_cache-f9419b01-cd53-472d-90d1-c18f6d77660a" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:54:34 user nova-compute[75245]: DEBUG nova.compute.manager [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] Instance network_info: |[{"id": "1fdc121e-0b9d-43ca-8bf8-9a245f0fd242", "address": "fa:16:3e:18:2e:2f", "network": {"id": "316cb9af-807d-4a69-874e-2054520f0e5f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1421560477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0907dff4e054429fa10392b730363eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fdc121e-0b", "ovs_interfaceid": "1fdc121e-0b9d-43ca-8bf8-9a245f0fd242", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 16:54:34 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-239ce0f0-747e-4c7b-b3f3-e012c902a7b4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:54:34 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-239ce0f0-747e-4c7b-b3f3-e012c902a7b4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.160s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:54:34 user nova-compute[75245]: INFO nova.scheduler.client.report [None req-239ce0f0-747e-4c7b-b3f3-e012c902a7b4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Deleted allocations for instance 25a0a73c-ed89-4530-aabb-a6a85e030482
Nov 29 16:54:35 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-239ce0f0-747e-4c7b-b3f3-e012c902a7b4 tempest-TestStampPattern-1627008304 tempest-TestStampPattern-1627008304-project-member] Lock "25a0a73c-ed89-4530-aabb-a6a85e030482" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.959s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:54:35 user nova-compute[75245]: DEBUG nova.compute.manager [req-e017ef11-67d9-4143-aac8-dae96564ed05 req-456d35ba-80b8-4fe4-a577-6b2fd11c7314 service nova] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Received event network-vif-unplugged-8f62d901-5ef0-4879-9f19-8a51f55fde1f {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:54:35 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-e017ef11-67d9-4143-aac8-dae96564ed05 req-456d35ba-80b8-4fe4-a577-6b2fd11c7314 service nova] Acquiring lock "25a0a73c-ed89-4530-aabb-a6a85e030482-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:54:35 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-e017ef11-67d9-4143-aac8-dae96564ed05 req-456d35ba-80b8-4fe4-a577-6b2fd11c7314 service nova] Lock "25a0a73c-ed89-4530-aabb-a6a85e030482-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:54:35 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-e017ef11-67d9-4143-aac8-dae96564ed05 req-456d35ba-80b8-4fe4-a577-6b2fd11c7314 service nova] Lock "25a0a73c-ed89-4530-aabb-a6a85e030482-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:54:35 user nova-compute[75245]: DEBUG nova.compute.manager [req-e017ef11-67d9-4143-aac8-dae96564ed05 req-456d35ba-80b8-4fe4-a577-6b2fd11c7314 service nova] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] No waiting events found dispatching network-vif-unplugged-8f62d901-5ef0-4879-9f19-8a51f55fde1f {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:54:35 user nova-compute[75245]: WARNING nova.compute.manager [req-e017ef11-67d9-4143-aac8-dae96564ed05 req-456d35ba-80b8-4fe4-a577-6b2fd11c7314 service nova] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Received unexpected event network-vif-unplugged-8f62d901-5ef0-4879-9f19-8a51f55fde1f for instance with vm_state deleted and task_state None.
Nov 29 16:54:35 user nova-compute[75245]: DEBUG nova.compute.manager [req-e017ef11-67d9-4143-aac8-dae96564ed05 req-456d35ba-80b8-4fe4-a577-6b2fd11c7314 service nova] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Received event network-vif-plugged-8f62d901-5ef0-4879-9f19-8a51f55fde1f {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:54:35 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-e017ef11-67d9-4143-aac8-dae96564ed05 req-456d35ba-80b8-4fe4-a577-6b2fd11c7314 service nova] Acquiring lock "25a0a73c-ed89-4530-aabb-a6a85e030482-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:54:35 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-e017ef11-67d9-4143-aac8-dae96564ed05 req-456d35ba-80b8-4fe4-a577-6b2fd11c7314 service nova] Lock "25a0a73c-ed89-4530-aabb-a6a85e030482-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:54:35 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-e017ef11-67d9-4143-aac8-dae96564ed05 req-456d35ba-80b8-4fe4-a577-6b2fd11c7314 service nova] Lock "25a0a73c-ed89-4530-aabb-a6a85e030482-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:54:35 user nova-compute[75245]: DEBUG nova.compute.manager [req-e017ef11-67d9-4143-aac8-dae96564ed05 req-456d35ba-80b8-4fe4-a577-6b2fd11c7314 service nova] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] No waiting events found dispatching network-vif-plugged-8f62d901-5ef0-4879-9f19-8a51f55fde1f {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:54:35 user nova-compute[75245]: WARNING nova.compute.manager [req-e017ef11-67d9-4143-aac8-dae96564ed05 req-456d35ba-80b8-4fe4-a577-6b2fd11c7314 service nova] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Received unexpected event network-vif-plugged-8f62d901-5ef0-4879-9f19-8a51f55fde1f for instance with vm_state deleted and task_state None.
Nov 29 16:54:35 user nova-compute[75245]: DEBUG nova.compute.manager [req-e017ef11-67d9-4143-aac8-dae96564ed05 req-456d35ba-80b8-4fe4-a577-6b2fd11c7314 service nova] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] Received event network-changed-1fdc121e-0b9d-43ca-8bf8-9a245f0fd242 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:54:35 user nova-compute[75245]: DEBUG nova.compute.manager [req-e017ef11-67d9-4143-aac8-dae96564ed05 req-456d35ba-80b8-4fe4-a577-6b2fd11c7314 service nova] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] Refreshing instance network info cache due to event network-changed-1fdc121e-0b9d-43ca-8bf8-9a245f0fd242. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:54:35 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-e017ef11-67d9-4143-aac8-dae96564ed05 req-456d35ba-80b8-4fe4-a577-6b2fd11c7314 service nova] Acquiring lock "refresh_cache-f9419b01-cd53-472d-90d1-c18f6d77660a" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:54:35 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-e017ef11-67d9-4143-aac8-dae96564ed05 req-456d35ba-80b8-4fe4-a577-6b2fd11c7314 service nova] Acquired lock "refresh_cache-f9419b01-cd53-472d-90d1-c18f6d77660a" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:54:35 user nova-compute[75245]: DEBUG nova.network.neutron [req-e017ef11-67d9-4143-aac8-dae96564ed05 req-456d35ba-80b8-4fe4-a577-6b2fd11c7314 service nova] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] Refreshing network info cache for port 1fdc121e-0b9d-43ca-8bf8-9a245f0fd242 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:54:35 user nova-compute[75245]: DEBUG nova.network.neutron [req-e017ef11-67d9-4143-aac8-dae96564ed05 req-456d35ba-80b8-4fe4-a577-6b2fd11c7314 service nova] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] Updated VIF entry in instance network info cache for port 1fdc121e-0b9d-43ca-8bf8-9a245f0fd242. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:54:35 user nova-compute[75245]: DEBUG nova.network.neutron [req-e017ef11-67d9-4143-aac8-dae96564ed05 req-456d35ba-80b8-4fe4-a577-6b2fd11c7314 service nova] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] Updating instance_info_cache with network_info: [{"id": "1fdc121e-0b9d-43ca-8bf8-9a245f0fd242", "address": "fa:16:3e:18:2e:2f", "network": {"id": "316cb9af-807d-4a69-874e-2054520f0e5f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1421560477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0907dff4e054429fa10392b730363eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fdc121e-0b", "ovs_interfaceid": "1fdc121e-0b9d-43ca-8bf8-9a245f0fd242", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:54:35 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-e017ef11-67d9-4143-aac8-dae96564ed05 req-456d35ba-80b8-4fe4-a577-6b2fd11c7314 service nova] Releasing lock "refresh_cache-f9419b01-cd53-472d-90d1-c18f6d77660a" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:54:35 user nova-compute[75245]: DEBUG nova.compute.manager [req-e017ef11-67d9-4143-aac8-dae96564ed05 req-456d35ba-80b8-4fe4-a577-6b2fd11c7314 service nova] [instance: 25a0a73c-ed89-4530-aabb-a6a85e030482] Received event network-vif-deleted-8f62d901-5ef0-4879-9f19-8a51f55fde1f {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:54:36 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:54:38 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:54:39 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:54:39 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:54:39 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75245) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 16:54:43 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:54:43 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:54:43 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75245) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 16:54:43 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:54:43 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:54:43 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:54:45 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:54:45 user nova-compute[75245]: DEBUG nova.compute.manager [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] Start spawning the instance on the hypervisor. {{(pid=75245) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 16:54:45 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] Creating instance directory {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 16:54:45 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] Creating image(s)
Nov 29 16:54:45 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] Did not create local disks {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 16:54:45 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] Ensure instance console log exists: /opt/stack/data/nova/instances/f9419b01-cd53-472d-90d1-c18f6d77660a/console.log {{(pid=75245) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 16:54:45 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:54:45 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:54:45 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:54:45 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] Start _get_guest_xml network_info=[{"id": "1fdc121e-0b9d-43ca-8bf8-9a245f0fd242", "address": "fa:16:3e:18:2e:2f", "network": {"id": "316cb9af-807d-4a69-874e-2054520f0e5f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1421560477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0907dff4e054429fa10392b730363eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fdc121e-0b", "ovs_interfaceid": "1fdc121e-0b9d-43ca-8bf8-9a245f0fd242", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '1bd3e8a5-c5a1-434b-b8a2-28889e6f6d78', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jgrAwYzR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f9419b01-cd53-472d-90d1-c18f6d77660a', 'attached_at': '', 'detached_at': '', 'volume_id': 'e93a66be-6371-430a-9c89-115f7750abc7', 'serial': 'e93a66be-6371-430a-9c89-115f7750abc7'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'guest_format': None, 'volume_type': None} {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 16:54:45 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:54:45 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:54:45 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 16:54:45 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] CPU controller missing on host. {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 16:54:45 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 16:54:45 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] CPU controller found on host. {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 16:54:45 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75245) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 16:54:45 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T16:06:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 16:54:45 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Flavor limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 16:54:45 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Image limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 16:54:45 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Flavor pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 16:54:45 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Image pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 16:54:45 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 16:54:45 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 16:54:45 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 16:54:45 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Got 1 possible topologies {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 16:54:45 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 16:54:45 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 16:54:45 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] Calling os-brick to attach iSCSI Volume {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 16:54:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jgrAwYzR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:54:45 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:54:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:54:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:54:45 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:54:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:54:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:54:45 user nova-compute[75245]: INFO os_brick.initiator.connectors.iscsi [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 16:54:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7 -p 172.16.0.220:3260 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:54:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:54:45 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4632f2-fdf0-4af8-9809-01a2c999b38c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:54:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 16:54:45 user nova-compute[75245]:  {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:54:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:54:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:54:45 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[be5eaed9-297f-471d-8046-e349abb2aeaa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7] added\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:54:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7] added
Nov 29 16:54:45 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:54:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:54:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:54:45 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e06342-4f19-4d33-92d2-fe5b85bb257c]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:54:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:54:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:54:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:54:45 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1f9380-5c5d-4d46-9bc9-1af529bee483]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:54:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:54:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jgrAwYzR {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:54:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jgrAwYzR" returned: 0 in 0.022s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:54:45 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f4be45c-7b9f-4759-bc88-942e74a4822e]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:54:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jgrAwYzR'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:54:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:54:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:54:45 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[5efe1d72-e82c-42ff-8e5d-2d0354084e1e]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:54:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:54:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:54:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:54:45 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[e93507e9-5143-41b6-8f72-68eab18b329e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:54:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 16:54:45 user nova-compute[75245]:  {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:54:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 16:54:45 user nova-compute[75245]:  {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:54:45 user nova-compute[75245]: WARNING os_brick.initiator.connectors.iscsi [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 16:54:45 user nova-compute[75245]: 
Nov 29 16:54:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7 -p 172.16.0.220:3260 --login {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:54:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:54:45 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0ff1a9-55eb-4130-a43a-ad16a368bd77]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:54:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7, portal: 172.16.0.220,3260]
Nov 29 16:54:45 user nova-compute[75245]: Login to [iface: default, target: iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7, portal: 172.16.0.220,3260] successful.
Nov 29 16:54:45 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:54:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:54:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:54:45 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc154548-814a-49b4-9577-bd6483740ec8]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:54:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:54:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:54:46 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:54:46 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d6c4d8d-8182-4c75-afd3-8dedcc04b687]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:54:46 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7 (non-flash)
Nov 29 16:54:46 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:54:46 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7 (non-flash)
Nov 29 16:54:46 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:54:46 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:54:46 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Connected to 172.16.0.220:3260 {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 16:54:46 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=75245) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 16:54:46 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75245) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 16:54:46 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:54:46 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:54:46 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[986c6dfd-aae3-4986-b0e2-52b94a52b42b]: (4, ('- - 0', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:54:46 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75245) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 16:54:46 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jgrAwYzR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 16:54:47 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:54:47 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '23366386531616137', 'path': '/dev/sdb'} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:54:47 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23366386531616137', 'path': '/dev/sdb'} {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 16:54:47 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:54:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1791857789',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1791857789',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1791857789',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxCJ2uTCUFf6lX+IbGbXHbVbbnWbvJD0z4gKB8uOjmfhOEMQgHiysJutJ7Ayf246Zi0gYvhm6yoqpPUXneGJi5qT/isxLWATEMcc/kn7vRZopID6UIgIMYHVfgfyTBiaQ==',key_name='tempest-keypair-1581814899',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0907dff4e054429fa10392b730363eb2',ramdisk_id='',reservation_id='r-ptd3znx9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-181783012',owner_user_name='tempest-TestVolumeBootPattern-181783012-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:54:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2870721a7fff4cf19291f0cbfaedae81',uuid=f9419b01-cd53-472d-90d1-c18f6d77660a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1fdc121e-0b9d-43ca-8bf8-9a245f0fd242", "address": "fa:16:3e:18:2e:2f", "network": {"id": "316cb9af-807d-4a69-874e-2054520f0e5f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1421560477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0907dff4e054429fa10392b730363eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fdc121e-0b", "ovs_interfaceid": "1fdc121e-0b9d-43ca-8bf8-9a245f0fd242", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:54:47 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Converting VIF {"id": "1fdc121e-0b9d-43ca-8bf8-9a245f0fd242", "address": "fa:16:3e:18:2e:2f", "network": {"id": "316cb9af-807d-4a69-874e-2054520f0e5f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1421560477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0907dff4e054429fa10392b730363eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fdc121e-0b", "ovs_interfaceid": "1fdc121e-0b9d-43ca-8bf8-9a245f0fd242", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:54:47 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:2e:2f,bridge_name='br-int',has_traffic_filtering=True,id=1fdc121e-0b9d-43ca-8bf8-9a245f0fd242,network=Network(316cb9af-807d-4a69-874e-2054520f0e5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fdc121e-0b') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:54:47 user nova-compute[75245]: DEBUG nova.objects.instance [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lazy-loading 'pci_devices' on Instance uuid f9419b01-cd53-472d-90d1-c18f6d77660a {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:54:47 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] End _get_guest_xml xml=<domain type="kvm">
Nov 29 16:54:47 user nova-compute[75245]:   <uuid>f9419b01-cd53-472d-90d1-c18f6d77660a</uuid>
Nov 29 16:54:47 user nova-compute[75245]:   <name>instance-0000002d</name>
Nov 29 16:54:47 user nova-compute[75245]:   <memory>524288</memory>
Nov 29 16:54:47 user nova-compute[75245]:   <vcpu>1</vcpu>
Nov 29 16:54:47 user nova-compute[75245]:   <metadata>
Nov 29 16:54:47 user nova-compute[75245]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 16:54:47 user nova-compute[75245]:       <nova:package version="0.0.0"/>
Nov 29 16:54:47 user nova-compute[75245]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1791857789</nova:name>
Nov 29 16:54:47 user nova-compute[75245]:       <nova:creationTime>2023-11-29 16:54:45</nova:creationTime>
Nov 29 16:54:47 user nova-compute[75245]:       <nova:flavor name="m1.tiny">
Nov 29 16:54:47 user nova-compute[75245]:         <nova:memory>512</nova:memory>
Nov 29 16:54:47 user nova-compute[75245]:         <nova:disk>1</nova:disk>
Nov 29 16:54:47 user nova-compute[75245]:         <nova:swap>0</nova:swap>
Nov 29 16:54:47 user nova-compute[75245]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 16:54:47 user nova-compute[75245]:         <nova:vcpus>1</nova:vcpus>
Nov 29 16:54:47 user nova-compute[75245]:       </nova:flavor>
Nov 29 16:54:47 user nova-compute[75245]:       <nova:owner>
Nov 29 16:54:47 user nova-compute[75245]:         <nova:user uuid="2870721a7fff4cf19291f0cbfaedae81">tempest-TestVolumeBootPattern-181783012-project-member</nova:user>
Nov 29 16:54:47 user nova-compute[75245]:         <nova:project uuid="0907dff4e054429fa10392b730363eb2">tempest-TestVolumeBootPattern-181783012</nova:project>
Nov 29 16:54:47 user nova-compute[75245]:       </nova:owner>
Nov 29 16:54:47 user nova-compute[75245]:       <nova:ports>
Nov 29 16:54:47 user nova-compute[75245]:         <nova:port uuid="1fdc121e-0b9d-43ca-8bf8-9a245f0fd242">
Nov 29 16:54:47 user nova-compute[75245]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 29 16:54:47 user nova-compute[75245]:         </nova:port>
Nov 29 16:54:47 user nova-compute[75245]:       </nova:ports>
Nov 29 16:54:47 user nova-compute[75245]:     </nova:instance>
Nov 29 16:54:47 user nova-compute[75245]:   </metadata>
Nov 29 16:54:47 user nova-compute[75245]:   <sysinfo type="smbios">
Nov 29 16:54:47 user nova-compute[75245]:     <system>
Nov 29 16:54:47 user nova-compute[75245]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 16:54:47 user nova-compute[75245]:       <entry name="product">OpenStack Nova</entry>
Nov 29 16:54:47 user nova-compute[75245]:       <entry name="version">0.0.0</entry>
Nov 29 16:54:47 user nova-compute[75245]:       <entry name="serial">f9419b01-cd53-472d-90d1-c18f6d77660a</entry>
Nov 29 16:54:47 user nova-compute[75245]:       <entry name="uuid">f9419b01-cd53-472d-90d1-c18f6d77660a</entry>
Nov 29 16:54:47 user nova-compute[75245]:       <entry name="family">Virtual Machine</entry>
Nov 29 16:54:47 user nova-compute[75245]:     </system>
Nov 29 16:54:47 user nova-compute[75245]:   </sysinfo>
Nov 29 16:54:47 user nova-compute[75245]:   <os>
Nov 29 16:54:47 user nova-compute[75245]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 16:54:47 user nova-compute[75245]:     <boot dev="hd"/>
Nov 29 16:54:47 user nova-compute[75245]:     <smbios mode="sysinfo"/>
Nov 29 16:54:47 user nova-compute[75245]:   </os>
Nov 29 16:54:47 user nova-compute[75245]:   <features>
Nov 29 16:54:47 user nova-compute[75245]:     <acpi/>
Nov 29 16:54:47 user nova-compute[75245]:     <apic/>
Nov 29 16:54:47 user nova-compute[75245]:     <vmcoreinfo/>
Nov 29 16:54:47 user nova-compute[75245]:   </features>
Nov 29 16:54:47 user nova-compute[75245]:   <clock offset="utc">
Nov 29 16:54:47 user nova-compute[75245]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 16:54:47 user nova-compute[75245]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 16:54:47 user nova-compute[75245]:     <timer name="hpet" present="no"/>
Nov 29 16:54:47 user nova-compute[75245]:   </clock>
Nov 29 16:54:47 user nova-compute[75245]:   <cpu mode="custom" match="exact">
Nov 29 16:54:47 user nova-compute[75245]:     <model>Nehalem</model>
Nov 29 16:54:47 user nova-compute[75245]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 16:54:47 user nova-compute[75245]:   </cpu>
Nov 29 16:54:47 user nova-compute[75245]:   <devices>
Nov 29 16:54:47 user nova-compute[75245]:     <disk type="block" device="disk">
Nov 29 16:54:47 user nova-compute[75245]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:54:47 user nova-compute[75245]:       <source dev="/dev/sdb"/>
Nov 29 16:54:47 user nova-compute[75245]:       <target dev="vda" bus="virtio"/>
Nov 29 16:54:47 user nova-compute[75245]:       <serial>e93a66be-6371-430a-9c89-115f7750abc7</serial>
Nov 29 16:54:47 user nova-compute[75245]:     </disk>
Nov 29 16:54:47 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 16:54:47 user nova-compute[75245]:       <mac address="fa:16:3e:18:2e:2f"/>
Nov 29 16:54:47 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:54:47 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 16:54:47 user nova-compute[75245]:       <target dev="tap1fdc121e-0b"/>
Nov 29 16:54:47 user nova-compute[75245]:     </interface>
Nov 29 16:54:47 user nova-compute[75245]:     <serial type="pty">
Nov 29 16:54:47 user nova-compute[75245]:       <log file="/opt/stack/data/nova/instances/f9419b01-cd53-472d-90d1-c18f6d77660a/console.log" append="off"/>
Nov 29 16:54:47 user nova-compute[75245]:     </serial>
Nov 29 16:54:47 user nova-compute[75245]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 16:54:47 user nova-compute[75245]:     <video>
Nov 29 16:54:47 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:54:47 user nova-compute[75245]:     </video>
Nov 29 16:54:47 user nova-compute[75245]:     <rng model="virtio">
Nov 29 16:54:47 user nova-compute[75245]:       <backend model="random">/dev/urandom</backend>
Nov 29 16:54:47 user nova-compute[75245]:     </rng>
Nov 29 16:54:47 user nova-compute[75245]:     <controller type="usb" index="0" model="none"/>
Nov 29 16:54:47 user nova-compute[75245]:     <memballoon model="virtio">
Nov 29 16:54:47 user nova-compute[75245]:       <stats period="10"/>
Nov 29 16:54:47 user nova-compute[75245]:     </memballoon>
Nov 29 16:54:47 user nova-compute[75245]:   </devices>
Nov 29 16:54:47 user nova-compute[75245]: </domain>
Nov 29 16:54:47 user nova-compute[75245]:  {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 16:54:47 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:54:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1791857789',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1791857789',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1791857789',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxCJ2uTCUFf6lX+IbGbXHbVbbnWbvJD0z4gKB8uOjmfhOEMQgHiysJutJ7Ayf246Zi0gYvhm6yoqpPUXneGJi5qT/isxLWATEMcc/kn7vRZopID6UIgIMYHVfgfyTBiaQ==',key_name='tempest-keypair-1581814899',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0907dff4e054429fa10392b730363eb2',ramdisk_id='',reservation_id='r-ptd3znx9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-181783012',owner_user_name='tempest-TestVolumeBootPattern-181783012-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:54:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2870721a7fff4cf19291f0cbfaedae81',uuid=f9419b01-cd53-472d-90d1-c18f6d77660a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1fdc121e-0b9d-43ca-8bf8-9a245f0fd242", "address": "fa:16:3e:18:2e:2f", "network": {"id": "316cb9af-807d-4a69-874e-2054520f0e5f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1421560477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0907dff4e054429fa10392b730363eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fdc121e-0b", "ovs_interfaceid": "1fdc121e-0b9d-43ca-8bf8-9a245f0fd242", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 16:54:47 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Converting VIF {"id": "1fdc121e-0b9d-43ca-8bf8-9a245f0fd242", "address": "fa:16:3e:18:2e:2f", "network": {"id": "316cb9af-807d-4a69-874e-2054520f0e5f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1421560477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0907dff4e054429fa10392b730363eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fdc121e-0b", "ovs_interfaceid": "1fdc121e-0b9d-43ca-8bf8-9a245f0fd242", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:54:47 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:2e:2f,bridge_name='br-int',has_traffic_filtering=True,id=1fdc121e-0b9d-43ca-8bf8-9a245f0fd242,network=Network(316cb9af-807d-4a69-874e-2054520f0e5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fdc121e-0b') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:54:47 user nova-compute[75245]: DEBUG os_vif [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:2e:2f,bridge_name='br-int',has_traffic_filtering=True,id=1fdc121e-0b9d-43ca-8bf8-9a245f0fd242,network=Network(316cb9af-807d-4a69-874e-2054520f0e5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fdc121e-0b') {{(pid=75245) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 16:54:47 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:54:47 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:54:47 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 16:54:47 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:54:47 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5ba97fc7-3fde-581b-92ac-e651afd71fb6', '_type': 'linux-noop'}}, row=False) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:54:47 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:54:47 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:54:47 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:54:47 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1fdc121e-0b, may_exist=True, interface_attrs={}) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:54:47 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1fdc121e-0b, col_values=(('qos', UUID('6e70fd08-8be8-4826-96c9-2cc17bcce9c3')),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:54:47 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1fdc121e-0b, col_values=(('external_ids', {'iface-id': '1fdc121e-0b9d-43ca-8bf8-9a245f0fd242', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:2e:2f', 'vm-uuid': 'f9419b01-cd53-472d-90d1-c18f6d77660a'}),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:54:47 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:54:47 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:54:47 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:54:47 user nova-compute[75245]: INFO os_vif [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:2e:2f,bridge_name='br-int',has_traffic_filtering=True,id=1fdc121e-0b9d-43ca-8bf8-9a245f0fd242,network=Network(316cb9af-807d-4a69-874e-2054520f0e5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fdc121e-0b')
Nov 29 16:54:47 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:54:47 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] No VIF found with MAC fa:16:3e:18:2e:2f, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:54:48 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:54:48 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:54:48 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:54:48 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:54:48 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:54:48 user nova-compute[75245]: DEBUG nova.compute.manager [req-9c10228f-f7fc-41da-aea2-d8bfe620fe38 req-b01a27a8-f89e-45b9-b60d-c5f8299044a6 service nova] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] Received event network-vif-plugged-1fdc121e-0b9d-43ca-8bf8-9a245f0fd242 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:54:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-9c10228f-f7fc-41da-aea2-d8bfe620fe38 req-b01a27a8-f89e-45b9-b60d-c5f8299044a6 service nova] Acquiring lock "f9419b01-cd53-472d-90d1-c18f6d77660a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:54:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-9c10228f-f7fc-41da-aea2-d8bfe620fe38 req-b01a27a8-f89e-45b9-b60d-c5f8299044a6 service nova] Lock "f9419b01-cd53-472d-90d1-c18f6d77660a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:54:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-9c10228f-f7fc-41da-aea2-d8bfe620fe38 req-b01a27a8-f89e-45b9-b60d-c5f8299044a6 service nova] Lock "f9419b01-cd53-472d-90d1-c18f6d77660a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:54:48 user nova-compute[75245]: DEBUG nova.compute.manager [req-9c10228f-f7fc-41da-aea2-d8bfe620fe38 req-b01a27a8-f89e-45b9-b60d-c5f8299044a6 service nova] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] No waiting events found dispatching network-vif-plugged-1fdc121e-0b9d-43ca-8bf8-9a245f0fd242 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:54:48 user nova-compute[75245]: WARNING nova.compute.manager [req-9c10228f-f7fc-41da-aea2-d8bfe620fe38 req-b01a27a8-f89e-45b9-b60d-c5f8299044a6 service nova] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] Received unexpected event network-vif-plugged-1fdc121e-0b9d-43ca-8bf8-9a245f0fd242 for instance with vm_state building and task_state spawning.
Nov 29 16:54:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:54:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:54:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:54:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:54:50 user nova-compute[75245]: DEBUG nova.compute.manager [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] Instance event wait completed in 0 seconds for  {{(pid=75245) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 16:54:50 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] Guest created on hypervisor {{(pid=75245) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 16:54:50 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] Instance spawned successfully.
Nov 29 16:54:50 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 16:54:50 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] Found default for hw_cdrom_bus of ide {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:54:50 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] Found default for hw_disk_bus of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:54:50 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] Found default for hw_input_bus of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:54:50 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] Found default for hw_pointer_model of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:54:50 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] Found default for hw_video_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:54:50 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] Found default for hw_vif_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:54:50 user nova-compute[75245]: INFO nova.compute.manager [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] Took 5.02 seconds to spawn the instance on the hypervisor.
Nov 29 16:54:50 user nova-compute[75245]: DEBUG nova.compute.manager [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:54:50 user nova-compute[75245]: DEBUG nova.compute.manager [req-461ab4af-a1d9-41e7-8197-754626bec22f req-e3429094-a0e7-4570-abb7-2d45ed28aa9f service nova] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] Received event network-vif-plugged-1fdc121e-0b9d-43ca-8bf8-9a245f0fd242 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:54:50 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-461ab4af-a1d9-41e7-8197-754626bec22f req-e3429094-a0e7-4570-abb7-2d45ed28aa9f service nova] Acquiring lock "f9419b01-cd53-472d-90d1-c18f6d77660a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:54:50 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-461ab4af-a1d9-41e7-8197-754626bec22f req-e3429094-a0e7-4570-abb7-2d45ed28aa9f service nova] Lock "f9419b01-cd53-472d-90d1-c18f6d77660a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:54:50 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-461ab4af-a1d9-41e7-8197-754626bec22f req-e3429094-a0e7-4570-abb7-2d45ed28aa9f service nova] Lock "f9419b01-cd53-472d-90d1-c18f6d77660a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:54:50 user nova-compute[75245]: DEBUG nova.compute.manager [req-461ab4af-a1d9-41e7-8197-754626bec22f req-e3429094-a0e7-4570-abb7-2d45ed28aa9f service nova] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] No waiting events found dispatching network-vif-plugged-1fdc121e-0b9d-43ca-8bf8-9a245f0fd242 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:54:50 user nova-compute[75245]: WARNING nova.compute.manager [req-461ab4af-a1d9-41e7-8197-754626bec22f req-e3429094-a0e7-4570-abb7-2d45ed28aa9f service nova] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] Received unexpected event network-vif-plugged-1fdc121e-0b9d-43ca-8bf8-9a245f0fd242 for instance with vm_state building and task_state spawning.
Nov 29 16:54:50 user nova-compute[75245]: INFO nova.compute.manager [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] Took 19.53 seconds to build instance.
Nov 29 16:54:50 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-7e49f699-97a9-48eb-8731-308059e6ba30 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "f9419b01-cd53-472d-90d1-c18f6d77660a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.634s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:54:52 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:54:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:54:57 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:55:02 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:55:02 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:55:02 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75245) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 16:55:02 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:55:02 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:55:02 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:55:07 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:55:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:55:12 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:55:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:55:17 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:55:19 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:55:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:55:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:55:25 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:55:25 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:55:25 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:55:25 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:55:25 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75245) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 16:55:25 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:55:26 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:55:26 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:55:26 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Hypervisor/Node resource view: name=user free_ram=8872MB free_disk=25.116500854492188GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75245) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 16:55:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:55:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:55:26 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance f9419b01-cd53-472d-90d1-c18f6d77660a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:55:26 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 16:55:26 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 16:55:26 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:55:26 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:55:26 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Compute_service record updated for user:user {{(pid=75245) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 16:55:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.185s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:55:27 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:55:27 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:55:27 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Starting heal instance info cache {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 16:55:27 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Rebuilding the list of instances to heal {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 16:55:27 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "refresh_cache-f9419b01-cd53-472d-90d1-c18f6d77660a" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:55:27 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquired lock "refresh_cache-f9419b01-cd53-472d-90d1-c18f6d77660a" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:55:27 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] Forcefully refreshing network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 16:55:27 user nova-compute[75245]: DEBUG nova.objects.instance [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lazy-loading 'info_cache' on Instance uuid f9419b01-cd53-472d-90d1-c18f6d77660a {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:55:27 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:55:28 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] Updating instance_info_cache with network_info: [{"id": "1fdc121e-0b9d-43ca-8bf8-9a245f0fd242", "address": "fa:16:3e:18:2e:2f", "network": {"id": "316cb9af-807d-4a69-874e-2054520f0e5f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1421560477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0907dff4e054429fa10392b730363eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fdc121e-0b", "ovs_interfaceid": "1fdc121e-0b9d-43ca-8bf8-9a245f0fd242", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:55:28 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Releasing lock "refresh_cache-f9419b01-cd53-472d-90d1-c18f6d77660a" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:55:28 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] Updated the network info_cache for instance {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 16:55:28 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:55:30 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:55:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:55:32 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:55:32 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:55:33 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:55:37 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:55:38 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:55:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:55:40 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:55:40 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75245) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 16:55:41 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:55:41 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:55:42 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:55:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:55:47 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:55:47 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:55:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:55:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Acquiring lock "6b3301cf-d51f-4876-af8b-bf1802537849" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:55:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Lock "6b3301cf-d51f-4876-af8b-bf1802537849" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:55:52 user nova-compute[75245]: DEBUG nova.compute.manager [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] Starting instance... {{(pid=75245) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 16:55:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:55:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:55:52 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75245) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 16:55:52 user nova-compute[75245]: INFO nova.compute.claims [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] Claim successful on node user
Nov 29 16:55:52 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:55:52 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:55:52 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:55:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.217s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:55:52 user nova-compute[75245]: DEBUG nova.compute.manager [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] Start building networks asynchronously for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 16:55:52 user nova-compute[75245]: DEBUG nova.compute.manager [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] Allocating IP information in the background. {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 16:55:52 user nova-compute[75245]: DEBUG nova.network.neutron [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] allocate_for_instance() {{(pid=75245) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 16:55:52 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 16:55:52 user nova-compute[75245]: DEBUG nova.compute.manager [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] Start building block device mappings for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 16:55:52 user nova-compute[75245]: DEBUG nova.policy [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3207e1ff86af4b91bef305f28848fbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3945a91aae184152ae3ad9e6307c69f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75245) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 16:55:52 user nova-compute[75245]: DEBUG nova.compute.manager [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] Start spawning the instance on the hypervisor. {{(pid=75245) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 16:55:52 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] Creating instance directory {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 16:55:52 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] Creating image(s)
Nov 29 16:55:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Acquiring lock "/opt/stack/data/nova/instances/6b3301cf-d51f-4876-af8b-bf1802537849/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:55:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Lock "/opt/stack/data/nova/instances/6b3301cf-d51f-4876-af8b-bf1802537849/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:55:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Lock "/opt/stack/data/nova/instances/6b3301cf-d51f-4876-af8b-bf1802537849/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:55:52 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:55:52 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.195s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:55:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Acquiring lock "d654f7206043e05d3525550b0fc885556eb999f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:55:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:55:52 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:55:52 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.193s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:55:52 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/6b3301cf-d51f-4876-af8b-bf1802537849/disk 1073741824 {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:55:53 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/6b3301cf-d51f-4876-af8b-bf1802537849/disk 1073741824" returned: 0 in 0.055s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:55:53 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:55:53 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:55:53 user nova-compute[75245]: DEBUG nova.network.neutron [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] Successfully created port: e11a9af6-997c-46df-975c-def9634baef0 {{(pid=75245) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 16:55:53 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.219s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:55:53 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6b3301cf-d51f-4876-af8b-bf1802537849/disk. size=1073741824 {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 16:55:53 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b3301cf-d51f-4876-af8b-bf1802537849/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:55:53 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b3301cf-d51f-4876-af8b-bf1802537849/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:55:53 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Cannot resize image /opt/stack/data/nova/instances/6b3301cf-d51f-4876-af8b-bf1802537849/disk to a smaller size. {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 16:55:53 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] Created local disks {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 16:55:53 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] Ensure instance console log exists: /opt/stack/data/nova/instances/6b3301cf-d51f-4876-af8b-bf1802537849/console.log {{(pid=75245) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 16:55:53 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:55:53 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:55:53 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:55:53 user nova-compute[75245]: DEBUG nova.network.neutron [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] Successfully updated port: e11a9af6-997c-46df-975c-def9634baef0 {{(pid=75245) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 16:55:53 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Acquiring lock "refresh_cache-6b3301cf-d51f-4876-af8b-bf1802537849" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:55:53 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Acquired lock "refresh_cache-6b3301cf-d51f-4876-af8b-bf1802537849" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:55:53 user nova-compute[75245]: DEBUG nova.network.neutron [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 16:55:53 user nova-compute[75245]: DEBUG nova.compute.manager [req-ab4e46fc-c1ee-4213-9fdc-40a7da7ebdcb req-326a35fd-4cfc-439a-a1c6-bb8a6ac2d54a service nova] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] Received event network-changed-e11a9af6-997c-46df-975c-def9634baef0 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:55:53 user nova-compute[75245]: DEBUG nova.compute.manager [req-ab4e46fc-c1ee-4213-9fdc-40a7da7ebdcb req-326a35fd-4cfc-439a-a1c6-bb8a6ac2d54a service nova] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] Refreshing instance network info cache due to event network-changed-e11a9af6-997c-46df-975c-def9634baef0. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:55:53 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-ab4e46fc-c1ee-4213-9fdc-40a7da7ebdcb req-326a35fd-4cfc-439a-a1c6-bb8a6ac2d54a service nova] Acquiring lock "refresh_cache-6b3301cf-d51f-4876-af8b-bf1802537849" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:55:54 user nova-compute[75245]: DEBUG nova.network.neutron [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] Instance cache missing network info. {{(pid=75245) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 16:55:54 user nova-compute[75245]: DEBUG nova.network.neutron [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] Updating instance_info_cache with network_info: [{"id": "e11a9af6-997c-46df-975c-def9634baef0", "address": "fa:16:3e:e4:cf:d6", "network": {"id": "9ac826d2-ead7-459b-8629-2c3ac5b3dc88", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1414777524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3945a91aae184152ae3ad9e6307c69f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape11a9af6-99", "ovs_interfaceid": "e11a9af6-997c-46df-975c-def9634baef0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:55:54 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Releasing lock "refresh_cache-6b3301cf-d51f-4876-af8b-bf1802537849" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:55:54 user nova-compute[75245]: DEBUG nova.compute.manager [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] Instance network_info: |[{"id": "e11a9af6-997c-46df-975c-def9634baef0", "address": "fa:16:3e:e4:cf:d6", "network": {"id": "9ac826d2-ead7-459b-8629-2c3ac5b3dc88", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1414777524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3945a91aae184152ae3ad9e6307c69f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape11a9af6-99", "ovs_interfaceid": "e11a9af6-997c-46df-975c-def9634baef0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 16:55:54 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-ab4e46fc-c1ee-4213-9fdc-40a7da7ebdcb req-326a35fd-4cfc-439a-a1c6-bb8a6ac2d54a service nova] Acquired lock "refresh_cache-6b3301cf-d51f-4876-af8b-bf1802537849" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:55:54 user nova-compute[75245]: DEBUG nova.network.neutron [req-ab4e46fc-c1ee-4213-9fdc-40a7da7ebdcb req-326a35fd-4cfc-439a-a1c6-bb8a6ac2d54a service nova] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] Refreshing network info cache for port e11a9af6-997c-46df-975c-def9634baef0 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:55:54 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] Start _get_guest_xml network_info=[{"id": "e11a9af6-997c-46df-975c-def9634baef0", "address": "fa:16:3e:e4:cf:d6", "network": {"id": "9ac826d2-ead7-459b-8629-2c3ac5b3dc88", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1414777524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3945a91aae184152ae3ad9e6307c69f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape11a9af6-99", "ovs_interfaceid": "e11a9af6-997c-46df-975c-def9634baef0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'a291d9c3-be02-4c6c-9649-4b45c5b7f487'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 16:55:54 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:55:54 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:55:54 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 16:55:54 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] CPU controller missing on host. {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 16:55:54 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 16:55:54 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] CPU controller found on host. {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 16:55:54 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75245) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 16:55:54 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T16:06:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 16:55:54 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Flavor limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 16:55:54 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Image limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 16:55:54 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Flavor pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 16:55:54 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Image pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 16:55:54 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 16:55:54 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 16:55:54 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 16:55:54 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Got 1 possible topologies {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 16:55:54 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 16:55:54 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 16:55:54 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:55:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-675138715',display_name='tempest-VolumesSnapshotTestJSON-instance-675138715',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-675138715',id=46,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPnkGcVV3fojpDPGmg99Pa1jIV5gZ3woUSS0sezlCvznNVilnP9zcVU8RN1avfNYR6d3nYdZpvelDi25tUNR0GxeGxrCXPeCUrhs4hvKQ3l91D9W5FTWbqC2Uin3Ung/uw==',key_name='tempest-keypair-1063465921',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3945a91aae184152ae3ad9e6307c69f2',ramdisk_id='',reservation_id='r-3n8yb9m3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-234601790',owner_user_name='tempest-VolumesSnapshotTestJSON-234601790-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:55:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3207e1ff86af4b91bef305f28848fbdb',uuid=6b3301cf-d51f-4876-af8b-bf1802537849,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e11a9af6-997c-46df-975c-def9634baef0", "address": "fa:16:3e:e4:cf:d6", "network": {"id": "9ac826d2-ead7-459b-8629-2c3ac5b3dc88", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1414777524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3945a91aae184152ae3ad9e6307c69f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape11a9af6-99", "ovs_interfaceid": "e11a9af6-997c-46df-975c-def9634baef0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:55:54 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Converting VIF {"id": "e11a9af6-997c-46df-975c-def9634baef0", "address": "fa:16:3e:e4:cf:d6", "network": {"id": "9ac826d2-ead7-459b-8629-2c3ac5b3dc88", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1414777524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3945a91aae184152ae3ad9e6307c69f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape11a9af6-99", "ovs_interfaceid": "e11a9af6-997c-46df-975c-def9634baef0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:55:54 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:cf:d6,bridge_name='br-int',has_traffic_filtering=True,id=e11a9af6-997c-46df-975c-def9634baef0,network=Network(9ac826d2-ead7-459b-8629-2c3ac5b3dc88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape11a9af6-99') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:55:54 user nova-compute[75245]: DEBUG nova.objects.instance [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Lazy-loading 'pci_devices' on Instance uuid 6b3301cf-d51f-4876-af8b-bf1802537849 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:55:54 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] End _get_guest_xml xml=<domain type="kvm">
Nov 29 16:55:54 user nova-compute[75245]:   <uuid>6b3301cf-d51f-4876-af8b-bf1802537849</uuid>
Nov 29 16:55:54 user nova-compute[75245]:   <name>instance-0000002e</name>
Nov 29 16:55:54 user nova-compute[75245]:   <memory>524288</memory>
Nov 29 16:55:54 user nova-compute[75245]:   <vcpu>1</vcpu>
Nov 29 16:55:54 user nova-compute[75245]:   <metadata>
Nov 29 16:55:54 user nova-compute[75245]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 16:55:54 user nova-compute[75245]:       <nova:package version="0.0.0"/>
Nov 29 16:55:54 user nova-compute[75245]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-675138715</nova:name>
Nov 29 16:55:54 user nova-compute[75245]:       <nova:creationTime>2023-11-29 16:55:54</nova:creationTime>
Nov 29 16:55:54 user nova-compute[75245]:       <nova:flavor name="m1.tiny">
Nov 29 16:55:54 user nova-compute[75245]:         <nova:memory>512</nova:memory>
Nov 29 16:55:54 user nova-compute[75245]:         <nova:disk>1</nova:disk>
Nov 29 16:55:54 user nova-compute[75245]:         <nova:swap>0</nova:swap>
Nov 29 16:55:54 user nova-compute[75245]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 16:55:54 user nova-compute[75245]:         <nova:vcpus>1</nova:vcpus>
Nov 29 16:55:54 user nova-compute[75245]:       </nova:flavor>
Nov 29 16:55:54 user nova-compute[75245]:       <nova:owner>
Nov 29 16:55:54 user nova-compute[75245]:         <nova:user uuid="3207e1ff86af4b91bef305f28848fbdb">tempest-VolumesSnapshotTestJSON-234601790-project-member</nova:user>
Nov 29 16:55:54 user nova-compute[75245]:         <nova:project uuid="3945a91aae184152ae3ad9e6307c69f2">tempest-VolumesSnapshotTestJSON-234601790</nova:project>
Nov 29 16:55:54 user nova-compute[75245]:       </nova:owner>
Nov 29 16:55:54 user nova-compute[75245]:       <nova:root type="image" uuid="a291d9c3-be02-4c6c-9649-4b45c5b7f487"/>
Nov 29 16:55:54 user nova-compute[75245]:       <nova:ports>
Nov 29 16:55:54 user nova-compute[75245]:         <nova:port uuid="e11a9af6-997c-46df-975c-def9634baef0">
Nov 29 16:55:54 user nova-compute[75245]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 29 16:55:54 user nova-compute[75245]:         </nova:port>
Nov 29 16:55:54 user nova-compute[75245]:       </nova:ports>
Nov 29 16:55:54 user nova-compute[75245]:     </nova:instance>
Nov 29 16:55:54 user nova-compute[75245]:   </metadata>
Nov 29 16:55:54 user nova-compute[75245]:   <sysinfo type="smbios">
Nov 29 16:55:54 user nova-compute[75245]:     <system>
Nov 29 16:55:54 user nova-compute[75245]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 16:55:54 user nova-compute[75245]:       <entry name="product">OpenStack Nova</entry>
Nov 29 16:55:54 user nova-compute[75245]:       <entry name="version">0.0.0</entry>
Nov 29 16:55:54 user nova-compute[75245]:       <entry name="serial">6b3301cf-d51f-4876-af8b-bf1802537849</entry>
Nov 29 16:55:54 user nova-compute[75245]:       <entry name="uuid">6b3301cf-d51f-4876-af8b-bf1802537849</entry>
Nov 29 16:55:54 user nova-compute[75245]:       <entry name="family">Virtual Machine</entry>
Nov 29 16:55:54 user nova-compute[75245]:     </system>
Nov 29 16:55:54 user nova-compute[75245]:   </sysinfo>
Nov 29 16:55:54 user nova-compute[75245]:   <os>
Nov 29 16:55:54 user nova-compute[75245]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 16:55:54 user nova-compute[75245]:     <boot dev="hd"/>
Nov 29 16:55:54 user nova-compute[75245]:     <smbios mode="sysinfo"/>
Nov 29 16:55:54 user nova-compute[75245]:   </os>
Nov 29 16:55:54 user nova-compute[75245]:   <features>
Nov 29 16:55:54 user nova-compute[75245]:     <acpi/>
Nov 29 16:55:54 user nova-compute[75245]:     <apic/>
Nov 29 16:55:54 user nova-compute[75245]:     <vmcoreinfo/>
Nov 29 16:55:54 user nova-compute[75245]:   </features>
Nov 29 16:55:54 user nova-compute[75245]:   <clock offset="utc">
Nov 29 16:55:54 user nova-compute[75245]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 16:55:54 user nova-compute[75245]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 16:55:54 user nova-compute[75245]:     <timer name="hpet" present="no"/>
Nov 29 16:55:54 user nova-compute[75245]:   </clock>
Nov 29 16:55:54 user nova-compute[75245]:   <cpu mode="custom" match="exact">
Nov 29 16:55:54 user nova-compute[75245]:     <model>Nehalem</model>
Nov 29 16:55:54 user nova-compute[75245]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 16:55:54 user nova-compute[75245]:   </cpu>
Nov 29 16:55:54 user nova-compute[75245]:   <devices>
Nov 29 16:55:54 user nova-compute[75245]:     <disk type="file" device="disk">
Nov 29 16:55:54 user nova-compute[75245]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 16:55:54 user nova-compute[75245]:       <source file="/opt/stack/data/nova/instances/6b3301cf-d51f-4876-af8b-bf1802537849/disk"/>
Nov 29 16:55:54 user nova-compute[75245]:       <target dev="vda" bus="virtio"/>
Nov 29 16:55:54 user nova-compute[75245]:     </disk>
Nov 29 16:55:54 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 16:55:54 user nova-compute[75245]:       <mac address="fa:16:3e:e4:cf:d6"/>
Nov 29 16:55:54 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:55:54 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 16:55:54 user nova-compute[75245]:       <target dev="tape11a9af6-99"/>
Nov 29 16:55:54 user nova-compute[75245]:     </interface>
Nov 29 16:55:54 user nova-compute[75245]:     <serial type="pty">
Nov 29 16:55:54 user nova-compute[75245]:       <log file="/opt/stack/data/nova/instances/6b3301cf-d51f-4876-af8b-bf1802537849/console.log" append="off"/>
Nov 29 16:55:54 user nova-compute[75245]:     </serial>
Nov 29 16:55:54 user nova-compute[75245]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 16:55:54 user nova-compute[75245]:     <video>
Nov 29 16:55:54 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:55:54 user nova-compute[75245]:     </video>
Nov 29 16:55:54 user nova-compute[75245]:     <rng model="virtio">
Nov 29 16:55:54 user nova-compute[75245]:       <backend model="random">/dev/urandom</backend>
Nov 29 16:55:54 user nova-compute[75245]:     </rng>
Nov 29 16:55:54 user nova-compute[75245]:     <controller type="usb" index="0" model="none"/>
Nov 29 16:55:54 user nova-compute[75245]:     <memballoon model="virtio">
Nov 29 16:55:54 user nova-compute[75245]:       <stats period="10"/>
Nov 29 16:55:54 user nova-compute[75245]:     </memballoon>
Nov 29 16:55:54 user nova-compute[75245]:   </devices>
Nov 29 16:55:54 user nova-compute[75245]: </domain>
Nov 29 16:55:54 user nova-compute[75245]:  {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 16:55:54 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:55:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-675138715',display_name='tempest-VolumesSnapshotTestJSON-instance-675138715',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-675138715',id=46,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPnkGcVV3fojpDPGmg99Pa1jIV5gZ3woUSS0sezlCvznNVilnP9zcVU8RN1avfNYR6d3nYdZpvelDi25tUNR0GxeGxrCXPeCUrhs4hvKQ3l91D9W5FTWbqC2Uin3Ung/uw==',key_name='tempest-keypair-1063465921',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3945a91aae184152ae3ad9e6307c69f2',ramdisk_id='',reservation_id='r-3n8yb9m3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-234601790',owner_user_name='tempest-VolumesSnapshotTestJSON-234601790-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:55:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3207e1ff86af4b91bef305f28848fbdb',uuid=6b3301cf-d51f-4876-af8b-bf1802537849,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e11a9af6-997c-46df-975c-def9634baef0", "address": "fa:16:3e:e4:cf:d6", "network": {"id": "9ac826d2-ead7-459b-8629-2c3ac5b3dc88", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1414777524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3945a91aae184152ae3ad9e6307c69f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape11a9af6-99", "ovs_interfaceid": "e11a9af6-997c-46df-975c-def9634baef0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 16:55:54 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Converting VIF {"id": "e11a9af6-997c-46df-975c-def9634baef0", "address": "fa:16:3e:e4:cf:d6", "network": {"id": "9ac826d2-ead7-459b-8629-2c3ac5b3dc88", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1414777524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3945a91aae184152ae3ad9e6307c69f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape11a9af6-99", "ovs_interfaceid": "e11a9af6-997c-46df-975c-def9634baef0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:55:54 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:cf:d6,bridge_name='br-int',has_traffic_filtering=True,id=e11a9af6-997c-46df-975c-def9634baef0,network=Network(9ac826d2-ead7-459b-8629-2c3ac5b3dc88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape11a9af6-99') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:55:54 user nova-compute[75245]: DEBUG os_vif [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:cf:d6,bridge_name='br-int',has_traffic_filtering=True,id=e11a9af6-997c-46df-975c-def9634baef0,network=Network(9ac826d2-ead7-459b-8629-2c3ac5b3dc88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape11a9af6-99') {{(pid=75245) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 16:55:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:55:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:55:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 16:55:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:55:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '21dff2f9-b2f6-58fe-8d04-b9e1cfb3060e', '_type': 'linux-noop'}}, row=False) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:55:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:55:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:55:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:55:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape11a9af6-99, may_exist=True, interface_attrs={}) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:55:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape11a9af6-99, col_values=(('qos', UUID('23eeb5d3-5094-48cd-8b53-c00068983c51')),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:55:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape11a9af6-99, col_values=(('external_ids', {'iface-id': 'e11a9af6-997c-46df-975c-def9634baef0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:cf:d6', 'vm-uuid': '6b3301cf-d51f-4876-af8b-bf1802537849'}),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:55:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:55:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:55:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:55:54 user nova-compute[75245]: INFO os_vif [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:cf:d6,bridge_name='br-int',has_traffic_filtering=True,id=e11a9af6-997c-46df-975c-def9634baef0,network=Network(9ac826d2-ead7-459b-8629-2c3ac5b3dc88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape11a9af6-99')
Nov 29 16:55:54 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:55:54 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] No VIF found with MAC fa:16:3e:e4:cf:d6, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:55:54 user nova-compute[75245]: DEBUG nova.network.neutron [req-ab4e46fc-c1ee-4213-9fdc-40a7da7ebdcb req-326a35fd-4cfc-439a-a1c6-bb8a6ac2d54a service nova] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] Updated VIF entry in instance network info cache for port e11a9af6-997c-46df-975c-def9634baef0. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:55:54 user nova-compute[75245]: DEBUG nova.network.neutron [req-ab4e46fc-c1ee-4213-9fdc-40a7da7ebdcb req-326a35fd-4cfc-439a-a1c6-bb8a6ac2d54a service nova] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] Updating instance_info_cache with network_info: [{"id": "e11a9af6-997c-46df-975c-def9634baef0", "address": "fa:16:3e:e4:cf:d6", "network": {"id": "9ac826d2-ead7-459b-8629-2c3ac5b3dc88", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1414777524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3945a91aae184152ae3ad9e6307c69f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape11a9af6-99", "ovs_interfaceid": "e11a9af6-997c-46df-975c-def9634baef0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:55:54 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-ab4e46fc-c1ee-4213-9fdc-40a7da7ebdcb req-326a35fd-4cfc-439a-a1c6-bb8a6ac2d54a service nova] Releasing lock "refresh_cache-6b3301cf-d51f-4876-af8b-bf1802537849" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:55:55 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:55:55 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:55:55 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:55:56 user nova-compute[75245]: DEBUG nova.compute.manager [req-dd9135ae-797d-4abd-b70c-0ce9f23ed4ac req-5b9548c0-adea-46a9-ad7d-503d9a02c2a9 service nova] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] Received event network-vif-plugged-e11a9af6-997c-46df-975c-def9634baef0 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:55:56 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-dd9135ae-797d-4abd-b70c-0ce9f23ed4ac req-5b9548c0-adea-46a9-ad7d-503d9a02c2a9 service nova] Acquiring lock "6b3301cf-d51f-4876-af8b-bf1802537849-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:55:56 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-dd9135ae-797d-4abd-b70c-0ce9f23ed4ac req-5b9548c0-adea-46a9-ad7d-503d9a02c2a9 service nova] Lock "6b3301cf-d51f-4876-af8b-bf1802537849-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:55:56 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-dd9135ae-797d-4abd-b70c-0ce9f23ed4ac req-5b9548c0-adea-46a9-ad7d-503d9a02c2a9 service nova] Lock "6b3301cf-d51f-4876-af8b-bf1802537849-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:55:56 user nova-compute[75245]: DEBUG nova.compute.manager [req-dd9135ae-797d-4abd-b70c-0ce9f23ed4ac req-5b9548c0-adea-46a9-ad7d-503d9a02c2a9 service nova] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] No waiting events found dispatching network-vif-plugged-e11a9af6-997c-46df-975c-def9634baef0 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:55:56 user nova-compute[75245]: WARNING nova.compute.manager [req-dd9135ae-797d-4abd-b70c-0ce9f23ed4ac req-5b9548c0-adea-46a9-ad7d-503d9a02c2a9 service nova] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] Received unexpected event network-vif-plugged-e11a9af6-997c-46df-975c-def9634baef0 for instance with vm_state building and task_state spawning.
Nov 29 16:55:56 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:55:56 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:55:56 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:55:57 user nova-compute[75245]: DEBUG nova.compute.manager [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] Instance event wait completed in 0 seconds for  {{(pid=75245) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 16:55:57 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] Guest created on hypervisor {{(pid=75245) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 16:55:57 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] Instance spawned successfully.
Nov 29 16:55:57 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 16:55:57 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] Found default for hw_cdrom_bus of ide {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:55:57 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] Found default for hw_disk_bus of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:55:57 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] Found default for hw_input_bus of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:55:57 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] Found default for hw_pointer_model of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:55:57 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] Found default for hw_video_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:55:57 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] Found default for hw_vif_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:55:57 user nova-compute[75245]: INFO nova.compute.manager [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] Took 5.34 seconds to spawn the instance on the hypervisor.
Nov 29 16:55:57 user nova-compute[75245]: DEBUG nova.compute.manager [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:55:58 user nova-compute[75245]: INFO nova.compute.manager [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] Took 5.92 seconds to build instance.
Nov 29 16:55:58 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-7bf09abe-0dcb-498b-bb0a-7f78d7eb8d52 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Lock "6b3301cf-d51f-4876-af8b-bf1802537849" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.018s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:55:58 user nova-compute[75245]: DEBUG nova.compute.manager [req-d712f66a-5a00-4fda-800d-324b8d80a530 req-ec8e2fac-de13-401e-b7a4-48046f7cb6d0 service nova] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] Received event network-vif-plugged-e11a9af6-997c-46df-975c-def9634baef0 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:55:58 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d712f66a-5a00-4fda-800d-324b8d80a530 req-ec8e2fac-de13-401e-b7a4-48046f7cb6d0 service nova] Acquiring lock "6b3301cf-d51f-4876-af8b-bf1802537849-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:55:58 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d712f66a-5a00-4fda-800d-324b8d80a530 req-ec8e2fac-de13-401e-b7a4-48046f7cb6d0 service nova] Lock "6b3301cf-d51f-4876-af8b-bf1802537849-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:55:58 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d712f66a-5a00-4fda-800d-324b8d80a530 req-ec8e2fac-de13-401e-b7a4-48046f7cb6d0 service nova] Lock "6b3301cf-d51f-4876-af8b-bf1802537849-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:55:58 user nova-compute[75245]: DEBUG nova.compute.manager [req-d712f66a-5a00-4fda-800d-324b8d80a530 req-ec8e2fac-de13-401e-b7a4-48046f7cb6d0 service nova] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] No waiting events found dispatching network-vif-plugged-e11a9af6-997c-46df-975c-def9634baef0 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:55:58 user nova-compute[75245]: WARNING nova.compute.manager [req-d712f66a-5a00-4fda-800d-324b8d80a530 req-ec8e2fac-de13-401e-b7a4-48046f7cb6d0 service nova] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] Received unexpected event network-vif-plugged-e11a9af6-997c-46df-975c-def9634baef0 for instance with vm_state active and task_state None.
Nov 29 16:55:59 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:56:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:56:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:56:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75245) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 16:56:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:56:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:56:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:56:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:56:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:56:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:56:19 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:56:19 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:56:22 user nova-compute[75245]: DEBUG nova.compute.manager [req-642dbc77-c496-44f3-a14c-7efe429ffe14 req-8940249c-72c6-4889-976d-779581eae717 service nova] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] Received event network-changed-1fdc121e-0b9d-43ca-8bf8-9a245f0fd242 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:56:22 user nova-compute[75245]: DEBUG nova.compute.manager [req-642dbc77-c496-44f3-a14c-7efe429ffe14 req-8940249c-72c6-4889-976d-779581eae717 service nova] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] Refreshing instance network info cache due to event network-changed-1fdc121e-0b9d-43ca-8bf8-9a245f0fd242. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:56:22 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-642dbc77-c496-44f3-a14c-7efe429ffe14 req-8940249c-72c6-4889-976d-779581eae717 service nova] Acquiring lock "refresh_cache-f9419b01-cd53-472d-90d1-c18f6d77660a" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:56:22 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-642dbc77-c496-44f3-a14c-7efe429ffe14 req-8940249c-72c6-4889-976d-779581eae717 service nova] Acquired lock "refresh_cache-f9419b01-cd53-472d-90d1-c18f6d77660a" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:56:22 user nova-compute[75245]: DEBUG nova.network.neutron [req-642dbc77-c496-44f3-a14c-7efe429ffe14 req-8940249c-72c6-4889-976d-779581eae717 service nova] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] Refreshing network info cache for port 1fdc121e-0b9d-43ca-8bf8-9a245f0fd242 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:56:22 user nova-compute[75245]: DEBUG nova.network.neutron [req-642dbc77-c496-44f3-a14c-7efe429ffe14 req-8940249c-72c6-4889-976d-779581eae717 service nova] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] Updated VIF entry in instance network info cache for port 1fdc121e-0b9d-43ca-8bf8-9a245f0fd242. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:56:22 user nova-compute[75245]: DEBUG nova.network.neutron [req-642dbc77-c496-44f3-a14c-7efe429ffe14 req-8940249c-72c6-4889-976d-779581eae717 service nova] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] Updating instance_info_cache with network_info: [{"id": "1fdc121e-0b9d-43ca-8bf8-9a245f0fd242", "address": "fa:16:3e:18:2e:2f", "network": {"id": "316cb9af-807d-4a69-874e-2054520f0e5f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1421560477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0907dff4e054429fa10392b730363eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fdc121e-0b", "ovs_interfaceid": "1fdc121e-0b9d-43ca-8bf8-9a245f0fd242", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:56:22 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-642dbc77-c496-44f3-a14c-7efe429ffe14 req-8940249c-72c6-4889-976d-779581eae717 service nova] Releasing lock "refresh_cache-f9419b01-cd53-472d-90d1-c18f6d77660a" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:56:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:56:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:56:27 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:56:27 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:56:27 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:56:27 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:56:27 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:56:27 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75245) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 16:56:27 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b3301cf-d51f-4876-af8b-bf1802537849/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:56:27 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b3301cf-d51f-4876-af8b-bf1802537849/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:56:27 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b3301cf-d51f-4876-af8b-bf1802537849/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:56:27 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b3301cf-d51f-4876-af8b-bf1802537849/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:56:27 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:56:28 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:56:28 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:56:28 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Hypervisor/Node resource view: name=user free_ram=8803MB free_disk=25.085182189941406GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75245) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 16:56:28 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:56:28 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:56:28 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance f9419b01-cd53-472d-90d1-c18f6d77660a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:56:28 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 6b3301cf-d51f-4876-af8b-bf1802537849 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:56:28 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 16:56:28 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 16:56:28 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Refreshing inventories for resource provider dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 16:56:28 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Updating ProviderTree inventory for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 16:56:28 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Updating inventory in ProviderTree for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 16:56:28 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Refreshing aggregate associations for resource provider dcc0ed27-167e-4f3a-a0de-183bb144a50c, aggregates: None {{(pid=75245) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 16:56:28 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Refreshing trait associations for resource provider dcc0ed27-167e-4f3a-a0de-183bb144a50c, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG {{(pid=75245) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 16:56:28 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:56:28 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:56:28 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Compute_service record updated for user:user {{(pid=75245) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 16:56:28 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.484s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:56:28 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Acquiring lock "1ce652dd-61ac-42b4-abb5-7c8bb9ed3328" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:56:28 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "1ce652dd-61ac-42b4-abb5-7c8bb9ed3328" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:56:29 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328] Starting instance... {{(pid=75245) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 16:56:29 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:56:29 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:56:29 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75245) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 16:56:29 user nova-compute[75245]: INFO nova.compute.claims [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328] Claim successful on node user
Nov 29 16:56:29 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:56:29 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:56:29 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.255s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:56:29 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328] Start building networks asynchronously for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 16:56:29 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:56:29 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 16:56:29 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:56:29 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328] Allocating IP information in the background. {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 16:56:29 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328] allocate_for_instance() {{(pid=75245) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 16:56:29 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328] Start building block device mappings for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 16:56:29 user nova-compute[75245]: INFO nova.virt.block_device [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328] Booting with volume snapshot 7adb9216-5b2c-4f9d-bc86-32d9d869ad12 at /dev/vda
Nov 29 16:56:29 user nova-compute[75245]: DEBUG nova.policy [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2870721a7fff4cf19291f0cbfaedae81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907dff4e054429fa10392b730363eb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75245) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 16:56:29 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:56:29 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Starting heal instance info cache {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 16:56:29 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Rebuilding the list of instances to heal {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 16:56:29 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328] Skipping network cache update for instance because it is Building. {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 29 16:56:29 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "refresh_cache-f9419b01-cd53-472d-90d1-c18f6d77660a" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:56:29 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquired lock "refresh_cache-f9419b01-cd53-472d-90d1-c18f6d77660a" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:56:29 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] Forcefully refreshing network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 16:56:29 user nova-compute[75245]: DEBUG nova.objects.instance [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lazy-loading 'info_cache' on Instance uuid f9419b01-cd53-472d-90d1-c18f6d77660a {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:56:30 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:56:30 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328] Successfully created port: 0cec61ae-b851-4903-bf62-11801ec08112 {{(pid=75245) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 16:56:30 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] Updating instance_info_cache with network_info: [{"id": "1fdc121e-0b9d-43ca-8bf8-9a245f0fd242", "address": "fa:16:3e:18:2e:2f", "network": {"id": "316cb9af-807d-4a69-874e-2054520f0e5f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1421560477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0907dff4e054429fa10392b730363eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fdc121e-0b", "ovs_interfaceid": "1fdc121e-0b9d-43ca-8bf8-9a245f0fd242", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:56:30 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Releasing lock "refresh_cache-f9419b01-cd53-472d-90d1-c18f6d77660a" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:56:30 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] Updated the network info_cache for instance {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 16:56:31 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328] Successfully updated port: 0cec61ae-b851-4903-bf62-11801ec08112 {{(pid=75245) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 16:56:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Acquiring lock "refresh_cache-1ce652dd-61ac-42b4-abb5-7c8bb9ed3328" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:56:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Acquired lock "refresh_cache-1ce652dd-61ac-42b4-abb5-7c8bb9ed3328" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:56:31 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 16:56:31 user nova-compute[75245]: DEBUG nova.compute.manager [req-cfc94237-209a-4b51-814b-b1ae5d038bb8 req-6beee87a-5b6e-49f1-8c45-bbbfb3e1e3e5 service nova] [instance: 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328] Received event network-changed-0cec61ae-b851-4903-bf62-11801ec08112 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:56:31 user nova-compute[75245]: DEBUG nova.compute.manager [req-cfc94237-209a-4b51-814b-b1ae5d038bb8 req-6beee87a-5b6e-49f1-8c45-bbbfb3e1e3e5 service nova] [instance: 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328] Refreshing instance network info cache due to event network-changed-0cec61ae-b851-4903-bf62-11801ec08112. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:56:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-cfc94237-209a-4b51-814b-b1ae5d038bb8 req-6beee87a-5b6e-49f1-8c45-bbbfb3e1e3e5 service nova] Acquiring lock "refresh_cache-1ce652dd-61ac-42b4-abb5-7c8bb9ed3328" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:56:31 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328] Instance cache missing network info. {{(pid=75245) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 16:56:31 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328] Updating instance_info_cache with network_info: [{"id": "0cec61ae-b851-4903-bf62-11801ec08112", "address": "fa:16:3e:5e:e8:72", "network": {"id": "316cb9af-807d-4a69-874e-2054520f0e5f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1421560477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0907dff4e054429fa10392b730363eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cec61ae-b8", "ovs_interfaceid": "0cec61ae-b851-4903-bf62-11801ec08112", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:56:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Releasing lock "refresh_cache-1ce652dd-61ac-42b4-abb5-7c8bb9ed3328" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:56:31 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328] Instance network_info: |[{"id": "0cec61ae-b851-4903-bf62-11801ec08112", "address": "fa:16:3e:5e:e8:72", "network": {"id": "316cb9af-807d-4a69-874e-2054520f0e5f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1421560477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0907dff4e054429fa10392b730363eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cec61ae-b8", "ovs_interfaceid": "0cec61ae-b851-4903-bf62-11801ec08112", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 16:56:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-cfc94237-209a-4b51-814b-b1ae5d038bb8 req-6beee87a-5b6e-49f1-8c45-bbbfb3e1e3e5 service nova] Acquired lock "refresh_cache-1ce652dd-61ac-42b4-abb5-7c8bb9ed3328" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:56:31 user nova-compute[75245]: DEBUG nova.network.neutron [req-cfc94237-209a-4b51-814b-b1ae5d038bb8 req-6beee87a-5b6e-49f1-8c45-bbbfb3e1e3e5 service nova] [instance: 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328] Refreshing network info cache for port 0cec61ae-b851-4903-bf62-11801ec08112 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:56:31 user nova-compute[75245]: DEBUG nova.network.neutron [req-cfc94237-209a-4b51-814b-b1ae5d038bb8 req-6beee87a-5b6e-49f1-8c45-bbbfb3e1e3e5 service nova] [instance: 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328] Updated VIF entry in instance network info cache for port 0cec61ae-b851-4903-bf62-11801ec08112. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:56:31 user nova-compute[75245]: DEBUG nova.network.neutron [req-cfc94237-209a-4b51-814b-b1ae5d038bb8 req-6beee87a-5b6e-49f1-8c45-bbbfb3e1e3e5 service nova] [instance: 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328] Updating instance_info_cache with network_info: [{"id": "0cec61ae-b851-4903-bf62-11801ec08112", "address": "fa:16:3e:5e:e8:72", "network": {"id": "316cb9af-807d-4a69-874e-2054520f0e5f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1421560477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0907dff4e054429fa10392b730363eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cec61ae-b8", "ovs_interfaceid": "0cec61ae-b851-4903-bf62-11801ec08112", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:56:32 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-cfc94237-209a-4b51-814b-b1ae5d038bb8 req-6beee87a-5b6e-49f1-8c45-bbbfb3e1e3e5 service nova] Releasing lock "refresh_cache-1ce652dd-61ac-42b4-abb5-7c8bb9ed3328" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:56:32 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:56:32 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Cleaning up deleted instances {{(pid=75245) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 16:56:32 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] There are 0 instances to clean {{(pid=75245) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 16:56:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:56:34 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:56:34 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:56:35 user nova-compute[75245]: DEBUG os_brick.utils [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:56:35 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:56:35 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:56:35 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[025b7960-c54c-4c81-9d62-155b44ef5343]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:69ed8ed87091\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:56:35 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:56:35 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:56:35 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f662ab-a64f-4db1-9f5b-f870961beb0a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:56:35 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:56:35 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:56:35 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[031921ad-3564-4b91-839a-33ef6285ca24]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:56:35 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f540ea1-5ff7-4d35-9b9b-3f77acee11dc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:56:35 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Running cmd (subprocess): nvme version {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:56:35 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] 'nvme version' failed. Not Retrying. {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:56:35 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] nvme not present on system {{(pid=75245) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 16:56:35 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:56:35 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:56:35 user nova-compute[75245]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 16:56:35 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b4edf7-d853-4dea-8cd3-1fcb8a68a5f1]: (4, '') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:56:35 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75245) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 16:56:35 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 16:56:35 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] LIGHTOS: no hostnqn found. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 16:56:35 user nova-compute[75245]: DEBUG os_brick.utils [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:69ed8ed87091', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:56:35 user nova-compute[75245]: DEBUG nova.virt.block_device [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328] Updating existing volume attachment record: da99af0c-2e49-4165-9531-5d7d06f10af5 {{(pid=75245) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 16:56:37 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:56:37 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75245) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 16:56:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:56:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:56:40 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:56:41 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:56:41 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:56:41 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75245) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 16:56:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:56:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:56:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75245) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 16:56:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:56:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:56:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:56:45 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328] Start spawning the instance on the hypervisor. {{(pid=75245) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 16:56:45 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328] Creating instance directory {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 16:56:45 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328] Creating image(s)
Nov 29 16:56:45 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328] Did not create local disks {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 16:56:45 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328] Ensure instance console log exists: /opt/stack/data/nova/instances/1ce652dd-61ac-42b4-abb5-7c8bb9ed3328/console.log {{(pid=75245) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 16:56:45 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:56:45 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:56:45 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:56:45 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328] Start _get_guest_xml network_info=[{"id": "0cec61ae-b851-4903-bf62-11801ec08112", "address": "fa:16:3e:5e:e8:72", "network": {"id": "316cb9af-807d-4a69-874e-2054520f0e5f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1421560477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0907dff4e054429fa10392b730363eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cec61ae-b8", "ovs_interfaceid": "0cec61ae-b851-4903-bf62-11801ec08112", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-29T16:56:24Z,direct_url=<?>,disk_format='qcow2',id=46f67faf-316d-4846-8405-dc2e24e67c6b,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-209668714',owner='0907dff4e054429fa10392b730363eb2',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-29T16:56:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': 'da99af0c-2e49-4165-9531-5d7d06f10af5', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0ec6a3cf-f562-485a-a1c5-14728db1def3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mVpjMUiC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1ce652dd-61ac-42b4-abb5-7c8bb9ed3328', 'attached_at': '', 'detached_at': '', 'volume_id': '0ec6a3cf-f562-485a-a1c5-14728db1def3', 'serial': '0ec6a3cf-f562-485a-a1c5-14728db1def3'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'guest_format': None, 'volume_type': None} {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 16:56:45 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:56:45 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:56:45 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 16:56:45 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] CPU controller missing on host. {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 16:56:45 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 16:56:45 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] CPU controller found on host. {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 16:56:45 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75245) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 16:56:45 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T16:06:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-29T16:56:24Z,direct_url=<?>,disk_format='qcow2',id=46f67faf-316d-4846-8405-dc2e24e67c6b,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-209668714',owner='0907dff4e054429fa10392b730363eb2',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-29T16:56:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 16:56:45 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Flavor limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 16:56:45 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Image limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 16:56:45 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Flavor pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 16:56:45 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Image pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 16:56:45 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 16:56:45 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 16:56:45 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 16:56:45 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Got 1 possible topologies {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 16:56:45 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 16:56:45 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 16:56:45 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328] Calling os-brick to attach iSCSI Volume {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 16:56:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0ec6a3cf-f562-485a-a1c5-14728db1def3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mVpjMUiC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:56:45 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:56:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:56:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:56:45 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:56:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ec6a3cf-f562-485a-a1c5-14728db1def3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:56:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ec6a3cf-f562-485a-a1c5-14728db1def3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:56:45 user nova-compute[75245]: INFO os_brick.initiator.connectors.iscsi [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 16:56:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ec6a3cf-f562-485a-a1c5-14728db1def3 -p 172.16.0.220:3260 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:56:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ec6a3cf-f562-485a-a1c5-14728db1def3 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:56:45 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca732661-31c0-447f-a4aa-769e581a60db]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:56:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 16:56:45 user nova-compute[75245]:  {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:56:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ec6a3cf-f562-485a-a1c5-14728db1def3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:56:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ec6a3cf-f562-485a-a1c5-14728db1def3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:56:45 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a55b64a-2236-448a-acd9-97492619a942]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ec6a3cf-f562-485a-a1c5-14728db1def3] added\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:56:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ec6a3cf-f562-485a-a1c5-14728db1def3] added
Nov 29 16:56:45 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:56:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ec6a3cf-f562-485a-a1c5-14728db1def3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:56:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ec6a3cf-f562-485a-a1c5-14728db1def3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:56:45 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[5839e63a-b6fb-40c7-852c-423e77fbe63b]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:56:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:56:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ec6a3cf-f562-485a-a1c5-14728db1def3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:56:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ec6a3cf-f562-485a-a1c5-14728db1def3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:56:45 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[5715acb2-81ca-419f-b60b-db9163c4d883]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:56:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:56:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ec6a3cf-f562-485a-a1c5-14728db1def3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mVpjMUiC {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:56:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ec6a3cf-f562-485a-a1c5-14728db1def3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mVpjMUiC" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:56:45 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8687d92-9d53-4c32-92d8-a46d01488623]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:56:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mVpjMUiC'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:56:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ec6a3cf-f562-485a-a1c5-14728db1def3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:56:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ec6a3cf-f562-485a-a1c5-14728db1def3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:56:45 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[041824df-af8d-4747-b521-e8f1083666e1]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:56:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:56:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:56:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:56:45 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[84fa74db-6045-4ac8-8e7b-4f103f14c325]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:56:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7 (non-flash)
Nov 29 16:56:45 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:56:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7 (non-flash)
Nov 29 16:56:45 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:56:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ec6a3cf-f562-485a-a1c5-14728db1def3 -p 172.16.0.220:3260 --login {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:56:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ec6a3cf-f562-485a-a1c5-14728db1def3 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:56:45 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ed5077-63a4-402f-bfc5-ef7dcc6e4592]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ec6a3cf-f562-485a-a1c5-14728db1def3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0ec6a3cf-f562-485a-a1c5-14728db1def3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:56:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ec6a3cf-f562-485a-a1c5-14728db1def3, portal: 172.16.0.220,3260]
Nov 29 16:56:45 user nova-compute[75245]: Login to [iface: default, target: iqn.2010-10.org.openstack:0ec6a3cf-f562-485a-a1c5-14728db1def3, portal: 172.16.0.220,3260] successful.
Nov 29 16:56:45 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:56:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ec6a3cf-f562-485a-a1c5-14728db1def3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:56:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ec6a3cf-f562-485a-a1c5-14728db1def3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:56:45 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb5088d-5a41-463d-ab9a-089bb4658c5c]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:56:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:56:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:56:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:56:45 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b0c4d1-8e56-466b-8f04-5e3ba8afa597]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec6a3cf-f562-485a-a1c5-14728db1def3 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:56:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7 (non-flash)
Nov 29 16:56:45 user nova-compute[75245]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec6a3cf-f562-485a-a1c5-14728db1def3 (non-flash)
Nov 29 16:56:45 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:56:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7 (non-flash)
Nov 29 16:56:45 user nova-compute[75245]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec6a3cf-f562-485a-a1c5-14728db1def3 (non-flash)
Nov 29 16:56:45 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:56:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ec6a3cf-f562-485a-a1c5-14728db1def3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:56:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Connected to 172.16.0.220:3260 {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 16:56:45 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] HCTL ('34', '-', '-', 0) found on session 53 with lun 0 {{(pid=75245) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 16:56:45 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75245) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 16:56:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:56:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:56:45 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f9012f-92b7-43ef-8fdd-d5871320de29]: (4, ('- - 0', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:56:45 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75245) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 16:56:45 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:0ec6a3cf-f562-485a-a1c5-14728db1def3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mVpjMUiC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 16:56:46 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:56:46 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '23666303536323730', 'path': '/dev/sdc'} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:56:46 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23666303536323730', 'path': '/dev/sdc'} {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 16:56:46 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:56:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1225779589',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1225779589',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1225779589',id=47,image_ref='46f67faf-316d-4846-8405-dc2e24e67c6b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPXmAvld7YOpDrFcHGm22r7/lW4I2Y/VNxF8WwkIY6sPhOTGa4aMr45GQXJFdrRO43XgjXO8uckQOw/BBXQnWMlxLSxv6cxbxxMOdH1Y2vnK4IAPX7dd15s3kpeOGwyFhw==',key_name='tempest-keypair-1049437226',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0907dff4e054429fa10392b730363eb2',ramdisk_id='',reservation_id='r-9ljtbsmq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-181783012',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-181783012-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-181783012',owner_user_name='tempest-TestVolumeBootPattern-181783012-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:56:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2870721a7fff4cf19291f0cbfaedae81',uuid=1ce652dd-61ac-42b4-abb5-7c8bb9ed3328,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0cec61ae-b851-4903-bf62-11801ec08112", "address": "fa:16:3e:5e:e8:72", "network": {"id": "316cb9af-807d-4a69-874e-2054520f0e5f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1421560477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0907dff4e054429fa10392b730363eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cec61ae-b8", "ovs_interfaceid": "0cec61ae-b851-4903-bf62-11801ec08112", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:56:46 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Converting VIF {"id": "0cec61ae-b851-4903-bf62-11801ec08112", "address": "fa:16:3e:5e:e8:72", "network": {"id": "316cb9af-807d-4a69-874e-2054520f0e5f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1421560477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0907dff4e054429fa10392b730363eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cec61ae-b8", "ovs_interfaceid": "0cec61ae-b851-4903-bf62-11801ec08112", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:56:46 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:e8:72,bridge_name='br-int',has_traffic_filtering=True,id=0cec61ae-b851-4903-bf62-11801ec08112,network=Network(316cb9af-807d-4a69-874e-2054520f0e5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cec61ae-b8') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:56:46 user nova-compute[75245]: DEBUG nova.objects.instance [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lazy-loading 'pci_devices' on Instance uuid 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:56:46 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328] End _get_guest_xml xml=<domain type="kvm">
Nov 29 16:56:46 user nova-compute[75245]:   <uuid>1ce652dd-61ac-42b4-abb5-7c8bb9ed3328</uuid>
Nov 29 16:56:46 user nova-compute[75245]:   <name>instance-0000002f</name>
Nov 29 16:56:46 user nova-compute[75245]:   <memory>524288</memory>
Nov 29 16:56:46 user nova-compute[75245]:   <vcpu>1</vcpu>
Nov 29 16:56:46 user nova-compute[75245]:   <metadata>
Nov 29 16:56:46 user nova-compute[75245]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 16:56:46 user nova-compute[75245]:       <nova:package version="0.0.0"/>
Nov 29 16:56:46 user nova-compute[75245]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1225779589</nova:name>
Nov 29 16:56:46 user nova-compute[75245]:       <nova:creationTime>2023-11-29 16:56:45</nova:creationTime>
Nov 29 16:56:46 user nova-compute[75245]:       <nova:flavor name="m1.tiny">
Nov 29 16:56:46 user nova-compute[75245]:         <nova:memory>512</nova:memory>
Nov 29 16:56:46 user nova-compute[75245]:         <nova:disk>1</nova:disk>
Nov 29 16:56:46 user nova-compute[75245]:         <nova:swap>0</nova:swap>
Nov 29 16:56:46 user nova-compute[75245]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 16:56:46 user nova-compute[75245]:         <nova:vcpus>1</nova:vcpus>
Nov 29 16:56:46 user nova-compute[75245]:       </nova:flavor>
Nov 29 16:56:46 user nova-compute[75245]:       <nova:owner>
Nov 29 16:56:46 user nova-compute[75245]:         <nova:user uuid="2870721a7fff4cf19291f0cbfaedae81">tempest-TestVolumeBootPattern-181783012-project-member</nova:user>
Nov 29 16:56:46 user nova-compute[75245]:         <nova:project uuid="0907dff4e054429fa10392b730363eb2">tempest-TestVolumeBootPattern-181783012</nova:project>
Nov 29 16:56:46 user nova-compute[75245]:       </nova:owner>
Nov 29 16:56:46 user nova-compute[75245]:       <nova:root type="image" uuid="46f67faf-316d-4846-8405-dc2e24e67c6b"/>
Nov 29 16:56:46 user nova-compute[75245]:       <nova:ports>
Nov 29 16:56:46 user nova-compute[75245]:         <nova:port uuid="0cec61ae-b851-4903-bf62-11801ec08112">
Nov 29 16:56:46 user nova-compute[75245]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 29 16:56:46 user nova-compute[75245]:         </nova:port>
Nov 29 16:56:46 user nova-compute[75245]:       </nova:ports>
Nov 29 16:56:46 user nova-compute[75245]:     </nova:instance>
Nov 29 16:56:46 user nova-compute[75245]:   </metadata>
Nov 29 16:56:46 user nova-compute[75245]:   <sysinfo type="smbios">
Nov 29 16:56:46 user nova-compute[75245]:     <system>
Nov 29 16:56:46 user nova-compute[75245]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 16:56:46 user nova-compute[75245]:       <entry name="product">OpenStack Nova</entry>
Nov 29 16:56:46 user nova-compute[75245]:       <entry name="version">0.0.0</entry>
Nov 29 16:56:46 user nova-compute[75245]:       <entry name="serial">1ce652dd-61ac-42b4-abb5-7c8bb9ed3328</entry>
Nov 29 16:56:46 user nova-compute[75245]:       <entry name="uuid">1ce652dd-61ac-42b4-abb5-7c8bb9ed3328</entry>
Nov 29 16:56:46 user nova-compute[75245]:       <entry name="family">Virtual Machine</entry>
Nov 29 16:56:46 user nova-compute[75245]:     </system>
Nov 29 16:56:46 user nova-compute[75245]:   </sysinfo>
Nov 29 16:56:46 user nova-compute[75245]:   <os>
Nov 29 16:56:46 user nova-compute[75245]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 16:56:46 user nova-compute[75245]:     <boot dev="hd"/>
Nov 29 16:56:46 user nova-compute[75245]:     <smbios mode="sysinfo"/>
Nov 29 16:56:46 user nova-compute[75245]:   </os>
Nov 29 16:56:46 user nova-compute[75245]:   <features>
Nov 29 16:56:46 user nova-compute[75245]:     <acpi/>
Nov 29 16:56:46 user nova-compute[75245]:     <apic/>
Nov 29 16:56:46 user nova-compute[75245]:     <vmcoreinfo/>
Nov 29 16:56:46 user nova-compute[75245]:   </features>
Nov 29 16:56:46 user nova-compute[75245]:   <clock offset="utc">
Nov 29 16:56:46 user nova-compute[75245]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 16:56:46 user nova-compute[75245]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 16:56:46 user nova-compute[75245]:     <timer name="hpet" present="no"/>
Nov 29 16:56:46 user nova-compute[75245]:   </clock>
Nov 29 16:56:46 user nova-compute[75245]:   <cpu mode="custom" match="exact">
Nov 29 16:56:46 user nova-compute[75245]:     <model>Nehalem</model>
Nov 29 16:56:46 user nova-compute[75245]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 16:56:46 user nova-compute[75245]:   </cpu>
Nov 29 16:56:46 user nova-compute[75245]:   <devices>
Nov 29 16:56:46 user nova-compute[75245]:     <disk type="block" device="disk">
Nov 29 16:56:46 user nova-compute[75245]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:56:46 user nova-compute[75245]:       <source dev="/dev/sdc"/>
Nov 29 16:56:46 user nova-compute[75245]:       <target dev="vda" bus="virtio"/>
Nov 29 16:56:46 user nova-compute[75245]:       <serial>0ec6a3cf-f562-485a-a1c5-14728db1def3</serial>
Nov 29 16:56:46 user nova-compute[75245]:     </disk>
Nov 29 16:56:46 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 16:56:46 user nova-compute[75245]:       <mac address="fa:16:3e:5e:e8:72"/>
Nov 29 16:56:46 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:56:46 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 16:56:46 user nova-compute[75245]:       <target dev="tap0cec61ae-b8"/>
Nov 29 16:56:46 user nova-compute[75245]:     </interface>
Nov 29 16:56:46 user nova-compute[75245]:     <serial type="pty">
Nov 29 16:56:46 user nova-compute[75245]:       <log file="/opt/stack/data/nova/instances/1ce652dd-61ac-42b4-abb5-7c8bb9ed3328/console.log" append="off"/>
Nov 29 16:56:46 user nova-compute[75245]:     </serial>
Nov 29 16:56:46 user nova-compute[75245]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 16:56:46 user nova-compute[75245]:     <video>
Nov 29 16:56:46 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:56:46 user nova-compute[75245]:     </video>
Nov 29 16:56:46 user nova-compute[75245]:     <rng model="virtio">
Nov 29 16:56:46 user nova-compute[75245]:       <backend model="random">/dev/urandom</backend>
Nov 29 16:56:46 user nova-compute[75245]:     </rng>
Nov 29 16:56:46 user nova-compute[75245]:     <controller type="usb" index="0" model="none"/>
Nov 29 16:56:46 user nova-compute[75245]:     <memballoon model="virtio">
Nov 29 16:56:46 user nova-compute[75245]:       <stats period="10"/>
Nov 29 16:56:46 user nova-compute[75245]:     </memballoon>
Nov 29 16:56:46 user nova-compute[75245]:   </devices>
Nov 29 16:56:46 user nova-compute[75245]: </domain>
Nov 29 16:56:46 user nova-compute[75245]:  {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 16:56:46 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:56:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1225779589',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1225779589',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1225779589',id=47,image_ref='46f67faf-316d-4846-8405-dc2e24e67c6b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPXmAvld7YOpDrFcHGm22r7/lW4I2Y/VNxF8WwkIY6sPhOTGa4aMr45GQXJFdrRO43XgjXO8uckQOw/BBXQnWMlxLSxv6cxbxxMOdH1Y2vnK4IAPX7dd15s3kpeOGwyFhw==',key_name='tempest-keypair-1049437226',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0907dff4e054429fa10392b730363eb2',ramdisk_id='',reservation_id='r-9ljtbsmq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-181783012',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-181783012-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-181783012',owner_user_name='tempest-TestVolumeBootPattern-181783012-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:56:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2870721a7fff4cf19291f0cbfaedae81',uuid=1ce652dd-61ac-42b4-abb5-7c8bb9ed3328,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0cec61ae-b851-4903-bf62-11801ec08112", "address": "fa:16:3e:5e:e8:72", "network": {"id": "316cb9af-807d-4a69-874e-2054520f0e5f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1421560477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0907dff4e054429fa10392b730363eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cec61ae-b8", "ovs_interfaceid": "0cec61ae-b851-4903-bf62-11801ec08112", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 16:56:46 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Converting VIF {"id": "0cec61ae-b851-4903-bf62-11801ec08112", "address": "fa:16:3e:5e:e8:72", "network": {"id": "316cb9af-807d-4a69-874e-2054520f0e5f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1421560477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0907dff4e054429fa10392b730363eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cec61ae-b8", "ovs_interfaceid": "0cec61ae-b851-4903-bf62-11801ec08112", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:56:46 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:e8:72,bridge_name='br-int',has_traffic_filtering=True,id=0cec61ae-b851-4903-bf62-11801ec08112,network=Network(316cb9af-807d-4a69-874e-2054520f0e5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cec61ae-b8') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:56:46 user nova-compute[75245]: DEBUG os_vif [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:e8:72,bridge_name='br-int',has_traffic_filtering=True,id=0cec61ae-b851-4903-bf62-11801ec08112,network=Network(316cb9af-807d-4a69-874e-2054520f0e5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cec61ae-b8') {{(pid=75245) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 16:56:46 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:56:46 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:56:46 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 16:56:46 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:56:46 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '24bf73f3-a554-5a8d-95f7-df72d268d78b', '_type': 'linux-noop'}}, row=False) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:56:46 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:56:46 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:56:46 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:56:46 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0cec61ae-b8, may_exist=True, interface_attrs={}) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:56:46 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0cec61ae-b8, col_values=(('qos', UUID('04b5e524-228e-4b68-8c34-b3c70d6dbd15')),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:56:46 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0cec61ae-b8, col_values=(('external_ids', {'iface-id': '0cec61ae-b851-4903-bf62-11801ec08112', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:e8:72', 'vm-uuid': '1ce652dd-61ac-42b4-abb5-7c8bb9ed3328'}),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:56:46 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:56:46 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:56:46 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:56:46 user nova-compute[75245]: INFO os_vif [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:e8:72,bridge_name='br-int',has_traffic_filtering=True,id=0cec61ae-b851-4903-bf62-11801ec08112,network=Network(316cb9af-807d-4a69-874e-2054520f0e5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cec61ae-b8')
Nov 29 16:56:46 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:56:46 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] No VIF found with MAC fa:16:3e:5e:e8:72, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:56:47 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:56:48 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:56:48 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:56:48 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:56:48 user nova-compute[75245]: DEBUG nova.compute.manager [req-94c20659-4584-4ea5-9068-534778fc6786 req-5f859966-1714-4a40-a9b5-b5bd35cfb88e service nova] [instance: 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328] Received event network-vif-plugged-0cec61ae-b851-4903-bf62-11801ec08112 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:56:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-94c20659-4584-4ea5-9068-534778fc6786 req-5f859966-1714-4a40-a9b5-b5bd35cfb88e service nova] Acquiring lock "1ce652dd-61ac-42b4-abb5-7c8bb9ed3328-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:56:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-94c20659-4584-4ea5-9068-534778fc6786 req-5f859966-1714-4a40-a9b5-b5bd35cfb88e service nova] Lock "1ce652dd-61ac-42b4-abb5-7c8bb9ed3328-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:56:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-94c20659-4584-4ea5-9068-534778fc6786 req-5f859966-1714-4a40-a9b5-b5bd35cfb88e service nova] Lock "1ce652dd-61ac-42b4-abb5-7c8bb9ed3328-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:56:48 user nova-compute[75245]: DEBUG nova.compute.manager [req-94c20659-4584-4ea5-9068-534778fc6786 req-5f859966-1714-4a40-a9b5-b5bd35cfb88e service nova] [instance: 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328] No waiting events found dispatching network-vif-plugged-0cec61ae-b851-4903-bf62-11801ec08112 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:56:48 user nova-compute[75245]: WARNING nova.compute.manager [req-94c20659-4584-4ea5-9068-534778fc6786 req-5f859966-1714-4a40-a9b5-b5bd35cfb88e service nova] [instance: 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328] Received unexpected event network-vif-plugged-0cec61ae-b851-4903-bf62-11801ec08112 for instance with vm_state building and task_state spawning.
Nov 29 16:56:48 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:56:48 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:56:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:56:50 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328] Instance event wait completed in 0 seconds for  {{(pid=75245) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 16:56:50 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328] Guest created on hypervisor {{(pid=75245) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 16:56:50 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328] Instance spawned successfully.
Nov 29 16:56:50 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 16:56:50 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328] Found default for hw_input_bus of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:56:50 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328] Found default for hw_pointer_model of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:56:50 user nova-compute[75245]: INFO nova.compute.manager [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328] Took 5.01 seconds to spawn the instance on the hypervisor.
Nov 29 16:56:50 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:56:50 user nova-compute[75245]: DEBUG nova.compute.manager [req-446b620f-59a3-4892-b380-5e166869b145 req-2fbbbc67-796b-43ab-bb14-9ceb90a5a52d service nova] [instance: 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328] Received event network-vif-plugged-0cec61ae-b851-4903-bf62-11801ec08112 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:56:50 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-446b620f-59a3-4892-b380-5e166869b145 req-2fbbbc67-796b-43ab-bb14-9ceb90a5a52d service nova] Acquiring lock "1ce652dd-61ac-42b4-abb5-7c8bb9ed3328-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:56:50 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-446b620f-59a3-4892-b380-5e166869b145 req-2fbbbc67-796b-43ab-bb14-9ceb90a5a52d service nova] Lock "1ce652dd-61ac-42b4-abb5-7c8bb9ed3328-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:56:50 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-446b620f-59a3-4892-b380-5e166869b145 req-2fbbbc67-796b-43ab-bb14-9ceb90a5a52d service nova] Lock "1ce652dd-61ac-42b4-abb5-7c8bb9ed3328-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:56:50 user nova-compute[75245]: DEBUG nova.compute.manager [req-446b620f-59a3-4892-b380-5e166869b145 req-2fbbbc67-796b-43ab-bb14-9ceb90a5a52d service nova] [instance: 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328] No waiting events found dispatching network-vif-plugged-0cec61ae-b851-4903-bf62-11801ec08112 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:56:50 user nova-compute[75245]: WARNING nova.compute.manager [req-446b620f-59a3-4892-b380-5e166869b145 req-2fbbbc67-796b-43ab-bb14-9ceb90a5a52d service nova] [instance: 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328] Received unexpected event network-vif-plugged-0cec61ae-b851-4903-bf62-11801ec08112 for instance with vm_state active and task_state None.
Nov 29 16:56:50 user nova-compute[75245]: INFO nova.compute.manager [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328] Took 21.39 seconds to build instance.
Nov 29 16:56:50 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:56:50 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1277fb8c-23bc-404a-bffb-5866792bcb79 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "1ce652dd-61ac-42b4-abb5-7c8bb9ed3328" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.491s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:56:51 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:56:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:56:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:56:56 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:57:01 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:57:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:57:06 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:57:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:57:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:57:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:57:16 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:57:19 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:57:21 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:57:26 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:57:27 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:57:28 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:57:28 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Starting heal instance info cache {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 16:57:28 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "refresh_cache-6b3301cf-d51f-4876-af8b-bf1802537849" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:57:28 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquired lock "refresh_cache-6b3301cf-d51f-4876-af8b-bf1802537849" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:57:28 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] Forcefully refreshing network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 16:57:29 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] Updating instance_info_cache with network_info: [{"id": "e11a9af6-997c-46df-975c-def9634baef0", "address": "fa:16:3e:e4:cf:d6", "network": {"id": "9ac826d2-ead7-459b-8629-2c3ac5b3dc88", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1414777524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3945a91aae184152ae3ad9e6307c69f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape11a9af6-99", "ovs_interfaceid": "e11a9af6-997c-46df-975c-def9634baef0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:57:29 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Releasing lock "refresh_cache-6b3301cf-d51f-4876-af8b-bf1802537849" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:57:29 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] Updated the network info_cache for instance {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 16:57:29 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:57:29 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:57:29 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:57:29 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:57:29 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75245) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 16:57:29 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:57:29 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b3301cf-d51f-4876-af8b-bf1802537849/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:57:29 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b3301cf-d51f-4876-af8b-bf1802537849/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:57:29 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b3301cf-d51f-4876-af8b-bf1802537849/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:57:29 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b3301cf-d51f-4876-af8b-bf1802537849/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:57:29 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:57:29 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:57:29 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:57:29 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Hypervisor/Node resource view: name=user free_ram=8729MB free_disk=25.08330535888672GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75245) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 16:57:29 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:57:29 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:57:30 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance f9419b01-cd53-472d-90d1-c18f6d77660a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:57:30 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 6b3301cf-d51f-4876-af8b-bf1802537849 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:57:30 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:57:30 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 16:57:30 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 16:57:30 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:57:30 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:57:30 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Compute_service record updated for user:user {{(pid=75245) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 16:57:30 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.305s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:57:31 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:57:36 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:57:37 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:57:37 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:57:40 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:57:41 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:57:41 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75245) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 16:57:41 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:57:41 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:57:41 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75245) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 16:57:41 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:57:41 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 16:57:41 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:57:43 user nova-compute[75245]: DEBUG nova.compute.manager [req-f4942c13-b4ce-4461-bf13-ff42b66dfb91 req-5d9e3066-533d-4860-ac96-c1e3a0eaa96a service nova] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] Received event network-changed-e11a9af6-997c-46df-975c-def9634baef0 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:57:43 user nova-compute[75245]: DEBUG nova.compute.manager [req-f4942c13-b4ce-4461-bf13-ff42b66dfb91 req-5d9e3066-533d-4860-ac96-c1e3a0eaa96a service nova] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] Refreshing instance network info cache due to event network-changed-e11a9af6-997c-46df-975c-def9634baef0. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:57:43 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-f4942c13-b4ce-4461-bf13-ff42b66dfb91 req-5d9e3066-533d-4860-ac96-c1e3a0eaa96a service nova] Acquiring lock "refresh_cache-6b3301cf-d51f-4876-af8b-bf1802537849" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:57:43 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-f4942c13-b4ce-4461-bf13-ff42b66dfb91 req-5d9e3066-533d-4860-ac96-c1e3a0eaa96a service nova] Acquired lock "refresh_cache-6b3301cf-d51f-4876-af8b-bf1802537849" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:57:43 user nova-compute[75245]: DEBUG nova.network.neutron [req-f4942c13-b4ce-4461-bf13-ff42b66dfb91 req-5d9e3066-533d-4860-ac96-c1e3a0eaa96a service nova] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] Refreshing network info cache for port e11a9af6-997c-46df-975c-def9634baef0 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:57:43 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:57:43 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-7ea0d316-4429-4138-be59-f7a5cb5c9777 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Acquiring lock "6b3301cf-d51f-4876-af8b-bf1802537849" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:57:43 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-7ea0d316-4429-4138-be59-f7a5cb5c9777 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Lock "6b3301cf-d51f-4876-af8b-bf1802537849" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:57:43 user nova-compute[75245]: DEBUG nova.objects.instance [None req-7ea0d316-4429-4138-be59-f7a5cb5c9777 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Lazy-loading 'flavor' on Instance uuid 6b3301cf-d51f-4876-af8b-bf1802537849 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:57:43 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-7ea0d316-4429-4138-be59-f7a5cb5c9777 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] Ignoring supplied device name: /dev/vdb
Nov 29 16:57:43 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-7ea0d316-4429-4138-be59-f7a5cb5c9777 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Lock "6b3301cf-d51f-4876-af8b-bf1802537849" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:57:43 user nova-compute[75245]: DEBUG nova.network.neutron [req-f4942c13-b4ce-4461-bf13-ff42b66dfb91 req-5d9e3066-533d-4860-ac96-c1e3a0eaa96a service nova] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] Updated VIF entry in instance network info cache for port e11a9af6-997c-46df-975c-def9634baef0. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:57:43 user nova-compute[75245]: DEBUG nova.network.neutron [req-f4942c13-b4ce-4461-bf13-ff42b66dfb91 req-5d9e3066-533d-4860-ac96-c1e3a0eaa96a service nova] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] Updating instance_info_cache with network_info: [{"id": "e11a9af6-997c-46df-975c-def9634baef0", "address": "fa:16:3e:e4:cf:d6", "network": {"id": "9ac826d2-ead7-459b-8629-2c3ac5b3dc88", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1414777524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3945a91aae184152ae3ad9e6307c69f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape11a9af6-99", "ovs_interfaceid": "e11a9af6-997c-46df-975c-def9634baef0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:57:43 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-7ea0d316-4429-4138-be59-f7a5cb5c9777 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Acquiring lock "6b3301cf-d51f-4876-af8b-bf1802537849" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:57:43 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-7ea0d316-4429-4138-be59-f7a5cb5c9777 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Lock "6b3301cf-d51f-4876-af8b-bf1802537849" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:57:43 user nova-compute[75245]: INFO nova.compute.manager [None req-7ea0d316-4429-4138-be59-f7a5cb5c9777 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] Attaching volume 3f27c413-15bc-49cf-b81b-9eea1bd601bd to /dev/vdb
Nov 29 16:57:43 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-f4942c13-b4ce-4461-bf13-ff42b66dfb91 req-5d9e3066-533d-4860-ac96-c1e3a0eaa96a service nova] Releasing lock "refresh_cache-6b3301cf-d51f-4876-af8b-bf1802537849" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:57:43 user nova-compute[75245]: DEBUG os_brick.utils [None req-7ea0d316-4429-4138-be59-f7a5cb5c9777 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:57:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:57:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:57:43 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c31e56f-10f2-4214-91a5-be6011304245]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:69ed8ed87091\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:57:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:57:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:57:43 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[e778845f-566b-44fe-93e7-0059e215d6c4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:57:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:57:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:57:43 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e61f42c-cf2d-48ad-84d3-933736eddeb8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:57:43 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[f877a482-db24-4ce4-a873-9b35ffa493f4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:57:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-7ea0d316-4429-4138-be59-f7a5cb5c9777 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Running cmd (subprocess): nvme version {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:57:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-7ea0d316-4429-4138-be59-f7a5cb5c9777 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] 'nvme version' failed. Not Retrying. {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:57:43 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7ea0d316-4429-4138-be59-f7a5cb5c9777 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] nvme not present on system {{(pid=75245) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 16:57:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:57:43 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 16:57:43 user nova-compute[75245]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 16:57:43 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[456d5ba4-a1e3-49de-8c8d-b3b970688cde]: (4, '') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:57:43 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-7ea0d316-4429-4138-be59-f7a5cb5c9777 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75245) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 16:57:43 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-7ea0d316-4429-4138-be59-f7a5cb5c9777 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 16:57:43 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-7ea0d316-4429-4138-be59-f7a5cb5c9777 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] LIGHTOS: no hostnqn found. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 16:57:43 user nova-compute[75245]: DEBUG os_brick.utils [None req-7ea0d316-4429-4138-be59-f7a5cb5c9777 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:69ed8ed87091', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:57:43 user nova-compute[75245]: DEBUG nova.virt.block_device [None req-7ea0d316-4429-4138-be59-f7a5cb5c9777 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] Updating existing volume attachment record: 22cc651e-66ce-4b99-bab3-b86431c11580 {{(pid=75245) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 16:57:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:57:46 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:57:47 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:57:47 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:57:47 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Triggering sync for uuid f9419b01-cd53-472d-90d1-c18f6d77660a {{(pid=75245) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 16:57:47 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Triggering sync for uuid 6b3301cf-d51f-4876-af8b-bf1802537849 {{(pid=75245) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 16:57:47 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Triggering sync for uuid 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328 {{(pid=75245) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 16:57:47 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "f9419b01-cd53-472d-90d1-c18f6d77660a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:57:47 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "f9419b01-cd53-472d-90d1-c18f6d77660a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:57:47 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "6b3301cf-d51f-4876-af8b-bf1802537849" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:57:47 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "1ce652dd-61ac-42b4-abb5-7c8bb9ed3328" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:57:47 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "1ce652dd-61ac-42b4-abb5-7c8bb9ed3328" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:57:47 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "f9419b01-cd53-472d-90d1-c18f6d77660a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:57:47 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "1ce652dd-61ac-42b4-abb5-7c8bb9ed3328" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:57:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:57:51 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ea0d316-4429-4138-be59-f7a5cb5c9777 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] Calling os-brick to attach iSCSI Volume {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 16:57:51 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea0d316-4429-4138-be59-f7a5cb5c9777 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3f27c413-15bc-49cf-b81b-9eea1bd601bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bHmNEiYu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:57:51 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-7ea0d316-4429-4138-be59-f7a5cb5c9777 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:57:51 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-7ea0d316-4429-4138-be59-f7a5cb5c9777 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:57:51 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-7ea0d316-4429-4138-be59-f7a5cb5c9777 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:57:51 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-7ea0d316-4429-4138-be59-f7a5cb5c9777 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:57:51 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-7ea0d316-4429-4138-be59-f7a5cb5c9777 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f27c413-15bc-49cf-b81b-9eea1bd601bd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:57:51 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-7ea0d316-4429-4138-be59-f7a5cb5c9777 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f27c413-15bc-49cf-b81b-9eea1bd601bd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:57:51 user nova-compute[75245]: INFO os_brick.initiator.connectors.iscsi [None req-7ea0d316-4429-4138-be59-f7a5cb5c9777 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 16:57:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f27c413-15bc-49cf-b81b-9eea1bd601bd -p 172.16.0.220:3260 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:57:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f27c413-15bc-49cf-b81b-9eea1bd601bd -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:57:51 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5cd5169-5969-4297-aef0-5cd286187f75]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:57:51 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea0d316-4429-4138-be59-f7a5cb5c9777 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 16:57:51 user nova-compute[75245]:  {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:57:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f27c413-15bc-49cf-b81b-9eea1bd601bd -p 172.16.0.220:3260 --interface default --op new {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:57:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f27c413-15bc-49cf-b81b-9eea1bd601bd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:57:51 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef57dcc-0e9e-4168-8671-04bbeed29e9d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3f27c413-15bc-49cf-b81b-9eea1bd601bd] added\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:57:51 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea0d316-4429-4138-be59-f7a5cb5c9777 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3f27c413-15bc-49cf-b81b-9eea1bd601bd] added
Nov 29 16:57:51 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:57:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f27c413-15bc-49cf-b81b-9eea1bd601bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:57:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f27c413-15bc-49cf-b81b-9eea1bd601bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:57:51 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ed25a6-a73e-407d-a0c0-0af5bf2218d5]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:57:51 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea0d316-4429-4138-be59-f7a5cb5c9777 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:57:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f27c413-15bc-49cf-b81b-9eea1bd601bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:57:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f27c413-15bc-49cf-b81b-9eea1bd601bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:57:51 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca26892a-0880-4f37-be78-1389d5423ebe]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:57:51 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea0d316-4429-4138-be59-f7a5cb5c9777 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:57:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f27c413-15bc-49cf-b81b-9eea1bd601bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bHmNEiYu {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:57:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f27c413-15bc-49cf-b81b-9eea1bd601bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bHmNEiYu" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:57:51 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a8aa693-29db-40e0-b464-540833a28a8e]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:57:51 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea0d316-4429-4138-be59-f7a5cb5c9777 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bHmNEiYu'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:57:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f27c413-15bc-49cf-b81b-9eea1bd601bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:57:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f27c413-15bc-49cf-b81b-9eea1bd601bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:57:51 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf8b2a7a-de4f-4aab-9ac9-1539d12468e3]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:57:51 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea0d316-4429-4138-be59-f7a5cb5c9777 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:57:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:57:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:57:51 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c44c94-7e07-41d8-8403-ddb5b58a28bb]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec6a3cf-f562-485a-a1c5-14728db1def3 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:57:51 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea0d316-4429-4138-be59-f7a5cb5c9777 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7 (non-flash)
Nov 29 16:57:51 user nova-compute[75245]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec6a3cf-f562-485a-a1c5-14728db1def3 (non-flash)
Nov 29 16:57:51 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:57:51 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea0d316-4429-4138-be59-f7a5cb5c9777 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7 (non-flash)
Nov 29 16:57:51 user nova-compute[75245]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec6a3cf-f562-485a-a1c5-14728db1def3 (non-flash)
Nov 29 16:57:51 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:57:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f27c413-15bc-49cf-b81b-9eea1bd601bd -p 172.16.0.220:3260 --login {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:57:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f27c413-15bc-49cf-b81b-9eea1bd601bd -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:57:51 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[822853c0-90b6-4dc6-bcfb-2886300dfc9e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3f27c413-15bc-49cf-b81b-9eea1bd601bd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3f27c413-15bc-49cf-b81b-9eea1bd601bd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:57:51 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea0d316-4429-4138-be59-f7a5cb5c9777 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3f27c413-15bc-49cf-b81b-9eea1bd601bd, portal: 172.16.0.220,3260]
Nov 29 16:57:51 user nova-compute[75245]: Login to [iface: default, target: iqn.2010-10.org.openstack:3f27c413-15bc-49cf-b81b-9eea1bd601bd, portal: 172.16.0.220,3260] successful.
Nov 29 16:57:51 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:57:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f27c413-15bc-49cf-b81b-9eea1bd601bd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:57:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f27c413-15bc-49cf-b81b-9eea1bd601bd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:57:51 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0fea838-906d-4d9b-8742-f327987fa5fd]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:57:51 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea0d316-4429-4138-be59-f7a5cb5c9777 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:57:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:57:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:57:51 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2920b5-8c39-4a91-a1bf-68cb6d91f3dc]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec6a3cf-f562-485a-a1c5-14728db1def3 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f27c413-15bc-49cf-b81b-9eea1bd601bd (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:57:51 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea0d316-4429-4138-be59-f7a5cb5c9777 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7 (non-flash)
Nov 29 16:57:51 user nova-compute[75245]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec6a3cf-f562-485a-a1c5-14728db1def3 (non-flash)
Nov 29 16:57:51 user nova-compute[75245]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f27c413-15bc-49cf-b81b-9eea1bd601bd (non-flash)
Nov 29 16:57:51 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:57:51 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea0d316-4429-4138-be59-f7a5cb5c9777 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7 (non-flash)
Nov 29 16:57:51 user nova-compute[75245]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec6a3cf-f562-485a-a1c5-14728db1def3 (non-flash)
Nov 29 16:57:51 user nova-compute[75245]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f27c413-15bc-49cf-b81b-9eea1bd601bd (non-flash)
Nov 29 16:57:51 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:57:51 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-7ea0d316-4429-4138-be59-f7a5cb5c9777 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f27c413-15bc-49cf-b81b-9eea1bd601bd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:57:51 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea0d316-4429-4138-be59-f7a5cb5c9777 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Connected to 172.16.0.220:3260 {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 16:57:51 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-7ea0d316-4429-4138-be59-f7a5cb5c9777 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] HCTL ('35', '-', '-', 0) found on session 54 with lun 0 {{(pid=75245) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 16:57:51 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-7ea0d316-4429-4138-be59-f7a5cb5c9777 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75245) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 16:57:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:57:51 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:57:51 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1af2b7-90bf-4897-8e7e-adac6966c75b]: (4, ('- - 0', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:57:51 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-7ea0d316-4429-4138-be59-f7a5cb5c9777 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Searching for a device in session 54 and hctl ['35', '*', '*', 0] yield: None {{(pid=75245) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 16:57:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:57:52 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-7ea0d316-4429-4138-be59-f7a5cb5c9777 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Searching for a device in session 54 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75245) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 16:57:52 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea0d316-4429-4138-be59-f7a5cb5c9777 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:3f27c413-15bc-49cf-b81b-9eea1bd601bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bHmNEiYu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 16:57:52 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-7ea0d316-4429-4138-be59-f7a5cb5c9777 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:57:52 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea0d316-4429-4138-be59-f7a5cb5c9777 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23732323736616664', 'path': '/dev/sdd'} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:57:52 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ea0d316-4429-4138-be59-f7a5cb5c9777 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23732323736616664', 'path': '/dev/sdd'} {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 16:57:52 user nova-compute[75245]: DEBUG nova.objects.instance [None req-7ea0d316-4429-4138-be59-f7a5cb5c9777 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Lazy-loading 'flavor' on Instance uuid 6b3301cf-d51f-4876-af8b-bf1802537849 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:57:52 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-7ea0d316-4429-4138-be59-f7a5cb5c9777 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 16:57:52 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:57:52 user nova-compute[75245]:   <source dev="/dev/sdd"/>
Nov 29 16:57:52 user nova-compute[75245]:   <target dev="vdb" bus="virtio"/>
Nov 29 16:57:52 user nova-compute[75245]:   <serial>3f27c413-15bc-49cf-b81b-9eea1bd601bd</serial>
Nov 29 16:57:52 user nova-compute[75245]: </disk>
Nov 29 16:57:52 user nova-compute[75245]:  {{(pid=75245) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 16:57:52 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-7ea0d316-4429-4138-be59-f7a5cb5c9777 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:57:52 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-7ea0d316-4429-4138-be59-f7a5cb5c9777 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:57:52 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-7ea0d316-4429-4138-be59-f7a5cb5c9777 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] No VIF found with MAC fa:16:3e:e4:cf:d6, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:57:53 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-7ea0d316-4429-4138-be59-f7a5cb5c9777 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Lock "6b3301cf-d51f-4876-af8b-bf1802537849" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.324s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:57:53 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "6b3301cf-d51f-4876-af8b-bf1802537849" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 5.399s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:57:53 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "6b3301cf-d51f-4876-af8b-bf1802537849" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.023s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:57:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:57:56 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:57:59 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:58:01 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:58:06 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:58:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:58:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:58:16 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:58:18 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-9995bb40-fa9f-4cca-98f4-a1935bad5aaf tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Acquiring lock "6b3301cf-d51f-4876-af8b-bf1802537849" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:58:18 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-9995bb40-fa9f-4cca-98f4-a1935bad5aaf tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Lock "6b3301cf-d51f-4876-af8b-bf1802537849" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:58:18 user nova-compute[75245]: INFO nova.compute.manager [None req-9995bb40-fa9f-4cca-98f4-a1935bad5aaf tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] Detaching volume 3f27c413-15bc-49cf-b81b-9eea1bd601bd
Nov 29 16:58:18 user nova-compute[75245]: INFO nova.virt.block_device [None req-9995bb40-fa9f-4cca-98f4-a1935bad5aaf tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] Attempting to driver detach volume 3f27c413-15bc-49cf-b81b-9eea1bd601bd from mountpoint /dev/vdb
Nov 29 16:58:18 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-9995bb40-fa9f-4cca-98f4-a1935bad5aaf tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Attempting to detach device vdb from instance 6b3301cf-d51f-4876-af8b-bf1802537849 from the persistent domain config. {{(pid=75245) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 16:58:18 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-9995bb40-fa9f-4cca-98f4-a1935bad5aaf tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 16:58:18 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:58:18 user nova-compute[75245]:   <source dev="/dev/sdd"/>
Nov 29 16:58:18 user nova-compute[75245]:   <target dev="vdb" bus="virtio"/>
Nov 29 16:58:18 user nova-compute[75245]:   <serial>3f27c413-15bc-49cf-b81b-9eea1bd601bd</serial>
Nov 29 16:58:18 user nova-compute[75245]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 16:58:18 user nova-compute[75245]: </disk>
Nov 29 16:58:18 user nova-compute[75245]:  {{(pid=75245) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 16:58:18 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-9995bb40-fa9f-4cca-98f4-a1935bad5aaf tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Successfully detached device vdb from instance 6b3301cf-d51f-4876-af8b-bf1802537849 from the persistent domain config.
Nov 29 16:58:18 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-9995bb40-fa9f-4cca-98f4-a1935bad5aaf tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6b3301cf-d51f-4876-af8b-bf1802537849 from the live domain config. {{(pid=75245) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 16:58:18 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-9995bb40-fa9f-4cca-98f4-a1935bad5aaf tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 16:58:18 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 16:58:18 user nova-compute[75245]:   <source dev="/dev/sdd"/>
Nov 29 16:58:18 user nova-compute[75245]:   <target dev="vdb" bus="virtio"/>
Nov 29 16:58:18 user nova-compute[75245]:   <serial>3f27c413-15bc-49cf-b81b-9eea1bd601bd</serial>
Nov 29 16:58:18 user nova-compute[75245]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 16:58:18 user nova-compute[75245]: </disk>
Nov 29 16:58:18 user nova-compute[75245]:  {{(pid=75245) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 16:58:18 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-707b297e-9006-4e09-a78f-0e9f8bf76ebe tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Acquiring lock "6b3301cf-d51f-4876-af8b-bf1802537849" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:58:18 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-9995bb40-fa9f-4cca-98f4-a1935bad5aaf tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6b3301cf-d51f-4876-af8b-bf1802537849 {{(pid=75245) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 16:58:19 user nova-compute[75245]: DEBUG nova.compute.manager [req-e1fe64a3-060f-4d46-98e5-8816903a08c9 req-39453469-1cac-480a-8edd-395e8a07d840 service nova] [instance: 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328] Received event network-changed-0cec61ae-b851-4903-bf62-11801ec08112 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:58:19 user nova-compute[75245]: DEBUG nova.compute.manager [req-e1fe64a3-060f-4d46-98e5-8816903a08c9 req-39453469-1cac-480a-8edd-395e8a07d840 service nova] [instance: 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328] Refreshing instance network info cache due to event network-changed-0cec61ae-b851-4903-bf62-11801ec08112. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:58:19 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-e1fe64a3-060f-4d46-98e5-8816903a08c9 req-39453469-1cac-480a-8edd-395e8a07d840 service nova] Acquiring lock "refresh_cache-1ce652dd-61ac-42b4-abb5-7c8bb9ed3328" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:58:19 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-e1fe64a3-060f-4d46-98e5-8816903a08c9 req-39453469-1cac-480a-8edd-395e8a07d840 service nova] Acquired lock "refresh_cache-1ce652dd-61ac-42b4-abb5-7c8bb9ed3328" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:58:19 user nova-compute[75245]: DEBUG nova.network.neutron [req-e1fe64a3-060f-4d46-98e5-8816903a08c9 req-39453469-1cac-480a-8edd-395e8a07d840 service nova] [instance: 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328] Refreshing network info cache for port 0cec61ae-b851-4903-bf62-11801ec08112 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:58:20 user nova-compute[75245]: DEBUG nova.network.neutron [req-e1fe64a3-060f-4d46-98e5-8816903a08c9 req-39453469-1cac-480a-8edd-395e8a07d840 service nova] [instance: 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328] Updated VIF entry in instance network info cache for port 0cec61ae-b851-4903-bf62-11801ec08112. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 16:58:20 user nova-compute[75245]: DEBUG nova.network.neutron [req-e1fe64a3-060f-4d46-98e5-8816903a08c9 req-39453469-1cac-480a-8edd-395e8a07d840 service nova] [instance: 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328] Updating instance_info_cache with network_info: [{"id": "0cec61ae-b851-4903-bf62-11801ec08112", "address": "fa:16:3e:5e:e8:72", "network": {"id": "316cb9af-807d-4a69-874e-2054520f0e5f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1421560477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0907dff4e054429fa10392b730363eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cec61ae-b8", "ovs_interfaceid": "0cec61ae-b851-4903-bf62-11801ec08112", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:58:20 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-e1fe64a3-060f-4d46-98e5-8816903a08c9 req-39453469-1cac-480a-8edd-395e8a07d840 service nova] Releasing lock "refresh_cache-1ce652dd-61ac-42b4-abb5-7c8bb9ed3328" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:58:20 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-261437d7-7f07-465a-bcf9-b1c28cf01411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Acquiring lock "1ce652dd-61ac-42b4-abb5-7c8bb9ed3328" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:58:20 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-261437d7-7f07-465a-bcf9-b1c28cf01411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "1ce652dd-61ac-42b4-abb5-7c8bb9ed3328" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:58:20 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-261437d7-7f07-465a-bcf9-b1c28cf01411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Acquiring lock "1ce652dd-61ac-42b4-abb5-7c8bb9ed3328-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:58:20 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-261437d7-7f07-465a-bcf9-b1c28cf01411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "1ce652dd-61ac-42b4-abb5-7c8bb9ed3328-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:58:20 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-261437d7-7f07-465a-bcf9-b1c28cf01411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "1ce652dd-61ac-42b4-abb5-7c8bb9ed3328-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:58:20 user nova-compute[75245]: INFO nova.compute.manager [None req-261437d7-7f07-465a-bcf9-b1c28cf01411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328] Terminating instance
Nov 29 16:58:20 user nova-compute[75245]: DEBUG nova.compute.manager [None req-261437d7-7f07-465a-bcf9-b1c28cf01411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328] Start destroying the instance on the hypervisor. {{(pid=75245) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 16:58:20 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:58:20 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:58:20 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:58:20 user nova-compute[75245]: DEBUG nova.compute.manager [req-56195257-1f69-44d6-9888-e13a22999fb7 req-0a4711be-f646-488f-866e-f2059b403878 service nova] [instance: 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328] Received event network-vif-unplugged-0cec61ae-b851-4903-bf62-11801ec08112 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:58:20 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-56195257-1f69-44d6-9888-e13a22999fb7 req-0a4711be-f646-488f-866e-f2059b403878 service nova] Acquiring lock "1ce652dd-61ac-42b4-abb5-7c8bb9ed3328-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:58:20 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-56195257-1f69-44d6-9888-e13a22999fb7 req-0a4711be-f646-488f-866e-f2059b403878 service nova] Lock "1ce652dd-61ac-42b4-abb5-7c8bb9ed3328-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:58:20 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-56195257-1f69-44d6-9888-e13a22999fb7 req-0a4711be-f646-488f-866e-f2059b403878 service nova] Lock "1ce652dd-61ac-42b4-abb5-7c8bb9ed3328-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:58:20 user nova-compute[75245]: DEBUG nova.compute.manager [req-56195257-1f69-44d6-9888-e13a22999fb7 req-0a4711be-f646-488f-866e-f2059b403878 service nova] [instance: 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328] No waiting events found dispatching network-vif-unplugged-0cec61ae-b851-4903-bf62-11801ec08112 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:58:20 user nova-compute[75245]: DEBUG nova.compute.manager [req-56195257-1f69-44d6-9888-e13a22999fb7 req-0a4711be-f646-488f-866e-f2059b403878 service nova] [instance: 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328] Received event network-vif-unplugged-0cec61ae-b851-4903-bf62-11801ec08112 for instance with task_state deleting. {{(pid=75245) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 16:58:20 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:58:20 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:58:21 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328] Instance destroyed successfully.
Nov 29 16:58:21 user nova-compute[75245]: DEBUG nova.objects.instance [None req-261437d7-7f07-465a-bcf9-b1c28cf01411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lazy-loading 'resources' on Instance uuid 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:58:21 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-261437d7-7f07-465a-bcf9-b1c28cf01411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:56:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1225779589',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1225779589',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1225779589',id=47,image_ref='46f67faf-316d-4846-8405-dc2e24e67c6b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPXmAvld7YOpDrFcHGm22r7/lW4I2Y/VNxF8WwkIY6sPhOTGa4aMr45GQXJFdrRO43XgjXO8uckQOw/BBXQnWMlxLSxv6cxbxxMOdH1Y2vnK4IAPX7dd15s3kpeOGwyFhw==',key_name='tempest-keypair-1049437226',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:56:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0907dff4e054429fa10392b730363eb2',ramdisk_id='',reservation_id='r-9ljtbsmq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-181783012',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-181783012-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-181783012',owner_user_name='tempest-TestVolumeBootPattern-181783012-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:56:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2870721a7fff4cf19291f0cbfaedae81',uuid=1ce652dd-61ac-42b4-abb5-7c8bb9ed3328,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0cec61ae-b851-4903-bf62-11801ec08112", "address": "fa:16:3e:5e:e8:72", "network": {"id": "316cb9af-807d-4a69-874e-2054520f0e5f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1421560477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0907dff4e054429fa10392b730363eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cec61ae-b8", "ovs_interfaceid": "0cec61ae-b851-4903-bf62-11801ec08112", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 16:58:21 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-261437d7-7f07-465a-bcf9-b1c28cf01411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Converting VIF {"id": "0cec61ae-b851-4903-bf62-11801ec08112", "address": "fa:16:3e:5e:e8:72", "network": {"id": "316cb9af-807d-4a69-874e-2054520f0e5f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1421560477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0907dff4e054429fa10392b730363eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cec61ae-b8", "ovs_interfaceid": "0cec61ae-b851-4903-bf62-11801ec08112", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:58:21 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-261437d7-7f07-465a-bcf9-b1c28cf01411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:e8:72,bridge_name='br-int',has_traffic_filtering=True,id=0cec61ae-b851-4903-bf62-11801ec08112,network=Network(316cb9af-807d-4a69-874e-2054520f0e5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cec61ae-b8') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:58:21 user nova-compute[75245]: DEBUG os_vif [None req-261437d7-7f07-465a-bcf9-b1c28cf01411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:e8:72,bridge_name='br-int',has_traffic_filtering=True,id=0cec61ae-b851-4903-bf62-11801ec08112,network=Network(316cb9af-807d-4a69-874e-2054520f0e5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cec61ae-b8') {{(pid=75245) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 16:58:21 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:58:21 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0cec61ae-b8, bridge=br-int, if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:58:21 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:58:21 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:58:21 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:58:21 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=04b5e524-228e-4b68-8c34-b3c70d6dbd15) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:58:21 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:58:21 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:58:21 user nova-compute[75245]: INFO os_vif [None req-261437d7-7f07-465a-bcf9-b1c28cf01411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:e8:72,bridge_name='br-int',has_traffic_filtering=True,id=0cec61ae-b851-4903-bf62-11801ec08112,network=Network(316cb9af-807d-4a69-874e-2054520f0e5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cec61ae-b8')
Nov 29 16:58:21 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-261437d7-7f07-465a-bcf9-b1c28cf01411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328] calling os-brick to detach iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 16:58:21 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-261437d7-7f07-465a-bcf9-b1c28cf01411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, {'target_iqn': 'iqn.2010-10.org.openstack:0ec6a3cf-f562-485a-a1c5-14728db1def3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mVpjMUiC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:58:21 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-261437d7-7f07-465a-bcf9-b1c28cf01411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:58:21 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-261437d7-7f07-465a-bcf9-b1c28cf01411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:58:21 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-261437d7-7f07-465a-bcf9-b1c28cf01411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:58:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:58:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:58:21 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c0cd0d2-19b0-4b1d-9793-8a348884a14d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3f27c413-15bc-49cf-b81b-9eea1bd601bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ec6a3cf-f562-485a-a1c5-14728db1def3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:58:21 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-261437d7-7f07-465a-bcf9-b1c28cf01411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 16:58:21 user nova-compute[75245]: No targets found.
Nov 29 16:58:21 user nova-compute[75245]: iSNS:
Nov 29 16:58:21 user nova-compute[75245]: No targets found.
Nov 29 16:58:21 user nova-compute[75245]: STATIC:
Nov 29 16:58:21 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:3f27c413-15bc-49cf-b81b-9eea1bd601bd
Nov 29 16:58:21 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:58:21 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:58:21 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:0ec6a3cf-f562-485a-a1c5-14728db1def3
Nov 29 16:58:21 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:58:21 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:58:21 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7
Nov 29 16:58:21 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:58:21 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:58:21 user nova-compute[75245]: FIRMWARE:
Nov 29 16:58:21 user nova-compute[75245]: No targets found.
Nov 29 16:58:21 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:58:21 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-261437d7-7f07-465a-bcf9-b1c28cf01411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 16:58:21 user nova-compute[75245]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 16:58:21 user nova-compute[75245]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75245) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 16:58:21 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-261437d7-7f07-465a-bcf9-b1c28cf01411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ec6a3cf-f562-485a-a1c5-14728db1def3', 0)] {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 16:58:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:58:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:58:21 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[33984ab1-9009-446d-b0bf-3fc01266f5f2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ec6a3cf-f562-485a-a1c5-14728db1def3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f27c413-15bc-49cf-b81b-9eea1bd601bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:58:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:58:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:58:21 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8cdbffc-9f74-4427-8821-af107a6305b8]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec6a3cf-f562-485a-a1c5-14728db1def3 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f27c413-15bc-49cf-b81b-9eea1bd601bd (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:58:21 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-261437d7-7f07-465a-bcf9-b1c28cf01411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7 (non-flash)
Nov 29 16:58:21 user nova-compute[75245]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec6a3cf-f562-485a-a1c5-14728db1def3 (non-flash)
Nov 29 16:58:21 user nova-compute[75245]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f27c413-15bc-49cf-b81b-9eea1bd601bd (non-flash)
Nov 29 16:58:21 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:58:21 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-261437d7-7f07-465a-bcf9-b1c28cf01411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7 (non-flash)
Nov 29 16:58:21 user nova-compute[75245]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec6a3cf-f562-485a-a1c5-14728db1def3 (non-flash)
Nov 29 16:58:21 user nova-compute[75245]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f27c413-15bc-49cf-b81b-9eea1bd601bd (non-flash)
Nov 29 16:58:21 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:58:21 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-261437d7-7f07-465a-bcf9-b1c28cf01411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0d56189ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ec6a3cf-f562-485a-a1c5-14728db1def3'): ({'sdc'}, set())}) {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 16:58:21 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-261437d7-7f07-465a-bcf9-b1c28cf01411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Removing single pathed devices sdc {{(pid=75245) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 16:58:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:58:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:58:21 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8747014-5325-4254-a576-886c65716aef]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:58:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:58:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:58:21 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e204ac-8a98-467e-96ed-03916fae0169]: (4, ('ok\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:58:21 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-261437d7-7f07-465a-bcf9-b1c28cf01411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Flushing IO for device /dev/sdc {{(pid=75245) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 16:58:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:58:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:58:21 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb783995-290c-4d62-89be-81b75a6fcb63]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:58:21 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-261437d7-7f07-465a-bcf9-b1c28cf01411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75245) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 16:58:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:58:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:58:21 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e534093-436c-4821-b20c-6f236acd6205]: (4, ('1', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:58:21 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-261437d7-7f07-465a-bcf9-b1c28cf01411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 16:58:21 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-261437d7-7f07-465a-bcf9-b1c28cf01411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] SCSI volumes sdc have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 16:58:21 user nova-compute[75245]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO4d7123f5-6f056270079e907d', '/dev/disk/by-id/scsi-23666303536323730', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_4d7123f5') {{(pid=86166) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 29 16:58:21 user nova-compute[75245]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO4d7123f5-6f056270079e907d
Nov 29 16:58:21 user nova-compute[75245]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23666303536323730
Nov 29 16:58:21 user nova-compute[75245]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_4d7123f5
Nov 29 16:58:21 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1d071a-7e04-492a-85f4-d5570415896f]: (4, None) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:58:21 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-261437d7-7f07-465a-bcf9-b1c28cf01411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ec6a3cf-f562-485a-a1c5-14728db1def3')] {{(pid=75245) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 16:58:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ec6a3cf-f562-485a-a1c5-14728db1def3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:58:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ec6a3cf-f562-485a-a1c5-14728db1def3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:58:21 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6644e40-07ed-47aa-8166-8c2521363972]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:58:21 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-261437d7-7f07-465a-bcf9-b1c28cf01411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:58:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ec6a3cf-f562-485a-a1c5-14728db1def3 -p 172.16.0.220:3260 --logout {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:58:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ec6a3cf-f562-485a-a1c5-14728db1def3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:58:21 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[e521e05c-bfca-4984-85db-f6831d286a89]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:0ec6a3cf-f562-485a-a1c5-14728db1def3, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:0ec6a3cf-f562-485a-a1c5-14728db1def3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:58:21 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-261437d7-7f07-465a-bcf9-b1c28cf01411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:0ec6a3cf-f562-485a-a1c5-14728db1def3, portal: 172.16.0.220,3260]
Nov 29 16:58:21 user nova-compute[75245]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:0ec6a3cf-f562-485a-a1c5-14728db1def3, portal: 172.16.0.220,3260] successful.
Nov 29 16:58:21 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:58:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ec6a3cf-f562-485a-a1c5-14728db1def3 -p 172.16.0.220:3260 --op delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:58:21 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ec6a3cf-f562-485a-a1c5-14728db1def3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:58:21 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[144f5665-6a59-486d-8d44-dc4d5e9d9108]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:58:21 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-261437d7-7f07-465a-bcf9-b1c28cf01411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:58:21 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-261437d7-7f07-465a-bcf9-b1c28cf01411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:58:21 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-261437d7-7f07-465a-bcf9-b1c28cf01411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] <== disconnect_volume: return (322ms) None {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:58:21 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-261437d7-7f07-465a-bcf9-b1c28cf01411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328] Disconnected iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 16:58:21 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-261437d7-7f07-465a-bcf9-b1c28cf01411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328] Deleting instance files /opt/stack/data/nova/instances/1ce652dd-61ac-42b4-abb5-7c8bb9ed3328_del
Nov 29 16:58:21 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-261437d7-7f07-465a-bcf9-b1c28cf01411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328] Deletion of /opt/stack/data/nova/instances/1ce652dd-61ac-42b4-abb5-7c8bb9ed3328_del complete
Nov 29 16:58:21 user nova-compute[75245]: INFO nova.compute.manager [None req-261437d7-7f07-465a-bcf9-b1c28cf01411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 29 16:58:21 user nova-compute[75245]: DEBUG oslo.service.loopingcall [None req-261437d7-7f07-465a-bcf9-b1c28cf01411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75245) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 16:58:21 user nova-compute[75245]: DEBUG nova.compute.manager [-] [instance: 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328] Deallocating network for instance {{(pid=75245) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 16:58:21 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328] deallocate_for_instance() {{(pid=75245) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 16:58:22 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:58:22 user nova-compute[75245]: INFO nova.compute.manager [-] [instance: 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328] Took 1.02 seconds to deallocate network for instance.
Nov 29 16:58:22 user nova-compute[75245]: DEBUG nova.compute.manager [req-d1afbce3-cdaf-46ef-b8cd-f56abe7c8326 req-db9528d4-e85b-4c5f-bf3b-1ca108417731 service nova] [instance: 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328] Received event network-vif-deleted-0cec61ae-b851-4903-bf62-11801ec08112 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:58:22 user nova-compute[75245]: INFO nova.compute.manager [req-d1afbce3-cdaf-46ef-b8cd-f56abe7c8326 req-db9528d4-e85b-4c5f-bf3b-1ca108417731 service nova] [instance: 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328] Neutron deleted interface 0cec61ae-b851-4903-bf62-11801ec08112; detaching it from the instance and deleting it from the info cache
Nov 29 16:58:22 user nova-compute[75245]: DEBUG nova.network.neutron [req-d1afbce3-cdaf-46ef-b8cd-f56abe7c8326 req-db9528d4-e85b-4c5f-bf3b-1ca108417731 service nova] [instance: 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:58:22 user nova-compute[75245]: DEBUG nova.compute.manager [req-d1afbce3-cdaf-46ef-b8cd-f56abe7c8326 req-db9528d4-e85b-4c5f-bf3b-1ca108417731 service nova] [instance: 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328] Detach interface failed, port_id=0cec61ae-b851-4903-bf62-11801ec08112, reason: Instance 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328 could not be found. {{(pid=75245) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 16:58:22 user nova-compute[75245]: DEBUG nova.compute.manager [req-d4f35ba2-d7f2-4483-b8c6-edd19829ba2b req-88bc5ec4-0679-4fdf-b00e-d062c3c16ec4 service nova] [instance: 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328] Received event network-vif-plugged-0cec61ae-b851-4903-bf62-11801ec08112 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:58:22 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d4f35ba2-d7f2-4483-b8c6-edd19829ba2b req-88bc5ec4-0679-4fdf-b00e-d062c3c16ec4 service nova] Acquiring lock "1ce652dd-61ac-42b4-abb5-7c8bb9ed3328-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:58:22 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d4f35ba2-d7f2-4483-b8c6-edd19829ba2b req-88bc5ec4-0679-4fdf-b00e-d062c3c16ec4 service nova] Lock "1ce652dd-61ac-42b4-abb5-7c8bb9ed3328-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:58:22 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d4f35ba2-d7f2-4483-b8c6-edd19829ba2b req-88bc5ec4-0679-4fdf-b00e-d062c3c16ec4 service nova] Lock "1ce652dd-61ac-42b4-abb5-7c8bb9ed3328-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:58:22 user nova-compute[75245]: DEBUG nova.compute.manager [req-d4f35ba2-d7f2-4483-b8c6-edd19829ba2b req-88bc5ec4-0679-4fdf-b00e-d062c3c16ec4 service nova] [instance: 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328] No waiting events found dispatching network-vif-plugged-0cec61ae-b851-4903-bf62-11801ec08112 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:58:22 user nova-compute[75245]: WARNING nova.compute.manager [req-d4f35ba2-d7f2-4483-b8c6-edd19829ba2b req-88bc5ec4-0679-4fdf-b00e-d062c3c16ec4 service nova] [instance: 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328] Received unexpected event network-vif-plugged-0cec61ae-b851-4903-bf62-11801ec08112 for instance with vm_state active and task_state deleting.
Nov 29 16:58:23 user nova-compute[75245]: INFO nova.compute.manager [None req-261437d7-7f07-465a-bcf9-b1c28cf01411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328] Took 0.76 seconds to detach 1 volumes for instance.
Nov 29 16:58:23 user nova-compute[75245]: DEBUG nova.compute.manager [None req-261437d7-7f07-465a-bcf9-b1c28cf01411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328] Deleting volume: 0ec6a3cf-f562-485a-a1c5-14728db1def3 {{(pid=75245) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 29 16:58:23 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-261437d7-7f07-465a-bcf9-b1c28cf01411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:58:23 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-261437d7-7f07-465a-bcf9-b1c28cf01411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:58:23 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-261437d7-7f07-465a-bcf9-b1c28cf01411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:58:23 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-261437d7-7f07-465a-bcf9-b1c28cf01411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:58:23 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-261437d7-7f07-465a-bcf9-b1c28cf01411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.157s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:58:23 user nova-compute[75245]: INFO nova.scheduler.client.report [None req-261437d7-7f07-465a-bcf9-b1c28cf01411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Deleted allocations for instance 1ce652dd-61ac-42b4-abb5-7c8bb9ed3328
Nov 29 16:58:23 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-261437d7-7f07-465a-bcf9-b1c28cf01411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "1ce652dd-61ac-42b4-abb5-7c8bb9ed3328" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.387s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:58:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:58:26 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:58:28 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:58:28 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Starting heal instance info cache {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 16:58:28 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Rebuilding the list of instances to heal {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 16:58:28 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] Skipping network cache update for instance because it is being deleted. {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9939}}
Nov 29 16:58:28 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "refresh_cache-f9419b01-cd53-472d-90d1-c18f6d77660a" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:58:28 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquired lock "refresh_cache-f9419b01-cd53-472d-90d1-c18f6d77660a" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:58:28 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] Forcefully refreshing network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 16:58:28 user nova-compute[75245]: DEBUG nova.objects.instance [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lazy-loading 'info_cache' on Instance uuid f9419b01-cd53-472d-90d1-c18f6d77660a {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:58:29 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] Updating instance_info_cache with network_info: [{"id": "1fdc121e-0b9d-43ca-8bf8-9a245f0fd242", "address": "fa:16:3e:18:2e:2f", "network": {"id": "316cb9af-807d-4a69-874e-2054520f0e5f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1421560477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0907dff4e054429fa10392b730363eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fdc121e-0b", "ovs_interfaceid": "1fdc121e-0b9d-43ca-8bf8-9a245f0fd242", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:58:29 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Releasing lock "refresh_cache-f9419b01-cd53-472d-90d1-c18f6d77660a" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:58:29 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] Updated the network info_cache for instance {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 16:58:29 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:58:29 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:58:29 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:58:29 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:58:29 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:58:29 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75245) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 16:58:29 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b3301cf-d51f-4876-af8b-bf1802537849/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:58:29 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b3301cf-d51f-4876-af8b-bf1802537849/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:58:29 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b3301cf-d51f-4876-af8b-bf1802537849/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:58:29 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b3301cf-d51f-4876-af8b-bf1802537849/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:58:29 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 16:58:30 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:58:30 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:58:30 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Hypervisor/Node resource view: name=user free_ram=8857MB free_disk=25.073974609375GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75245) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 16:58:30 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:58:30 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:58:30 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance f9419b01-cd53-472d-90d1-c18f6d77660a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:58:30 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 6b3301cf-d51f-4876-af8b-bf1802537849 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:58:30 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 16:58:30 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 16:58:30 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:58:30 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:58:30 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Compute_service record updated for user:user {{(pid=75245) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 16:58:30 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.248s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:58:31 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:58:36 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:58:36 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:58:38 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:58:38 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-9995bb40-fa9f-4cca-98f4-a1935bad5aaf tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6b3301cf-d51f-4876-af8b-bf1802537849 is timed out.
Nov 29 16:58:38 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-9995bb40-fa9f-4cca-98f4-a1935bad5aaf tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Successfully detached device vdb from instance 6b3301cf-d51f-4876-af8b-bf1802537849 from the live domain config.
Nov 29 16:58:38 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9995bb40-fa9f-4cca-98f4-a1935bad5aaf tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] calling os-brick to detach iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 16:58:38 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-9995bb40-fa9f-4cca-98f4-a1935bad5aaf tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, {'target_iqn': 'iqn.2010-10.org.openstack:3f27c413-15bc-49cf-b81b-9eea1bd601bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bHmNEiYu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:58:38 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-9995bb40-fa9f-4cca-98f4-a1935bad5aaf tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:58:38 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-9995bb40-fa9f-4cca-98f4-a1935bad5aaf tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:58:38 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-9995bb40-fa9f-4cca-98f4-a1935bad5aaf tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:58:38 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:58:38 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:58:38 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e37770e-68ec-4159-8a33-7c897b5eec11]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3f27c413-15bc-49cf-b81b-9eea1bd601bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:58:38 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-9995bb40-fa9f-4cca-98f4-a1935bad5aaf tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 16:58:38 user nova-compute[75245]: No targets found.
Nov 29 16:58:38 user nova-compute[75245]: iSNS:
Nov 29 16:58:38 user nova-compute[75245]: No targets found.
Nov 29 16:58:38 user nova-compute[75245]: STATIC:
Nov 29 16:58:38 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:3f27c413-15bc-49cf-b81b-9eea1bd601bd
Nov 29 16:58:38 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:58:38 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:58:38 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7
Nov 29 16:58:38 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:58:38 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:58:38 user nova-compute[75245]: FIRMWARE:
Nov 29 16:58:38 user nova-compute[75245]: No targets found.
Nov 29 16:58:38 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:58:38 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-9995bb40-fa9f-4cca-98f4-a1935bad5aaf tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 16:58:38 user nova-compute[75245]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 16:58:38 user nova-compute[75245]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75245) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 16:58:38 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-9995bb40-fa9f-4cca-98f4-a1935bad5aaf tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f27c413-15bc-49cf-b81b-9eea1bd601bd', 0)] {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 16:58:38 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:58:39 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:58:39 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e3f26e2-bd38-47ec-a9a8-725f9059592e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f27c413-15bc-49cf-b81b-9eea1bd601bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:58:39 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:58:39 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:58:39 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c1c2dd-c94f-4349-89b5-1a771427f29f]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f27c413-15bc-49cf-b81b-9eea1bd601bd (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:58:39 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-9995bb40-fa9f-4cca-98f4-a1935bad5aaf tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7 (non-flash)
Nov 29 16:58:39 user nova-compute[75245]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f27c413-15bc-49cf-b81b-9eea1bd601bd (non-flash)
Nov 29 16:58:39 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:58:39 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-9995bb40-fa9f-4cca-98f4-a1935bad5aaf tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7 (non-flash)
Nov 29 16:58:39 user nova-compute[75245]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f27c413-15bc-49cf-b81b-9eea1bd601bd (non-flash)
Nov 29 16:58:39 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:58:39 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-9995bb40-fa9f-4cca-98f4-a1935bad5aaf tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0d4d4dd990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f27c413-15bc-49cf-b81b-9eea1bd601bd'): ({'sdd'}, set())}) {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 16:58:39 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-9995bb40-fa9f-4cca-98f4-a1935bad5aaf tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Removing single pathed devices sdd {{(pid=75245) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 16:58:39 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:58:39 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:58:39 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[952885d6-7bb3-4686-a054-ba1587bde715]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:58:39 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:58:39 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:58:39 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[c602e528-0c6f-4cb1-aacf-51ad0a9f5748]: (4, ('ok\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:58:39 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-9995bb40-fa9f-4cca-98f4-a1935bad5aaf tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Flushing IO for device /dev/sdd {{(pid=75245) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 16:58:39 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:58:39 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:58:39 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6497622-e9f5-4dee-86d3-89cecbd9a9e3]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:58:39 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-9995bb40-fa9f-4cca-98f4-a1935bad5aaf tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75245) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 16:58:39 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:58:39 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:58:39 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[b923f585-fff9-4edc-92fe-2ed1406c66f6]: (4, ('1', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:58:39 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-9995bb40-fa9f-4cca-98f4-a1935bad5aaf tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 16:58:39 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-9995bb40-fa9f-4cca-98f4-a1935bad5aaf tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] SCSI volumes sdd have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 16:58:39 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-9995bb40-fa9f-4cca-98f4-a1935bad5aaf tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f27c413-15bc-49cf-b81b-9eea1bd601bd')] {{(pid=75245) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 16:58:39 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f27c413-15bc-49cf-b81b-9eea1bd601bd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:58:39 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f27c413-15bc-49cf-b81b-9eea1bd601bd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:58:39 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[32dec194-30cd-443f-905b-25aa2e9f4058]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:58:39 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-9995bb40-fa9f-4cca-98f4-a1935bad5aaf tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:58:39 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f27c413-15bc-49cf-b81b-9eea1bd601bd -p 172.16.0.220:3260 --logout {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:58:39 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f27c413-15bc-49cf-b81b-9eea1bd601bd -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:58:39 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[72088483-bbfc-493c-a591-cfe57cc66a7b]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:3f27c413-15bc-49cf-b81b-9eea1bd601bd, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:3f27c413-15bc-49cf-b81b-9eea1bd601bd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:58:39 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-9995bb40-fa9f-4cca-98f4-a1935bad5aaf tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:3f27c413-15bc-49cf-b81b-9eea1bd601bd, portal: 172.16.0.220,3260]
Nov 29 16:58:39 user nova-compute[75245]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:3f27c413-15bc-49cf-b81b-9eea1bd601bd, portal: 172.16.0.220,3260] successful.
Nov 29 16:58:39 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:58:39 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f27c413-15bc-49cf-b81b-9eea1bd601bd -p 172.16.0.220:3260 --op delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:58:39 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f27c413-15bc-49cf-b81b-9eea1bd601bd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:58:39 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f87c17-29b4-4683-8561-abb7509079f3]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:58:39 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-9995bb40-fa9f-4cca-98f4-a1935bad5aaf tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:58:39 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-9995bb40-fa9f-4cca-98f4-a1935bad5aaf tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:58:39 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-9995bb40-fa9f-4cca-98f4-a1935bad5aaf tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] <== disconnect_volume: return (292ms) None {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:58:39 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9995bb40-fa9f-4cca-98f4-a1935bad5aaf tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] Disconnected iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 16:58:40 user nova-compute[75245]: DEBUG nova.objects.instance [None req-9995bb40-fa9f-4cca-98f4-a1935bad5aaf tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Lazy-loading 'flavor' on Instance uuid 6b3301cf-d51f-4876-af8b-bf1802537849 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:58:40 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-9995bb40-fa9f-4cca-98f4-a1935bad5aaf tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Lock "6b3301cf-d51f-4876-af8b-bf1802537849" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.763s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:58:40 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-707b297e-9006-4e09-a78f-0e9f8bf76ebe tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Lock "6b3301cf-d51f-4876-af8b-bf1802537849" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.641s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:58:40 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-707b297e-9006-4e09-a78f-0e9f8bf76ebe tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Acquiring lock "6b3301cf-d51f-4876-af8b-bf1802537849-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:58:40 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-707b297e-9006-4e09-a78f-0e9f8bf76ebe tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Lock "6b3301cf-d51f-4876-af8b-bf1802537849-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:58:40 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-707b297e-9006-4e09-a78f-0e9f8bf76ebe tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Lock "6b3301cf-d51f-4876-af8b-bf1802537849-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:58:40 user nova-compute[75245]: INFO nova.compute.manager [None req-707b297e-9006-4e09-a78f-0e9f8bf76ebe tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] Terminating instance
Nov 29 16:58:40 user nova-compute[75245]: DEBUG nova.compute.manager [None req-707b297e-9006-4e09-a78f-0e9f8bf76ebe tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] Start destroying the instance on the hypervisor. {{(pid=75245) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 16:58:40 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:58:40 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:58:40 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:58:40 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:58:40 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:58:40 user nova-compute[75245]: DEBUG nova.compute.manager [req-60d6f267-abb4-432a-a915-7d85e26daa9e req-a6e383a7-32e8-4571-ad9e-756828def111 service nova] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] Received event network-vif-unplugged-e11a9af6-997c-46df-975c-def9634baef0 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:58:40 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-60d6f267-abb4-432a-a915-7d85e26daa9e req-a6e383a7-32e8-4571-ad9e-756828def111 service nova] Acquiring lock "6b3301cf-d51f-4876-af8b-bf1802537849-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:58:40 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-60d6f267-abb4-432a-a915-7d85e26daa9e req-a6e383a7-32e8-4571-ad9e-756828def111 service nova] Lock "6b3301cf-d51f-4876-af8b-bf1802537849-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:58:40 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-60d6f267-abb4-432a-a915-7d85e26daa9e req-a6e383a7-32e8-4571-ad9e-756828def111 service nova] Lock "6b3301cf-d51f-4876-af8b-bf1802537849-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:58:40 user nova-compute[75245]: DEBUG nova.compute.manager [req-60d6f267-abb4-432a-a915-7d85e26daa9e req-a6e383a7-32e8-4571-ad9e-756828def111 service nova] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] No waiting events found dispatching network-vif-unplugged-e11a9af6-997c-46df-975c-def9634baef0 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:58:40 user nova-compute[75245]: DEBUG nova.compute.manager [req-60d6f267-abb4-432a-a915-7d85e26daa9e req-a6e383a7-32e8-4571-ad9e-756828def111 service nova] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] Received event network-vif-unplugged-e11a9af6-997c-46df-975c-def9634baef0 for instance with task_state deleting. {{(pid=75245) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 16:58:40 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:58:40 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:58:40 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] Instance destroyed successfully.
Nov 29 16:58:40 user nova-compute[75245]: DEBUG nova.objects.instance [None req-707b297e-9006-4e09-a78f-0e9f8bf76ebe tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Lazy-loading 'resources' on Instance uuid 6b3301cf-d51f-4876-af8b-bf1802537849 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:58:40 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-707b297e-9006-4e09-a78f-0e9f8bf76ebe tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:55:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-675138715',display_name='tempest-VolumesSnapshotTestJSON-instance-675138715',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-675138715',id=46,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPnkGcVV3fojpDPGmg99Pa1jIV5gZ3woUSS0sezlCvznNVilnP9zcVU8RN1avfNYR6d3nYdZpvelDi25tUNR0GxeGxrCXPeCUrhs4hvKQ3l91D9W5FTWbqC2Uin3Ung/uw==',key_name='tempest-keypair-1063465921',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:55:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3945a91aae184152ae3ad9e6307c69f2',ramdisk_id='',reservation_id='r-3n8yb9m3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-234601790',owner_user_name='tempest-VolumesSnapshotTestJSON-234601790-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:55:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3207e1ff86af4b91bef305f28848fbdb',uuid=6b3301cf-d51f-4876-af8b-bf1802537849,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e11a9af6-997c-46df-975c-def9634baef0", "address": "fa:16:3e:e4:cf:d6", "network": {"id": "9ac826d2-ead7-459b-8629-2c3ac5b3dc88", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1414777524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3945a91aae184152ae3ad9e6307c69f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape11a9af6-99", "ovs_interfaceid": "e11a9af6-997c-46df-975c-def9634baef0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 16:58:40 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-707b297e-9006-4e09-a78f-0e9f8bf76ebe tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Converting VIF {"id": "e11a9af6-997c-46df-975c-def9634baef0", "address": "fa:16:3e:e4:cf:d6", "network": {"id": "9ac826d2-ead7-459b-8629-2c3ac5b3dc88", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1414777524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3945a91aae184152ae3ad9e6307c69f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape11a9af6-99", "ovs_interfaceid": "e11a9af6-997c-46df-975c-def9634baef0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:58:40 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-707b297e-9006-4e09-a78f-0e9f8bf76ebe tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e4:cf:d6,bridge_name='br-int',has_traffic_filtering=True,id=e11a9af6-997c-46df-975c-def9634baef0,network=Network(9ac826d2-ead7-459b-8629-2c3ac5b3dc88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape11a9af6-99') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:58:40 user nova-compute[75245]: DEBUG os_vif [None req-707b297e-9006-4e09-a78f-0e9f8bf76ebe tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:cf:d6,bridge_name='br-int',has_traffic_filtering=True,id=e11a9af6-997c-46df-975c-def9634baef0,network=Network(9ac826d2-ead7-459b-8629-2c3ac5b3dc88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape11a9af6-99') {{(pid=75245) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 16:58:40 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:58:40 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape11a9af6-99, bridge=br-int, if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:58:40 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:58:40 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:58:40 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=23eeb5d3-5094-48cd-8b53-c00068983c51) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:58:40 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:58:40 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:58:40 user nova-compute[75245]: INFO os_vif [None req-707b297e-9006-4e09-a78f-0e9f8bf76ebe tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:cf:d6,bridge_name='br-int',has_traffic_filtering=True,id=e11a9af6-997c-46df-975c-def9634baef0,network=Network(9ac826d2-ead7-459b-8629-2c3ac5b3dc88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape11a9af6-99')
Nov 29 16:58:40 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-707b297e-9006-4e09-a78f-0e9f8bf76ebe tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] calling os-brick to detach iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 16:58:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-707b297e-9006-4e09-a78f-0e9f8bf76ebe tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, {'target_iqn': 'iqn.2010-10.org.openstack:3f27c413-15bc-49cf-b81b-9eea1bd601bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bHmNEiYu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:58:40 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-707b297e-9006-4e09-a78f-0e9f8bf76ebe tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:58:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-707b297e-9006-4e09-a78f-0e9f8bf76ebe tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:58:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-707b297e-9006-4e09-a78f-0e9f8bf76ebe tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:58:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:58:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:58:40 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ddc37b0-5ede-47ec-b51b-b4d272f1cd2d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:58:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-707b297e-9006-4e09-a78f-0e9f8bf76ebe tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 16:58:40 user nova-compute[75245]: No targets found.
Nov 29 16:58:40 user nova-compute[75245]: iSNS:
Nov 29 16:58:40 user nova-compute[75245]: No targets found.
Nov 29 16:58:40 user nova-compute[75245]: STATIC:
Nov 29 16:58:40 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7
Nov 29 16:58:40 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:58:40 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:58:40 user nova-compute[75245]: FIRMWARE:
Nov 29 16:58:40 user nova-compute[75245]: No targets found.
Nov 29 16:58:40 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:58:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-707b297e-9006-4e09-a78f-0e9f8bf76ebe tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 16:58:40 user nova-compute[75245]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 16:58:40 user nova-compute[75245]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75245) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 16:58:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-707b297e-9006-4e09-a78f-0e9f8bf76ebe tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f27c413-15bc-49cf-b81b-9eea1bd601bd', 0)] {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 16:58:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:58:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:58:40 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63f11eb-1806-44fb-8e8e-4f2ac82e408e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:58:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:58:40 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:58:40 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc15e65-1145-48e3-935a-6fefd8e538ac]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:58:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-707b297e-9006-4e09-a78f-0e9f8bf76ebe tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7 (non-flash)
Nov 29 16:58:40 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:58:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-707b297e-9006-4e09-a78f-0e9f8bf76ebe tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7 (non-flash)
Nov 29 16:58:40 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:58:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-707b297e-9006-4e09-a78f-0e9f8bf76ebe tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0d441cca60>, {}) {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 16:58:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-707b297e-9006-4e09-a78f-0e9f8bf76ebe tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Disconnecting from: [] {{(pid=75245) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 16:58:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-707b297e-9006-4e09-a78f-0e9f8bf76ebe tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.071s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:58:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-707b297e-9006-4e09-a78f-0e9f8bf76ebe tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] <== disconnect_volume: return (74ms) None {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:58:40 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-707b297e-9006-4e09-a78f-0e9f8bf76ebe tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] Disconnected iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 16:58:40 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-707b297e-9006-4e09-a78f-0e9f8bf76ebe tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] Deleting instance files /opt/stack/data/nova/instances/6b3301cf-d51f-4876-af8b-bf1802537849_del
Nov 29 16:58:40 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-707b297e-9006-4e09-a78f-0e9f8bf76ebe tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] Deletion of /opt/stack/data/nova/instances/6b3301cf-d51f-4876-af8b-bf1802537849_del complete
Nov 29 16:58:41 user nova-compute[75245]: INFO nova.compute.manager [None req-707b297e-9006-4e09-a78f-0e9f8bf76ebe tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 29 16:58:41 user nova-compute[75245]: DEBUG oslo.service.loopingcall [None req-707b297e-9006-4e09-a78f-0e9f8bf76ebe tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75245) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 16:58:41 user nova-compute[75245]: DEBUG nova.compute.manager [-] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] Deallocating network for instance {{(pid=75245) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 16:58:41 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] deallocate_for_instance() {{(pid=75245) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 16:58:41 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:58:41 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75245) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 16:58:41 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:58:41 user nova-compute[75245]: INFO nova.compute.manager [-] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] Took 0.69 seconds to deallocate network for instance.
Nov 29 16:58:41 user nova-compute[75245]: WARNING nova.volume.cinder [None req-707b297e-9006-4e09-a78f-0e9f8bf76ebe tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Attachment 22cc651e-66ce-4b99-bab3-b86431c11580 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 22cc651e-66ce-4b99-bab3-b86431c11580. (HTTP 404) (Request-ID: req-bd6654d7-92ec-4592-8a41-d9ccd5bcdc10)
Nov 29 16:58:41 user nova-compute[75245]: INFO nova.compute.manager [None req-707b297e-9006-4e09-a78f-0e9f8bf76ebe tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] Took 0.03 seconds to detach 1 volumes for instance.
Nov 29 16:58:41 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-707b297e-9006-4e09-a78f-0e9f8bf76ebe tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:58:41 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-707b297e-9006-4e09-a78f-0e9f8bf76ebe tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:58:41 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-707b297e-9006-4e09-a78f-0e9f8bf76ebe tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:58:41 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-707b297e-9006-4e09-a78f-0e9f8bf76ebe tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:58:41 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-707b297e-9006-4e09-a78f-0e9f8bf76ebe tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.142s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:58:42 user nova-compute[75245]: INFO nova.scheduler.client.report [None req-707b297e-9006-4e09-a78f-0e9f8bf76ebe tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Deleted allocations for instance 6b3301cf-d51f-4876-af8b-bf1802537849
Nov 29 16:58:42 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-707b297e-9006-4e09-a78f-0e9f8bf76ebe tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Lock "6b3301cf-d51f-4876-af8b-bf1802537849" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.996s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:58:42 user nova-compute[75245]: DEBUG nova.compute.manager [req-54ff8cba-67ad-4d54-9bcd-9fed0e1aac25 req-8d92cfd4-0b2b-4ab6-aa15-551910246ae5 service nova] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] Received event network-vif-plugged-e11a9af6-997c-46df-975c-def9634baef0 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:58:42 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-54ff8cba-67ad-4d54-9bcd-9fed0e1aac25 req-8d92cfd4-0b2b-4ab6-aa15-551910246ae5 service nova] Acquiring lock "6b3301cf-d51f-4876-af8b-bf1802537849-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:58:42 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-54ff8cba-67ad-4d54-9bcd-9fed0e1aac25 req-8d92cfd4-0b2b-4ab6-aa15-551910246ae5 service nova] Lock "6b3301cf-d51f-4876-af8b-bf1802537849-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:58:42 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-54ff8cba-67ad-4d54-9bcd-9fed0e1aac25 req-8d92cfd4-0b2b-4ab6-aa15-551910246ae5 service nova] Lock "6b3301cf-d51f-4876-af8b-bf1802537849-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:58:42 user nova-compute[75245]: DEBUG nova.compute.manager [req-54ff8cba-67ad-4d54-9bcd-9fed0e1aac25 req-8d92cfd4-0b2b-4ab6-aa15-551910246ae5 service nova] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] No waiting events found dispatching network-vif-plugged-e11a9af6-997c-46df-975c-def9634baef0 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:58:42 user nova-compute[75245]: WARNING nova.compute.manager [req-54ff8cba-67ad-4d54-9bcd-9fed0e1aac25 req-8d92cfd4-0b2b-4ab6-aa15-551910246ae5 service nova] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] Received unexpected event network-vif-plugged-e11a9af6-997c-46df-975c-def9634baef0 for instance with vm_state deleted and task_state None.
Nov 29 16:58:42 user nova-compute[75245]: DEBUG nova.compute.manager [req-54ff8cba-67ad-4d54-9bcd-9fed0e1aac25 req-8d92cfd4-0b2b-4ab6-aa15-551910246ae5 service nova] [instance: 6b3301cf-d51f-4876-af8b-bf1802537849] Received event network-vif-deleted-e11a9af6-997c-46df-975c-def9634baef0 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:58:42 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:58:43 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:58:45 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:58:49 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:58:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:58:52 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:58:55 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:59:00 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:59:05 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:59:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:59:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-95288975-159a-4128-a436-1e5ec646c735 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Acquiring lock "f9419b01-cd53-472d-90d1-c18f6d77660a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:59:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-95288975-159a-4128-a436-1e5ec646c735 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "f9419b01-cd53-472d-90d1-c18f6d77660a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:59:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-95288975-159a-4128-a436-1e5ec646c735 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Acquiring lock "f9419b01-cd53-472d-90d1-c18f6d77660a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:59:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-95288975-159a-4128-a436-1e5ec646c735 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "f9419b01-cd53-472d-90d1-c18f6d77660a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:59:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-95288975-159a-4128-a436-1e5ec646c735 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "f9419b01-cd53-472d-90d1-c18f6d77660a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:59:15 user nova-compute[75245]: INFO nova.compute.manager [None req-95288975-159a-4128-a436-1e5ec646c735 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] Terminating instance
Nov 29 16:59:15 user nova-compute[75245]: DEBUG nova.compute.manager [None req-95288975-159a-4128-a436-1e5ec646c735 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] Start destroying the instance on the hypervisor. {{(pid=75245) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 16:59:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:59:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:59:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:59:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:59:15 user nova-compute[75245]: DEBUG nova.compute.manager [req-14b076b2-7705-4b9e-830e-33e7a0315a31 req-4d783581-0f1a-4c08-aeff-c15ea07f89a7 service nova] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] Received event network-vif-unplugged-1fdc121e-0b9d-43ca-8bf8-9a245f0fd242 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:59:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-14b076b2-7705-4b9e-830e-33e7a0315a31 req-4d783581-0f1a-4c08-aeff-c15ea07f89a7 service nova] Acquiring lock "f9419b01-cd53-472d-90d1-c18f6d77660a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:59:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-14b076b2-7705-4b9e-830e-33e7a0315a31 req-4d783581-0f1a-4c08-aeff-c15ea07f89a7 service nova] Lock "f9419b01-cd53-472d-90d1-c18f6d77660a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:59:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-14b076b2-7705-4b9e-830e-33e7a0315a31 req-4d783581-0f1a-4c08-aeff-c15ea07f89a7 service nova] Lock "f9419b01-cd53-472d-90d1-c18f6d77660a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:59:15 user nova-compute[75245]: DEBUG nova.compute.manager [req-14b076b2-7705-4b9e-830e-33e7a0315a31 req-4d783581-0f1a-4c08-aeff-c15ea07f89a7 service nova] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] No waiting events found dispatching network-vif-unplugged-1fdc121e-0b9d-43ca-8bf8-9a245f0fd242 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:59:15 user nova-compute[75245]: DEBUG nova.compute.manager [req-14b076b2-7705-4b9e-830e-33e7a0315a31 req-4d783581-0f1a-4c08-aeff-c15ea07f89a7 service nova] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] Received event network-vif-unplugged-1fdc121e-0b9d-43ca-8bf8-9a245f0fd242 for instance with task_state deleting. {{(pid=75245) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 16:59:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:59:15 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] Instance destroyed successfully.
Nov 29 16:59:15 user nova-compute[75245]: DEBUG nova.objects.instance [None req-95288975-159a-4128-a436-1e5ec646c735 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lazy-loading 'resources' on Instance uuid f9419b01-cd53-472d-90d1-c18f6d77660a {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:59:15 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-95288975-159a-4128-a436-1e5ec646c735 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:54:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1791857789',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1791857789',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1791857789',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxCJ2uTCUFf6lX+IbGbXHbVbbnWbvJD0z4gKB8uOjmfhOEMQgHiysJutJ7Ayf246Zi0gYvhm6yoqpPUXneGJi5qT/isxLWATEMcc/kn7vRZopID6UIgIMYHVfgfyTBiaQ==',key_name='tempest-keypair-1581814899',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:54:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0907dff4e054429fa10392b730363eb2',ramdisk_id='',reservation_id='r-ptd3znx9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-181783012',owner_user_name='tempest-TestVolumeBootPattern-181783012-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:54:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2870721a7fff4cf19291f0cbfaedae81',uuid=f9419b01-cd53-472d-90d1-c18f6d77660a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1fdc121e-0b9d-43ca-8bf8-9a245f0fd242", "address": "fa:16:3e:18:2e:2f", "network": {"id": "316cb9af-807d-4a69-874e-2054520f0e5f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1421560477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0907dff4e054429fa10392b730363eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fdc121e-0b", "ovs_interfaceid": "1fdc121e-0b9d-43ca-8bf8-9a245f0fd242", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 16:59:15 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-95288975-159a-4128-a436-1e5ec646c735 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Converting VIF {"id": "1fdc121e-0b9d-43ca-8bf8-9a245f0fd242", "address": "fa:16:3e:18:2e:2f", "network": {"id": "316cb9af-807d-4a69-874e-2054520f0e5f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1421560477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0907dff4e054429fa10392b730363eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fdc121e-0b", "ovs_interfaceid": "1fdc121e-0b9d-43ca-8bf8-9a245f0fd242", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:59:15 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-95288975-159a-4128-a436-1e5ec646c735 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:18:2e:2f,bridge_name='br-int',has_traffic_filtering=True,id=1fdc121e-0b9d-43ca-8bf8-9a245f0fd242,network=Network(316cb9af-807d-4a69-874e-2054520f0e5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fdc121e-0b') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:59:15 user nova-compute[75245]: DEBUG os_vif [None req-95288975-159a-4128-a436-1e5ec646c735 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:2e:2f,bridge_name='br-int',has_traffic_filtering=True,id=1fdc121e-0b9d-43ca-8bf8-9a245f0fd242,network=Network(316cb9af-807d-4a69-874e-2054520f0e5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fdc121e-0b') {{(pid=75245) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 16:59:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:59:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1fdc121e-0b, bridge=br-int, if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:59:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:59:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:59:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:59:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6e70fd08-8be8-4826-96c9-2cc17bcce9c3) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:59:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:59:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:59:15 user nova-compute[75245]: INFO os_vif [None req-95288975-159a-4128-a436-1e5ec646c735 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:2e:2f,bridge_name='br-int',has_traffic_filtering=True,id=1fdc121e-0b9d-43ca-8bf8-9a245f0fd242,network=Network(316cb9af-807d-4a69-874e-2054520f0e5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fdc121e-0b')
Nov 29 16:59:15 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95288975-159a-4128-a436-1e5ec646c735 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] calling os-brick to detach iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 16:59:15 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-95288975-159a-4128-a436-1e5ec646c735 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, {'target_iqn': 'iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jgrAwYzR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 16:59:15 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-95288975-159a-4128-a436-1e5ec646c735 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 16:59:15 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-95288975-159a-4128-a436-1e5ec646c735 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 16:59:15 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-95288975-159a-4128-a436-1e5ec646c735 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 16:59:15 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:59:15 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:59:15 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[f98636e9-abf0-4c3b-a173-0dcc0a3f2cc0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:59:15 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-95288975-159a-4128-a436-1e5ec646c735 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 16:59:15 user nova-compute[75245]: No targets found.
Nov 29 16:59:15 user nova-compute[75245]: iSNS:
Nov 29 16:59:15 user nova-compute[75245]: No targets found.
Nov 29 16:59:15 user nova-compute[75245]: STATIC:
Nov 29 16:59:15 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7
Nov 29 16:59:15 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 16:59:15 user nova-compute[75245]:                 Iface Name: default
Nov 29 16:59:15 user nova-compute[75245]: FIRMWARE:
Nov 29 16:59:15 user nova-compute[75245]: No targets found.
Nov 29 16:59:15 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:59:15 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-95288975-159a-4128-a436-1e5ec646c735 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 16:59:15 user nova-compute[75245]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 16:59:15 user nova-compute[75245]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75245) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 16:59:15 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-95288975-159a-4128-a436-1e5ec646c735 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7', 0)] {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 16:59:15 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:59:15 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:59:15 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1bb75c6-6b15-4bb3-a2bb-2371a09761ac]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:59:15 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:59:15 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:59:15 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7dbbac-2c89-49cf-adaf-60c70d63384c]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:59:15 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-95288975-159a-4128-a436-1e5ec646c735 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7 (non-flash)
Nov 29 16:59:15 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 16:59:15 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-95288975-159a-4128-a436-1e5ec646c735 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7 (non-flash)
Nov 29 16:59:15 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 16:59:15 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-95288975-159a-4128-a436-1e5ec646c735 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0d44470b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7'): ({'sdb'}, set())}) {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 16:59:15 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-95288975-159a-4128-a436-1e5ec646c735 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Removing single pathed devices sdb {{(pid=75245) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 16:59:15 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:59:15 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:59:15 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd738bb3-a39e-4df5-a28a-403598dca34b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:59:15 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:59:15 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:59:15 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b440d05-4f6d-43f5-b773-680cadc39d06]: (4, ('ok\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:59:15 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-95288975-159a-4128-a436-1e5ec646c735 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Flushing IO for device /dev/sdb {{(pid=75245) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 16:59:15 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:59:15 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:59:15 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f8254f-52e0-41e3-bec9-57f3eb1b6522]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:59:15 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-95288975-159a-4128-a436-1e5ec646c735 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75245) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 16:59:15 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:59:15 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:59:15 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b4b1dd-f792-41fd-9ecd-62df6ea7a2f4]: (4, ('1', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:59:15 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-95288975-159a-4128-a436-1e5ec646c735 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 16:59:15 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-95288975-159a-4128-a436-1e5ec646c735 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] SCSI volumes sdb have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 16:59:16 user nova-compute[75245]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_69cf0319', '/dev/disk/by-id/scsi-23366386531616137', '/dev/disk/by-id/scsi-1SCST_BIO69cf0319-3f8e1aa760ecbc79') {{(pid=86166) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 29 16:59:16 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a17b07e-f9fa-45c3-a609-db5092c0b067]: (4, None) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:59:16 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-95288975-159a-4128-a436-1e5ec646c735 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7')] {{(pid=75245) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 16:59:16 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:59:16 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:59:16 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[b886bf81-9b15-4eb8-a5b7-d5298f6352ee]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:59:16 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-95288975-159a-4128-a436-1e5ec646c735 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:59:16 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7 -p 172.16.0.220:3260 --logout {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:59:16 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:59:16 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d2b795-f00c-4119-a67c-eb7b59806b39]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:59:16 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-95288975-159a-4128-a436-1e5ec646c735 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7, portal: 172.16.0.220,3260]
Nov 29 16:59:16 user nova-compute[75245]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7, portal: 172.16.0.220,3260] successful.
Nov 29 16:59:16 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:59:16 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7 -p 172.16.0.220:3260 --op delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:59:16 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93a66be-6371-430a-9c89-115f7750abc7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:59:16 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e1f5cd-2441-406b-8e4e-92f4e554a6d2]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 16:59:16 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-95288975-159a-4128-a436-1e5ec646c735 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 16:59:16 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-95288975-159a-4128-a436-1e5ec646c735 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 16:59:16 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-95288975-159a-4128-a436-1e5ec646c735 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] <== disconnect_volume: return (293ms) None {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 16:59:16 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95288975-159a-4128-a436-1e5ec646c735 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] Disconnected iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 16:59:16 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-95288975-159a-4128-a436-1e5ec646c735 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] Deleting instance files /opt/stack/data/nova/instances/f9419b01-cd53-472d-90d1-c18f6d77660a_del
Nov 29 16:59:16 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-95288975-159a-4128-a436-1e5ec646c735 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] Deletion of /opt/stack/data/nova/instances/f9419b01-cd53-472d-90d1-c18f6d77660a_del complete
Nov 29 16:59:16 user nova-compute[75245]: INFO nova.compute.manager [None req-95288975-159a-4128-a436-1e5ec646c735 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] Took 1.13 seconds to destroy the instance on the hypervisor.
Nov 29 16:59:16 user nova-compute[75245]: DEBUG oslo.service.loopingcall [None req-95288975-159a-4128-a436-1e5ec646c735 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75245) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 16:59:16 user nova-compute[75245]: DEBUG nova.compute.manager [-] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] Deallocating network for instance {{(pid=75245) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 16:59:16 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] deallocate_for_instance() {{(pid=75245) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 16:59:16 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:59:16 user nova-compute[75245]: INFO nova.compute.manager [-] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] Took 0.67 seconds to deallocate network for instance.
Nov 29 16:59:16 user nova-compute[75245]: DEBUG nova.compute.manager [req-e9316e9e-ef00-49b5-af48-6f591339430b req-684eb28f-aaa2-4417-aa8f-5e91f76a0576 service nova] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] Received event network-vif-deleted-1fdc121e-0b9d-43ca-8bf8-9a245f0fd242 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:59:16 user nova-compute[75245]: INFO nova.compute.manager [req-e9316e9e-ef00-49b5-af48-6f591339430b req-684eb28f-aaa2-4417-aa8f-5e91f76a0576 service nova] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] Neutron deleted interface 1fdc121e-0b9d-43ca-8bf8-9a245f0fd242; detaching it from the instance and deleting it from the info cache
Nov 29 16:59:16 user nova-compute[75245]: DEBUG nova.network.neutron [req-e9316e9e-ef00-49b5-af48-6f591339430b req-684eb28f-aaa2-4417-aa8f-5e91f76a0576 service nova] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:59:16 user nova-compute[75245]: DEBUG nova.compute.manager [req-e9316e9e-ef00-49b5-af48-6f591339430b req-684eb28f-aaa2-4417-aa8f-5e91f76a0576 service nova] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] Detach interface failed, port_id=1fdc121e-0b9d-43ca-8bf8-9a245f0fd242, reason: Instance f9419b01-cd53-472d-90d1-c18f6d77660a could not be found. {{(pid=75245) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 16:59:17 user nova-compute[75245]: DEBUG nova.compute.manager [req-4a20d1ce-2ac3-48dd-8964-338c35e58a3b req-151bd542-7e9e-498a-9a45-5c11a94040be service nova] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] Received event network-vif-plugged-1fdc121e-0b9d-43ca-8bf8-9a245f0fd242 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:59:17 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-4a20d1ce-2ac3-48dd-8964-338c35e58a3b req-151bd542-7e9e-498a-9a45-5c11a94040be service nova] Acquiring lock "f9419b01-cd53-472d-90d1-c18f6d77660a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:59:17 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-4a20d1ce-2ac3-48dd-8964-338c35e58a3b req-151bd542-7e9e-498a-9a45-5c11a94040be service nova] Lock "f9419b01-cd53-472d-90d1-c18f6d77660a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:59:17 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-4a20d1ce-2ac3-48dd-8964-338c35e58a3b req-151bd542-7e9e-498a-9a45-5c11a94040be service nova] Lock "f9419b01-cd53-472d-90d1-c18f6d77660a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:59:17 user nova-compute[75245]: DEBUG nova.compute.manager [req-4a20d1ce-2ac3-48dd-8964-338c35e58a3b req-151bd542-7e9e-498a-9a45-5c11a94040be service nova] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] No waiting events found dispatching network-vif-plugged-1fdc121e-0b9d-43ca-8bf8-9a245f0fd242 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:59:17 user nova-compute[75245]: WARNING nova.compute.manager [req-4a20d1ce-2ac3-48dd-8964-338c35e58a3b req-151bd542-7e9e-498a-9a45-5c11a94040be service nova] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] Received unexpected event network-vif-plugged-1fdc121e-0b9d-43ca-8bf8-9a245f0fd242 for instance with vm_state active and task_state deleting.
Nov 29 16:59:17 user nova-compute[75245]: INFO nova.compute.manager [None req-95288975-159a-4128-a436-1e5ec646c735 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] Took 0.74 seconds to detach 1 volumes for instance.
Nov 29 16:59:17 user nova-compute[75245]: DEBUG nova.compute.manager [None req-95288975-159a-4128-a436-1e5ec646c735 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: f9419b01-cd53-472d-90d1-c18f6d77660a] Deleting volume: e93a66be-6371-430a-9c89-115f7750abc7 {{(pid=75245) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 29 16:59:17 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-95288975-159a-4128-a436-1e5ec646c735 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:59:17 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-95288975-159a-4128-a436-1e5ec646c735 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:59:17 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-95288975-159a-4128-a436-1e5ec646c735 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:59:17 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-95288975-159a-4128-a436-1e5ec646c735 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:59:17 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-95288975-159a-4128-a436-1e5ec646c735 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.109s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:59:17 user nova-compute[75245]: INFO nova.scheduler.client.report [None req-95288975-159a-4128-a436-1e5ec646c735 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Deleted allocations for instance f9419b01-cd53-472d-90d1-c18f6d77660a
Nov 29 16:59:17 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-95288975-159a-4128-a436-1e5ec646c735 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "f9419b01-cd53-472d-90d1-c18f6d77660a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.884s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:59:20 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:59:25 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:59:29 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:59:29 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Starting heal instance info cache {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 16:59:29 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Rebuilding the list of instances to heal {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 16:59:29 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Didn't find any instances for network info cache update. {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 16:59:29 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Acquiring lock "0ade598f-a253-413d-b53e-86f762500a6a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:59:29 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Lock "0ade598f-a253-413d-b53e-86f762500a6a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:59:29 user nova-compute[75245]: DEBUG nova.compute.manager [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] Starting instance... {{(pid=75245) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 16:59:29 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:59:29 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:59:29 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75245) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 16:59:29 user nova-compute[75245]: INFO nova.compute.claims [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] Claim successful on node user
Nov 29 16:59:30 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:59:30 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:59:30 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.268s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:59:30 user nova-compute[75245]: DEBUG nova.compute.manager [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] Start building networks asynchronously for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 16:59:30 user nova-compute[75245]: DEBUG nova.compute.manager [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] Allocating IP information in the background. {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 16:59:30 user nova-compute[75245]: DEBUG nova.network.neutron [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] allocate_for_instance() {{(pid=75245) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 16:59:30 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 16:59:30 user nova-compute[75245]: DEBUG nova.compute.manager [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] Start building block device mappings for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 16:59:30 user nova-compute[75245]: DEBUG nova.policy [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3207e1ff86af4b91bef305f28848fbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3945a91aae184152ae3ad9e6307c69f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75245) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 16:59:30 user nova-compute[75245]: DEBUG nova.compute.manager [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] Start spawning the instance on the hypervisor. {{(pid=75245) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 16:59:30 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] Creating instance directory {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 16:59:30 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] Creating image(s)
Nov 29 16:59:30 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Acquiring lock "/opt/stack/data/nova/instances/0ade598f-a253-413d-b53e-86f762500a6a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:59:30 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Lock "/opt/stack/data/nova/instances/0ade598f-a253-413d-b53e-86f762500a6a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:59:30 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Lock "/opt/stack/data/nova/instances/0ade598f-a253-413d-b53e-86f762500a6a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:59:30 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:59:30 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.181s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:59:30 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Acquiring lock "d654f7206043e05d3525550b0fc885556eb999f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:59:30 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:59:30 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:59:30 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.173s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:59:30 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/0ade598f-a253-413d-b53e-86f762500a6a/disk 1073741824 {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:59:30 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/0ade598f-a253-413d-b53e-86f762500a6a/disk 1073741824" returned: 0 in 0.051s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:59:30 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:59:30 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:59:30 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:59:30 user nova-compute[75245]: DEBUG nova.network.neutron [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] Successfully created port: eb33a8e0-514c-41d7-9478-c07cccb143d0 {{(pid=75245) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 16:59:30 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.179s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:59:30 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0ade598f-a253-413d-b53e-86f762500a6a/disk. size=1073741824 {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 16:59:30 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ade598f-a253-413d-b53e-86f762500a6a/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 16:59:31 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ade598f-a253-413d-b53e-86f762500a6a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 16:59:31 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Cannot resize image /opt/stack/data/nova/instances/0ade598f-a253-413d-b53e-86f762500a6a/disk to a smaller size. {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 16:59:31 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] Created local disks {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 16:59:31 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] Ensure instance console log exists: /opt/stack/data/nova/instances/0ade598f-a253-413d-b53e-86f762500a6a/console.log {{(pid=75245) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 16:59:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:59:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:59:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:59:31 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:59:31 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:59:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:59:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:59:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:59:31 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75245) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 16:59:31 user nova-compute[75245]: DEBUG nova.network.neutron [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] Successfully updated port: eb33a8e0-514c-41d7-9478-c07cccb143d0 {{(pid=75245) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 16:59:31 user nova-compute[75245]: DEBUG nova.compute.manager [req-ba09cf30-7cbc-4295-8fc3-3e600d900da5 req-4305e4a1-e1fc-4fa8-91d8-e541b799a9eb service nova] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] Received event network-changed-eb33a8e0-514c-41d7-9478-c07cccb143d0 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:59:31 user nova-compute[75245]: DEBUG nova.compute.manager [req-ba09cf30-7cbc-4295-8fc3-3e600d900da5 req-4305e4a1-e1fc-4fa8-91d8-e541b799a9eb service nova] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] Refreshing instance network info cache due to event network-changed-eb33a8e0-514c-41d7-9478-c07cccb143d0. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 16:59:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-ba09cf30-7cbc-4295-8fc3-3e600d900da5 req-4305e4a1-e1fc-4fa8-91d8-e541b799a9eb service nova] Acquiring lock "refresh_cache-0ade598f-a253-413d-b53e-86f762500a6a" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:59:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-ba09cf30-7cbc-4295-8fc3-3e600d900da5 req-4305e4a1-e1fc-4fa8-91d8-e541b799a9eb service nova] Acquired lock "refresh_cache-0ade598f-a253-413d-b53e-86f762500a6a" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:59:31 user nova-compute[75245]: DEBUG nova.network.neutron [req-ba09cf30-7cbc-4295-8fc3-3e600d900da5 req-4305e4a1-e1fc-4fa8-91d8-e541b799a9eb service nova] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] Refreshing network info cache for port eb33a8e0-514c-41d7-9478-c07cccb143d0 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 16:59:31 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:59:31 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:59:31 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Hypervisor/Node resource view: name=user free_ram=9078MB free_disk=25.099937438964844GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75245) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 16:59:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:59:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:59:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Acquiring lock "refresh_cache-0ade598f-a253-413d-b53e-86f762500a6a" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 16:59:32 user nova-compute[75245]: DEBUG nova.network.neutron [req-ba09cf30-7cbc-4295-8fc3-3e600d900da5 req-4305e4a1-e1fc-4fa8-91d8-e541b799a9eb service nova] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] Instance cache missing network info. {{(pid=75245) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 16:59:32 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 0ade598f-a253-413d-b53e-86f762500a6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 16:59:32 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 16:59:32 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 16:59:32 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 16:59:32 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 16:59:32 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Compute_service record updated for user:user {{(pid=75245) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 16:59:32 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.205s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:59:32 user nova-compute[75245]: DEBUG nova.network.neutron [req-ba09cf30-7cbc-4295-8fc3-3e600d900da5 req-4305e4a1-e1fc-4fa8-91d8-e541b799a9eb service nova] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:59:32 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-ba09cf30-7cbc-4295-8fc3-3e600d900da5 req-4305e4a1-e1fc-4fa8-91d8-e541b799a9eb service nova] Releasing lock "refresh_cache-0ade598f-a253-413d-b53e-86f762500a6a" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:59:32 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Acquired lock "refresh_cache-0ade598f-a253-413d-b53e-86f762500a6a" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 16:59:32 user nova-compute[75245]: DEBUG nova.network.neutron [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 16:59:32 user nova-compute[75245]: DEBUG nova.network.neutron [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] Instance cache missing network info. {{(pid=75245) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 16:59:32 user nova-compute[75245]: DEBUG nova.network.neutron [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] Updating instance_info_cache with network_info: [{"id": "eb33a8e0-514c-41d7-9478-c07cccb143d0", "address": "fa:16:3e:84:4a:9d", "network": {"id": "9ac826d2-ead7-459b-8629-2c3ac5b3dc88", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1414777524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3945a91aae184152ae3ad9e6307c69f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb33a8e0-51", "ovs_interfaceid": "eb33a8e0-514c-41d7-9478-c07cccb143d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 16:59:32 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Releasing lock "refresh_cache-0ade598f-a253-413d-b53e-86f762500a6a" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 16:59:32 user nova-compute[75245]: DEBUG nova.compute.manager [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] Instance network_info: |[{"id": "eb33a8e0-514c-41d7-9478-c07cccb143d0", "address": "fa:16:3e:84:4a:9d", "network": {"id": "9ac826d2-ead7-459b-8629-2c3ac5b3dc88", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1414777524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3945a91aae184152ae3ad9e6307c69f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb33a8e0-51", "ovs_interfaceid": "eb33a8e0-514c-41d7-9478-c07cccb143d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 16:59:32 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] Start _get_guest_xml network_info=[{"id": "eb33a8e0-514c-41d7-9478-c07cccb143d0", "address": "fa:16:3e:84:4a:9d", "network": {"id": "9ac826d2-ead7-459b-8629-2c3ac5b3dc88", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1414777524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3945a91aae184152ae3ad9e6307c69f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb33a8e0-51", "ovs_interfaceid": "eb33a8e0-514c-41d7-9478-c07cccb143d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'a291d9c3-be02-4c6c-9649-4b45c5b7f487'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 16:59:32 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:59:32 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 16:59:32 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 16:59:32 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] CPU controller missing on host. {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 16:59:32 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 16:59:32 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] CPU controller found on host. {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 16:59:32 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75245) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 16:59:32 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T16:06:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 16:59:32 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Flavor limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 16:59:32 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Image limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 16:59:32 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Flavor pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 16:59:32 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Image pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 16:59:32 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 16:59:32 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 16:59:32 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 16:59:32 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Got 1 possible topologies {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 16:59:32 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 16:59:32 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 16:59:32 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:59:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1162725982',display_name='tempest-VolumesSnapshotTestJSON-instance-1162725982',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1162725982',id=48,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDapKAhFMNKdyXMDxdFKrJUb5khKTPSzUrqcZgN+TbBN4gPvOfA+NyCDtn7WomCJZheIYVXI51JLxUuMWzJctOtIweF0w70S/iRSHJtdoLypVjEQKu1m+cIJLdc72Xa8iQ==',key_name='tempest-keypair-1141465662',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3945a91aae184152ae3ad9e6307c69f2',ramdisk_id='',reservation_id='r-xdd6k8ov',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-234601790',owner_user_name='tempest-VolumesSnapshotTestJSON-234601790-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:59:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3207e1ff86af4b91bef305f28848fbdb',uuid=0ade598f-a253-413d-b53e-86f762500a6a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb33a8e0-514c-41d7-9478-c07cccb143d0", "address": "fa:16:3e:84:4a:9d", "network": {"id": "9ac826d2-ead7-459b-8629-2c3ac5b3dc88", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1414777524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3945a91aae184152ae3ad9e6307c69f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb33a8e0-51", "ovs_interfaceid": "eb33a8e0-514c-41d7-9478-c07cccb143d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 16:59:32 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Converting VIF {"id": "eb33a8e0-514c-41d7-9478-c07cccb143d0", "address": "fa:16:3e:84:4a:9d", "network": {"id": "9ac826d2-ead7-459b-8629-2c3ac5b3dc88", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1414777524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3945a91aae184152ae3ad9e6307c69f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb33a8e0-51", "ovs_interfaceid": "eb33a8e0-514c-41d7-9478-c07cccb143d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:59:32 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:4a:9d,bridge_name='br-int',has_traffic_filtering=True,id=eb33a8e0-514c-41d7-9478-c07cccb143d0,network=Network(9ac826d2-ead7-459b-8629-2c3ac5b3dc88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb33a8e0-51') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:59:32 user nova-compute[75245]: DEBUG nova.objects.instance [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Lazy-loading 'pci_devices' on Instance uuid 0ade598f-a253-413d-b53e-86f762500a6a {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 16:59:32 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] End _get_guest_xml xml=<domain type="kvm">
Nov 29 16:59:32 user nova-compute[75245]:   <uuid>0ade598f-a253-413d-b53e-86f762500a6a</uuid>
Nov 29 16:59:32 user nova-compute[75245]:   <name>instance-00000030</name>
Nov 29 16:59:32 user nova-compute[75245]:   <memory>524288</memory>
Nov 29 16:59:32 user nova-compute[75245]:   <vcpu>1</vcpu>
Nov 29 16:59:32 user nova-compute[75245]:   <metadata>
Nov 29 16:59:32 user nova-compute[75245]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 16:59:32 user nova-compute[75245]:       <nova:package version="0.0.0"/>
Nov 29 16:59:32 user nova-compute[75245]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1162725982</nova:name>
Nov 29 16:59:32 user nova-compute[75245]:       <nova:creationTime>2023-11-29 16:59:32</nova:creationTime>
Nov 29 16:59:32 user nova-compute[75245]:       <nova:flavor name="m1.tiny">
Nov 29 16:59:32 user nova-compute[75245]:         <nova:memory>512</nova:memory>
Nov 29 16:59:32 user nova-compute[75245]:         <nova:disk>1</nova:disk>
Nov 29 16:59:32 user nova-compute[75245]:         <nova:swap>0</nova:swap>
Nov 29 16:59:32 user nova-compute[75245]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 16:59:32 user nova-compute[75245]:         <nova:vcpus>1</nova:vcpus>
Nov 29 16:59:32 user nova-compute[75245]:       </nova:flavor>
Nov 29 16:59:32 user nova-compute[75245]:       <nova:owner>
Nov 29 16:59:32 user nova-compute[75245]:         <nova:user uuid="3207e1ff86af4b91bef305f28848fbdb">tempest-VolumesSnapshotTestJSON-234601790-project-member</nova:user>
Nov 29 16:59:32 user nova-compute[75245]:         <nova:project uuid="3945a91aae184152ae3ad9e6307c69f2">tempest-VolumesSnapshotTestJSON-234601790</nova:project>
Nov 29 16:59:32 user nova-compute[75245]:       </nova:owner>
Nov 29 16:59:32 user nova-compute[75245]:       <nova:root type="image" uuid="a291d9c3-be02-4c6c-9649-4b45c5b7f487"/>
Nov 29 16:59:32 user nova-compute[75245]:       <nova:ports>
Nov 29 16:59:32 user nova-compute[75245]:         <nova:port uuid="eb33a8e0-514c-41d7-9478-c07cccb143d0">
Nov 29 16:59:32 user nova-compute[75245]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 29 16:59:32 user nova-compute[75245]:         </nova:port>
Nov 29 16:59:32 user nova-compute[75245]:       </nova:ports>
Nov 29 16:59:32 user nova-compute[75245]:     </nova:instance>
Nov 29 16:59:32 user nova-compute[75245]:   </metadata>
Nov 29 16:59:32 user nova-compute[75245]:   <sysinfo type="smbios">
Nov 29 16:59:32 user nova-compute[75245]:     <system>
Nov 29 16:59:32 user nova-compute[75245]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 16:59:32 user nova-compute[75245]:       <entry name="product">OpenStack Nova</entry>
Nov 29 16:59:32 user nova-compute[75245]:       <entry name="version">0.0.0</entry>
Nov 29 16:59:32 user nova-compute[75245]:       <entry name="serial">0ade598f-a253-413d-b53e-86f762500a6a</entry>
Nov 29 16:59:32 user nova-compute[75245]:       <entry name="uuid">0ade598f-a253-413d-b53e-86f762500a6a</entry>
Nov 29 16:59:32 user nova-compute[75245]:       <entry name="family">Virtual Machine</entry>
Nov 29 16:59:32 user nova-compute[75245]:     </system>
Nov 29 16:59:32 user nova-compute[75245]:   </sysinfo>
Nov 29 16:59:32 user nova-compute[75245]:   <os>
Nov 29 16:59:32 user nova-compute[75245]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 16:59:32 user nova-compute[75245]:     <boot dev="hd"/>
Nov 29 16:59:32 user nova-compute[75245]:     <smbios mode="sysinfo"/>
Nov 29 16:59:32 user nova-compute[75245]:   </os>
Nov 29 16:59:32 user nova-compute[75245]:   <features>
Nov 29 16:59:32 user nova-compute[75245]:     <acpi/>
Nov 29 16:59:32 user nova-compute[75245]:     <apic/>
Nov 29 16:59:32 user nova-compute[75245]:     <vmcoreinfo/>
Nov 29 16:59:32 user nova-compute[75245]:   </features>
Nov 29 16:59:32 user nova-compute[75245]:   <clock offset="utc">
Nov 29 16:59:32 user nova-compute[75245]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 16:59:32 user nova-compute[75245]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 16:59:32 user nova-compute[75245]:     <timer name="hpet" present="no"/>
Nov 29 16:59:32 user nova-compute[75245]:   </clock>
Nov 29 16:59:32 user nova-compute[75245]:   <cpu mode="custom" match="exact">
Nov 29 16:59:32 user nova-compute[75245]:     <model>Nehalem</model>
Nov 29 16:59:32 user nova-compute[75245]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 16:59:32 user nova-compute[75245]:   </cpu>
Nov 29 16:59:32 user nova-compute[75245]:   <devices>
Nov 29 16:59:32 user nova-compute[75245]:     <disk type="file" device="disk">
Nov 29 16:59:32 user nova-compute[75245]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 16:59:32 user nova-compute[75245]:       <source file="/opt/stack/data/nova/instances/0ade598f-a253-413d-b53e-86f762500a6a/disk"/>
Nov 29 16:59:32 user nova-compute[75245]:       <target dev="vda" bus="virtio"/>
Nov 29 16:59:32 user nova-compute[75245]:     </disk>
Nov 29 16:59:32 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 16:59:32 user nova-compute[75245]:       <mac address="fa:16:3e:84:4a:9d"/>
Nov 29 16:59:32 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:59:32 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 16:59:32 user nova-compute[75245]:       <target dev="tapeb33a8e0-51"/>
Nov 29 16:59:32 user nova-compute[75245]:     </interface>
Nov 29 16:59:32 user nova-compute[75245]:     <serial type="pty">
Nov 29 16:59:32 user nova-compute[75245]:       <log file="/opt/stack/data/nova/instances/0ade598f-a253-413d-b53e-86f762500a6a/console.log" append="off"/>
Nov 29 16:59:32 user nova-compute[75245]:     </serial>
Nov 29 16:59:32 user nova-compute[75245]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 16:59:32 user nova-compute[75245]:     <video>
Nov 29 16:59:32 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 16:59:32 user nova-compute[75245]:     </video>
Nov 29 16:59:32 user nova-compute[75245]:     <rng model="virtio">
Nov 29 16:59:32 user nova-compute[75245]:       <backend model="random">/dev/urandom</backend>
Nov 29 16:59:32 user nova-compute[75245]:     </rng>
Nov 29 16:59:32 user nova-compute[75245]:     <controller type="usb" index="0" model="none"/>
Nov 29 16:59:32 user nova-compute[75245]:     <memballoon model="virtio">
Nov 29 16:59:32 user nova-compute[75245]:       <stats period="10"/>
Nov 29 16:59:32 user nova-compute[75245]:     </memballoon>
Nov 29 16:59:32 user nova-compute[75245]:   </devices>
Nov 29 16:59:32 user nova-compute[75245]: </domain>
Nov 29 16:59:32 user nova-compute[75245]:  {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 16:59:32 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:59:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1162725982',display_name='tempest-VolumesSnapshotTestJSON-instance-1162725982',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1162725982',id=48,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDapKAhFMNKdyXMDxdFKrJUb5khKTPSzUrqcZgN+TbBN4gPvOfA+NyCDtn7WomCJZheIYVXI51JLxUuMWzJctOtIweF0w70S/iRSHJtdoLypVjEQKu1m+cIJLdc72Xa8iQ==',key_name='tempest-keypair-1141465662',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3945a91aae184152ae3ad9e6307c69f2',ramdisk_id='',reservation_id='r-xdd6k8ov',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-234601790',owner_user_name='tempest-VolumesSnapshotTestJSON-234601790-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T16:59:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3207e1ff86af4b91bef305f28848fbdb',uuid=0ade598f-a253-413d-b53e-86f762500a6a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb33a8e0-514c-41d7-9478-c07cccb143d0", "address": "fa:16:3e:84:4a:9d", "network": {"id": "9ac826d2-ead7-459b-8629-2c3ac5b3dc88", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1414777524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3945a91aae184152ae3ad9e6307c69f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb33a8e0-51", "ovs_interfaceid": "eb33a8e0-514c-41d7-9478-c07cccb143d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 16:59:32 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Converting VIF {"id": "eb33a8e0-514c-41d7-9478-c07cccb143d0", "address": "fa:16:3e:84:4a:9d", "network": {"id": "9ac826d2-ead7-459b-8629-2c3ac5b3dc88", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1414777524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3945a91aae184152ae3ad9e6307c69f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb33a8e0-51", "ovs_interfaceid": "eb33a8e0-514c-41d7-9478-c07cccb143d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 16:59:32 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:4a:9d,bridge_name='br-int',has_traffic_filtering=True,id=eb33a8e0-514c-41d7-9478-c07cccb143d0,network=Network(9ac826d2-ead7-459b-8629-2c3ac5b3dc88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb33a8e0-51') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 16:59:32 user nova-compute[75245]: DEBUG os_vif [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:4a:9d,bridge_name='br-int',has_traffic_filtering=True,id=eb33a8e0-514c-41d7-9478-c07cccb143d0,network=Network(9ac826d2-ead7-459b-8629-2c3ac5b3dc88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb33a8e0-51') {{(pid=75245) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 16:59:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:59:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:59:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 16:59:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:59:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bec185c9-f5db-5127-a8d6-4baf4d434345', '_type': 'linux-noop'}}, row=False) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:59:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:59:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:59:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:59:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeb33a8e0-51, may_exist=True, interface_attrs={}) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:59:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeb33a8e0-51, col_values=(('qos', UUID('8db18f84-fa35-48de-a0e1-c36915265e66')),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:59:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeb33a8e0-51, col_values=(('external_ids', {'iface-id': 'eb33a8e0-514c-41d7-9478-c07cccb143d0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:4a:9d', 'vm-uuid': '0ade598f-a253-413d-b53e-86f762500a6a'}),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 16:59:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:59:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:59:32 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:59:32 user nova-compute[75245]: INFO os_vif [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:4a:9d,bridge_name='br-int',has_traffic_filtering=True,id=eb33a8e0-514c-41d7-9478-c07cccb143d0,network=Network(9ac826d2-ead7-459b-8629-2c3ac5b3dc88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb33a8e0-51')
Nov 29 16:59:32 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 16:59:32 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] No VIF found with MAC fa:16:3e:84:4a:9d, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 16:59:33 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:59:33 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:59:33 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:59:34 user nova-compute[75245]: DEBUG nova.compute.manager [req-11891698-f585-459a-a529-dfdf6c84dbc4 req-07bf52c4-e642-44b1-a018-2fce421621e5 service nova] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] Received event network-vif-plugged-eb33a8e0-514c-41d7-9478-c07cccb143d0 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:59:34 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-11891698-f585-459a-a529-dfdf6c84dbc4 req-07bf52c4-e642-44b1-a018-2fce421621e5 service nova] Acquiring lock "0ade598f-a253-413d-b53e-86f762500a6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:59:34 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-11891698-f585-459a-a529-dfdf6c84dbc4 req-07bf52c4-e642-44b1-a018-2fce421621e5 service nova] Lock "0ade598f-a253-413d-b53e-86f762500a6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:59:34 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-11891698-f585-459a-a529-dfdf6c84dbc4 req-07bf52c4-e642-44b1-a018-2fce421621e5 service nova] Lock "0ade598f-a253-413d-b53e-86f762500a6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:59:34 user nova-compute[75245]: DEBUG nova.compute.manager [req-11891698-f585-459a-a529-dfdf6c84dbc4 req-07bf52c4-e642-44b1-a018-2fce421621e5 service nova] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] No waiting events found dispatching network-vif-plugged-eb33a8e0-514c-41d7-9478-c07cccb143d0 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:59:34 user nova-compute[75245]: WARNING nova.compute.manager [req-11891698-f585-459a-a529-dfdf6c84dbc4 req-07bf52c4-e642-44b1-a018-2fce421621e5 service nova] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] Received unexpected event network-vif-plugged-eb33a8e0-514c-41d7-9478-c07cccb143d0 for instance with vm_state building and task_state spawning.
Nov 29 16:59:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:59:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:59:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:59:36 user nova-compute[75245]: DEBUG nova.compute.manager [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] Instance event wait completed in 0 seconds for  {{(pid=75245) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 16:59:36 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] Guest created on hypervisor {{(pid=75245) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 16:59:36 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] Instance spawned successfully.
Nov 29 16:59:36 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 16:59:36 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] Found default for hw_cdrom_bus of ide {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:59:36 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] Found default for hw_disk_bus of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:59:36 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] Found default for hw_input_bus of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:59:36 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] Found default for hw_pointer_model of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:59:36 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] Found default for hw_video_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:59:36 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] Found default for hw_vif_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 16:59:36 user nova-compute[75245]: DEBUG nova.compute.manager [req-92003b30-1464-4be3-8998-4e4749b13788 req-08bea8f8-cb47-442f-ad9b-5087feaa1e18 service nova] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] Received event network-vif-plugged-eb33a8e0-514c-41d7-9478-c07cccb143d0 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 16:59:36 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-92003b30-1464-4be3-8998-4e4749b13788 req-08bea8f8-cb47-442f-ad9b-5087feaa1e18 service nova] Acquiring lock "0ade598f-a253-413d-b53e-86f762500a6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 16:59:36 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-92003b30-1464-4be3-8998-4e4749b13788 req-08bea8f8-cb47-442f-ad9b-5087feaa1e18 service nova] Lock "0ade598f-a253-413d-b53e-86f762500a6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 16:59:36 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-92003b30-1464-4be3-8998-4e4749b13788 req-08bea8f8-cb47-442f-ad9b-5087feaa1e18 service nova] Lock "0ade598f-a253-413d-b53e-86f762500a6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:59:36 user nova-compute[75245]: DEBUG nova.compute.manager [req-92003b30-1464-4be3-8998-4e4749b13788 req-08bea8f8-cb47-442f-ad9b-5087feaa1e18 service nova] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] No waiting events found dispatching network-vif-plugged-eb33a8e0-514c-41d7-9478-c07cccb143d0 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 16:59:36 user nova-compute[75245]: WARNING nova.compute.manager [req-92003b30-1464-4be3-8998-4e4749b13788 req-08bea8f8-cb47-442f-ad9b-5087feaa1e18 service nova] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] Received unexpected event network-vif-plugged-eb33a8e0-514c-41d7-9478-c07cccb143d0 for instance with vm_state building and task_state spawning.
Nov 29 16:59:36 user nova-compute[75245]: INFO nova.compute.manager [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] Took 5.98 seconds to spawn the instance on the hypervisor.
Nov 29 16:59:36 user nova-compute[75245]: DEBUG nova.compute.manager [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 16:59:36 user nova-compute[75245]: INFO nova.compute.manager [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] Took 6.60 seconds to build instance.
Nov 29 16:59:36 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-32228a1b-4e67-4550-9ba0-dee693d395ef tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Lock "0ade598f-a253-413d-b53e-86f762500a6a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.722s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 16:59:37 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:59:38 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:59:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:59:40 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:59:42 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:59:42 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75245) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 16:59:42 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:59:43 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:59:44 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:59:47 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 16:59:50 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 16:59:52 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:59:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:59:57 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 16:59:59 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:00:02 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:00:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:00:07 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:00:12 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:00:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Acquiring lock "3361ab88-2331-4b23-863e-49a912bb8c25" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:00:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "3361ab88-2331-4b23-863e-49a912bb8c25" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:00:15 user nova-compute[75245]: DEBUG nova.compute.manager [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3361ab88-2331-4b23-863e-49a912bb8c25] Starting instance... {{(pid=75245) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 17:00:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:00:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:00:15 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75245) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 17:00:15 user nova-compute[75245]: INFO nova.compute.claims [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3361ab88-2331-4b23-863e-49a912bb8c25] Claim successful on node user
Nov 29 17:00:15 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 17:00:15 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 17:00:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.227s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:00:15 user nova-compute[75245]: DEBUG nova.compute.manager [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3361ab88-2331-4b23-863e-49a912bb8c25] Start building networks asynchronously for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 17:00:15 user nova-compute[75245]: DEBUG nova.compute.manager [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3361ab88-2331-4b23-863e-49a912bb8c25] Allocating IP information in the background. {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 17:00:15 user nova-compute[75245]: DEBUG nova.network.neutron [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3361ab88-2331-4b23-863e-49a912bb8c25] allocate_for_instance() {{(pid=75245) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 17:00:16 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3361ab88-2331-4b23-863e-49a912bb8c25] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 17:00:16 user nova-compute[75245]: DEBUG nova.compute.manager [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3361ab88-2331-4b23-863e-49a912bb8c25] Start building block device mappings for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 17:00:16 user nova-compute[75245]: DEBUG nova.policy [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2870721a7fff4cf19291f0cbfaedae81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907dff4e054429fa10392b730363eb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75245) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 17:00:16 user nova-compute[75245]: INFO nova.virt.block_device [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3361ab88-2331-4b23-863e-49a912bb8c25] Booting with volume 64b1f27b-9bd5-40d8-af17-c9f4ec603535 at /dev/vda
Nov 29 17:00:16 user nova-compute[75245]: DEBUG os_brick.utils [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:00:16 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:00:16 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:00:16 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[81736f4d-b3b1-4bbb-a6e8-4e1f326712d9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:69ed8ed87091\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:00:16 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:00:16 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:00:16 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[df41aaf4-6a61-48ef-9dcf-ac282b1caed5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:00:16 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:00:16 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:00:16 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[3547cb19-ecfe-48ac-904b-0fceb3824c6f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:00:16 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d39850f-6820-44a8-b100-b83b9734d966]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:00:16 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Running cmd (subprocess): nvme version {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:00:16 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] 'nvme version' failed. Not Retrying. {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 17:00:16 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.nvmeof [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] nvme not present on system {{(pid=75245) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 17:00:16 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:00:16 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 17:00:16 user nova-compute[75245]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 17:00:16 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ad1f0e-2c29-4332-87fb-301c463cf581]: (4, '') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:00:16 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75245) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 17:00:16 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 17:00:16 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] LIGHTOS: no hostnqn found. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 17:00:16 user nova-compute[75245]: DEBUG os_brick.utils [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:69ed8ed87091', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:00:16 user nova-compute[75245]: DEBUG nova.virt.block_device [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3361ab88-2331-4b23-863e-49a912bb8c25] Updating existing volume attachment record: 06d51c05-806c-400e-86d6-696fdbff57b6 {{(pid=75245) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 17:00:16 user nova-compute[75245]: DEBUG nova.network.neutron [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3361ab88-2331-4b23-863e-49a912bb8c25] Successfully created port: 0643747a-6ca5-4738-a1f2-4f26b9cf5542 {{(pid=75245) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 17:00:17 user nova-compute[75245]: DEBUG nova.network.neutron [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3361ab88-2331-4b23-863e-49a912bb8c25] Successfully updated port: 0643747a-6ca5-4738-a1f2-4f26b9cf5542 {{(pid=75245) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 17:00:17 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Acquiring lock "refresh_cache-3361ab88-2331-4b23-863e-49a912bb8c25" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:00:17 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Acquired lock "refresh_cache-3361ab88-2331-4b23-863e-49a912bb8c25" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:00:17 user nova-compute[75245]: DEBUG nova.network.neutron [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3361ab88-2331-4b23-863e-49a912bb8c25] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 17:00:17 user nova-compute[75245]: DEBUG nova.compute.manager [req-85fe3fd4-debe-484c-90f6-2f76af0a3925 req-85acd9ea-f02d-4da7-a512-3cc8aad2830c service nova] [instance: 3361ab88-2331-4b23-863e-49a912bb8c25] Received event network-changed-0643747a-6ca5-4738-a1f2-4f26b9cf5542 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:00:17 user nova-compute[75245]: DEBUG nova.compute.manager [req-85fe3fd4-debe-484c-90f6-2f76af0a3925 req-85acd9ea-f02d-4da7-a512-3cc8aad2830c service nova] [instance: 3361ab88-2331-4b23-863e-49a912bb8c25] Refreshing instance network info cache due to event network-changed-0643747a-6ca5-4738-a1f2-4f26b9cf5542. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 17:00:17 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-85fe3fd4-debe-484c-90f6-2f76af0a3925 req-85acd9ea-f02d-4da7-a512-3cc8aad2830c service nova] Acquiring lock "refresh_cache-3361ab88-2331-4b23-863e-49a912bb8c25" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:00:17 user nova-compute[75245]: DEBUG nova.network.neutron [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3361ab88-2331-4b23-863e-49a912bb8c25] Instance cache missing network info. {{(pid=75245) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 17:00:17 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:00:17 user nova-compute[75245]: DEBUG nova.network.neutron [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3361ab88-2331-4b23-863e-49a912bb8c25] Updating instance_info_cache with network_info: [{"id": "0643747a-6ca5-4738-a1f2-4f26b9cf5542", "address": "fa:16:3e:57:a5:e6", "network": {"id": "316cb9af-807d-4a69-874e-2054520f0e5f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1421560477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0907dff4e054429fa10392b730363eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0643747a-6c", "ovs_interfaceid": "0643747a-6ca5-4738-a1f2-4f26b9cf5542", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:00:17 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Releasing lock "refresh_cache-3361ab88-2331-4b23-863e-49a912bb8c25" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:00:17 user nova-compute[75245]: DEBUG nova.compute.manager [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3361ab88-2331-4b23-863e-49a912bb8c25] Instance network_info: |[{"id": "0643747a-6ca5-4738-a1f2-4f26b9cf5542", "address": "fa:16:3e:57:a5:e6", "network": {"id": "316cb9af-807d-4a69-874e-2054520f0e5f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1421560477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0907dff4e054429fa10392b730363eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0643747a-6c", "ovs_interfaceid": "0643747a-6ca5-4738-a1f2-4f26b9cf5542", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 17:00:17 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-85fe3fd4-debe-484c-90f6-2f76af0a3925 req-85acd9ea-f02d-4da7-a512-3cc8aad2830c service nova] Acquired lock "refresh_cache-3361ab88-2331-4b23-863e-49a912bb8c25" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:00:17 user nova-compute[75245]: DEBUG nova.network.neutron [req-85fe3fd4-debe-484c-90f6-2f76af0a3925 req-85acd9ea-f02d-4da7-a512-3cc8aad2830c service nova] [instance: 3361ab88-2331-4b23-863e-49a912bb8c25] Refreshing network info cache for port 0643747a-6ca5-4738-a1f2-4f26b9cf5542 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 17:00:18 user nova-compute[75245]: DEBUG nova.network.neutron [req-85fe3fd4-debe-484c-90f6-2f76af0a3925 req-85acd9ea-f02d-4da7-a512-3cc8aad2830c service nova] [instance: 3361ab88-2331-4b23-863e-49a912bb8c25] Updated VIF entry in instance network info cache for port 0643747a-6ca5-4738-a1f2-4f26b9cf5542. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 17:00:18 user nova-compute[75245]: DEBUG nova.network.neutron [req-85fe3fd4-debe-484c-90f6-2f76af0a3925 req-85acd9ea-f02d-4da7-a512-3cc8aad2830c service nova] [instance: 3361ab88-2331-4b23-863e-49a912bb8c25] Updating instance_info_cache with network_info: [{"id": "0643747a-6ca5-4738-a1f2-4f26b9cf5542", "address": "fa:16:3e:57:a5:e6", "network": {"id": "316cb9af-807d-4a69-874e-2054520f0e5f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1421560477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0907dff4e054429fa10392b730363eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0643747a-6c", "ovs_interfaceid": "0643747a-6ca5-4738-a1f2-4f26b9cf5542", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:00:18 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-85fe3fd4-debe-484c-90f6-2f76af0a3925 req-85acd9ea-f02d-4da7-a512-3cc8aad2830c service nova] Releasing lock "refresh_cache-3361ab88-2331-4b23-863e-49a912bb8c25" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:00:22 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:00:23 user nova-compute[75245]: DEBUG nova.compute.manager [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3361ab88-2331-4b23-863e-49a912bb8c25] Start spawning the instance on the hypervisor. {{(pid=75245) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 17:00:23 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3361ab88-2331-4b23-863e-49a912bb8c25] Creating instance directory {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 17:00:23 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3361ab88-2331-4b23-863e-49a912bb8c25] Creating image(s)
Nov 29 17:00:23 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3361ab88-2331-4b23-863e-49a912bb8c25] Did not create local disks {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 17:00:23 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3361ab88-2331-4b23-863e-49a912bb8c25] Ensure instance console log exists: /opt/stack/data/nova/instances/3361ab88-2331-4b23-863e-49a912bb8c25/console.log {{(pid=75245) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 17:00:23 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:00:23 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:00:23 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:00:23 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3361ab88-2331-4b23-863e-49a912bb8c25] Start _get_guest_xml network_info=[{"id": "0643747a-6ca5-4738-a1f2-4f26b9cf5542", "address": "fa:16:3e:57:a5:e6", "network": {"id": "316cb9af-807d-4a69-874e-2054520f0e5f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1421560477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0907dff4e054429fa10392b730363eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0643747a-6c", "ovs_interfaceid": "0643747a-6ca5-4738-a1f2-4f26b9cf5542", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '06d51c05-806c-400e-86d6-696fdbff57b6', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TzHCXFWr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3361ab88-2331-4b23-863e-49a912bb8c25', 'attached_at': '', 'detached_at': '', 'volume_id': '64b1f27b-9bd5-40d8-af17-c9f4ec603535', 'serial': '64b1f27b-9bd5-40d8-af17-c9f4ec603535'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'guest_format': None, 'volume_type': None} {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 17:00:23 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:00:23 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:00:23 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 17:00:23 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] CPU controller missing on host. {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 17:00:23 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 17:00:23 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] CPU controller found on host. {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 17:00:23 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75245) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 17:00:23 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T16:06:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 17:00:23 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Flavor limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 17:00:23 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Image limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 17:00:23 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Flavor pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 17:00:23 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Image pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 17:00:23 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 17:00:23 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 17:00:23 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 17:00:23 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Got 1 possible topologies {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 17:00:23 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 17:00:23 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 17:00:23 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3361ab88-2331-4b23-863e-49a912bb8c25] Calling os-brick to attach iSCSI Volume {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 17:00:23 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TzHCXFWr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:00:23 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:00:23 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:00:23 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:00:23 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:00:23 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:00:23 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:00:23 user nova-compute[75245]: INFO os_brick.initiator.connectors.iscsi [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 17:00:23 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535 -p 172.16.0.220:3260 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:00:23 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:00:23 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84c11c2-1fad-4c7b-a538-1f8b6dea544c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:00:23 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 17:00:23 user nova-compute[75245]:  {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:00:23 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535 -p 172.16.0.220:3260 --interface default --op new {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:00:23 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:00:23 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf15484f-91d3-4647-89b9-39255a7ed22d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535] added\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:00:23 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535] added
Nov 29 17:00:23 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:00:23 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:00:23 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:00:23 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[068c2ea0-6efa-4f8f-ab73-dbf4487d3ed0]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:00:23 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:00:23 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:00:23 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:00:23 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[113a8cf6-915c-4201-916d-b3616d4c11cc]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:00:23 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:00:23 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TzHCXFWr {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:00:23 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TzHCXFWr" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:00:23 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[feadb769-0143-4dcc-9b72-c8885156172b]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:00:23 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TzHCXFWr'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:00:23 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:00:23 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:00:23 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af52256-2f96-4da1-beb4-5501f0f1bc38]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:00:23 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:00:23 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:00:23 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:00:23 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[391f16cd-a6d2-47d4-b5a6-62397f4b8bcd]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:00:23 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 17:00:23 user nova-compute[75245]:  {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:00:23 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 17:00:23 user nova-compute[75245]:  {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:00:23 user nova-compute[75245]: WARNING os_brick.initiator.connectors.iscsi [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 17:00:23 user nova-compute[75245]: 
Nov 29 17:00:23 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535 -p 172.16.0.220:3260 --login {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:00:23 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:00:23 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f78a5b2-6616-4795-9b7d-ebeaf5542a41]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:00:23 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535, portal: 172.16.0.220,3260]
Nov 29 17:00:23 user nova-compute[75245]: Login to [iface: default, target: iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535, portal: 172.16.0.220,3260] successful.
Nov 29 17:00:23 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:00:23 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:00:23 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:00:23 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0debb5-f360-4faa-a360-1403e2b75959]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:00:23 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:00:23 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:00:23 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:00:23 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[90dd4cee-0f11-4414-afd5-c30596d4796b]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:00:23 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535 (non-flash)
Nov 29 17:00:23 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:00:23 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535 (non-flash)
Nov 29 17:00:23 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:00:23 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:00:23 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Connected to 172.16.0.220:3260 {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 17:00:23 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=75245) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 17:00:23 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75245) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 17:00:23 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:00:23 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:00:23 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d850bd-2435-42f3-a680-084b0e55e652]: (4, ('- - 0', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:00:23 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: None {{(pid=75245) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 17:00:24 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75245) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 17:00:24 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TzHCXFWr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 17:00:24 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.280s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:00:24 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] <== connect_volume: return (1282ms) {'type': 'block', 'scsi_wwn': '23431343336363564', 'path': '/dev/sdb'} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:00:24 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3361ab88-2331-4b23-863e-49a912bb8c25] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23431343336363564', 'path': '/dev/sdb'} {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 17:00:24 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T17:00:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-835513259',display_name='tempest-TestVolumeBootPattern-server-835513259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-835513259',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/6kahxqemcvv41mFTGeaM46NrxYZRkkk4Ze4uyAwqVYPXEaYTvEEpOxaMUDr0qjGaA6sscRII1lYPmpLMrkcup8Fj5nDL441po4R7XAC4kU9bdh8ehoEbo0Y9HtbsAfw==',key_name='tempest-TestVolumeBootPattern-280401073',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0907dff4e054429fa10392b730363eb2',ramdisk_id='',reservation_id='r-5ymemp26',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-181783012',owner_user_name='tempest-TestVolumeBootPattern-181783012-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T17:00:16Z,user_data=None,user_id='2870721a7fff4cf19291f0cbfaedae81',uuid=3361ab88-2331-4b23-863e-49a912bb8c25,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0643747a-6ca5-4738-a1f2-4f26b9cf5542", "address": "fa:16:3e:57:a5:e6", "network": {"id": "316cb9af-807d-4a69-874e-2054520f0e5f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1421560477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0907dff4e054429fa10392b730363eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0643747a-6c", "ovs_interfaceid": "0643747a-6ca5-4738-a1f2-4f26b9cf5542", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 17:00:24 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Converting VIF {"id": "0643747a-6ca5-4738-a1f2-4f26b9cf5542", "address": "fa:16:3e:57:a5:e6", "network": {"id": "316cb9af-807d-4a69-874e-2054520f0e5f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1421560477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0907dff4e054429fa10392b730363eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0643747a-6c", "ovs_interfaceid": "0643747a-6ca5-4738-a1f2-4f26b9cf5542", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:00:24 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:a5:e6,bridge_name='br-int',has_traffic_filtering=True,id=0643747a-6ca5-4738-a1f2-4f26b9cf5542,network=Network(316cb9af-807d-4a69-874e-2054520f0e5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0643747a-6c') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:00:24 user nova-compute[75245]: DEBUG nova.objects.instance [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lazy-loading 'pci_devices' on Instance uuid 3361ab88-2331-4b23-863e-49a912bb8c25 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:00:24 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3361ab88-2331-4b23-863e-49a912bb8c25] End _get_guest_xml xml=<domain type="kvm">
Nov 29 17:00:24 user nova-compute[75245]:   <uuid>3361ab88-2331-4b23-863e-49a912bb8c25</uuid>
Nov 29 17:00:24 user nova-compute[75245]:   <name>instance-00000031</name>
Nov 29 17:00:24 user nova-compute[75245]:   <memory>524288</memory>
Nov 29 17:00:24 user nova-compute[75245]:   <vcpu>1</vcpu>
Nov 29 17:00:24 user nova-compute[75245]:   <metadata>
Nov 29 17:00:24 user nova-compute[75245]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 17:00:24 user nova-compute[75245]:       <nova:package version="0.0.0"/>
Nov 29 17:00:24 user nova-compute[75245]:       <nova:name>tempest-TestVolumeBootPattern-server-835513259</nova:name>
Nov 29 17:00:24 user nova-compute[75245]:       <nova:creationTime>2023-11-29 17:00:23</nova:creationTime>
Nov 29 17:00:24 user nova-compute[75245]:       <nova:flavor name="m1.tiny">
Nov 29 17:00:24 user nova-compute[75245]:         <nova:memory>512</nova:memory>
Nov 29 17:00:24 user nova-compute[75245]:         <nova:disk>1</nova:disk>
Nov 29 17:00:24 user nova-compute[75245]:         <nova:swap>0</nova:swap>
Nov 29 17:00:24 user nova-compute[75245]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 17:00:24 user nova-compute[75245]:         <nova:vcpus>1</nova:vcpus>
Nov 29 17:00:24 user nova-compute[75245]:       </nova:flavor>
Nov 29 17:00:24 user nova-compute[75245]:       <nova:owner>
Nov 29 17:00:24 user nova-compute[75245]:         <nova:user uuid="2870721a7fff4cf19291f0cbfaedae81">tempest-TestVolumeBootPattern-181783012-project-member</nova:user>
Nov 29 17:00:24 user nova-compute[75245]:         <nova:project uuid="0907dff4e054429fa10392b730363eb2">tempest-TestVolumeBootPattern-181783012</nova:project>
Nov 29 17:00:24 user nova-compute[75245]:       </nova:owner>
Nov 29 17:00:24 user nova-compute[75245]:       <nova:ports>
Nov 29 17:00:24 user nova-compute[75245]:         <nova:port uuid="0643747a-6ca5-4738-a1f2-4f26b9cf5542">
Nov 29 17:00:24 user nova-compute[75245]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 17:00:24 user nova-compute[75245]:         </nova:port>
Nov 29 17:00:24 user nova-compute[75245]:       </nova:ports>
Nov 29 17:00:24 user nova-compute[75245]:     </nova:instance>
Nov 29 17:00:24 user nova-compute[75245]:   </metadata>
Nov 29 17:00:24 user nova-compute[75245]:   <sysinfo type="smbios">
Nov 29 17:00:24 user nova-compute[75245]:     <system>
Nov 29 17:00:24 user nova-compute[75245]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 17:00:24 user nova-compute[75245]:       <entry name="product">OpenStack Nova</entry>
Nov 29 17:00:24 user nova-compute[75245]:       <entry name="version">0.0.0</entry>
Nov 29 17:00:24 user nova-compute[75245]:       <entry name="serial">3361ab88-2331-4b23-863e-49a912bb8c25</entry>
Nov 29 17:00:24 user nova-compute[75245]:       <entry name="uuid">3361ab88-2331-4b23-863e-49a912bb8c25</entry>
Nov 29 17:00:24 user nova-compute[75245]:       <entry name="family">Virtual Machine</entry>
Nov 29 17:00:24 user nova-compute[75245]:     </system>
Nov 29 17:00:24 user nova-compute[75245]:   </sysinfo>
Nov 29 17:00:24 user nova-compute[75245]:   <os>
Nov 29 17:00:24 user nova-compute[75245]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 17:00:24 user nova-compute[75245]:     <boot dev="hd"/>
Nov 29 17:00:24 user nova-compute[75245]:     <smbios mode="sysinfo"/>
Nov 29 17:00:24 user nova-compute[75245]:   </os>
Nov 29 17:00:24 user nova-compute[75245]:   <features>
Nov 29 17:00:24 user nova-compute[75245]:     <acpi/>
Nov 29 17:00:24 user nova-compute[75245]:     <apic/>
Nov 29 17:00:24 user nova-compute[75245]:     <vmcoreinfo/>
Nov 29 17:00:24 user nova-compute[75245]:   </features>
Nov 29 17:00:24 user nova-compute[75245]:   <clock offset="utc">
Nov 29 17:00:24 user nova-compute[75245]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 17:00:24 user nova-compute[75245]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 17:00:24 user nova-compute[75245]:     <timer name="hpet" present="no"/>
Nov 29 17:00:24 user nova-compute[75245]:   </clock>
Nov 29 17:00:24 user nova-compute[75245]:   <cpu mode="custom" match="exact">
Nov 29 17:00:24 user nova-compute[75245]:     <model>Nehalem</model>
Nov 29 17:00:24 user nova-compute[75245]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 17:00:24 user nova-compute[75245]:   </cpu>
Nov 29 17:00:24 user nova-compute[75245]:   <devices>
Nov 29 17:00:24 user nova-compute[75245]:     <disk type="block" device="disk">
Nov 29 17:00:24 user nova-compute[75245]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 17:00:24 user nova-compute[75245]:       <source dev="/dev/sdb"/>
Nov 29 17:00:24 user nova-compute[75245]:       <target dev="vda" bus="virtio"/>
Nov 29 17:00:24 user nova-compute[75245]:       <serial>64b1f27b-9bd5-40d8-af17-c9f4ec603535</serial>
Nov 29 17:00:24 user nova-compute[75245]:     </disk>
Nov 29 17:00:24 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 17:00:24 user nova-compute[75245]:       <mac address="fa:16:3e:57:a5:e6"/>
Nov 29 17:00:24 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 17:00:24 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 17:00:24 user nova-compute[75245]:       <target dev="tap0643747a-6c"/>
Nov 29 17:00:24 user nova-compute[75245]:     </interface>
Nov 29 17:00:24 user nova-compute[75245]:     <serial type="pty">
Nov 29 17:00:24 user nova-compute[75245]:       <log file="/opt/stack/data/nova/instances/3361ab88-2331-4b23-863e-49a912bb8c25/console.log" append="off"/>
Nov 29 17:00:24 user nova-compute[75245]:     </serial>
Nov 29 17:00:24 user nova-compute[75245]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 17:00:24 user nova-compute[75245]:     <video>
Nov 29 17:00:24 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 17:00:24 user nova-compute[75245]:     </video>
Nov 29 17:00:24 user nova-compute[75245]:     <rng model="virtio">
Nov 29 17:00:24 user nova-compute[75245]:       <backend model="random">/dev/urandom</backend>
Nov 29 17:00:24 user nova-compute[75245]:     </rng>
Nov 29 17:00:24 user nova-compute[75245]:     <controller type="usb" index="0" model="none"/>
Nov 29 17:00:24 user nova-compute[75245]:     <memballoon model="virtio">
Nov 29 17:00:24 user nova-compute[75245]:       <stats period="10"/>
Nov 29 17:00:24 user nova-compute[75245]:     </memballoon>
Nov 29 17:00:24 user nova-compute[75245]:   </devices>
Nov 29 17:00:24 user nova-compute[75245]: </domain>
Nov 29 17:00:24 user nova-compute[75245]:  {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 17:00:24 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T17:00:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-835513259',display_name='tempest-TestVolumeBootPattern-server-835513259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-835513259',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/6kahxqemcvv41mFTGeaM46NrxYZRkkk4Ze4uyAwqVYPXEaYTvEEpOxaMUDr0qjGaA6sscRII1lYPmpLMrkcup8Fj5nDL441po4R7XAC4kU9bdh8ehoEbo0Y9HtbsAfw==',key_name='tempest-TestVolumeBootPattern-280401073',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0907dff4e054429fa10392b730363eb2',ramdisk_id='',reservation_id='r-5ymemp26',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-181783012',owner_user_name='tempest-TestVolumeBootPattern-181783012-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T17:00:16Z,user_data=None,user_id='2870721a7fff4cf19291f0cbfaedae81',uuid=3361ab88-2331-4b23-863e-49a912bb8c25,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0643747a-6ca5-4738-a1f2-4f26b9cf5542", "address": "fa:16:3e:57:a5:e6", "network": {"id": "316cb9af-807d-4a69-874e-2054520f0e5f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1421560477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0907dff4e054429fa10392b730363eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0643747a-6c", "ovs_interfaceid": "0643747a-6ca5-4738-a1f2-4f26b9cf5542", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 17:00:24 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Converting VIF {"id": "0643747a-6ca5-4738-a1f2-4f26b9cf5542", "address": "fa:16:3e:57:a5:e6", "network": {"id": "316cb9af-807d-4a69-874e-2054520f0e5f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1421560477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0907dff4e054429fa10392b730363eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0643747a-6c", "ovs_interfaceid": "0643747a-6ca5-4738-a1f2-4f26b9cf5542", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:00:24 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:a5:e6,bridge_name='br-int',has_traffic_filtering=True,id=0643747a-6ca5-4738-a1f2-4f26b9cf5542,network=Network(316cb9af-807d-4a69-874e-2054520f0e5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0643747a-6c') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:00:24 user nova-compute[75245]: DEBUG os_vif [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:a5:e6,bridge_name='br-int',has_traffic_filtering=True,id=0643747a-6ca5-4738-a1f2-4f26b9cf5542,network=Network(316cb9af-807d-4a69-874e-2054520f0e5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0643747a-6c') {{(pid=75245) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 17:00:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:00:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:00:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 17:00:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:00:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c04045d1-6ab6-5b45-af6c-79568a211cac', '_type': 'linux-noop'}}, row=False) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:00:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:00:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:00:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0643747a-6c, may_exist=True, interface_attrs={}) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:00:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0643747a-6c, col_values=(('qos', UUID('ed06e1cb-635e-44fb-b84e-8be8b9a6f27c')),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:00:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0643747a-6c, col_values=(('external_ids', {'iface-id': '0643747a-6ca5-4738-a1f2-4f26b9cf5542', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:a5:e6', 'vm-uuid': '3361ab88-2331-4b23-863e-49a912bb8c25'}),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:00:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:00:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:00:24 user nova-compute[75245]: INFO os_vif [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:a5:e6,bridge_name='br-int',has_traffic_filtering=True,id=0643747a-6ca5-4738-a1f2-4f26b9cf5542,network=Network(316cb9af-807d-4a69-874e-2054520f0e5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0643747a-6c')
Nov 29 17:00:24 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 17:00:24 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] No VIF found with MAC fa:16:3e:57:a5:e6, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 17:00:25 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:00:25 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:00:25 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:00:26 user nova-compute[75245]: DEBUG nova.compute.manager [req-425ff450-0869-45a6-93f2-be1a7c208d18 req-bca8669a-00a7-423b-8684-ebde3385a587 service nova] [instance: 3361ab88-2331-4b23-863e-49a912bb8c25] Received event network-vif-plugged-0643747a-6ca5-4738-a1f2-4f26b9cf5542 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:00:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-425ff450-0869-45a6-93f2-be1a7c208d18 req-bca8669a-00a7-423b-8684-ebde3385a587 service nova] Acquiring lock "3361ab88-2331-4b23-863e-49a912bb8c25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:00:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-425ff450-0869-45a6-93f2-be1a7c208d18 req-bca8669a-00a7-423b-8684-ebde3385a587 service nova] Lock "3361ab88-2331-4b23-863e-49a912bb8c25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:00:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-425ff450-0869-45a6-93f2-be1a7c208d18 req-bca8669a-00a7-423b-8684-ebde3385a587 service nova] Lock "3361ab88-2331-4b23-863e-49a912bb8c25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:00:26 user nova-compute[75245]: DEBUG nova.compute.manager [req-425ff450-0869-45a6-93f2-be1a7c208d18 req-bca8669a-00a7-423b-8684-ebde3385a587 service nova] [instance: 3361ab88-2331-4b23-863e-49a912bb8c25] No waiting events found dispatching network-vif-plugged-0643747a-6ca5-4738-a1f2-4f26b9cf5542 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:00:26 user nova-compute[75245]: WARNING nova.compute.manager [req-425ff450-0869-45a6-93f2-be1a7c208d18 req-bca8669a-00a7-423b-8684-ebde3385a587 service nova] [instance: 3361ab88-2331-4b23-863e-49a912bb8c25] Received unexpected event network-vif-plugged-0643747a-6ca5-4738-a1f2-4f26b9cf5542 for instance with vm_state building and task_state spawning.
Nov 29 17:00:26 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:00:26 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:00:28 user nova-compute[75245]: DEBUG nova.compute.manager [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3361ab88-2331-4b23-863e-49a912bb8c25] Instance event wait completed in 0 seconds for  {{(pid=75245) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 17:00:28 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3361ab88-2331-4b23-863e-49a912bb8c25] Guest created on hypervisor {{(pid=75245) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 17:00:28 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 3361ab88-2331-4b23-863e-49a912bb8c25] Instance spawned successfully.
Nov 29 17:00:28 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3361ab88-2331-4b23-863e-49a912bb8c25] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 17:00:28 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3361ab88-2331-4b23-863e-49a912bb8c25] Found default for hw_cdrom_bus of ide {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:00:28 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3361ab88-2331-4b23-863e-49a912bb8c25] Found default for hw_disk_bus of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:00:28 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3361ab88-2331-4b23-863e-49a912bb8c25] Found default for hw_input_bus of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:00:28 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3361ab88-2331-4b23-863e-49a912bb8c25] Found default for hw_pointer_model of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:00:28 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3361ab88-2331-4b23-863e-49a912bb8c25] Found default for hw_video_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:00:28 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3361ab88-2331-4b23-863e-49a912bb8c25] Found default for hw_vif_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:00:28 user nova-compute[75245]: INFO nova.compute.manager [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3361ab88-2331-4b23-863e-49a912bb8c25] Took 4.97 seconds to spawn the instance on the hypervisor.
Nov 29 17:00:28 user nova-compute[75245]: DEBUG nova.compute.manager [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3361ab88-2331-4b23-863e-49a912bb8c25] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 17:00:28 user nova-compute[75245]: DEBUG nova.compute.manager [req-01491e6b-5319-437a-8423-579ef6cb9726 req-46c2207d-a6a6-4951-ad3d-49f2e7bfd82c service nova] [instance: 3361ab88-2331-4b23-863e-49a912bb8c25] Received event network-vif-plugged-0643747a-6ca5-4738-a1f2-4f26b9cf5542 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:00:28 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-01491e6b-5319-437a-8423-579ef6cb9726 req-46c2207d-a6a6-4951-ad3d-49f2e7bfd82c service nova] Acquiring lock "3361ab88-2331-4b23-863e-49a912bb8c25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:00:28 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-01491e6b-5319-437a-8423-579ef6cb9726 req-46c2207d-a6a6-4951-ad3d-49f2e7bfd82c service nova] Lock "3361ab88-2331-4b23-863e-49a912bb8c25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:00:28 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-01491e6b-5319-437a-8423-579ef6cb9726 req-46c2207d-a6a6-4951-ad3d-49f2e7bfd82c service nova] Lock "3361ab88-2331-4b23-863e-49a912bb8c25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:00:28 user nova-compute[75245]: DEBUG nova.compute.manager [req-01491e6b-5319-437a-8423-579ef6cb9726 req-46c2207d-a6a6-4951-ad3d-49f2e7bfd82c service nova] [instance: 3361ab88-2331-4b23-863e-49a912bb8c25] No waiting events found dispatching network-vif-plugged-0643747a-6ca5-4738-a1f2-4f26b9cf5542 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:00:28 user nova-compute[75245]: WARNING nova.compute.manager [req-01491e6b-5319-437a-8423-579ef6cb9726 req-46c2207d-a6a6-4951-ad3d-49f2e7bfd82c service nova] [instance: 3361ab88-2331-4b23-863e-49a912bb8c25] Received unexpected event network-vif-plugged-0643747a-6ca5-4738-a1f2-4f26b9cf5542 for instance with vm_state building and task_state spawning.
Nov 29 17:00:28 user nova-compute[75245]: INFO nova.compute.manager [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3361ab88-2331-4b23-863e-49a912bb8c25] Took 12.64 seconds to build instance.
Nov 29 17:00:28 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-985c67bd-a812-4fe6-bcc1-61ab0c4a7384 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "3361ab88-2331-4b23-863e-49a912bb8c25" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.727s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:00:29 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:00:29 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:00:31 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:00:31 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Starting heal instance info cache {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 17:00:31 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Rebuilding the list of instances to heal {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 17:00:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "refresh_cache-0ade598f-a253-413d-b53e-86f762500a6a" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:00:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquired lock "refresh_cache-0ade598f-a253-413d-b53e-86f762500a6a" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:00:31 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] Forcefully refreshing network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 17:00:31 user nova-compute[75245]: DEBUG nova.objects.instance [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lazy-loading 'info_cache' on Instance uuid 0ade598f-a253-413d-b53e-86f762500a6a {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:00:31 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] Updating instance_info_cache with network_info: [{"id": "eb33a8e0-514c-41d7-9478-c07cccb143d0", "address": "fa:16:3e:84:4a:9d", "network": {"id": "9ac826d2-ead7-459b-8629-2c3ac5b3dc88", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1414777524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3945a91aae184152ae3ad9e6307c69f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb33a8e0-51", "ovs_interfaceid": "eb33a8e0-514c-41d7-9478-c07cccb143d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:00:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Releasing lock "refresh_cache-0ade598f-a253-413d-b53e-86f762500a6a" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:00:31 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] Updated the network info_cache for instance {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 17:00:33 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:00:33 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:00:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:00:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:00:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:00:33 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75245) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 17:00:33 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ade598f-a253-413d-b53e-86f762500a6a/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:00:33 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ade598f-a253-413d-b53e-86f762500a6a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:00:33 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ade598f-a253-413d-b53e-86f762500a6a/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:00:33 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ade598f-a253-413d-b53e-86f762500a6a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:00:33 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 17:00:34 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:00:34 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:00:34 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Hypervisor/Node resource view: name=user free_ram=8872MB free_disk=25.06926727294922GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75245) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 17:00:34 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:00:34 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:00:34 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 0ade598f-a253-413d-b53e-86f762500a6a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:00:34 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 3361ab88-2331-4b23-863e-49a912bb8c25 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:00:34 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 17:00:34 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 17:00:34 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 17:00:34 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 17:00:34 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Compute_service record updated for user:user {{(pid=75245) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 17:00:34 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.214s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:00:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:00:38 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:00:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:00:40 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:00:43 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:00:43 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:00:43 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75245) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 17:00:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:00:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:00:46 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:00:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:00:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:00:50 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:00:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:00:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:00:56 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:00:59 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:00:59 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:01:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:01:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:01:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75245) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 17:01:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 17:01:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 17:01:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:01:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:01:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:01:19 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:01:20 user nova-compute[75245]: DEBUG nova.compute.manager [req-0fe1696a-b4bc-4625-ac20-7c40f51caaeb req-62615383-2d93-4eab-8fb3-3ed7e3ba1df1 service nova] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] Received event network-changed-eb33a8e0-514c-41d7-9478-c07cccb143d0 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:01:20 user nova-compute[75245]: DEBUG nova.compute.manager [req-0fe1696a-b4bc-4625-ac20-7c40f51caaeb req-62615383-2d93-4eab-8fb3-3ed7e3ba1df1 service nova] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] Refreshing instance network info cache due to event network-changed-eb33a8e0-514c-41d7-9478-c07cccb143d0. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 17:01:20 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-0fe1696a-b4bc-4625-ac20-7c40f51caaeb req-62615383-2d93-4eab-8fb3-3ed7e3ba1df1 service nova] Acquiring lock "refresh_cache-0ade598f-a253-413d-b53e-86f762500a6a" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:01:20 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-0fe1696a-b4bc-4625-ac20-7c40f51caaeb req-62615383-2d93-4eab-8fb3-3ed7e3ba1df1 service nova] Acquired lock "refresh_cache-0ade598f-a253-413d-b53e-86f762500a6a" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:01:20 user nova-compute[75245]: DEBUG nova.network.neutron [req-0fe1696a-b4bc-4625-ac20-7c40f51caaeb req-62615383-2d93-4eab-8fb3-3ed7e3ba1df1 service nova] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] Refreshing network info cache for port eb33a8e0-514c-41d7-9478-c07cccb143d0 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 17:01:20 user nova-compute[75245]: DEBUG nova.network.neutron [req-0fe1696a-b4bc-4625-ac20-7c40f51caaeb req-62615383-2d93-4eab-8fb3-3ed7e3ba1df1 service nova] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] Updated VIF entry in instance network info cache for port eb33a8e0-514c-41d7-9478-c07cccb143d0. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 17:01:20 user nova-compute[75245]: DEBUG nova.network.neutron [req-0fe1696a-b4bc-4625-ac20-7c40f51caaeb req-62615383-2d93-4eab-8fb3-3ed7e3ba1df1 service nova] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] Updating instance_info_cache with network_info: [{"id": "eb33a8e0-514c-41d7-9478-c07cccb143d0", "address": "fa:16:3e:84:4a:9d", "network": {"id": "9ac826d2-ead7-459b-8629-2c3ac5b3dc88", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1414777524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3945a91aae184152ae3ad9e6307c69f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb33a8e0-51", "ovs_interfaceid": "eb33a8e0-514c-41d7-9478-c07cccb143d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:01:20 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-0fe1696a-b4bc-4625-ac20-7c40f51caaeb req-62615383-2d93-4eab-8fb3-3ed7e3ba1df1 service nova] Releasing lock "refresh_cache-0ade598f-a253-413d-b53e-86f762500a6a" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:01:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3680d746-89db-41db-b314-56bf28a99f4f tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Acquiring lock "0ade598f-a253-413d-b53e-86f762500a6a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:01:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3680d746-89db-41db-b314-56bf28a99f4f tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Lock "0ade598f-a253-413d-b53e-86f762500a6a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:01:21 user nova-compute[75245]: DEBUG nova.objects.instance [None req-3680d746-89db-41db-b314-56bf28a99f4f tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Lazy-loading 'flavor' on Instance uuid 0ade598f-a253-413d-b53e-86f762500a6a {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:01:21 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-3680d746-89db-41db-b314-56bf28a99f4f tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] Ignoring supplied device name: /dev/vdb
Nov 29 17:01:21 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3680d746-89db-41db-b314-56bf28a99f4f tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Lock "0ade598f-a253-413d-b53e-86f762500a6a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:01:22 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3680d746-89db-41db-b314-56bf28a99f4f tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Acquiring lock "0ade598f-a253-413d-b53e-86f762500a6a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:01:22 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3680d746-89db-41db-b314-56bf28a99f4f tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Lock "0ade598f-a253-413d-b53e-86f762500a6a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:01:22 user nova-compute[75245]: INFO nova.compute.manager [None req-3680d746-89db-41db-b314-56bf28a99f4f tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] Attaching volume 1870a760-f9d2-4089-b7cf-106f9d3c381c to /dev/vdb
Nov 29 17:01:22 user nova-compute[75245]: DEBUG os_brick.utils [None req-3680d746-89db-41db-b314-56bf28a99f4f tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:01:22 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:01:22 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:01:22 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[e302f897-e3f2-48de-9829-052868a1790e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:69ed8ed87091\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:01:22 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:01:22 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:01:22 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[630d919f-b31d-49e3-b57e-c7ce796f091b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:01:22 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:01:22 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:01:22 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0bc3634-a95a-4b38-b86c-dddaff487656]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:01:22 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c7119f-0dbf-448f-8ddd-8cf7818aa794]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:01:22 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-3680d746-89db-41db-b314-56bf28a99f4f tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Running cmd (subprocess): nvme version {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:01:22 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-3680d746-89db-41db-b314-56bf28a99f4f tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] 'nvme version' failed. Not Retrying. {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 17:01:22 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3680d746-89db-41db-b314-56bf28a99f4f tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] nvme not present on system {{(pid=75245) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 17:01:22 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:01:22 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 17:01:22 user nova-compute[75245]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 17:01:22 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf865e4a-16d1-451a-8970-c8c2eb0a94af]: (4, '') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:01:22 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-3680d746-89db-41db-b314-56bf28a99f4f tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75245) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 17:01:22 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-3680d746-89db-41db-b314-56bf28a99f4f tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 17:01:22 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-3680d746-89db-41db-b314-56bf28a99f4f tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] LIGHTOS: no hostnqn found. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 17:01:22 user nova-compute[75245]: DEBUG os_brick.utils [None req-3680d746-89db-41db-b314-56bf28a99f4f tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:69ed8ed87091', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:01:22 user nova-compute[75245]: DEBUG nova.virt.block_device [None req-3680d746-89db-41db-b314-56bf28a99f4f tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] Updating existing volume attachment record: 4d650114-3720-4742-a21b-db1f1fc86000 {{(pid=75245) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 17:01:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:01:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:01:29 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:01:29 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:01:29 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3680d746-89db-41db-b314-56bf28a99f4f tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] Calling os-brick to attach iSCSI Volume {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 17:01:29 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-3680d746-89db-41db-b314-56bf28a99f4f tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1870a760-f9d2-4089-b7cf-106f9d3c381c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tarlsicw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:01:29 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-3680d746-89db-41db-b314-56bf28a99f4f tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:01:29 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-3680d746-89db-41db-b314-56bf28a99f4f tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:01:29 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-3680d746-89db-41db-b314-56bf28a99f4f tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:01:29 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-3680d746-89db-41db-b314-56bf28a99f4f tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:01:29 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-3680d746-89db-41db-b314-56bf28a99f4f tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1870a760-f9d2-4089-b7cf-106f9d3c381c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:01:29 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-3680d746-89db-41db-b314-56bf28a99f4f tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1870a760-f9d2-4089-b7cf-106f9d3c381c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:01:29 user nova-compute[75245]: INFO os_brick.initiator.connectors.iscsi [None req-3680d746-89db-41db-b314-56bf28a99f4f tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 17:01:29 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1870a760-f9d2-4089-b7cf-106f9d3c381c -p 172.16.0.220:3260 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:01:29 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1870a760-f9d2-4089-b7cf-106f9d3c381c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:01:29 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff462fb-b77b-4d72-ae9d-5b7ba4ce235f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:01:29 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-3680d746-89db-41db-b314-56bf28a99f4f tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 17:01:29 user nova-compute[75245]:  {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:01:29 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1870a760-f9d2-4089-b7cf-106f9d3c381c -p 172.16.0.220:3260 --interface default --op new {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:01:30 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1870a760-f9d2-4089-b7cf-106f9d3c381c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:01:30 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace34c9b-4942-49b0-aee4-eaeedff4b8ef]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1870a760-f9d2-4089-b7cf-106f9d3c381c] added\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:01:30 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-3680d746-89db-41db-b314-56bf28a99f4f tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1870a760-f9d2-4089-b7cf-106f9d3c381c] added
Nov 29 17:01:30 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:01:30 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1870a760-f9d2-4089-b7cf-106f9d3c381c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:01:30 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1870a760-f9d2-4089-b7cf-106f9d3c381c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:01:30 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa809563-1d7f-4eae-9ee7-d090af152dba]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:01:30 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-3680d746-89db-41db-b314-56bf28a99f4f tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:01:30 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1870a760-f9d2-4089-b7cf-106f9d3c381c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:01:30 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1870a760-f9d2-4089-b7cf-106f9d3c381c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:01:30 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[63fa86e3-ff48-4b21-a62d-d0e39b59e1d5]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:01:30 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-3680d746-89db-41db-b314-56bf28a99f4f tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:01:30 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1870a760-f9d2-4089-b7cf-106f9d3c381c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tarlsicw {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:01:30 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1870a760-f9d2-4089-b7cf-106f9d3c381c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tarlsicw" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:01:30 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[594a257c-e7b2-4abf-9fdd-4837615233b2]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:01:30 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-3680d746-89db-41db-b314-56bf28a99f4f tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tarlsicw'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:01:30 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1870a760-f9d2-4089-b7cf-106f9d3c381c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:01:30 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1870a760-f9d2-4089-b7cf-106f9d3c381c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:01:30 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc96f11-98b4-4582-b2a8-625e4a9b066f]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:01:30 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-3680d746-89db-41db-b314-56bf28a99f4f tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:01:30 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:01:30 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:01:30 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a21885-9e81-4f90-b980-abae4d8e0234]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:01:30 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-3680d746-89db-41db-b314-56bf28a99f4f tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535 (non-flash)
Nov 29 17:01:30 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:01:30 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-3680d746-89db-41db-b314-56bf28a99f4f tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535 (non-flash)
Nov 29 17:01:30 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:01:30 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1870a760-f9d2-4089-b7cf-106f9d3c381c -p 172.16.0.220:3260 --login {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:01:30 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1870a760-f9d2-4089-b7cf-106f9d3c381c -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:01:30 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0fe4fb7-b385-4802-a802-f3ca7dd21f59]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1870a760-f9d2-4089-b7cf-106f9d3c381c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1870a760-f9d2-4089-b7cf-106f9d3c381c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:01:30 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-3680d746-89db-41db-b314-56bf28a99f4f tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1870a760-f9d2-4089-b7cf-106f9d3c381c, portal: 172.16.0.220,3260]
Nov 29 17:01:30 user nova-compute[75245]: Login to [iface: default, target: iqn.2010-10.org.openstack:1870a760-f9d2-4089-b7cf-106f9d3c381c, portal: 172.16.0.220,3260] successful.
Nov 29 17:01:30 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:01:30 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1870a760-f9d2-4089-b7cf-106f9d3c381c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:01:30 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1870a760-f9d2-4089-b7cf-106f9d3c381c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:01:30 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a66f15-bc33-47f7-9fd9-61d20a816093]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:01:30 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-3680d746-89db-41db-b314-56bf28a99f4f tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:01:30 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:01:30 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:01:30 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[b323a787-6ad8-4356-a27c-8fc947a28e4d]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1870a760-f9d2-4089-b7cf-106f9d3c381c (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:01:30 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-3680d746-89db-41db-b314-56bf28a99f4f tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535 (non-flash)
Nov 29 17:01:30 user nova-compute[75245]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1870a760-f9d2-4089-b7cf-106f9d3c381c (non-flash)
Nov 29 17:01:30 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:01:30 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-3680d746-89db-41db-b314-56bf28a99f4f tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535 (non-flash)
Nov 29 17:01:30 user nova-compute[75245]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1870a760-f9d2-4089-b7cf-106f9d3c381c (non-flash)
Nov 29 17:01:30 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:01:30 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-3680d746-89db-41db-b314-56bf28a99f4f tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1870a760-f9d2-4089-b7cf-106f9d3c381c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:01:30 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-3680d746-89db-41db-b314-56bf28a99f4f tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Connected to 172.16.0.220:3260 {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 17:01:30 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-3680d746-89db-41db-b314-56bf28a99f4f tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] HCTL ('34', '-', '-', 0) found on session 56 with lun 0 {{(pid=75245) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 17:01:30 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-3680d746-89db-41db-b314-56bf28a99f4f tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75245) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 17:01:30 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:01:30 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:01:30 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc29306-a995-40d2-91e3-115f282ec43a]: (4, ('- - 0', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:01:30 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-3680d746-89db-41db-b314-56bf28a99f4f tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Searching for a device in session 56 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75245) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 17:01:30 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-3680d746-89db-41db-b314-56bf28a99f4f tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:1870a760-f9d2-4089-b7cf-106f9d3c381c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tarlsicw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 17:01:31 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-3680d746-89db-41db-b314-56bf28a99f4f tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:01:31 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-3680d746-89db-41db-b314-56bf28a99f4f tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '26462353133373138', 'path': '/dev/sdc'} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:01:31 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3680d746-89db-41db-b314-56bf28a99f4f tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26462353133373138', 'path': '/dev/sdc'} {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 17:01:31 user nova-compute[75245]: DEBUG nova.objects.instance [None req-3680d746-89db-41db-b314-56bf28a99f4f tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Lazy-loading 'flavor' on Instance uuid 0ade598f-a253-413d-b53e-86f762500a6a {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:01:31 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-3680d746-89db-41db-b314-56bf28a99f4f tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 17:01:31 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 17:01:31 user nova-compute[75245]:   <source dev="/dev/sdc"/>
Nov 29 17:01:31 user nova-compute[75245]:   <target dev="vdb" bus="virtio"/>
Nov 29 17:01:31 user nova-compute[75245]:   <serial>1870a760-f9d2-4089-b7cf-106f9d3c381c</serial>
Nov 29 17:01:31 user nova-compute[75245]: </disk>
Nov 29 17:01:31 user nova-compute[75245]:  {{(pid=75245) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 17:01:31 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:01:31 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Starting heal instance info cache {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 17:01:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "refresh_cache-3361ab88-2331-4b23-863e-49a912bb8c25" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:01:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquired lock "refresh_cache-3361ab88-2331-4b23-863e-49a912bb8c25" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:01:31 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 3361ab88-2331-4b23-863e-49a912bb8c25] Forcefully refreshing network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 17:01:31 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-3680d746-89db-41db-b314-56bf28a99f4f tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 17:01:31 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-3680d746-89db-41db-b314-56bf28a99f4f tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 17:01:31 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-3680d746-89db-41db-b314-56bf28a99f4f tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] No VIF found with MAC fa:16:3e:84:4a:9d, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 17:01:31 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-3680d746-89db-41db-b314-56bf28a99f4f tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Lock "0ade598f-a253-413d-b53e-86f762500a6a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.089s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:01:32 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 3361ab88-2331-4b23-863e-49a912bb8c25] Updating instance_info_cache with network_info: [{"id": "0643747a-6ca5-4738-a1f2-4f26b9cf5542", "address": "fa:16:3e:57:a5:e6", "network": {"id": "316cb9af-807d-4a69-874e-2054520f0e5f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1421560477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0907dff4e054429fa10392b730363eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0643747a-6c", "ovs_interfaceid": "0643747a-6ca5-4738-a1f2-4f26b9cf5542", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:01:32 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Releasing lock "refresh_cache-3361ab88-2331-4b23-863e-49a912bb8c25" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:01:32 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 3361ab88-2331-4b23-863e-49a912bb8c25] Updated the network info_cache for instance {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 17:01:33 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:01:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:01:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:01:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75245) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 17:01:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 17:01:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 17:01:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:01:35 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:01:35 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:01:35 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:01:35 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:01:35 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75245) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 17:01:35 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ade598f-a253-413d-b53e-86f762500a6a/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:01:35 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ade598f-a253-413d-b53e-86f762500a6a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:01:35 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ade598f-a253-413d-b53e-86f762500a6a/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:01:35 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ade598f-a253-413d-b53e-86f762500a6a/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:01:35 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 17:01:36 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 17:01:36 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:01:36 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:01:36 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Hypervisor/Node resource view: name=user free_ram=8854MB free_disk=25.068294525146484GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75245) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 17:01:36 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:01:36 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:01:36 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 0ade598f-a253-413d-b53e-86f762500a6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:01:36 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 3361ab88-2331-4b23-863e-49a912bb8c25 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:01:36 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 17:01:36 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 17:01:36 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Refreshing inventories for resource provider dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 17:01:36 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Updating ProviderTree inventory for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 17:01:36 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Updating inventory in ProviderTree for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 17:01:36 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Refreshing aggregate associations for resource provider dcc0ed27-167e-4f3a-a0de-183bb144a50c, aggregates: None {{(pid=75245) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 17:01:36 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Refreshing trait associations for resource provider dcc0ed27-167e-4f3a-a0de-183bb144a50c, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG {{(pid=75245) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 17:01:36 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 17:01:36 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 17:01:36 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Compute_service record updated for user:user {{(pid=75245) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 17:01:36 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.423s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:01:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:01:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:01:39 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:01:40 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:01:41 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:01:41 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75245) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 17:01:42 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:01:42 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Cleaning up deleted instances {{(pid=75245) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 17:01:42 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] There are 0 instances to clean {{(pid=75245) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 17:01:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:01:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:01:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75245) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 17:01:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 17:01:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 17:01:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:01:45 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:01:45 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:01:45 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75245) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 17:01:47 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:01:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:01:52 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:01:54 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-6c771a7d-34b5-48b0-a214-f67bb20eb469 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Acquiring lock "0ade598f-a253-413d-b53e-86f762500a6a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:01:54 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-6c771a7d-34b5-48b0-a214-f67bb20eb469 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Lock "0ade598f-a253-413d-b53e-86f762500a6a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:01:54 user nova-compute[75245]: INFO nova.compute.manager [None req-6c771a7d-34b5-48b0-a214-f67bb20eb469 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] Detaching volume 1870a760-f9d2-4089-b7cf-106f9d3c381c
Nov 29 17:01:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:01:54 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-8e5888cb-001b-4132-b385-0cb8d6d0d757 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Acquiring lock "0ade598f-a253-413d-b53e-86f762500a6a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:01:54 user nova-compute[75245]: INFO nova.virt.block_device [None req-6c771a7d-34b5-48b0-a214-f67bb20eb469 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] Attempting to driver detach volume 1870a760-f9d2-4089-b7cf-106f9d3c381c from mountpoint /dev/vdb
Nov 29 17:01:54 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-6c771a7d-34b5-48b0-a214-f67bb20eb469 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Attempting to detach device vdb from instance 0ade598f-a253-413d-b53e-86f762500a6a from the persistent domain config. {{(pid=75245) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 17:01:54 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-6c771a7d-34b5-48b0-a214-f67bb20eb469 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 17:01:54 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 17:01:54 user nova-compute[75245]:   <source dev="/dev/sdc"/>
Nov 29 17:01:54 user nova-compute[75245]:   <target dev="vdb" bus="virtio"/>
Nov 29 17:01:54 user nova-compute[75245]:   <serial>1870a760-f9d2-4089-b7cf-106f9d3c381c</serial>
Nov 29 17:01:54 user nova-compute[75245]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 17:01:54 user nova-compute[75245]: </disk>
Nov 29 17:01:54 user nova-compute[75245]:  {{(pid=75245) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 17:01:54 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-6c771a7d-34b5-48b0-a214-f67bb20eb469 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Successfully detached device vdb from instance 0ade598f-a253-413d-b53e-86f762500a6a from the persistent domain config.
Nov 29 17:01:54 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-6c771a7d-34b5-48b0-a214-f67bb20eb469 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0ade598f-a253-413d-b53e-86f762500a6a from the live domain config. {{(pid=75245) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 17:01:54 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-6c771a7d-34b5-48b0-a214-f67bb20eb469 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 17:01:54 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 17:01:54 user nova-compute[75245]:   <source dev="/dev/sdc"/>
Nov 29 17:01:54 user nova-compute[75245]:   <target dev="vdb" bus="virtio"/>
Nov 29 17:01:54 user nova-compute[75245]:   <serial>1870a760-f9d2-4089-b7cf-106f9d3c381c</serial>
Nov 29 17:01:54 user nova-compute[75245]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 17:01:54 user nova-compute[75245]: </disk>
Nov 29 17:01:54 user nova-compute[75245]:  {{(pid=75245) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 17:01:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:01:55 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-6c771a7d-34b5-48b0-a214-f67bb20eb469 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0ade598f-a253-413d-b53e-86f762500a6a {{(pid=75245) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 17:01:59 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:01:59 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:01:59 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75245) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 17:01:59 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 17:01:59 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 17:01:59 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:02:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:02:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:02:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75245) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 17:02:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 17:02:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 17:02:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:02:05 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:02:06 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:02:07 user nova-compute[75245]: DEBUG nova.compute.manager [req-b896424c-e97a-4b29-bdfd-4911e83303d9 req-4d52872e-f4a2-46ba-82df-73285b5085b2 service nova] [instance: 3361ab88-2331-4b23-863e-49a912bb8c25] Received event network-changed-0643747a-6ca5-4738-a1f2-4f26b9cf5542 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:02:07 user nova-compute[75245]: DEBUG nova.compute.manager [req-b896424c-e97a-4b29-bdfd-4911e83303d9 req-4d52872e-f4a2-46ba-82df-73285b5085b2 service nova] [instance: 3361ab88-2331-4b23-863e-49a912bb8c25] Refreshing instance network info cache due to event network-changed-0643747a-6ca5-4738-a1f2-4f26b9cf5542. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 17:02:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b896424c-e97a-4b29-bdfd-4911e83303d9 req-4d52872e-f4a2-46ba-82df-73285b5085b2 service nova] Acquiring lock "refresh_cache-3361ab88-2331-4b23-863e-49a912bb8c25" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:02:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b896424c-e97a-4b29-bdfd-4911e83303d9 req-4d52872e-f4a2-46ba-82df-73285b5085b2 service nova] Acquired lock "refresh_cache-3361ab88-2331-4b23-863e-49a912bb8c25" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:02:07 user nova-compute[75245]: DEBUG nova.network.neutron [req-b896424c-e97a-4b29-bdfd-4911e83303d9 req-4d52872e-f4a2-46ba-82df-73285b5085b2 service nova] [instance: 3361ab88-2331-4b23-863e-49a912bb8c25] Refreshing network info cache for port 0643747a-6ca5-4738-a1f2-4f26b9cf5542 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 17:02:07 user nova-compute[75245]: DEBUG nova.network.neutron [req-b896424c-e97a-4b29-bdfd-4911e83303d9 req-4d52872e-f4a2-46ba-82df-73285b5085b2 service nova] [instance: 3361ab88-2331-4b23-863e-49a912bb8c25] Updated VIF entry in instance network info cache for port 0643747a-6ca5-4738-a1f2-4f26b9cf5542. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 17:02:07 user nova-compute[75245]: DEBUG nova.network.neutron [req-b896424c-e97a-4b29-bdfd-4911e83303d9 req-4d52872e-f4a2-46ba-82df-73285b5085b2 service nova] [instance: 3361ab88-2331-4b23-863e-49a912bb8c25] Updating instance_info_cache with network_info: [{"id": "0643747a-6ca5-4738-a1f2-4f26b9cf5542", "address": "fa:16:3e:57:a5:e6", "network": {"id": "316cb9af-807d-4a69-874e-2054520f0e5f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1421560477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0907dff4e054429fa10392b730363eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0643747a-6c", "ovs_interfaceid": "0643747a-6ca5-4738-a1f2-4f26b9cf5542", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:02:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b896424c-e97a-4b29-bdfd-4911e83303d9 req-4d52872e-f4a2-46ba-82df-73285b5085b2 service nova] Releasing lock "refresh_cache-3361ab88-2331-4b23-863e-49a912bb8c25" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:02:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-87ec2092-e35a-431c-8c7a-9789d5fcf5c3 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Acquiring lock "3361ab88-2331-4b23-863e-49a912bb8c25" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:02:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-87ec2092-e35a-431c-8c7a-9789d5fcf5c3 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "3361ab88-2331-4b23-863e-49a912bb8c25" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:02:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-87ec2092-e35a-431c-8c7a-9789d5fcf5c3 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Acquiring lock "3361ab88-2331-4b23-863e-49a912bb8c25-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:02:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-87ec2092-e35a-431c-8c7a-9789d5fcf5c3 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "3361ab88-2331-4b23-863e-49a912bb8c25-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:02:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-87ec2092-e35a-431c-8c7a-9789d5fcf5c3 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "3361ab88-2331-4b23-863e-49a912bb8c25-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:02:08 user nova-compute[75245]: INFO nova.compute.manager [None req-87ec2092-e35a-431c-8c7a-9789d5fcf5c3 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3361ab88-2331-4b23-863e-49a912bb8c25] Terminating instance
Nov 29 17:02:08 user nova-compute[75245]: DEBUG nova.compute.manager [None req-87ec2092-e35a-431c-8c7a-9789d5fcf5c3 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3361ab88-2331-4b23-863e-49a912bb8c25] Start destroying the instance on the hypervisor. {{(pid=75245) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 17:02:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:02:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:02:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:02:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:02:08 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 3361ab88-2331-4b23-863e-49a912bb8c25] Instance destroyed successfully.
Nov 29 17:02:08 user nova-compute[75245]: DEBUG nova.objects.instance [None req-87ec2092-e35a-431c-8c7a-9789d5fcf5c3 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lazy-loading 'resources' on Instance uuid 3361ab88-2331-4b23-863e-49a912bb8c25 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:02:08 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-87ec2092-e35a-431c-8c7a-9789d5fcf5c3 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T17:00:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-835513259',display_name='tempest-TestVolumeBootPattern-server-835513259',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-835513259',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/6kahxqemcvv41mFTGeaM46NrxYZRkkk4Ze4uyAwqVYPXEaYTvEEpOxaMUDr0qjGaA6sscRII1lYPmpLMrkcup8Fj5nDL441po4R7XAC4kU9bdh8ehoEbo0Y9HtbsAfw==',key_name='tempest-TestVolumeBootPattern-280401073',keypairs=<?>,launch_index=0,launched_at=2023-11-29T17:00:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0907dff4e054429fa10392b730363eb2',ramdisk_id='',reservation_id='r-5ymemp26',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-181783012',owner_user_name='tempest-TestVolumeBootPattern-181783012-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T17:00:28Z,user_data=None,user_id='2870721a7fff4cf19291f0cbfaedae81',uuid=3361ab88-2331-4b23-863e-49a912bb8c25,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0643747a-6ca5-4738-a1f2-4f26b9cf5542", "address": "fa:16:3e:57:a5:e6", "network": {"id": "316cb9af-807d-4a69-874e-2054520f0e5f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1421560477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0907dff4e054429fa10392b730363eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0643747a-6c", "ovs_interfaceid": "0643747a-6ca5-4738-a1f2-4f26b9cf5542", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 17:02:08 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-87ec2092-e35a-431c-8c7a-9789d5fcf5c3 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Converting VIF {"id": "0643747a-6ca5-4738-a1f2-4f26b9cf5542", "address": "fa:16:3e:57:a5:e6", "network": {"id": "316cb9af-807d-4a69-874e-2054520f0e5f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1421560477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0907dff4e054429fa10392b730363eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0643747a-6c", "ovs_interfaceid": "0643747a-6ca5-4738-a1f2-4f26b9cf5542", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:02:08 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-87ec2092-e35a-431c-8c7a-9789d5fcf5c3 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:57:a5:e6,bridge_name='br-int',has_traffic_filtering=True,id=0643747a-6ca5-4738-a1f2-4f26b9cf5542,network=Network(316cb9af-807d-4a69-874e-2054520f0e5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0643747a-6c') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:02:08 user nova-compute[75245]: DEBUG os_vif [None req-87ec2092-e35a-431c-8c7a-9789d5fcf5c3 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:a5:e6,bridge_name='br-int',has_traffic_filtering=True,id=0643747a-6ca5-4738-a1f2-4f26b9cf5542,network=Network(316cb9af-807d-4a69-874e-2054520f0e5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0643747a-6c') {{(pid=75245) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 17:02:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:02:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0643747a-6c, bridge=br-int, if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:02:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:02:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:02:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:02:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ed06e1cb-635e-44fb-b84e-8be8b9a6f27c) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:02:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:02:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:02:08 user nova-compute[75245]: INFO os_vif [None req-87ec2092-e35a-431c-8c7a-9789d5fcf5c3 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:a5:e6,bridge_name='br-int',has_traffic_filtering=True,id=0643747a-6ca5-4738-a1f2-4f26b9cf5542,network=Network(316cb9af-807d-4a69-874e-2054520f0e5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0643747a-6c')
Nov 29 17:02:08 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87ec2092-e35a-431c-8c7a-9789d5fcf5c3 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3361ab88-2331-4b23-863e-49a912bb8c25] calling os-brick to detach iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 17:02:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ec2092-e35a-431c-8c7a-9789d5fcf5c3 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, {'target_iqn': 'iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TzHCXFWr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:02:08 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-87ec2092-e35a-431c-8c7a-9789d5fcf5c3 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:02:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-87ec2092-e35a-431c-8c7a-9789d5fcf5c3 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:02:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-87ec2092-e35a-431c-8c7a-9789d5fcf5c3 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:02:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:02:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:02:08 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[48512fed-c923-4b68-a8bb-154be12fb3e5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1870a760-f9d2-4089-b7cf-106f9d3c381c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:02:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ec2092-e35a-431c-8c7a-9789d5fcf5c3 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 17:02:08 user nova-compute[75245]: No targets found.
Nov 29 17:02:08 user nova-compute[75245]: iSNS:
Nov 29 17:02:08 user nova-compute[75245]: No targets found.
Nov 29 17:02:08 user nova-compute[75245]: STATIC:
Nov 29 17:02:08 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:1870a760-f9d2-4089-b7cf-106f9d3c381c
Nov 29 17:02:08 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:02:08 user nova-compute[75245]:                 Iface Name: default
Nov 29 17:02:08 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535
Nov 29 17:02:08 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:02:08 user nova-compute[75245]:                 Iface Name: default
Nov 29 17:02:08 user nova-compute[75245]: FIRMWARE:
Nov 29 17:02:08 user nova-compute[75245]: No targets found.
Nov 29 17:02:08 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:02:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ec2092-e35a-431c-8c7a-9789d5fcf5c3 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 17:02:08 user nova-compute[75245]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 17:02:08 user nova-compute[75245]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75245) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 17:02:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ec2092-e35a-431c-8c7a-9789d5fcf5c3 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535', 0)] {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 17:02:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:02:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:02:08 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[2218a649-1e9e-4aa1-b2ce-adf96164feae]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1870a760-f9d2-4089-b7cf-106f9d3c381c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:02:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:02:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:02:08 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[433d48a1-6ffb-4411-bb91-7dd83b6aa78b]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1870a760-f9d2-4089-b7cf-106f9d3c381c (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:02:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ec2092-e35a-431c-8c7a-9789d5fcf5c3 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535 (non-flash)
Nov 29 17:02:08 user nova-compute[75245]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1870a760-f9d2-4089-b7cf-106f9d3c381c (non-flash)
Nov 29 17:02:08 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:02:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ec2092-e35a-431c-8c7a-9789d5fcf5c3 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535 (non-flash)
Nov 29 17:02:08 user nova-compute[75245]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1870a760-f9d2-4089-b7cf-106f9d3c381c (non-flash)
Nov 29 17:02:08 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:02:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ec2092-e35a-431c-8c7a-9789d5fcf5c3 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0d2065d6c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535'): ({'sdb'}, set())}) {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 17:02:08 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-87ec2092-e35a-431c-8c7a-9789d5fcf5c3 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Removing single pathed devices sdb {{(pid=75245) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 17:02:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:02:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:02:08 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[d86ee257-0667-4240-abcf-1b866627c050]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:02:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:02:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:02:08 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c019097-02a2-4c2f-ad49-3c648632c221]: (4, ('ok\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:02:08 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-87ec2092-e35a-431c-8c7a-9789d5fcf5c3 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Flushing IO for device /dev/sdb {{(pid=75245) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 17:02:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:02:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.011s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:02:08 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e91112-12a5-49c8-830f-7a4e7a712517]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:02:08 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-87ec2092-e35a-431c-8c7a-9789d5fcf5c3 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75245) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 17:02:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:02:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:02:09 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[224cf77b-cee1-42ae-a6e3-96932815e636]: (4, ('1', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:02:09 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-87ec2092-e35a-431c-8c7a-9789d5fcf5c3 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 17:02:09 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-87ec2092-e35a-431c-8c7a-9789d5fcf5c3 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] SCSI volumes sdb have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 17:02:09 user nova-compute[75245]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO8d2ed5be-4143665d8e5d5414', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_8d2ed5be', '/dev/disk/by-id/scsi-23431343336363564') {{(pid=86166) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 29 17:02:09 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e35a44-ccf6-4ddb-ad70-791f58082fd3]: (4, None) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:02:09 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ec2092-e35a-431c-8c7a-9789d5fcf5c3 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535')] {{(pid=75245) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 17:02:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:02:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:02:09 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c5c83a0-55e2-4fac-ab62-088d34880573]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:02:09 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ec2092-e35a-431c-8c7a-9789d5fcf5c3 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:02:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535 -p 172.16.0.220:3260 --logout {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:02:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:02:09 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[b431d9b9-4405-49e6-8a9d-694952ea4401]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:02:09 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ec2092-e35a-431c-8c7a-9789d5fcf5c3 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535, portal: 172.16.0.220,3260]
Nov 29 17:02:09 user nova-compute[75245]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535, portal: 172.16.0.220,3260] successful.
Nov 29 17:02:09 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:02:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535 -p 172.16.0.220:3260 --op delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:02:09 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:02:09 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[7677410e-1d07-4d94-8067-19f87435b696]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:02:09 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ec2092-e35a-431c-8c7a-9789d5fcf5c3 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:02:09 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-87ec2092-e35a-431c-8c7a-9789d5fcf5c3 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:02:09 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ec2092-e35a-431c-8c7a-9789d5fcf5c3 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] <== disconnect_volume: return (317ms) None {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:02:09 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87ec2092-e35a-431c-8c7a-9789d5fcf5c3 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3361ab88-2331-4b23-863e-49a912bb8c25] Disconnected iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 17:02:09 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-87ec2092-e35a-431c-8c7a-9789d5fcf5c3 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3361ab88-2331-4b23-863e-49a912bb8c25] Deleting instance files /opt/stack/data/nova/instances/3361ab88-2331-4b23-863e-49a912bb8c25_del
Nov 29 17:02:09 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-87ec2092-e35a-431c-8c7a-9789d5fcf5c3 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3361ab88-2331-4b23-863e-49a912bb8c25] Deletion of /opt/stack/data/nova/instances/3361ab88-2331-4b23-863e-49a912bb8c25_del complete
Nov 29 17:02:09 user nova-compute[75245]: INFO nova.compute.manager [None req-87ec2092-e35a-431c-8c7a-9789d5fcf5c3 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3361ab88-2331-4b23-863e-49a912bb8c25] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 29 17:02:09 user nova-compute[75245]: DEBUG oslo.service.loopingcall [None req-87ec2092-e35a-431c-8c7a-9789d5fcf5c3 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75245) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 17:02:09 user nova-compute[75245]: DEBUG nova.compute.manager [-] [instance: 3361ab88-2331-4b23-863e-49a912bb8c25] Deallocating network for instance {{(pid=75245) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 17:02:09 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: 3361ab88-2331-4b23-863e-49a912bb8c25] deallocate_for_instance() {{(pid=75245) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 17:02:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:02:09 user nova-compute[75245]: DEBUG nova.compute.manager [req-805462f6-507a-4ce8-8acc-a725acd5e0c0 req-31978c6a-d5c6-4835-b27b-d2034a1aacfd service nova] [instance: 3361ab88-2331-4b23-863e-49a912bb8c25] Received event network-vif-unplugged-0643747a-6ca5-4738-a1f2-4f26b9cf5542 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:02:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-805462f6-507a-4ce8-8acc-a725acd5e0c0 req-31978c6a-d5c6-4835-b27b-d2034a1aacfd service nova] Acquiring lock "3361ab88-2331-4b23-863e-49a912bb8c25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:02:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-805462f6-507a-4ce8-8acc-a725acd5e0c0 req-31978c6a-d5c6-4835-b27b-d2034a1aacfd service nova] Lock "3361ab88-2331-4b23-863e-49a912bb8c25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:02:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-805462f6-507a-4ce8-8acc-a725acd5e0c0 req-31978c6a-d5c6-4835-b27b-d2034a1aacfd service nova] Lock "3361ab88-2331-4b23-863e-49a912bb8c25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:02:09 user nova-compute[75245]: DEBUG nova.compute.manager [req-805462f6-507a-4ce8-8acc-a725acd5e0c0 req-31978c6a-d5c6-4835-b27b-d2034a1aacfd service nova] [instance: 3361ab88-2331-4b23-863e-49a912bb8c25] No waiting events found dispatching network-vif-unplugged-0643747a-6ca5-4738-a1f2-4f26b9cf5542 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:02:09 user nova-compute[75245]: DEBUG nova.compute.manager [req-805462f6-507a-4ce8-8acc-a725acd5e0c0 req-31978c6a-d5c6-4835-b27b-d2034a1aacfd service nova] [instance: 3361ab88-2331-4b23-863e-49a912bb8c25] Received event network-vif-unplugged-0643747a-6ca5-4738-a1f2-4f26b9cf5542 for instance with task_state deleting. {{(pid=75245) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 17:02:09 user nova-compute[75245]: DEBUG nova.compute.manager [req-805462f6-507a-4ce8-8acc-a725acd5e0c0 req-31978c6a-d5c6-4835-b27b-d2034a1aacfd service nova] [instance: 3361ab88-2331-4b23-863e-49a912bb8c25] Received event network-vif-plugged-0643747a-6ca5-4738-a1f2-4f26b9cf5542 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:02:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-805462f6-507a-4ce8-8acc-a725acd5e0c0 req-31978c6a-d5c6-4835-b27b-d2034a1aacfd service nova] Acquiring lock "3361ab88-2331-4b23-863e-49a912bb8c25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:02:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-805462f6-507a-4ce8-8acc-a725acd5e0c0 req-31978c6a-d5c6-4835-b27b-d2034a1aacfd service nova] Lock "3361ab88-2331-4b23-863e-49a912bb8c25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:02:09 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-805462f6-507a-4ce8-8acc-a725acd5e0c0 req-31978c6a-d5c6-4835-b27b-d2034a1aacfd service nova] Lock "3361ab88-2331-4b23-863e-49a912bb8c25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:02:09 user nova-compute[75245]: DEBUG nova.compute.manager [req-805462f6-507a-4ce8-8acc-a725acd5e0c0 req-31978c6a-d5c6-4835-b27b-d2034a1aacfd service nova] [instance: 3361ab88-2331-4b23-863e-49a912bb8c25] No waiting events found dispatching network-vif-plugged-0643747a-6ca5-4738-a1f2-4f26b9cf5542 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:02:09 user nova-compute[75245]: WARNING nova.compute.manager [req-805462f6-507a-4ce8-8acc-a725acd5e0c0 req-31978c6a-d5c6-4835-b27b-d2034a1aacfd service nova] [instance: 3361ab88-2331-4b23-863e-49a912bb8c25] Received unexpected event network-vif-plugged-0643747a-6ca5-4738-a1f2-4f26b9cf5542 for instance with vm_state active and task_state deleting.
Nov 29 17:02:09 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: 3361ab88-2331-4b23-863e-49a912bb8c25] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:02:09 user nova-compute[75245]: INFO nova.compute.manager [-] [instance: 3361ab88-2331-4b23-863e-49a912bb8c25] Took 0.74 seconds to deallocate network for instance.
Nov 29 17:02:09 user nova-compute[75245]: DEBUG nova.compute.manager [req-ab4a8efa-bf80-42b8-8491-9f8e1a35ac52 req-724bcb4e-1a2b-43be-a242-7cc1f72cc78e service nova] [instance: 3361ab88-2331-4b23-863e-49a912bb8c25] Received event network-vif-deleted-0643747a-6ca5-4738-a1f2-4f26b9cf5542 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:02:10 user nova-compute[75245]: INFO nova.compute.manager [None req-87ec2092-e35a-431c-8c7a-9789d5fcf5c3 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3361ab88-2331-4b23-863e-49a912bb8c25] Took 0.79 seconds to detach 1 volumes for instance.
Nov 29 17:02:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-87ec2092-e35a-431c-8c7a-9789d5fcf5c3 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:02:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-87ec2092-e35a-431c-8c7a-9789d5fcf5c3 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:02:10 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-87ec2092-e35a-431c-8c7a-9789d5fcf5c3 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 17:02:10 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-87ec2092-e35a-431c-8c7a-9789d5fcf5c3 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 17:02:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-87ec2092-e35a-431c-8c7a-9789d5fcf5c3 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.136s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:02:11 user nova-compute[75245]: INFO nova.scheduler.client.report [None req-87ec2092-e35a-431c-8c7a-9789d5fcf5c3 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Deleted allocations for instance 3361ab88-2331-4b23-863e-49a912bb8c25
Nov 29 17:02:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-87ec2092-e35a-431c-8c7a-9789d5fcf5c3 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "3361ab88-2331-4b23-863e-49a912bb8c25" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.054s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:02:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:02:15 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-6c771a7d-34b5-48b0-a214-f67bb20eb469 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0ade598f-a253-413d-b53e-86f762500a6a is timed out.
Nov 29 17:02:15 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-6c771a7d-34b5-48b0-a214-f67bb20eb469 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Successfully detached device vdb from instance 0ade598f-a253-413d-b53e-86f762500a6a from the live domain config.
Nov 29 17:02:15 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c771a7d-34b5-48b0-a214-f67bb20eb469 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] calling os-brick to detach iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 17:02:15 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c771a7d-34b5-48b0-a214-f67bb20eb469 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, {'target_iqn': 'iqn.2010-10.org.openstack:1870a760-f9d2-4089-b7cf-106f9d3c381c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tarlsicw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:02:15 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-6c771a7d-34b5-48b0-a214-f67bb20eb469 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:02:15 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-6c771a7d-34b5-48b0-a214-f67bb20eb469 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:02:15 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-6c771a7d-34b5-48b0-a214-f67bb20eb469 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:02:15 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:02:15 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:02:15 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[78cb2f11-ade8-4795-8e11-28b9e22c4e80]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1870a760-f9d2-4089-b7cf-106f9d3c381c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:02:15 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c771a7d-34b5-48b0-a214-f67bb20eb469 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 17:02:15 user nova-compute[75245]: No targets found.
Nov 29 17:02:15 user nova-compute[75245]: iSNS:
Nov 29 17:02:15 user nova-compute[75245]: No targets found.
Nov 29 17:02:15 user nova-compute[75245]: STATIC:
Nov 29 17:02:15 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:1870a760-f9d2-4089-b7cf-106f9d3c381c
Nov 29 17:02:15 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:02:15 user nova-compute[75245]:                 Iface Name: default
Nov 29 17:02:15 user nova-compute[75245]: FIRMWARE:
Nov 29 17:02:15 user nova-compute[75245]: No targets found.
Nov 29 17:02:15 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:02:15 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c771a7d-34b5-48b0-a214-f67bb20eb469 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 17:02:15 user nova-compute[75245]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 17:02:15 user nova-compute[75245]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75245) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 17:02:15 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c771a7d-34b5-48b0-a214-f67bb20eb469 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1870a760-f9d2-4089-b7cf-106f9d3c381c', 0)] {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 17:02:15 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:02:15 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:02:15 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c33bd7-560b-4900-b5fa-f98087e913de]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1870a760-f9d2-4089-b7cf-106f9d3c381c\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:02:15 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:02:15 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:02:15 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[d84627ce-a3a2-4d81-a854-eab3e85f3bfe]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1870a760-f9d2-4089-b7cf-106f9d3c381c (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:02:15 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c771a7d-34b5-48b0-a214-f67bb20eb469 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1870a760-f9d2-4089-b7cf-106f9d3c381c (non-flash)
Nov 29 17:02:15 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:02:15 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c771a7d-34b5-48b0-a214-f67bb20eb469 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1870a760-f9d2-4089-b7cf-106f9d3c381c (non-flash)
Nov 29 17:02:15 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:02:15 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c771a7d-34b5-48b0-a214-f67bb20eb469 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0d206dfbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1870a760-f9d2-4089-b7cf-106f9d3c381c'): ({'sdc'}, set())}) {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 17:02:15 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-6c771a7d-34b5-48b0-a214-f67bb20eb469 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Removing single pathed devices sdc {{(pid=75245) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 17:02:15 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:02:15 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:02:15 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f2b1da-e2ab-444c-af93-3f2a842cfd2d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:02:15 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:02:15 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:02:15 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[36944ba8-1d10-4ab4-9da7-fec5418d6210]: (4, ('ok\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:02:15 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-6c771a7d-34b5-48b0-a214-f67bb20eb469 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Flushing IO for device /dev/sdc {{(pid=75245) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 17:02:15 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:02:15 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:02:15 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b9e7e0-ff81-4293-86c2-f6db98eccf05]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:02:15 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-6c771a7d-34b5-48b0-a214-f67bb20eb469 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75245) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 17:02:15 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:02:15 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:02:15 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a54da9-bad5-463d-aa4b-fdca6860b2fa]: (4, ('1', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:02:15 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-6c771a7d-34b5-48b0-a214-f67bb20eb469 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 17:02:15 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-6c771a7d-34b5-48b0-a214-f67bb20eb469 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] SCSI volumes sdc have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 17:02:15 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c771a7d-34b5-48b0-a214-f67bb20eb469 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1870a760-f9d2-4089-b7cf-106f9d3c381c')] {{(pid=75245) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 17:02:15 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1870a760-f9d2-4089-b7cf-106f9d3c381c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:02:15 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1870a760-f9d2-4089-b7cf-106f9d3c381c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:02:15 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[3698f427-2a3d-421a-be8b-590c41ac3537]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:02:15 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c771a7d-34b5-48b0-a214-f67bb20eb469 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:02:15 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1870a760-f9d2-4089-b7cf-106f9d3c381c -p 172.16.0.220:3260 --logout {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:02:15 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1870a760-f9d2-4089-b7cf-106f9d3c381c -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:02:15 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[cccbfc0b-b6ba-4055-8537-9091610481d0]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:1870a760-f9d2-4089-b7cf-106f9d3c381c, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:1870a760-f9d2-4089-b7cf-106f9d3c381c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:02:15 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c771a7d-34b5-48b0-a214-f67bb20eb469 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:1870a760-f9d2-4089-b7cf-106f9d3c381c, portal: 172.16.0.220,3260]
Nov 29 17:02:15 user nova-compute[75245]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:1870a760-f9d2-4089-b7cf-106f9d3c381c, portal: 172.16.0.220,3260] successful.
Nov 29 17:02:15 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:02:15 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1870a760-f9d2-4089-b7cf-106f9d3c381c -p 172.16.0.220:3260 --op delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:02:15 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1870a760-f9d2-4089-b7cf-106f9d3c381c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:02:15 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ae6320-a37d-44cb-b227-d40b408ad5ae]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:02:15 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c771a7d-34b5-48b0-a214-f67bb20eb469 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:02:15 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-6c771a7d-34b5-48b0-a214-f67bb20eb469 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.259s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:02:15 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c771a7d-34b5-48b0-a214-f67bb20eb469 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] <== disconnect_volume: return (260ms) None {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:02:15 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c771a7d-34b5-48b0-a214-f67bb20eb469 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] Disconnected iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 17:02:16 user nova-compute[75245]: DEBUG nova.objects.instance [None req-6c771a7d-34b5-48b0-a214-f67bb20eb469 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Lazy-loading 'flavor' on Instance uuid 0ade598f-a253-413d-b53e-86f762500a6a {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:02:16 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-6c771a7d-34b5-48b0-a214-f67bb20eb469 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Lock "0ade598f-a253-413d-b53e-86f762500a6a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.684s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:02:16 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-8e5888cb-001b-4132-b385-0cb8d6d0d757 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Lock "0ade598f-a253-413d-b53e-86f762500a6a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.577s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:02:16 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-8e5888cb-001b-4132-b385-0cb8d6d0d757 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Acquiring lock "0ade598f-a253-413d-b53e-86f762500a6a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:02:16 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-8e5888cb-001b-4132-b385-0cb8d6d0d757 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Lock "0ade598f-a253-413d-b53e-86f762500a6a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:02:16 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-8e5888cb-001b-4132-b385-0cb8d6d0d757 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Lock "0ade598f-a253-413d-b53e-86f762500a6a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:02:16 user nova-compute[75245]: INFO nova.compute.manager [None req-8e5888cb-001b-4132-b385-0cb8d6d0d757 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] Terminating instance
Nov 29 17:02:16 user nova-compute[75245]: DEBUG nova.compute.manager [None req-8e5888cb-001b-4132-b385-0cb8d6d0d757 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] Start destroying the instance on the hypervisor. {{(pid=75245) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 17:02:16 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:02:16 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:02:16 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:02:16 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:02:16 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:02:16 user nova-compute[75245]: DEBUG nova.compute.manager [req-c1080916-50d9-42ac-8846-28e50f827ce9 req-e8c213e1-92fa-4b16-be30-ec7a04272194 service nova] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] Received event network-vif-unplugged-eb33a8e0-514c-41d7-9478-c07cccb143d0 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:02:16 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-c1080916-50d9-42ac-8846-28e50f827ce9 req-e8c213e1-92fa-4b16-be30-ec7a04272194 service nova] Acquiring lock "0ade598f-a253-413d-b53e-86f762500a6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:02:16 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-c1080916-50d9-42ac-8846-28e50f827ce9 req-e8c213e1-92fa-4b16-be30-ec7a04272194 service nova] Lock "0ade598f-a253-413d-b53e-86f762500a6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:02:16 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-c1080916-50d9-42ac-8846-28e50f827ce9 req-e8c213e1-92fa-4b16-be30-ec7a04272194 service nova] Lock "0ade598f-a253-413d-b53e-86f762500a6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:02:16 user nova-compute[75245]: DEBUG nova.compute.manager [req-c1080916-50d9-42ac-8846-28e50f827ce9 req-e8c213e1-92fa-4b16-be30-ec7a04272194 service nova] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] No waiting events found dispatching network-vif-unplugged-eb33a8e0-514c-41d7-9478-c07cccb143d0 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:02:16 user nova-compute[75245]: DEBUG nova.compute.manager [req-c1080916-50d9-42ac-8846-28e50f827ce9 req-e8c213e1-92fa-4b16-be30-ec7a04272194 service nova] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] Received event network-vif-unplugged-eb33a8e0-514c-41d7-9478-c07cccb143d0 for instance with task_state deleting. {{(pid=75245) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 17:02:16 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] Instance destroyed successfully.
Nov 29 17:02:16 user nova-compute[75245]: DEBUG nova.objects.instance [None req-8e5888cb-001b-4132-b385-0cb8d6d0d757 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Lazy-loading 'resources' on Instance uuid 0ade598f-a253-413d-b53e-86f762500a6a {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:02:16 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-8e5888cb-001b-4132-b385-0cb8d6d0d757 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T16:59:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1162725982',display_name='tempest-VolumesSnapshotTestJSON-instance-1162725982',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1162725982',id=48,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDapKAhFMNKdyXMDxdFKrJUb5khKTPSzUrqcZgN+TbBN4gPvOfA+NyCDtn7WomCJZheIYVXI51JLxUuMWzJctOtIweF0w70S/iRSHJtdoLypVjEQKu1m+cIJLdc72Xa8iQ==',key_name='tempest-keypair-1141465662',keypairs=<?>,launch_index=0,launched_at=2023-11-29T16:59:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3945a91aae184152ae3ad9e6307c69f2',ramdisk_id='',reservation_id='r-xdd6k8ov',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-234601790',owner_user_name='tempest-VolumesSnapshotTestJSON-234601790-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T16:59:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3207e1ff86af4b91bef305f28848fbdb',uuid=0ade598f-a253-413d-b53e-86f762500a6a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eb33a8e0-514c-41d7-9478-c07cccb143d0", "address": "fa:16:3e:84:4a:9d", "network": {"id": "9ac826d2-ead7-459b-8629-2c3ac5b3dc88", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1414777524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3945a91aae184152ae3ad9e6307c69f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb33a8e0-51", "ovs_interfaceid": "eb33a8e0-514c-41d7-9478-c07cccb143d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 17:02:16 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-8e5888cb-001b-4132-b385-0cb8d6d0d757 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Converting VIF {"id": "eb33a8e0-514c-41d7-9478-c07cccb143d0", "address": "fa:16:3e:84:4a:9d", "network": {"id": "9ac826d2-ead7-459b-8629-2c3ac5b3dc88", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1414777524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3945a91aae184152ae3ad9e6307c69f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb33a8e0-51", "ovs_interfaceid": "eb33a8e0-514c-41d7-9478-c07cccb143d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:02:16 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-8e5888cb-001b-4132-b385-0cb8d6d0d757 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:84:4a:9d,bridge_name='br-int',has_traffic_filtering=True,id=eb33a8e0-514c-41d7-9478-c07cccb143d0,network=Network(9ac826d2-ead7-459b-8629-2c3ac5b3dc88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb33a8e0-51') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:02:16 user nova-compute[75245]: DEBUG os_vif [None req-8e5888cb-001b-4132-b385-0cb8d6d0d757 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:4a:9d,bridge_name='br-int',has_traffic_filtering=True,id=eb33a8e0-514c-41d7-9478-c07cccb143d0,network=Network(9ac826d2-ead7-459b-8629-2c3ac5b3dc88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb33a8e0-51') {{(pid=75245) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 17:02:16 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:02:16 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeb33a8e0-51, bridge=br-int, if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:02:16 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:02:16 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:02:16 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:02:16 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8db18f84-fa35-48de-a0e1-c36915265e66) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:02:16 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:02:16 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:02:16 user nova-compute[75245]: INFO os_vif [None req-8e5888cb-001b-4132-b385-0cb8d6d0d757 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:4a:9d,bridge_name='br-int',has_traffic_filtering=True,id=eb33a8e0-514c-41d7-9478-c07cccb143d0,network=Network(9ac826d2-ead7-459b-8629-2c3ac5b3dc88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb33a8e0-51')
Nov 29 17:02:16 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e5888cb-001b-4132-b385-0cb8d6d0d757 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] calling os-brick to detach iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 17:02:16 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5888cb-001b-4132-b385-0cb8d6d0d757 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, {'target_iqn': 'iqn.2010-10.org.openstack:1870a760-f9d2-4089-b7cf-106f9d3c381c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tarlsicw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:02:16 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-8e5888cb-001b-4132-b385-0cb8d6d0d757 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:02:16 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-8e5888cb-001b-4132-b385-0cb8d6d0d757 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:02:16 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-8e5888cb-001b-4132-b385-0cb8d6d0d757 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:02:16 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:02:16 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:02:16 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 17:02:16 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[dd593eeb-be49-4caa-a15f-9db844db4a3f]: Unexpected error while running command.
Nov 29 17:02:16 user nova-compute[75245]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 29 17:02:16 user nova-compute[75245]: Exit code: 21
Nov 29 17:02:16 user nova-compute[75245]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 29 17:02:16 user nova-compute[75245]: Stderr: '' {{(pid=86166) _process_cmd /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:477}}
Nov 29 17:02:16 user nova-compute[75245]: Traceback (most recent call last):
Nov 29 17:02:16 user nova-compute[75245]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 474, in _process_cmd
Nov 29 17:02:16 user nova-compute[75245]:     ret = func(*f_args, **f_kwargs)
Nov 29 17:02:16 user nova-compute[75245]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Nov 29 17:02:16 user nova-compute[75245]:     return func(*args, **kwargs)
Nov 29 17:02:16 user nova-compute[75245]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Nov 29 17:02:16 user nova-compute[75245]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Nov 29 17:02:16 user nova-compute[75245]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Nov 29 17:02:16 user nova-compute[75245]:     return putils.execute(on_execute=on_execute,
Nov 29 17:02:16 user nova-compute[75245]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py", line 438, in execute
Nov 29 17:02:16 user nova-compute[75245]:     raise ProcessExecutionError(exit_code=_returncode,
Nov 29 17:02:16 user nova-compute[75245]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 29 17:02:16 user nova-compute[75245]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 29 17:02:16 user nova-compute[75245]: Exit code: 21
Nov 29 17:02:16 user nova-compute[75245]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 29 17:02:16 user nova-compute[75245]: Stderr: ''
Nov 29 17:02:16 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd593eeb-be49-4caa-a15f-9db844db4a3f]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:02:16 user nova-compute[75245]: ERROR os_brick.initiator.connectors.iscsi [None req-8e5888cb-001b-4132-b385-0cb8d6d0d757 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 29 17:02:16 user nova-compute[75245]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 29 17:02:16 user nova-compute[75245]: Exit code: 21
Nov 29 17:02:16 user nova-compute[75245]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 29 17:02:16 user nova-compute[75245]: Stderr: ''
Nov 29 17:02:16 user nova-compute[75245]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Nov 29 17:02:16 user nova-compute[75245]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 217, in _get_ips_iqns_luns
Nov 29 17:02:16 user nova-compute[75245]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Nov 29 17:02:16 user nova-compute[75245]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 376, in _get_discoverydb_portals
Nov 29 17:02:16 user nova-compute[75245]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Nov 29 17:02:16 user nova-compute[75245]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 1188, in _run_iscsiadm_bare
Nov 29 17:02:16 user nova-compute[75245]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Nov 29 17:02:16 user nova-compute[75245]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/executor.py", line 55, in _execute
Nov 29 17:02:16 user nova-compute[75245]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Nov 29 17:02:16 user nova-compute[75245]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Nov 29 17:02:16 user nova-compute[75245]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Nov 29 17:02:16 user nova-compute[75245]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Nov 29 17:02:16 user nova-compute[75245]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Nov 29 17:02:16 user nova-compute[75245]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 215, in remote_call
Nov 29 17:02:16 user nova-compute[75245]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Nov 29 17:02:16 user nova-compute[75245]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 29 17:02:16 user nova-compute[75245]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Nov 29 17:02:16 user nova-compute[75245]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Nov 29 17:02:16 user nova-compute[75245]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 29 17:02:16 user nova-compute[75245]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Nov 29 17:02:16 user nova-compute[75245]: ERROR os_brick.initiator.connectors.iscsi 
Nov 29 17:02:16 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5888cb-001b-4132-b385-0cb8d6d0d757 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=75245) _cleanup_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:934}}
Nov 29 17:02:16 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-8e5888cb-001b-4132-b385-0cb8d6d0d757 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.032s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:02:16 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5888cb-001b-4132-b385-0cb8d6d0d757 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] <== disconnect_volume: return (33ms) None {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:02:16 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e5888cb-001b-4132-b385-0cb8d6d0d757 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] Disconnected iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 17:02:16 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-8e5888cb-001b-4132-b385-0cb8d6d0d757 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] Deleting instance files /opt/stack/data/nova/instances/0ade598f-a253-413d-b53e-86f762500a6a_del
Nov 29 17:02:16 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-8e5888cb-001b-4132-b385-0cb8d6d0d757 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] Deletion of /opt/stack/data/nova/instances/0ade598f-a253-413d-b53e-86f762500a6a_del complete
Nov 29 17:02:16 user nova-compute[75245]: INFO nova.compute.manager [None req-8e5888cb-001b-4132-b385-0cb8d6d0d757 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 29 17:02:16 user nova-compute[75245]: DEBUG oslo.service.loopingcall [None req-8e5888cb-001b-4132-b385-0cb8d6d0d757 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75245) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 17:02:16 user nova-compute[75245]: DEBUG nova.compute.manager [-] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] Deallocating network for instance {{(pid=75245) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 17:02:16 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] deallocate_for_instance() {{(pid=75245) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 17:02:17 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:02:17 user nova-compute[75245]: INFO nova.compute.manager [-] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] Took 0.78 seconds to deallocate network for instance.
Nov 29 17:02:17 user nova-compute[75245]: WARNING nova.volume.cinder [None req-8e5888cb-001b-4132-b385-0cb8d6d0d757 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Attachment 4d650114-3720-4742-a21b-db1f1fc86000 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 4d650114-3720-4742-a21b-db1f1fc86000. (HTTP 404) (Request-ID: req-3c830f03-aa1d-4a41-a280-e10bccf84307)
Nov 29 17:02:17 user nova-compute[75245]: INFO nova.compute.manager [None req-8e5888cb-001b-4132-b385-0cb8d6d0d757 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] Took 0.03 seconds to detach 1 volumes for instance.
Nov 29 17:02:17 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-8e5888cb-001b-4132-b385-0cb8d6d0d757 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:02:17 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-8e5888cb-001b-4132-b385-0cb8d6d0d757 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:02:17 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-8e5888cb-001b-4132-b385-0cb8d6d0d757 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 17:02:17 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-8e5888cb-001b-4132-b385-0cb8d6d0d757 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 17:02:18 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-8e5888cb-001b-4132-b385-0cb8d6d0d757 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.127s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:02:18 user nova-compute[75245]: INFO nova.scheduler.client.report [None req-8e5888cb-001b-4132-b385-0cb8d6d0d757 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Deleted allocations for instance 0ade598f-a253-413d-b53e-86f762500a6a
Nov 29 17:02:18 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-8e5888cb-001b-4132-b385-0cb8d6d0d757 tempest-VolumesSnapshotTestJSON-234601790 tempest-VolumesSnapshotTestJSON-234601790-project-member] Lock "0ade598f-a253-413d-b53e-86f762500a6a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.026s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:02:18 user nova-compute[75245]: DEBUG nova.compute.manager [req-db3a6cc2-318d-4906-8f46-e8ef10db6bfd req-fc90ffb3-8b85-4d27-95fe-128adc18f2ef service nova] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] Received event network-vif-plugged-eb33a8e0-514c-41d7-9478-c07cccb143d0 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:02:18 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-db3a6cc2-318d-4906-8f46-e8ef10db6bfd req-fc90ffb3-8b85-4d27-95fe-128adc18f2ef service nova] Acquiring lock "0ade598f-a253-413d-b53e-86f762500a6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:02:18 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-db3a6cc2-318d-4906-8f46-e8ef10db6bfd req-fc90ffb3-8b85-4d27-95fe-128adc18f2ef service nova] Lock "0ade598f-a253-413d-b53e-86f762500a6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:02:18 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-db3a6cc2-318d-4906-8f46-e8ef10db6bfd req-fc90ffb3-8b85-4d27-95fe-128adc18f2ef service nova] Lock "0ade598f-a253-413d-b53e-86f762500a6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:02:18 user nova-compute[75245]: DEBUG nova.compute.manager [req-db3a6cc2-318d-4906-8f46-e8ef10db6bfd req-fc90ffb3-8b85-4d27-95fe-128adc18f2ef service nova] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] No waiting events found dispatching network-vif-plugged-eb33a8e0-514c-41d7-9478-c07cccb143d0 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:02:18 user nova-compute[75245]: WARNING nova.compute.manager [req-db3a6cc2-318d-4906-8f46-e8ef10db6bfd req-fc90ffb3-8b85-4d27-95fe-128adc18f2ef service nova] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] Received unexpected event network-vif-plugged-eb33a8e0-514c-41d7-9478-c07cccb143d0 for instance with vm_state deleted and task_state None.
Nov 29 17:02:18 user nova-compute[75245]: DEBUG nova.compute.manager [req-db3a6cc2-318d-4906-8f46-e8ef10db6bfd req-fc90ffb3-8b85-4d27-95fe-128adc18f2ef service nova] [instance: 0ade598f-a253-413d-b53e-86f762500a6a] Received event network-vif-deleted-eb33a8e0-514c-41d7-9478-c07cccb143d0 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:02:21 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:02:26 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:02:26 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:02:26 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75245) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 17:02:26 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 17:02:26 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 17:02:26 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:02:31 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:02:32 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:02:32 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Starting heal instance info cache {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 17:02:32 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Rebuilding the list of instances to heal {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 17:02:32 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Didn't find any instances for network info cache update. {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 17:02:35 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:02:36 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:02:37 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:02:37 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:02:37 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:02:37 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:02:37 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75245) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 17:02:37 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:02:37 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:02:37 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Hypervisor/Node resource view: name=user free_ram=9066MB free_disk=25.087162017822266GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75245) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 17:02:37 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:02:37 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:02:37 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 17:02:37 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 17:02:37 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 17:02:38 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 17:02:38 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Compute_service record updated for user:user {{(pid=75245) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 17:02:38 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.150s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:02:40 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:02:40 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:02:41 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:02:45 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:02:45 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:02:45 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75245) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 17:02:46 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:02:49 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:02:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:02:52 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:02:56 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:02:56 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:03:00 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Acquiring lock "24b84c61-6ea0-4187-abc8-80a967d5bf70" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:03:00 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "24b84c61-6ea0-4187-abc8-80a967d5bf70" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:03:00 user nova-compute[75245]: DEBUG nova.compute.manager [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Starting instance... {{(pid=75245) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 17:03:00 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:03:00 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:03:00 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75245) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 17:03:00 user nova-compute[75245]: INFO nova.compute.claims [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Claim successful on node user
Nov 29 17:03:00 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 17:03:00 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 17:03:00 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.199s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:03:00 user nova-compute[75245]: DEBUG nova.compute.manager [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Start building networks asynchronously for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 17:03:00 user nova-compute[75245]: DEBUG nova.compute.manager [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Allocating IP information in the background. {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 17:03:00 user nova-compute[75245]: DEBUG nova.network.neutron [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] allocate_for_instance() {{(pid=75245) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 17:03:00 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 17:03:00 user nova-compute[75245]: DEBUG nova.compute.manager [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Start building block device mappings for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 17:03:01 user nova-compute[75245]: DEBUG nova.policy [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2870721a7fff4cf19291f0cbfaedae81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907dff4e054429fa10392b730363eb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75245) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 17:03:01 user nova-compute[75245]: INFO nova.virt.block_device [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Booting with volume 64b1f27b-9bd5-40d8-af17-c9f4ec603535 at /dev/vda
Nov 29 17:03:01 user nova-compute[75245]: DEBUG os_brick.utils [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:03:01 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:03:01 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:03:01 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a06f1ae-cbf7-471e-b0f1-d7204a42d9a6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:69ed8ed87091\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:03:01 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:03:01 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:03:01 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[eccf5d90-4eab-4000-ab44-f6b00db54993]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:03:01 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:03:01 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:03:01 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ef2e03-e4ba-46f5-be47-626b93b8b2b7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:03:01 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3e126a-5f09-4788-8c80-26dfa167607e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:03:01 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Running cmd (subprocess): nvme version {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:03:01 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] 'nvme version' failed. Not Retrying. {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 17:03:01 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.nvmeof [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] nvme not present on system {{(pid=75245) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 17:03:01 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:03:01 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 17:03:01 user nova-compute[75245]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 17:03:01 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[64131acd-cd62-485a-8aa1-24324a120561]: (4, '') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:03:01 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75245) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 17:03:01 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 17:03:01 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] LIGHTOS: no hostnqn found. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 17:03:01 user nova-compute[75245]: DEBUG os_brick.utils [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:69ed8ed87091', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:03:01 user nova-compute[75245]: DEBUG nova.virt.block_device [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Updating existing volume attachment record: ac7bc751-c480-43f2-8544-a0903cd85521 {{(pid=75245) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 17:03:01 user nova-compute[75245]: DEBUG nova.network.neutron [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Successfully created port: 4312d216-4dad-48e3-b3f5-fda6ff4a2a66 {{(pid=75245) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 17:03:01 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:03:02 user nova-compute[75245]: DEBUG nova.network.neutron [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Successfully updated port: 4312d216-4dad-48e3-b3f5-fda6ff4a2a66 {{(pid=75245) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 17:03:02 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Acquiring lock "refresh_cache-24b84c61-6ea0-4187-abc8-80a967d5bf70" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:03:02 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Acquired lock "refresh_cache-24b84c61-6ea0-4187-abc8-80a967d5bf70" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:03:02 user nova-compute[75245]: DEBUG nova.network.neutron [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 17:03:02 user nova-compute[75245]: DEBUG nova.compute.manager [req-9e035038-f648-4774-87bb-87f493f08ed3 req-a5062a91-4cdf-4879-bbdd-427868ad5063 service nova] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Received event network-changed-4312d216-4dad-48e3-b3f5-fda6ff4a2a66 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:03:02 user nova-compute[75245]: DEBUG nova.compute.manager [req-9e035038-f648-4774-87bb-87f493f08ed3 req-a5062a91-4cdf-4879-bbdd-427868ad5063 service nova] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Refreshing instance network info cache due to event network-changed-4312d216-4dad-48e3-b3f5-fda6ff4a2a66. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 17:03:02 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-9e035038-f648-4774-87bb-87f493f08ed3 req-a5062a91-4cdf-4879-bbdd-427868ad5063 service nova] Acquiring lock "refresh_cache-24b84c61-6ea0-4187-abc8-80a967d5bf70" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:03:02 user nova-compute[75245]: DEBUG nova.network.neutron [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Instance cache missing network info. {{(pid=75245) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 17:03:02 user nova-compute[75245]: DEBUG nova.network.neutron [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Updating instance_info_cache with network_info: [{"id": "4312d216-4dad-48e3-b3f5-fda6ff4a2a66", "address": "fa:16:3e:a9:76:89", "network": {"id": "316cb9af-807d-4a69-874e-2054520f0e5f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1421560477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0907dff4e054429fa10392b730363eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4312d216-4d", "ovs_interfaceid": "4312d216-4dad-48e3-b3f5-fda6ff4a2a66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:03:02 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Releasing lock "refresh_cache-24b84c61-6ea0-4187-abc8-80a967d5bf70" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:03:02 user nova-compute[75245]: DEBUG nova.compute.manager [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Instance network_info: |[{"id": "4312d216-4dad-48e3-b3f5-fda6ff4a2a66", "address": "fa:16:3e:a9:76:89", "network": {"id": "316cb9af-807d-4a69-874e-2054520f0e5f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1421560477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0907dff4e054429fa10392b730363eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4312d216-4d", "ovs_interfaceid": "4312d216-4dad-48e3-b3f5-fda6ff4a2a66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 17:03:02 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-9e035038-f648-4774-87bb-87f493f08ed3 req-a5062a91-4cdf-4879-bbdd-427868ad5063 service nova] Acquired lock "refresh_cache-24b84c61-6ea0-4187-abc8-80a967d5bf70" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:03:02 user nova-compute[75245]: DEBUG nova.network.neutron [req-9e035038-f648-4774-87bb-87f493f08ed3 req-a5062a91-4cdf-4879-bbdd-427868ad5063 service nova] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Refreshing network info cache for port 4312d216-4dad-48e3-b3f5-fda6ff4a2a66 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 17:03:03 user nova-compute[75245]: DEBUG nova.network.neutron [req-9e035038-f648-4774-87bb-87f493f08ed3 req-a5062a91-4cdf-4879-bbdd-427868ad5063 service nova] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Updated VIF entry in instance network info cache for port 4312d216-4dad-48e3-b3f5-fda6ff4a2a66. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 17:03:03 user nova-compute[75245]: DEBUG nova.network.neutron [req-9e035038-f648-4774-87bb-87f493f08ed3 req-a5062a91-4cdf-4879-bbdd-427868ad5063 service nova] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Updating instance_info_cache with network_info: [{"id": "4312d216-4dad-48e3-b3f5-fda6ff4a2a66", "address": "fa:16:3e:a9:76:89", "network": {"id": "316cb9af-807d-4a69-874e-2054520f0e5f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1421560477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0907dff4e054429fa10392b730363eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4312d216-4d", "ovs_interfaceid": "4312d216-4dad-48e3-b3f5-fda6ff4a2a66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:03:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-9e035038-f648-4774-87bb-87f493f08ed3 req-a5062a91-4cdf-4879-bbdd-427868ad5063 service nova] Releasing lock "refresh_cache-24b84c61-6ea0-4187-abc8-80a967d5bf70" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:03:06 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:03:08 user nova-compute[75245]: DEBUG nova.compute.manager [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Start spawning the instance on the hypervisor. {{(pid=75245) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 17:03:08 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Creating instance directory {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 17:03:08 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Creating image(s)
Nov 29 17:03:08 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Did not create local disks {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 17:03:08 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Ensure instance console log exists: /opt/stack/data/nova/instances/24b84c61-6ea0-4187-abc8-80a967d5bf70/console.log {{(pid=75245) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 17:03:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:03:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:03:08 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:03:08 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Start _get_guest_xml network_info=[{"id": "4312d216-4dad-48e3-b3f5-fda6ff4a2a66", "address": "fa:16:3e:a9:76:89", "network": {"id": "316cb9af-807d-4a69-874e-2054520f0e5f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1421560477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0907dff4e054429fa10392b730363eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4312d216-4d", "ovs_interfaceid": "4312d216-4dad-48e3-b3f5-fda6ff4a2a66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': 'ac7bc751-c480-43f2-8544-a0903cd85521', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TzHCXFWr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '24b84c61-6ea0-4187-abc8-80a967d5bf70', 'attached_at': '', 'detached_at': '', 'volume_id': '64b1f27b-9bd5-40d8-af17-c9f4ec603535', 'serial': '64b1f27b-9bd5-40d8-af17-c9f4ec603535'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'guest_format': None, 'volume_type': None} {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 17:03:08 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:03:08 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:03:08 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 17:03:08 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] CPU controller missing on host. {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 17:03:08 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 17:03:08 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] CPU controller found on host. {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 17:03:08 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75245) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 17:03:08 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T16:06:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 17:03:08 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Flavor limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 17:03:08 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Image limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 17:03:08 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Flavor pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 17:03:08 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Image pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 17:03:08 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 17:03:08 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 17:03:08 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 17:03:08 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Got 1 possible topologies {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 17:03:08 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 17:03:08 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 17:03:08 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Calling os-brick to attach iSCSI Volume {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 17:03:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TzHCXFWr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:03:08 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:03:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:03:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:03:08 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:03:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:03:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:03:08 user nova-compute[75245]: INFO os_brick.initiator.connectors.iscsi [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 17:03:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535 -p 172.16.0.220:3260 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:03:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:03:08 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[14edc3d8-134b-44a9-8192-937c3eaa236f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:03:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 17:03:08 user nova-compute[75245]:  {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:03:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535 -p 172.16.0.220:3260 --interface default --op new {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:03:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:03:08 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e68bcd0-4dd3-44f3-ae93-19d7166ca75e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535] added\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:03:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535] added
Nov 29 17:03:08 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:03:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:03:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:03:08 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb0dcdd-fc74-414b-b853-c476a652590a]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:03:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:03:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:03:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:03:08 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[27adb3b3-8457-4d67-b5db-86e979bfdc7d]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:03:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:03:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TzHCXFWr {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:03:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TzHCXFWr" returned: 0 in 0.023s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:03:08 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f82861-3aa7-438d-af6b-0724325d69ff]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:03:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TzHCXFWr'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:03:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:03:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:03:08 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae155baf-39c8-4a40-ac5f-8688aa01078e]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:03:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:03:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:03:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:03:08 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[905e6e6a-7ef2-4468-b4ce-c37ec0f090dc]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:03:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 17:03:08 user nova-compute[75245]:  {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:03:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 17:03:08 user nova-compute[75245]:  {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:03:08 user nova-compute[75245]: WARNING os_brick.initiator.connectors.iscsi [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 17:03:08 user nova-compute[75245]: 
Nov 29 17:03:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535 -p 172.16.0.220:3260 --login {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:03:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:03:08 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1be7d87-aad6-48d5-b8ec-dc9e01ada03f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:03:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535, portal: 172.16.0.220,3260]
Nov 29 17:03:08 user nova-compute[75245]: Login to [iface: default, target: iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535, portal: 172.16.0.220,3260] successful.
Nov 29 17:03:08 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:03:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:03:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:03:08 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0288a97-a7ad-4dba-b139-335df809672e]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:03:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:03:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:03:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:03:08 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fbf66c2-c054-4ae3-b985-ce6d44a8e009]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:03:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535 (non-flash)
Nov 29 17:03:08 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:03:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535 (non-flash)
Nov 29 17:03:08 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:03:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:03:08 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Connected to 172.16.0.220:3260 {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 17:03:08 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=75245) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 17:03:08 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75245) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 17:03:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:03:08 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:03:08 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f527b4-2e4c-45bc-af0f-dd7f8fbd5852]: (4, ('- - 0', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:03:08 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: None {{(pid=75245) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 17:03:09 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75245) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 17:03:09 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TzHCXFWr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 17:03:09 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.281s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:03:09 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] <== connect_volume: return (1283ms) {'type': 'block', 'scsi_wwn': '23431343336363564', 'path': '/dev/sdb'} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:03:09 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23431343336363564', 'path': '/dev/sdb'} {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 17:03:09 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T17:02:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1870259533',display_name='tempest-TestVolumeBootPattern-server-1870259533',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1870259533',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/6kahxqemcvv41mFTGeaM46NrxYZRkkk4Ze4uyAwqVYPXEaYTvEEpOxaMUDr0qjGaA6sscRII1lYPmpLMrkcup8Fj5nDL441po4R7XAC4kU9bdh8ehoEbo0Y9HtbsAfw==',key_name='tempest-TestVolumeBootPattern-280401073',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0907dff4e054429fa10392b730363eb2',ramdisk_id='',reservation_id='r-l0v56rjx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-181783012',owner_user_name='tempest-TestVolumeBootPattern-181783012-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T17:03:01Z,user_data=None,user_id='2870721a7fff4cf19291f0cbfaedae81',uuid=24b84c61-6ea0-4187-abc8-80a967d5bf70,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4312d216-4dad-48e3-b3f5-fda6ff4a2a66", "address": "fa:16:3e:a9:76:89", "network": {"id": "316cb9af-807d-4a69-874e-2054520f0e5f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1421560477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0907dff4e054429fa10392b730363eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4312d216-4d", "ovs_interfaceid": "4312d216-4dad-48e3-b3f5-fda6ff4a2a66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 17:03:09 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Converting VIF {"id": "4312d216-4dad-48e3-b3f5-fda6ff4a2a66", "address": "fa:16:3e:a9:76:89", "network": {"id": "316cb9af-807d-4a69-874e-2054520f0e5f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1421560477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0907dff4e054429fa10392b730363eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4312d216-4d", "ovs_interfaceid": "4312d216-4dad-48e3-b3f5-fda6ff4a2a66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:03:09 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:76:89,bridge_name='br-int',has_traffic_filtering=True,id=4312d216-4dad-48e3-b3f5-fda6ff4a2a66,network=Network(316cb9af-807d-4a69-874e-2054520f0e5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4312d216-4d') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:03:09 user nova-compute[75245]: DEBUG nova.objects.instance [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lazy-loading 'pci_devices' on Instance uuid 24b84c61-6ea0-4187-abc8-80a967d5bf70 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:03:09 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] End _get_guest_xml xml=<domain type="kvm">
Nov 29 17:03:09 user nova-compute[75245]:   <uuid>24b84c61-6ea0-4187-abc8-80a967d5bf70</uuid>
Nov 29 17:03:09 user nova-compute[75245]:   <name>instance-00000032</name>
Nov 29 17:03:09 user nova-compute[75245]:   <memory>524288</memory>
Nov 29 17:03:09 user nova-compute[75245]:   <vcpu>1</vcpu>
Nov 29 17:03:09 user nova-compute[75245]:   <metadata>
Nov 29 17:03:09 user nova-compute[75245]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 17:03:09 user nova-compute[75245]:       <nova:package version="0.0.0"/>
Nov 29 17:03:09 user nova-compute[75245]:       <nova:name>tempest-TestVolumeBootPattern-server-1870259533</nova:name>
Nov 29 17:03:09 user nova-compute[75245]:       <nova:creationTime>2023-11-29 17:03:08</nova:creationTime>
Nov 29 17:03:09 user nova-compute[75245]:       <nova:flavor name="m1.tiny">
Nov 29 17:03:09 user nova-compute[75245]:         <nova:memory>512</nova:memory>
Nov 29 17:03:09 user nova-compute[75245]:         <nova:disk>1</nova:disk>
Nov 29 17:03:09 user nova-compute[75245]:         <nova:swap>0</nova:swap>
Nov 29 17:03:09 user nova-compute[75245]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 17:03:09 user nova-compute[75245]:         <nova:vcpus>1</nova:vcpus>
Nov 29 17:03:09 user nova-compute[75245]:       </nova:flavor>
Nov 29 17:03:09 user nova-compute[75245]:       <nova:owner>
Nov 29 17:03:09 user nova-compute[75245]:         <nova:user uuid="2870721a7fff4cf19291f0cbfaedae81">tempest-TestVolumeBootPattern-181783012-project-member</nova:user>
Nov 29 17:03:09 user nova-compute[75245]:         <nova:project uuid="0907dff4e054429fa10392b730363eb2">tempest-TestVolumeBootPattern-181783012</nova:project>
Nov 29 17:03:09 user nova-compute[75245]:       </nova:owner>
Nov 29 17:03:09 user nova-compute[75245]:       <nova:ports>
Nov 29 17:03:09 user nova-compute[75245]:         <nova:port uuid="4312d216-4dad-48e3-b3f5-fda6ff4a2a66">
Nov 29 17:03:09 user nova-compute[75245]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 29 17:03:09 user nova-compute[75245]:         </nova:port>
Nov 29 17:03:09 user nova-compute[75245]:       </nova:ports>
Nov 29 17:03:09 user nova-compute[75245]:     </nova:instance>
Nov 29 17:03:09 user nova-compute[75245]:   </metadata>
Nov 29 17:03:09 user nova-compute[75245]:   <sysinfo type="smbios">
Nov 29 17:03:09 user nova-compute[75245]:     <system>
Nov 29 17:03:09 user nova-compute[75245]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 17:03:09 user nova-compute[75245]:       <entry name="product">OpenStack Nova</entry>
Nov 29 17:03:09 user nova-compute[75245]:       <entry name="version">0.0.0</entry>
Nov 29 17:03:09 user nova-compute[75245]:       <entry name="serial">24b84c61-6ea0-4187-abc8-80a967d5bf70</entry>
Nov 29 17:03:09 user nova-compute[75245]:       <entry name="uuid">24b84c61-6ea0-4187-abc8-80a967d5bf70</entry>
Nov 29 17:03:09 user nova-compute[75245]:       <entry name="family">Virtual Machine</entry>
Nov 29 17:03:09 user nova-compute[75245]:     </system>
Nov 29 17:03:09 user nova-compute[75245]:   </sysinfo>
Nov 29 17:03:09 user nova-compute[75245]:   <os>
Nov 29 17:03:09 user nova-compute[75245]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 17:03:09 user nova-compute[75245]:     <boot dev="hd"/>
Nov 29 17:03:09 user nova-compute[75245]:     <smbios mode="sysinfo"/>
Nov 29 17:03:09 user nova-compute[75245]:   </os>
Nov 29 17:03:09 user nova-compute[75245]:   <features>
Nov 29 17:03:09 user nova-compute[75245]:     <acpi/>
Nov 29 17:03:09 user nova-compute[75245]:     <apic/>
Nov 29 17:03:09 user nova-compute[75245]:     <vmcoreinfo/>
Nov 29 17:03:09 user nova-compute[75245]:   </features>
Nov 29 17:03:09 user nova-compute[75245]:   <clock offset="utc">
Nov 29 17:03:09 user nova-compute[75245]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 17:03:09 user nova-compute[75245]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 17:03:09 user nova-compute[75245]:     <timer name="hpet" present="no"/>
Nov 29 17:03:09 user nova-compute[75245]:   </clock>
Nov 29 17:03:09 user nova-compute[75245]:   <cpu mode="custom" match="exact">
Nov 29 17:03:09 user nova-compute[75245]:     <model>Nehalem</model>
Nov 29 17:03:09 user nova-compute[75245]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 17:03:09 user nova-compute[75245]:   </cpu>
Nov 29 17:03:09 user nova-compute[75245]:   <devices>
Nov 29 17:03:09 user nova-compute[75245]:     <disk type="block" device="disk">
Nov 29 17:03:09 user nova-compute[75245]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 17:03:09 user nova-compute[75245]:       <source dev="/dev/sdb"/>
Nov 29 17:03:09 user nova-compute[75245]:       <target dev="vda" bus="virtio"/>
Nov 29 17:03:09 user nova-compute[75245]:       <serial>64b1f27b-9bd5-40d8-af17-c9f4ec603535</serial>
Nov 29 17:03:09 user nova-compute[75245]:     </disk>
Nov 29 17:03:09 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 17:03:09 user nova-compute[75245]:       <mac address="fa:16:3e:a9:76:89"/>
Nov 29 17:03:09 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 17:03:09 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 17:03:09 user nova-compute[75245]:       <target dev="tap4312d216-4d"/>
Nov 29 17:03:09 user nova-compute[75245]:     </interface>
Nov 29 17:03:09 user nova-compute[75245]:     <serial type="pty">
Nov 29 17:03:09 user nova-compute[75245]:       <log file="/opt/stack/data/nova/instances/24b84c61-6ea0-4187-abc8-80a967d5bf70/console.log" append="off"/>
Nov 29 17:03:09 user nova-compute[75245]:     </serial>
Nov 29 17:03:09 user nova-compute[75245]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 17:03:09 user nova-compute[75245]:     <video>
Nov 29 17:03:09 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 17:03:09 user nova-compute[75245]:     </video>
Nov 29 17:03:09 user nova-compute[75245]:     <rng model="virtio">
Nov 29 17:03:09 user nova-compute[75245]:       <backend model="random">/dev/urandom</backend>
Nov 29 17:03:09 user nova-compute[75245]:     </rng>
Nov 29 17:03:09 user nova-compute[75245]:     <controller type="usb" index="0" model="none"/>
Nov 29 17:03:09 user nova-compute[75245]:     <memballoon model="virtio">
Nov 29 17:03:09 user nova-compute[75245]:       <stats period="10"/>
Nov 29 17:03:09 user nova-compute[75245]:     </memballoon>
Nov 29 17:03:09 user nova-compute[75245]:   </devices>
Nov 29 17:03:09 user nova-compute[75245]: </domain>
Nov 29 17:03:09 user nova-compute[75245]:  {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 17:03:10 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T17:02:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1870259533',display_name='tempest-TestVolumeBootPattern-server-1870259533',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1870259533',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/6kahxqemcvv41mFTGeaM46NrxYZRkkk4Ze4uyAwqVYPXEaYTvEEpOxaMUDr0qjGaA6sscRII1lYPmpLMrkcup8Fj5nDL441po4R7XAC4kU9bdh8ehoEbo0Y9HtbsAfw==',key_name='tempest-TestVolumeBootPattern-280401073',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0907dff4e054429fa10392b730363eb2',ramdisk_id='',reservation_id='r-l0v56rjx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-181783012',owner_user_name='tempest-TestVolumeBootPattern-181783012-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T17:03:01Z,user_data=None,user_id='2870721a7fff4cf19291f0cbfaedae81',uuid=24b84c61-6ea0-4187-abc8-80a967d5bf70,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4312d216-4dad-48e3-b3f5-fda6ff4a2a66", "address": "fa:16:3e:a9:76:89", "network": {"id": "316cb9af-807d-4a69-874e-2054520f0e5f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1421560477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0907dff4e054429fa10392b730363eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4312d216-4d", "ovs_interfaceid": "4312d216-4dad-48e3-b3f5-fda6ff4a2a66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 17:03:10 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Converting VIF {"id": "4312d216-4dad-48e3-b3f5-fda6ff4a2a66", "address": "fa:16:3e:a9:76:89", "network": {"id": "316cb9af-807d-4a69-874e-2054520f0e5f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1421560477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0907dff4e054429fa10392b730363eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4312d216-4d", "ovs_interfaceid": "4312d216-4dad-48e3-b3f5-fda6ff4a2a66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:03:10 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:76:89,bridge_name='br-int',has_traffic_filtering=True,id=4312d216-4dad-48e3-b3f5-fda6ff4a2a66,network=Network(316cb9af-807d-4a69-874e-2054520f0e5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4312d216-4d') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:03:10 user nova-compute[75245]: DEBUG os_vif [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:76:89,bridge_name='br-int',has_traffic_filtering=True,id=4312d216-4dad-48e3-b3f5-fda6ff4a2a66,network=Network(316cb9af-807d-4a69-874e-2054520f0e5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4312d216-4d') {{(pid=75245) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 17:03:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:03:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:03:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 17:03:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:03:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bad661af-120e-5753-8bba-e3babf9a3230', '_type': 'linux-noop'}}, row=False) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:03:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:03:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:03:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:03:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4312d216-4d, may_exist=True, interface_attrs={}) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:03:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4312d216-4d, col_values=(('qos', UUID('7705575a-51ea-40a9-8d1c-2c3a95ca8215')),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:03:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4312d216-4d, col_values=(('external_ids', {'iface-id': '4312d216-4dad-48e3-b3f5-fda6ff4a2a66', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:76:89', 'vm-uuid': '24b84c61-6ea0-4187-abc8-80a967d5bf70'}),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:03:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:03:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:03:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:03:10 user nova-compute[75245]: INFO os_vif [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:76:89,bridge_name='br-int',has_traffic_filtering=True,id=4312d216-4dad-48e3-b3f5-fda6ff4a2a66,network=Network(316cb9af-807d-4a69-874e-2054520f0e5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4312d216-4d')
Nov 29 17:03:10 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 17:03:10 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] No VIF found with MAC fa:16:3e:a9:76:89, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 17:03:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:03:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:03:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:03:11 user nova-compute[75245]: DEBUG nova.compute.manager [req-01aefb21-66b2-4e8d-952e-d383af707fc2 req-680ac986-eda6-4ec5-ba64-2ce8b9c050ef service nova] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Received event network-vif-plugged-4312d216-4dad-48e3-b3f5-fda6ff4a2a66 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:03:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-01aefb21-66b2-4e8d-952e-d383af707fc2 req-680ac986-eda6-4ec5-ba64-2ce8b9c050ef service nova] Acquiring lock "24b84c61-6ea0-4187-abc8-80a967d5bf70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:03:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-01aefb21-66b2-4e8d-952e-d383af707fc2 req-680ac986-eda6-4ec5-ba64-2ce8b9c050ef service nova] Lock "24b84c61-6ea0-4187-abc8-80a967d5bf70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:03:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-01aefb21-66b2-4e8d-952e-d383af707fc2 req-680ac986-eda6-4ec5-ba64-2ce8b9c050ef service nova] Lock "24b84c61-6ea0-4187-abc8-80a967d5bf70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:03:11 user nova-compute[75245]: DEBUG nova.compute.manager [req-01aefb21-66b2-4e8d-952e-d383af707fc2 req-680ac986-eda6-4ec5-ba64-2ce8b9c050ef service nova] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] No waiting events found dispatching network-vif-plugged-4312d216-4dad-48e3-b3f5-fda6ff4a2a66 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:03:11 user nova-compute[75245]: WARNING nova.compute.manager [req-01aefb21-66b2-4e8d-952e-d383af707fc2 req-680ac986-eda6-4ec5-ba64-2ce8b9c050ef service nova] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Received unexpected event network-vif-plugged-4312d216-4dad-48e3-b3f5-fda6ff4a2a66 for instance with vm_state building and task_state spawning.
Nov 29 17:03:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:03:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:03:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:03:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:03:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:03:13 user nova-compute[75245]: DEBUG nova.compute.manager [req-2f3ee04c-b8b7-4d77-b2e9-b32d7f287ae9 req-2382ee0e-a722-4099-b70c-37b4ec60bc20 service nova] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Received event network-vif-plugged-4312d216-4dad-48e3-b3f5-fda6ff4a2a66 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:03:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-2f3ee04c-b8b7-4d77-b2e9-b32d7f287ae9 req-2382ee0e-a722-4099-b70c-37b4ec60bc20 service nova] Acquiring lock "24b84c61-6ea0-4187-abc8-80a967d5bf70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:03:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-2f3ee04c-b8b7-4d77-b2e9-b32d7f287ae9 req-2382ee0e-a722-4099-b70c-37b4ec60bc20 service nova] Lock "24b84c61-6ea0-4187-abc8-80a967d5bf70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:03:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-2f3ee04c-b8b7-4d77-b2e9-b32d7f287ae9 req-2382ee0e-a722-4099-b70c-37b4ec60bc20 service nova] Lock "24b84c61-6ea0-4187-abc8-80a967d5bf70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:03:13 user nova-compute[75245]: DEBUG nova.compute.manager [req-2f3ee04c-b8b7-4d77-b2e9-b32d7f287ae9 req-2382ee0e-a722-4099-b70c-37b4ec60bc20 service nova] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] No waiting events found dispatching network-vif-plugged-4312d216-4dad-48e3-b3f5-fda6ff4a2a66 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:03:13 user nova-compute[75245]: WARNING nova.compute.manager [req-2f3ee04c-b8b7-4d77-b2e9-b32d7f287ae9 req-2382ee0e-a722-4099-b70c-37b4ec60bc20 service nova] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Received unexpected event network-vif-plugged-4312d216-4dad-48e3-b3f5-fda6ff4a2a66 for instance with vm_state building and task_state spawning.
Nov 29 17:03:13 user nova-compute[75245]: DEBUG nova.compute.manager [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Instance event wait completed in 0 seconds for  {{(pid=75245) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 17:03:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Guest created on hypervisor {{(pid=75245) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 17:03:13 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Instance spawned successfully.
Nov 29 17:03:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 17:03:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Found default for hw_cdrom_bus of ide {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:03:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Found default for hw_disk_bus of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:03:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Found default for hw_input_bus of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:03:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Found default for hw_pointer_model of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:03:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Found default for hw_video_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:03:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Found default for hw_vif_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:03:13 user nova-compute[75245]: INFO nova.compute.manager [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Took 5.24 seconds to spawn the instance on the hypervisor.
Nov 29 17:03:13 user nova-compute[75245]: DEBUG nova.compute.manager [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 17:03:13 user nova-compute[75245]: INFO nova.compute.manager [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Took 13.31 seconds to build instance.
Nov 29 17:03:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-104c6bce-dca9-4568-84f1-97841e42bc43 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "24b84c61-6ea0-4187-abc8-80a967d5bf70" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.407s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:03:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:03:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:03:20 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:03:20 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:03:20 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75245) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 17:03:20 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 17:03:20 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 17:03:20 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:03:25 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:03:29 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:03:30 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:03:32 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:03:32 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Starting heal instance info cache {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 17:03:32 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Rebuilding the list of instances to heal {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 17:03:32 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "refresh_cache-24b84c61-6ea0-4187-abc8-80a967d5bf70" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:03:32 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquired lock "refresh_cache-24b84c61-6ea0-4187-abc8-80a967d5bf70" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:03:32 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Forcefully refreshing network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 17:03:32 user nova-compute[75245]: DEBUG nova.objects.instance [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lazy-loading 'info_cache' on Instance uuid 24b84c61-6ea0-4187-abc8-80a967d5bf70 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:03:32 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Updating instance_info_cache with network_info: [{"id": "4312d216-4dad-48e3-b3f5-fda6ff4a2a66", "address": "fa:16:3e:a9:76:89", "network": {"id": "316cb9af-807d-4a69-874e-2054520f0e5f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1421560477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0907dff4e054429fa10392b730363eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4312d216-4d", "ovs_interfaceid": "4312d216-4dad-48e3-b3f5-fda6ff4a2a66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:03:32 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Releasing lock "refresh_cache-24b84c61-6ea0-4187-abc8-80a967d5bf70" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:03:32 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Updated the network info_cache for instance {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 17:03:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:03:35 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:03:36 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:03:36 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:03:37 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:03:37 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:03:37 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:03:37 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:03:37 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75245) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 17:03:37 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 17:03:37 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:03:37 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:03:37 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Hypervisor/Node resource view: name=user free_ram=8899MB free_disk=25.08426284790039GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75245) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 17:03:37 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:03:37 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:03:38 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 24b84c61-6ea0-4187-abc8-80a967d5bf70 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:03:38 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 17:03:38 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 17:03:38 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 17:03:38 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 17:03:38 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Compute_service record updated for user:user {{(pid=75245) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 17:03:38 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.190s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:03:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:03:40 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:03:41 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:03:41 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:03:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:03:45 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:03:47 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:03:47 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:03:47 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75245) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 17:03:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:03:50 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:03:53 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:03:55 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:04:00 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:04:05 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:04:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:04:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:04:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:04:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75245) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 17:04:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 17:04:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 17:04:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:04:20 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:04:25 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:04:30 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:04:30 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:04:30 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75245) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 17:04:30 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 17:04:30 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 17:04:30 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:04:33 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:04:33 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Starting heal instance info cache {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 17:04:33 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Rebuilding the list of instances to heal {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 17:04:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "refresh_cache-24b84c61-6ea0-4187-abc8-80a967d5bf70" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:04:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquired lock "refresh_cache-24b84c61-6ea0-4187-abc8-80a967d5bf70" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:04:33 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Forcefully refreshing network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 17:04:33 user nova-compute[75245]: DEBUG nova.objects.instance [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lazy-loading 'info_cache' on Instance uuid 24b84c61-6ea0-4187-abc8-80a967d5bf70 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:04:33 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Updating instance_info_cache with network_info: [{"id": "4312d216-4dad-48e3-b3f5-fda6ff4a2a66", "address": "fa:16:3e:a9:76:89", "network": {"id": "316cb9af-807d-4a69-874e-2054520f0e5f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1421560477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0907dff4e054429fa10392b730363eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4312d216-4d", "ovs_interfaceid": "4312d216-4dad-48e3-b3f5-fda6ff4a2a66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:04:34 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Releasing lock "refresh_cache-24b84c61-6ea0-4187-abc8-80a967d5bf70" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:04:34 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Updated the network info_cache for instance {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 17:04:35 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:04:37 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:04:37 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:04:37 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:04:37 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:04:37 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:04:37 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75245) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 17:04:37 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 17:04:37 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:04:37 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:04:37 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Hypervisor/Node resource view: name=user free_ram=8955MB free_disk=25.082046508789062GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75245) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 17:04:37 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:04:37 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:04:38 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 24b84c61-6ea0-4187-abc8-80a967d5bf70 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:04:38 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 17:04:38 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 17:04:38 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 17:04:38 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 17:04:38 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Compute_service record updated for user:user {{(pid=75245) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 17:04:38 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.363s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:04:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:04:40 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:04:43 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:04:43 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:04:45 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:04:47 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:04:47 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75245) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 17:04:48 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:04:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:04:50 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:04:52 user nova-compute[75245]: DEBUG nova.compute.manager [req-94f32c9c-9d7c-4498-b0d7-0fddce670893 req-0a7f6987-3e3c-4810-899e-ca56be82321b service nova] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Received event network-changed-4312d216-4dad-48e3-b3f5-fda6ff4a2a66 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:04:52 user nova-compute[75245]: DEBUG nova.compute.manager [req-94f32c9c-9d7c-4498-b0d7-0fddce670893 req-0a7f6987-3e3c-4810-899e-ca56be82321b service nova] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Refreshing instance network info cache due to event network-changed-4312d216-4dad-48e3-b3f5-fda6ff4a2a66. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 17:04:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-94f32c9c-9d7c-4498-b0d7-0fddce670893 req-0a7f6987-3e3c-4810-899e-ca56be82321b service nova] Acquiring lock "refresh_cache-24b84c61-6ea0-4187-abc8-80a967d5bf70" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:04:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-94f32c9c-9d7c-4498-b0d7-0fddce670893 req-0a7f6987-3e3c-4810-899e-ca56be82321b service nova] Acquired lock "refresh_cache-24b84c61-6ea0-4187-abc8-80a967d5bf70" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:04:52 user nova-compute[75245]: DEBUG nova.network.neutron [req-94f32c9c-9d7c-4498-b0d7-0fddce670893 req-0a7f6987-3e3c-4810-899e-ca56be82321b service nova] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Refreshing network info cache for port 4312d216-4dad-48e3-b3f5-fda6ff4a2a66 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 17:04:53 user nova-compute[75245]: DEBUG nova.network.neutron [req-94f32c9c-9d7c-4498-b0d7-0fddce670893 req-0a7f6987-3e3c-4810-899e-ca56be82321b service nova] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Updated VIF entry in instance network info cache for port 4312d216-4dad-48e3-b3f5-fda6ff4a2a66. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 17:04:53 user nova-compute[75245]: DEBUG nova.network.neutron [req-94f32c9c-9d7c-4498-b0d7-0fddce670893 req-0a7f6987-3e3c-4810-899e-ca56be82321b service nova] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Updating instance_info_cache with network_info: [{"id": "4312d216-4dad-48e3-b3f5-fda6ff4a2a66", "address": "fa:16:3e:a9:76:89", "network": {"id": "316cb9af-807d-4a69-874e-2054520f0e5f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1421560477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0907dff4e054429fa10392b730363eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4312d216-4d", "ovs_interfaceid": "4312d216-4dad-48e3-b3f5-fda6ff4a2a66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:04:53 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-94f32c9c-9d7c-4498-b0d7-0fddce670893 req-0a7f6987-3e3c-4810-899e-ca56be82321b service nova] Releasing lock "refresh_cache-24b84c61-6ea0-4187-abc8-80a967d5bf70" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:04:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:04:55 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:04:55 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:04:59 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:05:00 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:05:01 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Acquiring lock "3bc30b2b-4f87-4f25-bdc9-870170d1d87a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:05:01 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "3bc30b2b-4f87-4f25-bdc9-870170d1d87a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:05:01 user nova-compute[75245]: DEBUG nova.compute.manager [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] Starting instance... {{(pid=75245) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 17:05:01 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:05:01 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:05:01 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75245) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 17:05:01 user nova-compute[75245]: INFO nova.compute.claims [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] Claim successful on node user
Nov 29 17:05:01 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:05:01 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 17:05:01 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 17:05:01 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.335s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:05:01 user nova-compute[75245]: DEBUG nova.compute.manager [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] Start building networks asynchronously for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 17:05:01 user nova-compute[75245]: DEBUG nova.compute.manager [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] Allocating IP information in the background. {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 17:05:01 user nova-compute[75245]: DEBUG nova.network.neutron [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] allocate_for_instance() {{(pid=75245) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 17:05:01 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 17:05:01 user nova-compute[75245]: DEBUG nova.compute.manager [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] Start building block device mappings for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 17:05:01 user nova-compute[75245]: DEBUG nova.policy [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2870721a7fff4cf19291f0cbfaedae81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907dff4e054429fa10392b730363eb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75245) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 17:05:01 user nova-compute[75245]: INFO nova.virt.block_device [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] Booting with volume 38894568-48a0-4bb3-8bcc-958f240a359a at /dev/vda
Nov 29 17:05:01 user nova-compute[75245]: DEBUG os_brick.utils [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:05:01 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:05:01 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:05:01 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c9dd64-e46c-4774-b61a-d67d5f94e772]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:69ed8ed87091\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:05:01 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:05:01 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:05:01 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a54007-1810-441d-9cf5-302ead4b2b86]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:05:01 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:05:01 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:05:01 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad0dcd5-a502-467c-9c8c-9287cd2feb06]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:05:01 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[e08a4e53-f692-489b-9872-617c38b8cd12]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:05:01 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Running cmd (subprocess): nvme version {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:05:02 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] 'nvme version' failed. Not Retrying. {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 17:05:02 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] nvme not present on system {{(pid=75245) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 17:05:02 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:05:02 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 17:05:02 user nova-compute[75245]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 17:05:02 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[3631ceb4-8155-41a5-a78d-49397709fbfc]: (4, '') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:05:02 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75245) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 17:05:02 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 17:05:02 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] LIGHTOS: no hostnqn found. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 17:05:02 user nova-compute[75245]: DEBUG os_brick.utils [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:69ed8ed87091', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:05:02 user nova-compute[75245]: DEBUG nova.virt.block_device [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] Updating existing volume attachment record: 6e2c7ea9-a37a-4eab-9283-0f714538d345 {{(pid=75245) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 17:05:02 user nova-compute[75245]: DEBUG nova.network.neutron [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] Successfully created port: 33161be2-34ff-4c91-853a-072c30869966 {{(pid=75245) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 17:05:03 user nova-compute[75245]: DEBUG nova.network.neutron [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] Successfully updated port: 33161be2-34ff-4c91-853a-072c30869966 {{(pid=75245) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 17:05:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Acquiring lock "refresh_cache-3bc30b2b-4f87-4f25-bdc9-870170d1d87a" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:05:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Acquired lock "refresh_cache-3bc30b2b-4f87-4f25-bdc9-870170d1d87a" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:05:03 user nova-compute[75245]: DEBUG nova.network.neutron [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 17:05:03 user nova-compute[75245]: DEBUG nova.network.neutron [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] Instance cache missing network info. {{(pid=75245) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 17:05:03 user nova-compute[75245]: DEBUG nova.compute.manager [req-330aef10-8a8f-43a9-8f9a-a1ee533a164d req-9b94cf01-db28-4a6f-a32a-c3e79c472c6e service nova] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] Received event network-changed-33161be2-34ff-4c91-853a-072c30869966 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:05:03 user nova-compute[75245]: DEBUG nova.compute.manager [req-330aef10-8a8f-43a9-8f9a-a1ee533a164d req-9b94cf01-db28-4a6f-a32a-c3e79c472c6e service nova] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] Refreshing instance network info cache due to event network-changed-33161be2-34ff-4c91-853a-072c30869966. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 17:05:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-330aef10-8a8f-43a9-8f9a-a1ee533a164d req-9b94cf01-db28-4a6f-a32a-c3e79c472c6e service nova] Acquiring lock "refresh_cache-3bc30b2b-4f87-4f25-bdc9-870170d1d87a" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:05:03 user nova-compute[75245]: DEBUG nova.network.neutron [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] Updating instance_info_cache with network_info: [{"id": "33161be2-34ff-4c91-853a-072c30869966", "address": "fa:16:3e:32:67:f9", "network": {"id": "316cb9af-807d-4a69-874e-2054520f0e5f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1421560477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0907dff4e054429fa10392b730363eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33161be2-34", "ovs_interfaceid": "33161be2-34ff-4c91-853a-072c30869966", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:05:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Releasing lock "refresh_cache-3bc30b2b-4f87-4f25-bdc9-870170d1d87a" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:05:03 user nova-compute[75245]: DEBUG nova.compute.manager [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] Instance network_info: |[{"id": "33161be2-34ff-4c91-853a-072c30869966", "address": "fa:16:3e:32:67:f9", "network": {"id": "316cb9af-807d-4a69-874e-2054520f0e5f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1421560477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0907dff4e054429fa10392b730363eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33161be2-34", "ovs_interfaceid": "33161be2-34ff-4c91-853a-072c30869966", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 17:05:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-330aef10-8a8f-43a9-8f9a-a1ee533a164d req-9b94cf01-db28-4a6f-a32a-c3e79c472c6e service nova] Acquired lock "refresh_cache-3bc30b2b-4f87-4f25-bdc9-870170d1d87a" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:05:03 user nova-compute[75245]: DEBUG nova.network.neutron [req-330aef10-8a8f-43a9-8f9a-a1ee533a164d req-9b94cf01-db28-4a6f-a32a-c3e79c472c6e service nova] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] Refreshing network info cache for port 33161be2-34ff-4c91-853a-072c30869966 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 17:05:04 user nova-compute[75245]: DEBUG nova.network.neutron [req-330aef10-8a8f-43a9-8f9a-a1ee533a164d req-9b94cf01-db28-4a6f-a32a-c3e79c472c6e service nova] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] Updated VIF entry in instance network info cache for port 33161be2-34ff-4c91-853a-072c30869966. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 17:05:04 user nova-compute[75245]: DEBUG nova.network.neutron [req-330aef10-8a8f-43a9-8f9a-a1ee533a164d req-9b94cf01-db28-4a6f-a32a-c3e79c472c6e service nova] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] Updating instance_info_cache with network_info: [{"id": "33161be2-34ff-4c91-853a-072c30869966", "address": "fa:16:3e:32:67:f9", "network": {"id": "316cb9af-807d-4a69-874e-2054520f0e5f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1421560477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0907dff4e054429fa10392b730363eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33161be2-34", "ovs_interfaceid": "33161be2-34ff-4c91-853a-072c30869966", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:05:04 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-330aef10-8a8f-43a9-8f9a-a1ee533a164d req-9b94cf01-db28-4a6f-a32a-c3e79c472c6e service nova] Releasing lock "refresh_cache-3bc30b2b-4f87-4f25-bdc9-870170d1d87a" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:05:05 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:05:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:05:10 user nova-compute[75245]: DEBUG nova.compute.manager [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] Start spawning the instance on the hypervisor. {{(pid=75245) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 17:05:10 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] Creating instance directory {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 17:05:10 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] Creating image(s)
Nov 29 17:05:10 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] Did not create local disks {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 17:05:10 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] Ensure instance console log exists: /opt/stack/data/nova/instances/3bc30b2b-4f87-4f25-bdc9-870170d1d87a/console.log {{(pid=75245) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 17:05:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:05:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:05:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:05:10 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] Start _get_guest_xml network_info=[{"id": "33161be2-34ff-4c91-853a-072c30869966", "address": "fa:16:3e:32:67:f9", "network": {"id": "316cb9af-807d-4a69-874e-2054520f0e5f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1421560477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0907dff4e054429fa10392b730363eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33161be2-34", "ovs_interfaceid": "33161be2-34ff-4c91-853a-072c30869966", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '6e2c7ea9-a37a-4eab-9283-0f714538d345', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:38894568-48a0-4bb3-8bcc-958f240a359a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'saWnZoKC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3bc30b2b-4f87-4f25-bdc9-870170d1d87a', 'attached_at': '', 'detached_at': '', 'volume_id': '38894568-48a0-4bb3-8bcc-958f240a359a', 'serial': '38894568-48a0-4bb3-8bcc-958f240a359a'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'guest_format': None, 'volume_type': None} {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 17:05:10 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:05:10 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:05:10 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 17:05:10 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] CPU controller missing on host. {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 17:05:10 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 17:05:10 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] CPU controller found on host. {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 17:05:10 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75245) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 17:05:10 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T16:06:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 17:05:10 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Flavor limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 17:05:10 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Image limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 17:05:10 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Flavor pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 17:05:10 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Image pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 17:05:10 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 17:05:10 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 17:05:10 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 17:05:10 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Got 1 possible topologies {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 17:05:10 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 17:05:10 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 17:05:10 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] Calling os-brick to attach iSCSI Volume {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 17:05:10 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:38894568-48a0-4bb3-8bcc-958f240a359a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'saWnZoKC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:05:10 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:05:10 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:05:10 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:05:10 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:05:10 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38894568-48a0-4bb3-8bcc-958f240a359a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:05:10 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38894568-48a0-4bb3-8bcc-958f240a359a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:05:10 user nova-compute[75245]: INFO os_brick.initiator.connectors.iscsi [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 17:05:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:05:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38894568-48a0-4bb3-8bcc-958f240a359a -p 172.16.0.220:3260 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:05:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38894568-48a0-4bb3-8bcc-958f240a359a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:05:10 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab03246-39a2-4e06-8e63-e7f1e0d95f6e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:05:10 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 17:05:10 user nova-compute[75245]:  {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:05:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38894568-48a0-4bb3-8bcc-958f240a359a -p 172.16.0.220:3260 --interface default --op new {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:05:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38894568-48a0-4bb3-8bcc-958f240a359a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:05:10 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2d6483-2b80-496d-9863-21a486f2ebee]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:38894568-48a0-4bb3-8bcc-958f240a359a] added\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:05:10 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:38894568-48a0-4bb3-8bcc-958f240a359a] added
Nov 29 17:05:10 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:05:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38894568-48a0-4bb3-8bcc-958f240a359a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:05:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38894568-48a0-4bb3-8bcc-958f240a359a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:05:10 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[414fdb9c-b425-475f-9907-13b21b62735d]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:05:10 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:05:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38894568-48a0-4bb3-8bcc-958f240a359a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:05:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38894568-48a0-4bb3-8bcc-958f240a359a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:05:10 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[b73d7ef0-6e9f-4a7d-8ab2-33988028f911]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:05:10 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:05:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38894568-48a0-4bb3-8bcc-958f240a359a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v saWnZoKC {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:05:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38894568-48a0-4bb3-8bcc-958f240a359a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v saWnZoKC" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:05:10 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e053635-b46e-452c-a0cc-8a6a9ea8c5e0]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:05:10 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'saWnZoKC'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:05:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38894568-48a0-4bb3-8bcc-958f240a359a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:05:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38894568-48a0-4bb3-8bcc-958f240a359a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:05:10 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[be0ed643-3149-4fe5-ab52-741996e83dda]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:05:10 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:05:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:05:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:05:10 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[0449e9b8-0f41-48a9-bff4-dd6b356d5ef2]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:05:10 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535 (non-flash)
Nov 29 17:05:10 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:05:10 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535 (non-flash)
Nov 29 17:05:10 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:05:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38894568-48a0-4bb3-8bcc-958f240a359a -p 172.16.0.220:3260 --login {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:05:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38894568-48a0-4bb3-8bcc-958f240a359a -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:05:10 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c39bfac-fc8c-42c8-b927-5c1eb0be56ad]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:38894568-48a0-4bb3-8bcc-958f240a359a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:38894568-48a0-4bb3-8bcc-958f240a359a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:05:10 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:38894568-48a0-4bb3-8bcc-958f240a359a, portal: 172.16.0.220,3260]
Nov 29 17:05:10 user nova-compute[75245]: Login to [iface: default, target: iqn.2010-10.org.openstack:38894568-48a0-4bb3-8bcc-958f240a359a, portal: 172.16.0.220,3260] successful.
Nov 29 17:05:10 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:05:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38894568-48a0-4bb3-8bcc-958f240a359a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:05:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38894568-48a0-4bb3-8bcc-958f240a359a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:05:10 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[b40ce165-9eb8-4461-b925-3833293a3984]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:05:10 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:05:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:05:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:05:10 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[be83c51f-c741-4f1a-8c87-0af2ad682505]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38894568-48a0-4bb3-8bcc-958f240a359a (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:05:10 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535 (non-flash)
Nov 29 17:05:10 user nova-compute[75245]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38894568-48a0-4bb3-8bcc-958f240a359a (non-flash)
Nov 29 17:05:10 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:05:10 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535 (non-flash)
Nov 29 17:05:10 user nova-compute[75245]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38894568-48a0-4bb3-8bcc-958f240a359a (non-flash)
Nov 29 17:05:10 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:05:10 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38894568-48a0-4bb3-8bcc-958f240a359a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:05:10 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Connected to 172.16.0.220:3260 {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 17:05:10 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] HCTL ('34', '-', '-', 0) found on session 58 with lun 0 {{(pid=75245) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 17:05:10 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75245) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 17:05:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:05:10 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:05:10 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb06067-a7f6-4979-a7bd-1e8bc7ff517f]: (4, ('- - 0', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:05:10 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: None {{(pid=75245) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 17:05:11 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75245) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 17:05:11 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:38894568-48a0-4bb3-8bcc-958f240a359a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'saWnZoKC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 17:05:11 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:05:11 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '26433376535636232', 'path': '/dev/sdc'} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:05:11 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26433376535636232', 'path': '/dev/sdc'} {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 17:05:11 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T17:05:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-373346850',display_name='tempest-TestVolumeBootPattern-server-373346850',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-373346850',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/6kahxqemcvv41mFTGeaM46NrxYZRkkk4Ze4uyAwqVYPXEaYTvEEpOxaMUDr0qjGaA6sscRII1lYPmpLMrkcup8Fj5nDL441po4R7XAC4kU9bdh8ehoEbo0Y9HtbsAfw==',key_name='tempest-TestVolumeBootPattern-280401073',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0907dff4e054429fa10392b730363eb2',ramdisk_id='',reservation_id='r-43vc26j4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-181783012',owner_user_name='tempest-TestVolumeBootPattern-181783012-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T17:05:02Z,user_data=None,user_id='2870721a7fff4cf19291f0cbfaedae81',uuid=3bc30b2b-4f87-4f25-bdc9-870170d1d87a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "33161be2-34ff-4c91-853a-072c30869966", "address": "fa:16:3e:32:67:f9", "network": {"id": "316cb9af-807d-4a69-874e-2054520f0e5f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1421560477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0907dff4e054429fa10392b730363eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33161be2-34", "ovs_interfaceid": "33161be2-34ff-4c91-853a-072c30869966", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 17:05:11 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Converting VIF {"id": "33161be2-34ff-4c91-853a-072c30869966", "address": "fa:16:3e:32:67:f9", "network": {"id": "316cb9af-807d-4a69-874e-2054520f0e5f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1421560477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0907dff4e054429fa10392b730363eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33161be2-34", "ovs_interfaceid": "33161be2-34ff-4c91-853a-072c30869966", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:05:11 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:67:f9,bridge_name='br-int',has_traffic_filtering=True,id=33161be2-34ff-4c91-853a-072c30869966,network=Network(316cb9af-807d-4a69-874e-2054520f0e5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33161be2-34') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:05:11 user nova-compute[75245]: DEBUG nova.objects.instance [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lazy-loading 'pci_devices' on Instance uuid 3bc30b2b-4f87-4f25-bdc9-870170d1d87a {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:05:11 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] End _get_guest_xml xml=<domain type="kvm">
Nov 29 17:05:11 user nova-compute[75245]:   <uuid>3bc30b2b-4f87-4f25-bdc9-870170d1d87a</uuid>
Nov 29 17:05:11 user nova-compute[75245]:   <name>instance-00000033</name>
Nov 29 17:05:11 user nova-compute[75245]:   <memory>524288</memory>
Nov 29 17:05:11 user nova-compute[75245]:   <vcpu>1</vcpu>
Nov 29 17:05:11 user nova-compute[75245]:   <metadata>
Nov 29 17:05:11 user nova-compute[75245]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 17:05:11 user nova-compute[75245]:       <nova:package version="0.0.0"/>
Nov 29 17:05:11 user nova-compute[75245]:       <nova:name>tempest-TestVolumeBootPattern-server-373346850</nova:name>
Nov 29 17:05:11 user nova-compute[75245]:       <nova:creationTime>2023-11-29 17:05:10</nova:creationTime>
Nov 29 17:05:11 user nova-compute[75245]:       <nova:flavor name="m1.tiny">
Nov 29 17:05:11 user nova-compute[75245]:         <nova:memory>512</nova:memory>
Nov 29 17:05:11 user nova-compute[75245]:         <nova:disk>1</nova:disk>
Nov 29 17:05:11 user nova-compute[75245]:         <nova:swap>0</nova:swap>
Nov 29 17:05:11 user nova-compute[75245]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 17:05:11 user nova-compute[75245]:         <nova:vcpus>1</nova:vcpus>
Nov 29 17:05:11 user nova-compute[75245]:       </nova:flavor>
Nov 29 17:05:11 user nova-compute[75245]:       <nova:owner>
Nov 29 17:05:11 user nova-compute[75245]:         <nova:user uuid="2870721a7fff4cf19291f0cbfaedae81">tempest-TestVolumeBootPattern-181783012-project-member</nova:user>
Nov 29 17:05:11 user nova-compute[75245]:         <nova:project uuid="0907dff4e054429fa10392b730363eb2">tempest-TestVolumeBootPattern-181783012</nova:project>
Nov 29 17:05:11 user nova-compute[75245]:       </nova:owner>
Nov 29 17:05:11 user nova-compute[75245]:       <nova:ports>
Nov 29 17:05:11 user nova-compute[75245]:         <nova:port uuid="33161be2-34ff-4c91-853a-072c30869966">
Nov 29 17:05:11 user nova-compute[75245]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 17:05:11 user nova-compute[75245]:         </nova:port>
Nov 29 17:05:11 user nova-compute[75245]:       </nova:ports>
Nov 29 17:05:11 user nova-compute[75245]:     </nova:instance>
Nov 29 17:05:11 user nova-compute[75245]:   </metadata>
Nov 29 17:05:11 user nova-compute[75245]:   <sysinfo type="smbios">
Nov 29 17:05:11 user nova-compute[75245]:     <system>
Nov 29 17:05:11 user nova-compute[75245]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 17:05:11 user nova-compute[75245]:       <entry name="product">OpenStack Nova</entry>
Nov 29 17:05:11 user nova-compute[75245]:       <entry name="version">0.0.0</entry>
Nov 29 17:05:11 user nova-compute[75245]:       <entry name="serial">3bc30b2b-4f87-4f25-bdc9-870170d1d87a</entry>
Nov 29 17:05:11 user nova-compute[75245]:       <entry name="uuid">3bc30b2b-4f87-4f25-bdc9-870170d1d87a</entry>
Nov 29 17:05:11 user nova-compute[75245]:       <entry name="family">Virtual Machine</entry>
Nov 29 17:05:11 user nova-compute[75245]:     </system>
Nov 29 17:05:11 user nova-compute[75245]:   </sysinfo>
Nov 29 17:05:11 user nova-compute[75245]:   <os>
Nov 29 17:05:11 user nova-compute[75245]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 17:05:11 user nova-compute[75245]:     <boot dev="hd"/>
Nov 29 17:05:11 user nova-compute[75245]:     <smbios mode="sysinfo"/>
Nov 29 17:05:11 user nova-compute[75245]:   </os>
Nov 29 17:05:11 user nova-compute[75245]:   <features>
Nov 29 17:05:11 user nova-compute[75245]:     <acpi/>
Nov 29 17:05:11 user nova-compute[75245]:     <apic/>
Nov 29 17:05:11 user nova-compute[75245]:     <vmcoreinfo/>
Nov 29 17:05:11 user nova-compute[75245]:   </features>
Nov 29 17:05:11 user nova-compute[75245]:   <clock offset="utc">
Nov 29 17:05:11 user nova-compute[75245]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 17:05:11 user nova-compute[75245]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 17:05:11 user nova-compute[75245]:     <timer name="hpet" present="no"/>
Nov 29 17:05:11 user nova-compute[75245]:   </clock>
Nov 29 17:05:11 user nova-compute[75245]:   <cpu mode="custom" match="exact">
Nov 29 17:05:11 user nova-compute[75245]:     <model>Nehalem</model>
Nov 29 17:05:11 user nova-compute[75245]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 17:05:11 user nova-compute[75245]:   </cpu>
Nov 29 17:05:11 user nova-compute[75245]:   <devices>
Nov 29 17:05:11 user nova-compute[75245]:     <disk type="block" device="disk">
Nov 29 17:05:11 user nova-compute[75245]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 17:05:11 user nova-compute[75245]:       <source dev="/dev/sdc"/>
Nov 29 17:05:11 user nova-compute[75245]:       <target dev="vda" bus="virtio"/>
Nov 29 17:05:11 user nova-compute[75245]:       <serial>38894568-48a0-4bb3-8bcc-958f240a359a</serial>
Nov 29 17:05:11 user nova-compute[75245]:     </disk>
Nov 29 17:05:11 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 17:05:11 user nova-compute[75245]:       <mac address="fa:16:3e:32:67:f9"/>
Nov 29 17:05:11 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 17:05:11 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 17:05:11 user nova-compute[75245]:       <target dev="tap33161be2-34"/>
Nov 29 17:05:11 user nova-compute[75245]:     </interface>
Nov 29 17:05:11 user nova-compute[75245]:     <serial type="pty">
Nov 29 17:05:11 user nova-compute[75245]:       <log file="/opt/stack/data/nova/instances/3bc30b2b-4f87-4f25-bdc9-870170d1d87a/console.log" append="off"/>
Nov 29 17:05:11 user nova-compute[75245]:     </serial>
Nov 29 17:05:11 user nova-compute[75245]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 17:05:11 user nova-compute[75245]:     <video>
Nov 29 17:05:11 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 17:05:11 user nova-compute[75245]:     </video>
Nov 29 17:05:11 user nova-compute[75245]:     <rng model="virtio">
Nov 29 17:05:11 user nova-compute[75245]:       <backend model="random">/dev/urandom</backend>
Nov 29 17:05:11 user nova-compute[75245]:     </rng>
Nov 29 17:05:11 user nova-compute[75245]:     <controller type="usb" index="0" model="none"/>
Nov 29 17:05:11 user nova-compute[75245]:     <memballoon model="virtio">
Nov 29 17:05:11 user nova-compute[75245]:       <stats period="10"/>
Nov 29 17:05:11 user nova-compute[75245]:     </memballoon>
Nov 29 17:05:11 user nova-compute[75245]:   </devices>
Nov 29 17:05:11 user nova-compute[75245]: </domain>
Nov 29 17:05:11 user nova-compute[75245]:  {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 17:05:11 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T17:05:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-373346850',display_name='tempest-TestVolumeBootPattern-server-373346850',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-373346850',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/6kahxqemcvv41mFTGeaM46NrxYZRkkk4Ze4uyAwqVYPXEaYTvEEpOxaMUDr0qjGaA6sscRII1lYPmpLMrkcup8Fj5nDL441po4R7XAC4kU9bdh8ehoEbo0Y9HtbsAfw==',key_name='tempest-TestVolumeBootPattern-280401073',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0907dff4e054429fa10392b730363eb2',ramdisk_id='',reservation_id='r-43vc26j4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-181783012',owner_user_name='tempest-TestVolumeBootPattern-181783012-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T17:05:02Z,user_data=None,user_id='2870721a7fff4cf19291f0cbfaedae81',uuid=3bc30b2b-4f87-4f25-bdc9-870170d1d87a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "33161be2-34ff-4c91-853a-072c30869966", "address": "fa:16:3e:32:67:f9", "network": {"id": "316cb9af-807d-4a69-874e-2054520f0e5f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1421560477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0907dff4e054429fa10392b730363eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33161be2-34", "ovs_interfaceid": "33161be2-34ff-4c91-853a-072c30869966", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 17:05:11 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Converting VIF {"id": "33161be2-34ff-4c91-853a-072c30869966", "address": "fa:16:3e:32:67:f9", "network": {"id": "316cb9af-807d-4a69-874e-2054520f0e5f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1421560477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0907dff4e054429fa10392b730363eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33161be2-34", "ovs_interfaceid": "33161be2-34ff-4c91-853a-072c30869966", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:05:11 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:67:f9,bridge_name='br-int',has_traffic_filtering=True,id=33161be2-34ff-4c91-853a-072c30869966,network=Network(316cb9af-807d-4a69-874e-2054520f0e5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33161be2-34') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:05:11 user nova-compute[75245]: DEBUG os_vif [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:67:f9,bridge_name='br-int',has_traffic_filtering=True,id=33161be2-34ff-4c91-853a-072c30869966,network=Network(316cb9af-807d-4a69-874e-2054520f0e5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33161be2-34') {{(pid=75245) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 17:05:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:05:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:05:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 17:05:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:05:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd81d4c64-b44c-522a-89f0-e86d73b8ac41', '_type': 'linux-noop'}}, row=False) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:05:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:05:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:05:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap33161be2-34, may_exist=True, interface_attrs={}) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:05:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap33161be2-34, col_values=(('qos', UUID('5ac8419c-9a82-4edf-a8e6-7fd320fc5656')),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:05:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap33161be2-34, col_values=(('external_ids', {'iface-id': '33161be2-34ff-4c91-853a-072c30869966', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:67:f9', 'vm-uuid': '3bc30b2b-4f87-4f25-bdc9-870170d1d87a'}),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:05:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:05:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:05:11 user nova-compute[75245]: INFO os_vif [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:67:f9,bridge_name='br-int',has_traffic_filtering=True,id=33161be2-34ff-4c91-853a-072c30869966,network=Network(316cb9af-807d-4a69-874e-2054520f0e5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33161be2-34')
Nov 29 17:05:11 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 17:05:11 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] No VIF found with MAC fa:16:3e:32:67:f9, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 17:05:12 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:05:12 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:05:12 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:05:12 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:05:13 user nova-compute[75245]: DEBUG nova.compute.manager [req-41756ff7-88d2-4f9b-b810-3e1dc80ca53d req-04cfe3c5-abdf-4cf7-ad32-41ad281c7b4e service nova] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] Received event network-vif-plugged-33161be2-34ff-4c91-853a-072c30869966 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:05:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-41756ff7-88d2-4f9b-b810-3e1dc80ca53d req-04cfe3c5-abdf-4cf7-ad32-41ad281c7b4e service nova] Acquiring lock "3bc30b2b-4f87-4f25-bdc9-870170d1d87a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:05:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-41756ff7-88d2-4f9b-b810-3e1dc80ca53d req-04cfe3c5-abdf-4cf7-ad32-41ad281c7b4e service nova] Lock "3bc30b2b-4f87-4f25-bdc9-870170d1d87a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:05:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-41756ff7-88d2-4f9b-b810-3e1dc80ca53d req-04cfe3c5-abdf-4cf7-ad32-41ad281c7b4e service nova] Lock "3bc30b2b-4f87-4f25-bdc9-870170d1d87a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:05:13 user nova-compute[75245]: DEBUG nova.compute.manager [req-41756ff7-88d2-4f9b-b810-3e1dc80ca53d req-04cfe3c5-abdf-4cf7-ad32-41ad281c7b4e service nova] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] No waiting events found dispatching network-vif-plugged-33161be2-34ff-4c91-853a-072c30869966 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:05:13 user nova-compute[75245]: WARNING nova.compute.manager [req-41756ff7-88d2-4f9b-b810-3e1dc80ca53d req-04cfe3c5-abdf-4cf7-ad32-41ad281c7b4e service nova] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] Received unexpected event network-vif-plugged-33161be2-34ff-4c91-853a-072c30869966 for instance with vm_state building and task_state spawning.
Nov 29 17:05:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:05:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:05:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:05:14 user nova-compute[75245]: DEBUG nova.compute.manager [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] Instance event wait completed in 0 seconds for  {{(pid=75245) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 17:05:14 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] Guest created on hypervisor {{(pid=75245) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 17:05:14 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] Instance spawned successfully.
Nov 29 17:05:14 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 17:05:14 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] Found default for hw_cdrom_bus of ide {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:05:14 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] Found default for hw_disk_bus of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:05:14 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] Found default for hw_input_bus of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:05:14 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] Found default for hw_pointer_model of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:05:14 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] Found default for hw_video_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:05:14 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] Found default for hw_vif_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:05:15 user nova-compute[75245]: INFO nova.compute.manager [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] Took 4.97 seconds to spawn the instance on the hypervisor.
Nov 29 17:05:15 user nova-compute[75245]: DEBUG nova.compute.manager [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 17:05:15 user nova-compute[75245]: DEBUG nova.compute.manager [req-1c4b4b00-f5ac-47c4-8904-657b7eafe8c4 req-1b8360fc-d9b5-455f-88e1-be35a6818f96 service nova] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] Received event network-vif-plugged-33161be2-34ff-4c91-853a-072c30869966 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:05:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-1c4b4b00-f5ac-47c4-8904-657b7eafe8c4 req-1b8360fc-d9b5-455f-88e1-be35a6818f96 service nova] Acquiring lock "3bc30b2b-4f87-4f25-bdc9-870170d1d87a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:05:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-1c4b4b00-f5ac-47c4-8904-657b7eafe8c4 req-1b8360fc-d9b5-455f-88e1-be35a6818f96 service nova] Lock "3bc30b2b-4f87-4f25-bdc9-870170d1d87a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:05:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-1c4b4b00-f5ac-47c4-8904-657b7eafe8c4 req-1b8360fc-d9b5-455f-88e1-be35a6818f96 service nova] Lock "3bc30b2b-4f87-4f25-bdc9-870170d1d87a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:05:15 user nova-compute[75245]: DEBUG nova.compute.manager [req-1c4b4b00-f5ac-47c4-8904-657b7eafe8c4 req-1b8360fc-d9b5-455f-88e1-be35a6818f96 service nova] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] No waiting events found dispatching network-vif-plugged-33161be2-34ff-4c91-853a-072c30869966 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:05:15 user nova-compute[75245]: WARNING nova.compute.manager [req-1c4b4b00-f5ac-47c4-8904-657b7eafe8c4 req-1b8360fc-d9b5-455f-88e1-be35a6818f96 service nova] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] Received unexpected event network-vif-plugged-33161be2-34ff-4c91-853a-072c30869966 for instance with vm_state building and task_state spawning.
Nov 29 17:05:15 user nova-compute[75245]: INFO nova.compute.manager [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] Took 13.81 seconds to build instance.
Nov 29 17:05:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-ef11e2aa-68f1-4571-a5c1-365171b46657 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "3bc30b2b-4f87-4f25-bdc9-870170d1d87a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.903s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:05:16 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:05:21 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:05:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:05:26 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:05:29 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:05:31 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:05:33 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:05:33 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Starting heal instance info cache {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 17:05:33 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Rebuilding the list of instances to heal {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 17:05:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "refresh_cache-24b84c61-6ea0-4187-abc8-80a967d5bf70" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:05:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquired lock "refresh_cache-24b84c61-6ea0-4187-abc8-80a967d5bf70" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:05:33 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Forcefully refreshing network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 17:05:33 user nova-compute[75245]: DEBUG nova.objects.instance [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lazy-loading 'info_cache' on Instance uuid 24b84c61-6ea0-4187-abc8-80a967d5bf70 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:05:34 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Updating instance_info_cache with network_info: [{"id": "4312d216-4dad-48e3-b3f5-fda6ff4a2a66", "address": "fa:16:3e:a9:76:89", "network": {"id": "316cb9af-807d-4a69-874e-2054520f0e5f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1421560477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0907dff4e054429fa10392b730363eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4312d216-4d", "ovs_interfaceid": "4312d216-4dad-48e3-b3f5-fda6ff4a2a66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:05:34 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Releasing lock "refresh_cache-24b84c61-6ea0-4187-abc8-80a967d5bf70" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:05:34 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Updated the network info_cache for instance {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 17:05:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:05:36 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:05:39 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:05:39 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:05:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:05:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:05:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:05:39 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75245) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 17:05:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:05:39 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 17:05:39 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 17:05:39 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:05:39 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:05:39 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Hypervisor/Node resource view: name=user free_ram=8833MB free_disk=25.080097198486328GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75245) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 17:05:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:05:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:05:40 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 24b84c61-6ea0-4187-abc8-80a967d5bf70 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:05:40 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 3bc30b2b-4f87-4f25-bdc9-870170d1d87a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:05:40 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 17:05:40 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 17:05:40 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 17:05:40 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 17:05:40 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Compute_service record updated for user:user {{(pid=75245) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 17:05:40 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.220s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:05:41 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:05:44 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:05:44 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:05:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:05:46 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:05:48 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:05:49 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:05:49 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:05:49 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75245) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 17:05:51 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:05:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:05:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:05:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75245) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 17:05:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 17:05:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 17:05:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:05:56 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:05:57 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:06:01 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:06:06 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:06:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:06:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:06:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75245) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 17:06:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 17:06:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 17:06:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:06:16 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:06:21 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:06:26 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:06:31 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:06:33 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:06:33 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Starting heal instance info cache {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 17:06:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "refresh_cache-3bc30b2b-4f87-4f25-bdc9-870170d1d87a" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:06:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquired lock "refresh_cache-3bc30b2b-4f87-4f25-bdc9-870170d1d87a" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:06:33 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] Forcefully refreshing network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 17:06:34 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] Updating instance_info_cache with network_info: [{"id": "33161be2-34ff-4c91-853a-072c30869966", "address": "fa:16:3e:32:67:f9", "network": {"id": "316cb9af-807d-4a69-874e-2054520f0e5f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1421560477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0907dff4e054429fa10392b730363eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33161be2-34", "ovs_interfaceid": "33161be2-34ff-4c91-853a-072c30869966", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:06:34 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Releasing lock "refresh_cache-3bc30b2b-4f87-4f25-bdc9-870170d1d87a" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:06:34 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] Updated the network info_cache for instance {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 17:06:36 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:06:40 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:06:40 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:06:40 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:06:40 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:06:40 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75245) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 17:06:40 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 17:06:40 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 17:06:40 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:06:40 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:06:40 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Hypervisor/Node resource view: name=user free_ram=8936MB free_disk=25.0794677734375GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75245) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 17:06:40 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:06:40 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:06:41 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 24b84c61-6ea0-4187-abc8-80a967d5bf70 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:06:41 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 3bc30b2b-4f87-4f25-bdc9-870170d1d87a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:06:41 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 17:06:41 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 17:06:41 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Refreshing inventories for resource provider dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 17:06:41 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Updating ProviderTree inventory for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 17:06:41 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Updating inventory in ProviderTree for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 17:06:41 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Refreshing aggregate associations for resource provider dcc0ed27-167e-4f3a-a0de-183bb144a50c, aggregates: None {{(pid=75245) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 17:06:41 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Refreshing trait associations for resource provider dcc0ed27-167e-4f3a-a0de-183bb144a50c, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG {{(pid=75245) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 17:06:41 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 17:06:41 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 17:06:41 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Compute_service record updated for user:user {{(pid=75245) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 17:06:41 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.334s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:06:41 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:06:42 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:06:43 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:06:43 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:06:43 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Cleaning up deleted instances {{(pid=75245) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 17:06:43 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] There are 0 instances to clean {{(pid=75245) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 17:06:44 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:06:46 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:06:50 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:06:50 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75245) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 17:06:51 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:06:51 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:06:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:06:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:06:52 user nova-compute[75245]: DEBUG nova.compute.manager [req-d98170ba-7687-4a88-8b38-57d8bfcd8cea req-aae2ca4b-6ad0-4284-b52b-aac1f27bed6f service nova] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] Received event network-changed-33161be2-34ff-4c91-853a-072c30869966 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:06:52 user nova-compute[75245]: DEBUG nova.compute.manager [req-d98170ba-7687-4a88-8b38-57d8bfcd8cea req-aae2ca4b-6ad0-4284-b52b-aac1f27bed6f service nova] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] Refreshing instance network info cache due to event network-changed-33161be2-34ff-4c91-853a-072c30869966. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 17:06:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d98170ba-7687-4a88-8b38-57d8bfcd8cea req-aae2ca4b-6ad0-4284-b52b-aac1f27bed6f service nova] Acquiring lock "refresh_cache-3bc30b2b-4f87-4f25-bdc9-870170d1d87a" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:06:52 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d98170ba-7687-4a88-8b38-57d8bfcd8cea req-aae2ca4b-6ad0-4284-b52b-aac1f27bed6f service nova] Acquired lock "refresh_cache-3bc30b2b-4f87-4f25-bdc9-870170d1d87a" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:06:52 user nova-compute[75245]: DEBUG nova.network.neutron [req-d98170ba-7687-4a88-8b38-57d8bfcd8cea req-aae2ca4b-6ad0-4284-b52b-aac1f27bed6f service nova] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] Refreshing network info cache for port 33161be2-34ff-4c91-853a-072c30869966 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 17:06:53 user nova-compute[75245]: DEBUG nova.network.neutron [req-d98170ba-7687-4a88-8b38-57d8bfcd8cea req-aae2ca4b-6ad0-4284-b52b-aac1f27bed6f service nova] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] Updated VIF entry in instance network info cache for port 33161be2-34ff-4c91-853a-072c30869966. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 17:06:53 user nova-compute[75245]: DEBUG nova.network.neutron [req-d98170ba-7687-4a88-8b38-57d8bfcd8cea req-aae2ca4b-6ad0-4284-b52b-aac1f27bed6f service nova] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] Updating instance_info_cache with network_info: [{"id": "33161be2-34ff-4c91-853a-072c30869966", "address": "fa:16:3e:32:67:f9", "network": {"id": "316cb9af-807d-4a69-874e-2054520f0e5f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1421560477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0907dff4e054429fa10392b730363eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33161be2-34", "ovs_interfaceid": "33161be2-34ff-4c91-853a-072c30869966", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:06:53 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d98170ba-7687-4a88-8b38-57d8bfcd8cea req-aae2ca4b-6ad0-4284-b52b-aac1f27bed6f service nova] Releasing lock "refresh_cache-3bc30b2b-4f87-4f25-bdc9-870170d1d87a" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:06:53 user nova-compute[75245]: DEBUG nova.compute.manager [req-5c249dbb-8f19-4b73-bb98-a93797cf5095 req-70605361-dea2-4424-b272-9b72c7ee01f1 service nova] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] Received event network-changed-33161be2-34ff-4c91-853a-072c30869966 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:06:53 user nova-compute[75245]: DEBUG nova.compute.manager [req-5c249dbb-8f19-4b73-bb98-a93797cf5095 req-70605361-dea2-4424-b272-9b72c7ee01f1 service nova] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] Refreshing instance network info cache due to event network-changed-33161be2-34ff-4c91-853a-072c30869966. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 17:06:53 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-5c249dbb-8f19-4b73-bb98-a93797cf5095 req-70605361-dea2-4424-b272-9b72c7ee01f1 service nova] Acquiring lock "refresh_cache-3bc30b2b-4f87-4f25-bdc9-870170d1d87a" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:06:53 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-5c249dbb-8f19-4b73-bb98-a93797cf5095 req-70605361-dea2-4424-b272-9b72c7ee01f1 service nova] Acquired lock "refresh_cache-3bc30b2b-4f87-4f25-bdc9-870170d1d87a" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:06:53 user nova-compute[75245]: DEBUG nova.network.neutron [req-5c249dbb-8f19-4b73-bb98-a93797cf5095 req-70605361-dea2-4424-b272-9b72c7ee01f1 service nova] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] Refreshing network info cache for port 33161be2-34ff-4c91-853a-072c30869966 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 17:06:53 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-5ff0b738-3018-4ed5-83cd-7591ce8dc411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Acquiring lock "3bc30b2b-4f87-4f25-bdc9-870170d1d87a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:06:53 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-5ff0b738-3018-4ed5-83cd-7591ce8dc411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "3bc30b2b-4f87-4f25-bdc9-870170d1d87a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:06:53 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-5ff0b738-3018-4ed5-83cd-7591ce8dc411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Acquiring lock "3bc30b2b-4f87-4f25-bdc9-870170d1d87a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:06:53 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-5ff0b738-3018-4ed5-83cd-7591ce8dc411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "3bc30b2b-4f87-4f25-bdc9-870170d1d87a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:06:53 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-5ff0b738-3018-4ed5-83cd-7591ce8dc411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "3bc30b2b-4f87-4f25-bdc9-870170d1d87a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:06:53 user nova-compute[75245]: INFO nova.compute.manager [None req-5ff0b738-3018-4ed5-83cd-7591ce8dc411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] Terminating instance
Nov 29 17:06:53 user nova-compute[75245]: DEBUG nova.compute.manager [None req-5ff0b738-3018-4ed5-83cd-7591ce8dc411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] Start destroying the instance on the hypervisor. {{(pid=75245) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 17:06:53 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:06:53 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:06:53 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:06:53 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:06:53 user nova-compute[75245]: DEBUG nova.compute.manager [req-7f0dd917-e334-4b46-92c9-9c90a9574cf5 req-a79d96de-3870-4596-8c47-9907a6d1b40f service nova] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] Received event network-vif-unplugged-33161be2-34ff-4c91-853a-072c30869966 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:06:53 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-7f0dd917-e334-4b46-92c9-9c90a9574cf5 req-a79d96de-3870-4596-8c47-9907a6d1b40f service nova] Acquiring lock "3bc30b2b-4f87-4f25-bdc9-870170d1d87a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:06:53 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-7f0dd917-e334-4b46-92c9-9c90a9574cf5 req-a79d96de-3870-4596-8c47-9907a6d1b40f service nova] Lock "3bc30b2b-4f87-4f25-bdc9-870170d1d87a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:06:53 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-7f0dd917-e334-4b46-92c9-9c90a9574cf5 req-a79d96de-3870-4596-8c47-9907a6d1b40f service nova] Lock "3bc30b2b-4f87-4f25-bdc9-870170d1d87a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:06:53 user nova-compute[75245]: DEBUG nova.compute.manager [req-7f0dd917-e334-4b46-92c9-9c90a9574cf5 req-a79d96de-3870-4596-8c47-9907a6d1b40f service nova] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] No waiting events found dispatching network-vif-unplugged-33161be2-34ff-4c91-853a-072c30869966 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:06:53 user nova-compute[75245]: DEBUG nova.compute.manager [req-7f0dd917-e334-4b46-92c9-9c90a9574cf5 req-a79d96de-3870-4596-8c47-9907a6d1b40f service nova] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] Received event network-vif-unplugged-33161be2-34ff-4c91-853a-072c30869966 for instance with task_state deleting. {{(pid=75245) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 17:06:54 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] Instance destroyed successfully.
Nov 29 17:06:54 user nova-compute[75245]: DEBUG nova.objects.instance [None req-5ff0b738-3018-4ed5-83cd-7591ce8dc411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lazy-loading 'resources' on Instance uuid 3bc30b2b-4f87-4f25-bdc9-870170d1d87a {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:06:54 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-5ff0b738-3018-4ed5-83cd-7591ce8dc411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T17:05:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-373346850',display_name='tempest-TestVolumeBootPattern-server-373346850',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-373346850',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/6kahxqemcvv41mFTGeaM46NrxYZRkkk4Ze4uyAwqVYPXEaYTvEEpOxaMUDr0qjGaA6sscRII1lYPmpLMrkcup8Fj5nDL441po4R7XAC4kU9bdh8ehoEbo0Y9HtbsAfw==',key_name='tempest-TestVolumeBootPattern-280401073',keypairs=<?>,launch_index=0,launched_at=2023-11-29T17:05:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0907dff4e054429fa10392b730363eb2',ramdisk_id='',reservation_id='r-43vc26j4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-181783012',owner_user_name='tempest-TestVolumeBootPattern-181783012-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T17:05:15Z,user_data=None,user_id='2870721a7fff4cf19291f0cbfaedae81',uuid=3bc30b2b-4f87-4f25-bdc9-870170d1d87a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "33161be2-34ff-4c91-853a-072c30869966", "address": "fa:16:3e:32:67:f9", "network": {"id": "316cb9af-807d-4a69-874e-2054520f0e5f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1421560477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0907dff4e054429fa10392b730363eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33161be2-34", "ovs_interfaceid": "33161be2-34ff-4c91-853a-072c30869966", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 17:06:54 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-5ff0b738-3018-4ed5-83cd-7591ce8dc411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Converting VIF {"id": "33161be2-34ff-4c91-853a-072c30869966", "address": "fa:16:3e:32:67:f9", "network": {"id": "316cb9af-807d-4a69-874e-2054520f0e5f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1421560477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0907dff4e054429fa10392b730363eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33161be2-34", "ovs_interfaceid": "33161be2-34ff-4c91-853a-072c30869966", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:06:54 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-5ff0b738-3018-4ed5-83cd-7591ce8dc411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:32:67:f9,bridge_name='br-int',has_traffic_filtering=True,id=33161be2-34ff-4c91-853a-072c30869966,network=Network(316cb9af-807d-4a69-874e-2054520f0e5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33161be2-34') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:06:54 user nova-compute[75245]: DEBUG os_vif [None req-5ff0b738-3018-4ed5-83cd-7591ce8dc411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:67:f9,bridge_name='br-int',has_traffic_filtering=True,id=33161be2-34ff-4c91-853a-072c30869966,network=Network(316cb9af-807d-4a69-874e-2054520f0e5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33161be2-34') {{(pid=75245) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 17:06:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:06:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap33161be2-34, bridge=br-int, if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:06:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:06:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:06:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:06:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5ac8419c-9a82-4edf-a8e6-7fd320fc5656) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:06:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:06:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:06:54 user nova-compute[75245]: DEBUG nova.network.neutron [req-5c249dbb-8f19-4b73-bb98-a93797cf5095 req-70605361-dea2-4424-b272-9b72c7ee01f1 service nova] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] Updated VIF entry in instance network info cache for port 33161be2-34ff-4c91-853a-072c30869966. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 17:06:54 user nova-compute[75245]: DEBUG nova.network.neutron [req-5c249dbb-8f19-4b73-bb98-a93797cf5095 req-70605361-dea2-4424-b272-9b72c7ee01f1 service nova] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] Updating instance_info_cache with network_info: [{"id": "33161be2-34ff-4c91-853a-072c30869966", "address": "fa:16:3e:32:67:f9", "network": {"id": "316cb9af-807d-4a69-874e-2054520f0e5f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1421560477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0907dff4e054429fa10392b730363eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33161be2-34", "ovs_interfaceid": "33161be2-34ff-4c91-853a-072c30869966", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:06:54 user nova-compute[75245]: INFO os_vif [None req-5ff0b738-3018-4ed5-83cd-7591ce8dc411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:67:f9,bridge_name='br-int',has_traffic_filtering=True,id=33161be2-34ff-4c91-853a-072c30869966,network=Network(316cb9af-807d-4a69-874e-2054520f0e5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33161be2-34')
Nov 29 17:06:54 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ff0b738-3018-4ed5-83cd-7591ce8dc411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] calling os-brick to detach iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 17:06:54 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ff0b738-3018-4ed5-83cd-7591ce8dc411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, {'target_iqn': 'iqn.2010-10.org.openstack:38894568-48a0-4bb3-8bcc-958f240a359a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'saWnZoKC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:06:54 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-5ff0b738-3018-4ed5-83cd-7591ce8dc411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:06:54 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-5ff0b738-3018-4ed5-83cd-7591ce8dc411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:06:54 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-5ff0b738-3018-4ed5-83cd-7591ce8dc411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:06:54 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:06:54 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-5c249dbb-8f19-4b73-bb98-a93797cf5095 req-70605361-dea2-4424-b272-9b72c7ee01f1 service nova] Releasing lock "refresh_cache-3bc30b2b-4f87-4f25-bdc9-870170d1d87a" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:06:54 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:06:54 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c85d47-d768-4291-be4b-ef65e4e3d9e6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:38894568-48a0-4bb3-8bcc-958f240a359a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:06:54 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ff0b738-3018-4ed5-83cd-7591ce8dc411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 17:06:54 user nova-compute[75245]: No targets found.
Nov 29 17:06:54 user nova-compute[75245]: iSNS:
Nov 29 17:06:54 user nova-compute[75245]: No targets found.
Nov 29 17:06:54 user nova-compute[75245]: STATIC:
Nov 29 17:06:54 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:38894568-48a0-4bb3-8bcc-958f240a359a
Nov 29 17:06:54 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:06:54 user nova-compute[75245]:                 Iface Name: default
Nov 29 17:06:54 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535
Nov 29 17:06:54 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:06:54 user nova-compute[75245]:                 Iface Name: default
Nov 29 17:06:54 user nova-compute[75245]: FIRMWARE:
Nov 29 17:06:54 user nova-compute[75245]: No targets found.
Nov 29 17:06:54 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:06:54 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ff0b738-3018-4ed5-83cd-7591ce8dc411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 17:06:54 user nova-compute[75245]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 17:06:54 user nova-compute[75245]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75245) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 17:06:54 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ff0b738-3018-4ed5-83cd-7591ce8dc411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38894568-48a0-4bb3-8bcc-958f240a359a', 0)] {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 17:06:54 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:06:54 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:06:54 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d5d70b-5d26-41f2-a751-6cc62c3ce43f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38894568-48a0-4bb3-8bcc-958f240a359a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:06:54 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:06:54 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:06:54 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4da8181-11e1-4946-a204-99ede71fd062]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38894568-48a0-4bb3-8bcc-958f240a359a (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:06:54 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ff0b738-3018-4ed5-83cd-7591ce8dc411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535 (non-flash)
Nov 29 17:06:54 user nova-compute[75245]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38894568-48a0-4bb3-8bcc-958f240a359a (non-flash)
Nov 29 17:06:54 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:06:54 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ff0b738-3018-4ed5-83cd-7591ce8dc411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535 (non-flash)
Nov 29 17:06:54 user nova-compute[75245]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38894568-48a0-4bb3-8bcc-958f240a359a (non-flash)
Nov 29 17:06:54 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:06:54 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ff0b738-3018-4ed5-83cd-7591ce8dc411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0d4c1f9b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38894568-48a0-4bb3-8bcc-958f240a359a'): ({'sdc'}, set())}) {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 17:06:54 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-5ff0b738-3018-4ed5-83cd-7591ce8dc411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Removing single pathed devices sdc {{(pid=75245) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 17:06:54 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:06:54 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:06:54 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea04fb1-406c-460d-bb86-7690ec992da5]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:06:54 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:06:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:06:54 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:06:54 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdaba8eb-bc61-4e72-8914-44bf0914d82d]: (4, ('ok\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:06:54 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-5ff0b738-3018-4ed5-83cd-7591ce8dc411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Flushing IO for device /dev/sdc {{(pid=75245) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 17:06:54 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:06:54 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:06:54 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dcdf494-618f-464d-b0b2-dc8fae2fe292]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:06:54 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-5ff0b738-3018-4ed5-83cd-7591ce8dc411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75245) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 17:06:54 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:06:54 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:06:54 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d19b706-e687-47c4-8166-089652a0462e]: (4, ('1', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:06:54 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-5ff0b738-3018-4ed5-83cd-7591ce8dc411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 17:06:54 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-5ff0b738-3018-4ed5-83cd-7591ce8dc411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] SCSI volumes sdc have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 17:06:54 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ff0b738-3018-4ed5-83cd-7591ce8dc411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38894568-48a0-4bb3-8bcc-958f240a359a')] {{(pid=75245) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 17:06:54 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38894568-48a0-4bb3-8bcc-958f240a359a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:06:54 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38894568-48a0-4bb3-8bcc-958f240a359a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:06:54 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[af78b2bb-1e9d-44a5-bbc3-040fd25d30c3]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:06:54 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ff0b738-3018-4ed5-83cd-7591ce8dc411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:06:54 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38894568-48a0-4bb3-8bcc-958f240a359a -p 172.16.0.220:3260 --logout {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:06:54 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38894568-48a0-4bb3-8bcc-958f240a359a -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:06:54 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c1d9d6-4850-4e6a-99e0-a0d9f08c32f2]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:38894568-48a0-4bb3-8bcc-958f240a359a, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:38894568-48a0-4bb3-8bcc-958f240a359a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:06:54 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ff0b738-3018-4ed5-83cd-7591ce8dc411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:38894568-48a0-4bb3-8bcc-958f240a359a, portal: 172.16.0.220,3260]
Nov 29 17:06:54 user nova-compute[75245]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:38894568-48a0-4bb3-8bcc-958f240a359a, portal: 172.16.0.220,3260] successful.
Nov 29 17:06:54 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:06:54 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38894568-48a0-4bb3-8bcc-958f240a359a -p 172.16.0.220:3260 --op delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:06:54 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38894568-48a0-4bb3-8bcc-958f240a359a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:06:54 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[0beaade1-9ec2-4ff3-ab37-c5e2580704a7]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:06:54 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ff0b738-3018-4ed5-83cd-7591ce8dc411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:06:54 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-5ff0b738-3018-4ed5-83cd-7591ce8dc411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:06:54 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ff0b738-3018-4ed5-83cd-7591ce8dc411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] <== disconnect_volume: return (312ms) None {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:06:54 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ff0b738-3018-4ed5-83cd-7591ce8dc411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] Disconnected iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 17:06:54 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-5ff0b738-3018-4ed5-83cd-7591ce8dc411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] Deleting instance files /opt/stack/data/nova/instances/3bc30b2b-4f87-4f25-bdc9-870170d1d87a_del
Nov 29 17:06:54 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-5ff0b738-3018-4ed5-83cd-7591ce8dc411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] Deletion of /opt/stack/data/nova/instances/3bc30b2b-4f87-4f25-bdc9-870170d1d87a_del complete
Nov 29 17:06:54 user nova-compute[75245]: INFO nova.compute.manager [None req-5ff0b738-3018-4ed5-83cd-7591ce8dc411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 29 17:06:54 user nova-compute[75245]: DEBUG oslo.service.loopingcall [None req-5ff0b738-3018-4ed5-83cd-7591ce8dc411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75245) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 17:06:54 user nova-compute[75245]: DEBUG nova.compute.manager [-] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] Deallocating network for instance {{(pid=75245) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 17:06:54 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] deallocate_for_instance() {{(pid=75245) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 17:06:55 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:06:55 user nova-compute[75245]: INFO nova.compute.manager [-] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] Took 0.45 seconds to deallocate network for instance.
Nov 29 17:06:55 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:06:55 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75245) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 17:06:56 user nova-compute[75245]: INFO nova.compute.manager [None req-5ff0b738-3018-4ed5-83cd-7591ce8dc411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] Took 0.81 seconds to detach 1 volumes for instance.
Nov 29 17:06:56 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-5ff0b738-3018-4ed5-83cd-7591ce8dc411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:06:56 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-5ff0b738-3018-4ed5-83cd-7591ce8dc411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:06:56 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-5ff0b738-3018-4ed5-83cd-7591ce8dc411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 17:06:56 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-5ff0b738-3018-4ed5-83cd-7591ce8dc411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 17:06:56 user nova-compute[75245]: DEBUG nova.compute.manager [req-ae1aff61-9b4b-4527-82b9-95bce1f2beac req-c7fe8406-eb5d-4a2a-ae37-786895d52314 service nova] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] Received event network-vif-plugged-33161be2-34ff-4c91-853a-072c30869966 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:06:56 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-ae1aff61-9b4b-4527-82b9-95bce1f2beac req-c7fe8406-eb5d-4a2a-ae37-786895d52314 service nova] Acquiring lock "3bc30b2b-4f87-4f25-bdc9-870170d1d87a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:06:56 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-ae1aff61-9b4b-4527-82b9-95bce1f2beac req-c7fe8406-eb5d-4a2a-ae37-786895d52314 service nova] Lock "3bc30b2b-4f87-4f25-bdc9-870170d1d87a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:06:56 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-ae1aff61-9b4b-4527-82b9-95bce1f2beac req-c7fe8406-eb5d-4a2a-ae37-786895d52314 service nova] Lock "3bc30b2b-4f87-4f25-bdc9-870170d1d87a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:06:56 user nova-compute[75245]: DEBUG nova.compute.manager [req-ae1aff61-9b4b-4527-82b9-95bce1f2beac req-c7fe8406-eb5d-4a2a-ae37-786895d52314 service nova] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] No waiting events found dispatching network-vif-plugged-33161be2-34ff-4c91-853a-072c30869966 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:06:56 user nova-compute[75245]: WARNING nova.compute.manager [req-ae1aff61-9b4b-4527-82b9-95bce1f2beac req-c7fe8406-eb5d-4a2a-ae37-786895d52314 service nova] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] Received unexpected event network-vif-plugged-33161be2-34ff-4c91-853a-072c30869966 for instance with vm_state deleted and task_state None.
Nov 29 17:06:56 user nova-compute[75245]: DEBUG nova.compute.manager [req-ae1aff61-9b4b-4527-82b9-95bce1f2beac req-c7fe8406-eb5d-4a2a-ae37-786895d52314 service nova] [instance: 3bc30b2b-4f87-4f25-bdc9-870170d1d87a] Received event network-vif-deleted-33161be2-34ff-4c91-853a-072c30869966 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:06:56 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-5ff0b738-3018-4ed5-83cd-7591ce8dc411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.131s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:06:56 user nova-compute[75245]: INFO nova.scheduler.client.report [None req-5ff0b738-3018-4ed5-83cd-7591ce8dc411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Deleted allocations for instance 3bc30b2b-4f87-4f25-bdc9-870170d1d87a
Nov 29 17:06:56 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-5ff0b738-3018-4ed5-83cd-7591ce8dc411 tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "3bc30b2b-4f87-4f25-bdc9-870170d1d87a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.857s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:06:57 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:06:59 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:07:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:07:05 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:07:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:07:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:07:17 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:07:19 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:07:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:07:29 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:07:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:07:34 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:07:34 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Starting heal instance info cache {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 17:07:34 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Rebuilding the list of instances to heal {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 17:07:34 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "refresh_cache-24b84c61-6ea0-4187-abc8-80a967d5bf70" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:07:34 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquired lock "refresh_cache-24b84c61-6ea0-4187-abc8-80a967d5bf70" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:07:34 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Forcefully refreshing network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 17:07:34 user nova-compute[75245]: DEBUG nova.objects.instance [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lazy-loading 'info_cache' on Instance uuid 24b84c61-6ea0-4187-abc8-80a967d5bf70 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:07:35 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Updating instance_info_cache with network_info: [{"id": "4312d216-4dad-48e3-b3f5-fda6ff4a2a66", "address": "fa:16:3e:a9:76:89", "network": {"id": "316cb9af-807d-4a69-874e-2054520f0e5f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1421560477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0907dff4e054429fa10392b730363eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4312d216-4d", "ovs_interfaceid": "4312d216-4dad-48e3-b3f5-fda6ff4a2a66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:07:35 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Releasing lock "refresh_cache-24b84c61-6ea0-4187-abc8-80a967d5bf70" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:07:35 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Updated the network info_cache for instance {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 17:07:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:07:40 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:07:40 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:07:40 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:07:40 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:07:40 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75245) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 17:07:40 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 17:07:40 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:07:40 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:07:40 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Hypervisor/Node resource view: name=user free_ram=9033MB free_disk=25.078617095947266GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75245) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 17:07:40 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:07:40 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:07:41 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance 24b84c61-6ea0-4187-abc8-80a967d5bf70 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:07:41 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 17:07:41 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 17:07:41 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 17:07:41 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 17:07:41 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Compute_service record updated for user:user {{(pid=75245) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 17:07:41 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.163s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:07:44 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:07:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:07:44 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:07:46 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:07:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:07:49 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:07:51 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:07:51 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:07:51 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75245) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 17:07:52 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:07:52 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:07:53 user nova-compute[75245]: DEBUG nova.compute.manager [req-d26c455f-85a5-46bc-8037-4ecdb41330e9 req-dc91cce8-f52c-4aef-b77d-a9f6391855d3 service nova] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Received event network-changed-4312d216-4dad-48e3-b3f5-fda6ff4a2a66 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:07:53 user nova-compute[75245]: DEBUG nova.compute.manager [req-d26c455f-85a5-46bc-8037-4ecdb41330e9 req-dc91cce8-f52c-4aef-b77d-a9f6391855d3 service nova] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Refreshing instance network info cache due to event network-changed-4312d216-4dad-48e3-b3f5-fda6ff4a2a66. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 17:07:53 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d26c455f-85a5-46bc-8037-4ecdb41330e9 req-dc91cce8-f52c-4aef-b77d-a9f6391855d3 service nova] Acquiring lock "refresh_cache-24b84c61-6ea0-4187-abc8-80a967d5bf70" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:07:53 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d26c455f-85a5-46bc-8037-4ecdb41330e9 req-dc91cce8-f52c-4aef-b77d-a9f6391855d3 service nova] Acquired lock "refresh_cache-24b84c61-6ea0-4187-abc8-80a967d5bf70" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:07:53 user nova-compute[75245]: DEBUG nova.network.neutron [req-d26c455f-85a5-46bc-8037-4ecdb41330e9 req-dc91cce8-f52c-4aef-b77d-a9f6391855d3 service nova] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Refreshing network info cache for port 4312d216-4dad-48e3-b3f5-fda6ff4a2a66 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 17:07:53 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-914bd3ff-4f31-4aba-a806-12d18be1a76c tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Acquiring lock "24b84c61-6ea0-4187-abc8-80a967d5bf70" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:07:53 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-914bd3ff-4f31-4aba-a806-12d18be1a76c tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "24b84c61-6ea0-4187-abc8-80a967d5bf70" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:07:53 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-914bd3ff-4f31-4aba-a806-12d18be1a76c tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Acquiring lock "24b84c61-6ea0-4187-abc8-80a967d5bf70-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:07:53 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-914bd3ff-4f31-4aba-a806-12d18be1a76c tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "24b84c61-6ea0-4187-abc8-80a967d5bf70-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:07:53 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-914bd3ff-4f31-4aba-a806-12d18be1a76c tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "24b84c61-6ea0-4187-abc8-80a967d5bf70-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:07:53 user nova-compute[75245]: INFO nova.compute.manager [None req-914bd3ff-4f31-4aba-a806-12d18be1a76c tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Terminating instance
Nov 29 17:07:53 user nova-compute[75245]: DEBUG nova.compute.manager [None req-914bd3ff-4f31-4aba-a806-12d18be1a76c tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Start destroying the instance on the hypervisor. {{(pid=75245) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 17:07:53 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:07:53 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:07:53 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:07:53 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:07:53 user nova-compute[75245]: DEBUG nova.compute.manager [req-881d9ae5-3c3e-4947-9b78-4e1e9dc29ed7 req-6adb4061-118c-4f00-b555-b85c016889b4 service nova] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Received event network-vif-unplugged-4312d216-4dad-48e3-b3f5-fda6ff4a2a66 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:07:53 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-881d9ae5-3c3e-4947-9b78-4e1e9dc29ed7 req-6adb4061-118c-4f00-b555-b85c016889b4 service nova] Acquiring lock "24b84c61-6ea0-4187-abc8-80a967d5bf70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:07:53 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-881d9ae5-3c3e-4947-9b78-4e1e9dc29ed7 req-6adb4061-118c-4f00-b555-b85c016889b4 service nova] Lock "24b84c61-6ea0-4187-abc8-80a967d5bf70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:07:53 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-881d9ae5-3c3e-4947-9b78-4e1e9dc29ed7 req-6adb4061-118c-4f00-b555-b85c016889b4 service nova] Lock "24b84c61-6ea0-4187-abc8-80a967d5bf70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:07:53 user nova-compute[75245]: DEBUG nova.compute.manager [req-881d9ae5-3c3e-4947-9b78-4e1e9dc29ed7 req-6adb4061-118c-4f00-b555-b85c016889b4 service nova] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] No waiting events found dispatching network-vif-unplugged-4312d216-4dad-48e3-b3f5-fda6ff4a2a66 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:07:53 user nova-compute[75245]: DEBUG nova.compute.manager [req-881d9ae5-3c3e-4947-9b78-4e1e9dc29ed7 req-6adb4061-118c-4f00-b555-b85c016889b4 service nova] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Received event network-vif-unplugged-4312d216-4dad-48e3-b3f5-fda6ff4a2a66 for instance with task_state deleting. {{(pid=75245) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 17:07:53 user nova-compute[75245]: DEBUG nova.network.neutron [req-d26c455f-85a5-46bc-8037-4ecdb41330e9 req-dc91cce8-f52c-4aef-b77d-a9f6391855d3 service nova] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Updated VIF entry in instance network info cache for port 4312d216-4dad-48e3-b3f5-fda6ff4a2a66. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 17:07:53 user nova-compute[75245]: DEBUG nova.network.neutron [req-d26c455f-85a5-46bc-8037-4ecdb41330e9 req-dc91cce8-f52c-4aef-b77d-a9f6391855d3 service nova] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Updating instance_info_cache with network_info: [{"id": "4312d216-4dad-48e3-b3f5-fda6ff4a2a66", "address": "fa:16:3e:a9:76:89", "network": {"id": "316cb9af-807d-4a69-874e-2054520f0e5f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1421560477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0907dff4e054429fa10392b730363eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4312d216-4d", "ovs_interfaceid": "4312d216-4dad-48e3-b3f5-fda6ff4a2a66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:07:53 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-d26c455f-85a5-46bc-8037-4ecdb41330e9 req-dc91cce8-f52c-4aef-b77d-a9f6391855d3 service nova] Releasing lock "refresh_cache-24b84c61-6ea0-4187-abc8-80a967d5bf70" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:07:53 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Instance destroyed successfully.
Nov 29 17:07:53 user nova-compute[75245]: DEBUG nova.objects.instance [None req-914bd3ff-4f31-4aba-a806-12d18be1a76c tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lazy-loading 'resources' on Instance uuid 24b84c61-6ea0-4187-abc8-80a967d5bf70 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:07:53 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-914bd3ff-4f31-4aba-a806-12d18be1a76c tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T17:02:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1870259533',display_name='tempest-TestVolumeBootPattern-server-1870259533',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1870259533',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/6kahxqemcvv41mFTGeaM46NrxYZRkkk4Ze4uyAwqVYPXEaYTvEEpOxaMUDr0qjGaA6sscRII1lYPmpLMrkcup8Fj5nDL441po4R7XAC4kU9bdh8ehoEbo0Y9HtbsAfw==',key_name='tempest-TestVolumeBootPattern-280401073',keypairs=<?>,launch_index=0,launched_at=2023-11-29T17:03:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0907dff4e054429fa10392b730363eb2',ramdisk_id='',reservation_id='r-l0v56rjx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-181783012',owner_user_name='tempest-TestVolumeBootPattern-181783012-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T17:03:14Z,user_data=None,user_id='2870721a7fff4cf19291f0cbfaedae81',uuid=24b84c61-6ea0-4187-abc8-80a967d5bf70,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4312d216-4dad-48e3-b3f5-fda6ff4a2a66", "address": "fa:16:3e:a9:76:89", "network": {"id": "316cb9af-807d-4a69-874e-2054520f0e5f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1421560477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0907dff4e054429fa10392b730363eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4312d216-4d", "ovs_interfaceid": "4312d216-4dad-48e3-b3f5-fda6ff4a2a66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 17:07:53 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-914bd3ff-4f31-4aba-a806-12d18be1a76c tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Converting VIF {"id": "4312d216-4dad-48e3-b3f5-fda6ff4a2a66", "address": "fa:16:3e:a9:76:89", "network": {"id": "316cb9af-807d-4a69-874e-2054520f0e5f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1421560477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0907dff4e054429fa10392b730363eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4312d216-4d", "ovs_interfaceid": "4312d216-4dad-48e3-b3f5-fda6ff4a2a66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:07:53 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-914bd3ff-4f31-4aba-a806-12d18be1a76c tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a9:76:89,bridge_name='br-int',has_traffic_filtering=True,id=4312d216-4dad-48e3-b3f5-fda6ff4a2a66,network=Network(316cb9af-807d-4a69-874e-2054520f0e5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4312d216-4d') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:07:53 user nova-compute[75245]: DEBUG os_vif [None req-914bd3ff-4f31-4aba-a806-12d18be1a76c tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:76:89,bridge_name='br-int',has_traffic_filtering=True,id=4312d216-4dad-48e3-b3f5-fda6ff4a2a66,network=Network(316cb9af-807d-4a69-874e-2054520f0e5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4312d216-4d') {{(pid=75245) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 17:07:53 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:07:53 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4312d216-4d, bridge=br-int, if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:07:53 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:07:53 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:07:53 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7705575a-51ea-40a9-8d1c-2c3a95ca8215) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:07:53 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:07:53 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:07:53 user nova-compute[75245]: INFO os_vif [None req-914bd3ff-4f31-4aba-a806-12d18be1a76c tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:76:89,bridge_name='br-int',has_traffic_filtering=True,id=4312d216-4dad-48e3-b3f5-fda6ff4a2a66,network=Network(316cb9af-807d-4a69-874e-2054520f0e5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4312d216-4d')
Nov 29 17:07:53 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-914bd3ff-4f31-4aba-a806-12d18be1a76c tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] calling os-brick to detach iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 17:07:53 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-914bd3ff-4f31-4aba-a806-12d18be1a76c tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, {'target_iqn': 'iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TzHCXFWr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:07:53 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-914bd3ff-4f31-4aba-a806-12d18be1a76c tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:07:53 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-914bd3ff-4f31-4aba-a806-12d18be1a76c tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:07:53 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-914bd3ff-4f31-4aba-a806-12d18be1a76c tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:07:53 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:07:53 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:07:53 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc2c460-87ce-448d-8c71-542627dd0814]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:07:53 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-914bd3ff-4f31-4aba-a806-12d18be1a76c tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 17:07:53 user nova-compute[75245]: No targets found.
Nov 29 17:07:53 user nova-compute[75245]: iSNS:
Nov 29 17:07:53 user nova-compute[75245]: No targets found.
Nov 29 17:07:53 user nova-compute[75245]: STATIC:
Nov 29 17:07:53 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535
Nov 29 17:07:53 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:07:53 user nova-compute[75245]:                 Iface Name: default
Nov 29 17:07:53 user nova-compute[75245]: FIRMWARE:
Nov 29 17:07:53 user nova-compute[75245]: No targets found.
Nov 29 17:07:53 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:07:53 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-914bd3ff-4f31-4aba-a806-12d18be1a76c tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 17:07:53 user nova-compute[75245]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 17:07:53 user nova-compute[75245]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75245) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 17:07:53 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-914bd3ff-4f31-4aba-a806-12d18be1a76c tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535', 0)] {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 17:07:53 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:07:53 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:07:53 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[79af30ea-f931-443f-af28-2f600197cbeb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:07:53 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:07:54 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:07:54 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[94419a33-9894-4d59-9bb6-bd909d81a68b]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:07:54 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-914bd3ff-4f31-4aba-a806-12d18be1a76c tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535 (non-flash)
Nov 29 17:07:54 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:07:54 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-914bd3ff-4f31-4aba-a806-12d18be1a76c tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535 (non-flash)
Nov 29 17:07:54 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:07:54 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-914bd3ff-4f31-4aba-a806-12d18be1a76c tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0d205ca560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535'): ({'sdb'}, set())}) {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 17:07:54 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-914bd3ff-4f31-4aba-a806-12d18be1a76c tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Removing single pathed devices sdb {{(pid=75245) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 17:07:54 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:07:54 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:07:54 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1efcd5-ea1b-46a3-abcb-148f4e4b3ed5]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:07:54 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:07:54 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:07:54 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[640c2f4c-15fc-4688-ba7d-9c8760a63661]: (4, ('ok\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:07:54 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-914bd3ff-4f31-4aba-a806-12d18be1a76c tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Flushing IO for device /dev/sdb {{(pid=75245) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 17:07:54 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:07:54 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:07:54 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[af437bec-3bff-4279-9a6b-474254bb600f]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:07:54 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-914bd3ff-4f31-4aba-a806-12d18be1a76c tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75245) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 17:07:54 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:07:54 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:07:54 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e7c75c-606e-462d-93c2-f030787787ae]: (4, ('1', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:07:54 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-914bd3ff-4f31-4aba-a806-12d18be1a76c tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 17:07:54 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-914bd3ff-4f31-4aba-a806-12d18be1a76c tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] SCSI volumes sdb have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 17:07:54 user nova-compute[75245]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO8d2ed5be-4143665d8e5d5414', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_8d2ed5be', '/dev/disk/by-id/scsi-23431343336363564') {{(pid=86166) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 29 17:07:54 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d1f2d6-e90f-474e-9eb2-7d36495bdbf6]: (4, None) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:07:54 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-914bd3ff-4f31-4aba-a806-12d18be1a76c tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535')] {{(pid=75245) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 17:07:54 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:07:54 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:07:54 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[0370b54d-fdba-4e5a-b623-f9e05e5d1b0d]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:07:54 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-914bd3ff-4f31-4aba-a806-12d18be1a76c tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:07:54 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535 -p 172.16.0.220:3260 --logout {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:07:54 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:07:54 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd4523b5-ab53-4237-a31a-3897a3cd36ce]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:07:54 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-914bd3ff-4f31-4aba-a806-12d18be1a76c tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535, portal: 172.16.0.220,3260]
Nov 29 17:07:54 user nova-compute[75245]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535, portal: 172.16.0.220,3260] successful.
Nov 29 17:07:54 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:07:54 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535 -p 172.16.0.220:3260 --op delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:07:54 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64b1f27b-9bd5-40d8-af17-c9f4ec603535 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:07:54 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[409e4d6b-9bd2-46e8-b601-b01c8aa8dc07]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:07:54 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-914bd3ff-4f31-4aba-a806-12d18be1a76c tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:07:54 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-914bd3ff-4f31-4aba-a806-12d18be1a76c tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:07:54 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-914bd3ff-4f31-4aba-a806-12d18be1a76c tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] <== disconnect_volume: return (280ms) None {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:07:54 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-914bd3ff-4f31-4aba-a806-12d18be1a76c tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Disconnected iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 17:07:54 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-914bd3ff-4f31-4aba-a806-12d18be1a76c tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Deleting instance files /opt/stack/data/nova/instances/24b84c61-6ea0-4187-abc8-80a967d5bf70_del
Nov 29 17:07:54 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-914bd3ff-4f31-4aba-a806-12d18be1a76c tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Deletion of /opt/stack/data/nova/instances/24b84c61-6ea0-4187-abc8-80a967d5bf70_del complete
Nov 29 17:07:54 user nova-compute[75245]: INFO nova.compute.manager [None req-914bd3ff-4f31-4aba-a806-12d18be1a76c tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Took 1.22 seconds to destroy the instance on the hypervisor.
Nov 29 17:07:54 user nova-compute[75245]: DEBUG oslo.service.loopingcall [None req-914bd3ff-4f31-4aba-a806-12d18be1a76c tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75245) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 17:07:54 user nova-compute[75245]: DEBUG nova.compute.manager [-] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Deallocating network for instance {{(pid=75245) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 17:07:54 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] deallocate_for_instance() {{(pid=75245) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 17:07:54 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:07:54 user nova-compute[75245]: INFO nova.compute.manager [-] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Took 0.46 seconds to deallocate network for instance.
Nov 29 17:07:54 user nova-compute[75245]: DEBUG nova.compute.manager [req-7ed546c5-4288-459e-854d-cb1090bb269c req-b749321e-a1fb-43e2-87fc-8c7d5c695d1a service nova] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Received event network-vif-deleted-4312d216-4dad-48e3-b3f5-fda6ff4a2a66 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:07:55 user nova-compute[75245]: DEBUG nova.compute.manager [req-b8129bde-874b-46a0-aa31-0fd65912f44b req-ebfd9bd0-1dfd-456a-8065-cc5b14433a15 service nova] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Received event network-vif-plugged-4312d216-4dad-48e3-b3f5-fda6ff4a2a66 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:07:55 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b8129bde-874b-46a0-aa31-0fd65912f44b req-ebfd9bd0-1dfd-456a-8065-cc5b14433a15 service nova] Acquiring lock "24b84c61-6ea0-4187-abc8-80a967d5bf70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:07:55 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b8129bde-874b-46a0-aa31-0fd65912f44b req-ebfd9bd0-1dfd-456a-8065-cc5b14433a15 service nova] Lock "24b84c61-6ea0-4187-abc8-80a967d5bf70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:07:55 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b8129bde-874b-46a0-aa31-0fd65912f44b req-ebfd9bd0-1dfd-456a-8065-cc5b14433a15 service nova] Lock "24b84c61-6ea0-4187-abc8-80a967d5bf70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:07:55 user nova-compute[75245]: DEBUG nova.compute.manager [req-b8129bde-874b-46a0-aa31-0fd65912f44b req-ebfd9bd0-1dfd-456a-8065-cc5b14433a15 service nova] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] No waiting events found dispatching network-vif-plugged-4312d216-4dad-48e3-b3f5-fda6ff4a2a66 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:07:55 user nova-compute[75245]: WARNING nova.compute.manager [req-b8129bde-874b-46a0-aa31-0fd65912f44b req-ebfd9bd0-1dfd-456a-8065-cc5b14433a15 service nova] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Received unexpected event network-vif-plugged-4312d216-4dad-48e3-b3f5-fda6ff4a2a66 for instance with vm_state active and task_state deleting.
Nov 29 17:07:55 user nova-compute[75245]: INFO nova.compute.manager [None req-914bd3ff-4f31-4aba-a806-12d18be1a76c tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] [instance: 24b84c61-6ea0-4187-abc8-80a967d5bf70] Took 0.76 seconds to detach 1 volumes for instance.
Nov 29 17:07:55 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-914bd3ff-4f31-4aba-a806-12d18be1a76c tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:07:55 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-914bd3ff-4f31-4aba-a806-12d18be1a76c tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:07:55 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-914bd3ff-4f31-4aba-a806-12d18be1a76c tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 17:07:55 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-914bd3ff-4f31-4aba-a806-12d18be1a76c tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 17:07:55 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-914bd3ff-4f31-4aba-a806-12d18be1a76c tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.121s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:07:55 user nova-compute[75245]: INFO nova.scheduler.client.report [None req-914bd3ff-4f31-4aba-a806-12d18be1a76c tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Deleted allocations for instance 24b84c61-6ea0-4187-abc8-80a967d5bf70
Nov 29 17:07:55 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-914bd3ff-4f31-4aba-a806-12d18be1a76c tempest-TestVolumeBootPattern-181783012 tempest-TestVolumeBootPattern-181783012-project-member] Lock "24b84c61-6ea0-4187-abc8-80a967d5bf70" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.748s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:07:58 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:07:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:08:03 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:08:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:08:10 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:08:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:08:18 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:08:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:08:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:08:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75245) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 17:08:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 17:08:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 17:08:23 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:08:28 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:08:33 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:08:35 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:08:35 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Starting heal instance info cache {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 17:08:35 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Rebuilding the list of instances to heal {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 17:08:35 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Didn't find any instances for network info cache update. {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 17:08:38 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:08:41 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:08:41 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:08:41 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:08:41 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:08:41 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75245) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 17:08:41 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:08:41 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:08:41 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Hypervisor/Node resource view: name=user free_ram=9136MB free_disk=25.069927215576172GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75245) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 17:08:41 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:08:41 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:08:41 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 17:08:41 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 17:08:41 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 17:08:41 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 17:08:42 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Compute_service record updated for user:user {{(pid=75245) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 17:08:42 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.137s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:08:43 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:08:46 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:08:46 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:08:46 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:08:48 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:08:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:08:51 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:08:53 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:08:53 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:08:53 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75245) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 17:08:53 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:08:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:08:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:08:58 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:08:59 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:09:00 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:09:02 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:09:03 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:09:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:09:05 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:09:07 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:09:08 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:09:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:09:10 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:09:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Acquiring lock "ffa56d44-cd40-4b42-9d6d-f37ba3759b13" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:09:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Lock "ffa56d44-cd40-4b42-9d6d-f37ba3759b13" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:09:12 user nova-compute[75245]: DEBUG nova.compute.manager [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Starting instance... {{(pid=75245) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 17:09:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:09:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:09:12 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75245) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 17:09:12 user nova-compute[75245]: INFO nova.compute.claims [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Claim successful on node user
Nov 29 17:09:12 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 17:09:12 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 17:09:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.211s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:09:12 user nova-compute[75245]: DEBUG nova.compute.manager [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Start building networks asynchronously for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 17:09:12 user nova-compute[75245]: DEBUG nova.compute.manager [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Allocating IP information in the background. {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 17:09:12 user nova-compute[75245]: DEBUG nova.network.neutron [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] allocate_for_instance() {{(pid=75245) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 17:09:12 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 17:09:12 user nova-compute[75245]: DEBUG nova.compute.manager [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Start building block device mappings for instance. {{(pid=75245) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 17:09:12 user nova-compute[75245]: DEBUG nova.compute.manager [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Start spawning the instance on the hypervisor. {{(pid=75245) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 17:09:12 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Creating instance directory {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 17:09:12 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Creating image(s)
Nov 29 17:09:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Acquiring lock "/opt/stack/data/nova/instances/ffa56d44-cd40-4b42-9d6d-f37ba3759b13/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:09:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Lock "/opt/stack/data/nova/instances/ffa56d44-cd40-4b42-9d6d-f37ba3759b13/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:09:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Lock "/opt/stack/data/nova/instances/ffa56d44-cd40-4b42-9d6d-f37ba3759b13/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:09:12 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:09:13 user nova-compute[75245]: DEBUG nova.policy [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '93438518561c47a589c735c23ee6d6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2019bc75cdd34c3bb817000f6fe60a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75245) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 17:09:13 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.178s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:09:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Acquiring lock "d654f7206043e05d3525550b0fc885556eb999f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:09:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:09:13 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:09:13 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.172s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:09:13 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/ffa56d44-cd40-4b42-9d6d-f37ba3759b13/disk 1073741824 {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:09:13 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8,backing_fmt=raw /opt/stack/data/nova/instances/ffa56d44-cd40-4b42-9d6d-f37ba3759b13/disk 1073741824" returned: 0 in 0.053s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:09:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Lock "d654f7206043e05d3525550b0fc885556eb999f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:09:13 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:09:13 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d654f7206043e05d3525550b0fc885556eb999f8 --force-share --output=json" returned: 0 in 0.181s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:09:13 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ffa56d44-cd40-4b42-9d6d-f37ba3759b13/disk. size=1073741824 {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 17:09:13 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffa56d44-cd40-4b42-9d6d-f37ba3759b13/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:09:13 user nova-compute[75245]: DEBUG nova.network.neutron [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Successfully created port: 671bebb6-5146-45a2-b5b3-3307af4160c9 {{(pid=75245) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 17:09:13 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffa56d44-cd40-4b42-9d6d-f37ba3759b13/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:09:13 user nova-compute[75245]: DEBUG nova.virt.disk.api [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Cannot resize image /opt/stack/data/nova/instances/ffa56d44-cd40-4b42-9d6d-f37ba3759b13/disk to a smaller size. {{(pid=75245) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 17:09:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Created local disks {{(pid=75245) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 17:09:13 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Ensure instance console log exists: /opt/stack/data/nova/instances/ffa56d44-cd40-4b42-9d6d-f37ba3759b13/console.log {{(pid=75245) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 17:09:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:09:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:09:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:09:13 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:09:14 user nova-compute[75245]: DEBUG nova.network.neutron [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Successfully updated port: 671bebb6-5146-45a2-b5b3-3307af4160c9 {{(pid=75245) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 17:09:14 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Acquiring lock "refresh_cache-ffa56d44-cd40-4b42-9d6d-f37ba3759b13" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:09:14 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Acquired lock "refresh_cache-ffa56d44-cd40-4b42-9d6d-f37ba3759b13" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:09:14 user nova-compute[75245]: DEBUG nova.network.neutron [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Building network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 17:09:14 user nova-compute[75245]: DEBUG nova.network.neutron [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Instance cache missing network info. {{(pid=75245) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 17:09:14 user nova-compute[75245]: DEBUG nova.compute.manager [req-cc746e24-b2fa-44da-bf8e-6a9792041b5f req-fb1b04fa-addd-4387-afe2-4c048c7b4f96 service nova] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Received event network-changed-671bebb6-5146-45a2-b5b3-3307af4160c9 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:09:14 user nova-compute[75245]: DEBUG nova.compute.manager [req-cc746e24-b2fa-44da-bf8e-6a9792041b5f req-fb1b04fa-addd-4387-afe2-4c048c7b4f96 service nova] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Refreshing instance network info cache due to event network-changed-671bebb6-5146-45a2-b5b3-3307af4160c9. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 17:09:14 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-cc746e24-b2fa-44da-bf8e-6a9792041b5f req-fb1b04fa-addd-4387-afe2-4c048c7b4f96 service nova] Acquiring lock "refresh_cache-ffa56d44-cd40-4b42-9d6d-f37ba3759b13" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:09:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:09:14 user nova-compute[75245]: DEBUG nova.network.neutron [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Updating instance_info_cache with network_info: [{"id": "671bebb6-5146-45a2-b5b3-3307af4160c9", "address": "fa:16:3e:70:67:f1", "network": {"id": "d88c85cd-909b-4c70-92cf-ae0ba3b1d136", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-301851142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2019bc75cdd34c3bb817000f6fe60a11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap671bebb6-51", "ovs_interfaceid": "671bebb6-5146-45a2-b5b3-3307af4160c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:09:14 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Releasing lock "refresh_cache-ffa56d44-cd40-4b42-9d6d-f37ba3759b13" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:09:14 user nova-compute[75245]: DEBUG nova.compute.manager [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Instance network_info: |[{"id": "671bebb6-5146-45a2-b5b3-3307af4160c9", "address": "fa:16:3e:70:67:f1", "network": {"id": "d88c85cd-909b-4c70-92cf-ae0ba3b1d136", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-301851142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2019bc75cdd34c3bb817000f6fe60a11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap671bebb6-51", "ovs_interfaceid": "671bebb6-5146-45a2-b5b3-3307af4160c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75245) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 17:09:14 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-cc746e24-b2fa-44da-bf8e-6a9792041b5f req-fb1b04fa-addd-4387-afe2-4c048c7b4f96 service nova] Acquired lock "refresh_cache-ffa56d44-cd40-4b42-9d6d-f37ba3759b13" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:09:14 user nova-compute[75245]: DEBUG nova.network.neutron [req-cc746e24-b2fa-44da-bf8e-6a9792041b5f req-fb1b04fa-addd-4387-afe2-4c048c7b4f96 service nova] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Refreshing network info cache for port 671bebb6-5146-45a2-b5b3-3307af4160c9 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 17:09:14 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Start _get_guest_xml network_info=[{"id": "671bebb6-5146-45a2-b5b3-3307af4160c9", "address": "fa:16:3e:70:67:f1", "network": {"id": "d88c85cd-909b-4c70-92cf-ae0ba3b1d136", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-301851142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2019bc75cdd34c3bb817000f6fe60a11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap671bebb6-51", "ovs_interfaceid": "671bebb6-5146-45a2-b5b3-3307af4160c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'a291d9c3-be02-4c6c-9649-4b45c5b7f487'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 17:09:14 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:09:14 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:09:14 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 17:09:14 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] CPU controller missing on host. {{(pid=75245) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 17:09:14 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 17:09:14 user nova-compute[75245]: DEBUG nova.virt.libvirt.host [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] CPU controller found on host. {{(pid=75245) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 17:09:14 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75245) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 17:09:14 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T16:06:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T16:06:17Z,direct_url=<?>,disk_format='qcow2',id=a291d9c3-be02-4c6c-9649-4b45c5b7f487,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ffdbebd41351498089cb0fadd3b40e6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T16:06:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 17:09:14 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Flavor limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 17:09:14 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Image limits 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 17:09:14 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Flavor pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 17:09:14 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Image pref 0:0:0 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 17:09:14 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 17:09:14 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 17:09:14 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 17:09:14 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Got 1 possible topologies {{(pid=75245) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 17:09:14 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 17:09:14 user nova-compute[75245]: DEBUG nova.virt.hardware [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75245) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 17:09:14 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T17:09:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-938654112',display_name='tempest-SnapshotDataIntegrityTests-server-938654112',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-938654112',id=52,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPJNQUOudoKx0edwqpsPintiYISj8f70ERA8ryVrTjGEARPIi7Btclu9jNU0DUa96skoE8fTVP5scZcTvt0WwtQ2ASEjX46dutfWg7v1g9pvgCfKflSEChS8uITRtfjSA==',key_name='tempest-keypair-1250106869',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2019bc75cdd34c3bb817000f6fe60a11',ramdisk_id='',reservation_id='r-83umoqcn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-866351896',owner_user_name='tempest-SnapshotDataIntegrityTests-866351896-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T17:09:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93438518561c47a589c735c23ee6d6d9',uuid=ffa56d44-cd40-4b42-9d6d-f37ba3759b13,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "671bebb6-5146-45a2-b5b3-3307af4160c9", "address": "fa:16:3e:70:67:f1", "network": {"id": "d88c85cd-909b-4c70-92cf-ae0ba3b1d136", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-301851142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2019bc75cdd34c3bb817000f6fe60a11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap671bebb6-51", "ovs_interfaceid": "671bebb6-5146-45a2-b5b3-3307af4160c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75245) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 17:09:14 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Converting VIF {"id": "671bebb6-5146-45a2-b5b3-3307af4160c9", "address": "fa:16:3e:70:67:f1", "network": {"id": "d88c85cd-909b-4c70-92cf-ae0ba3b1d136", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-301851142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2019bc75cdd34c3bb817000f6fe60a11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap671bebb6-51", "ovs_interfaceid": "671bebb6-5146-45a2-b5b3-3307af4160c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:09:14 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:67:f1,bridge_name='br-int',has_traffic_filtering=True,id=671bebb6-5146-45a2-b5b3-3307af4160c9,network=Network(d88c85cd-909b-4c70-92cf-ae0ba3b1d136),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap671bebb6-51') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:09:14 user nova-compute[75245]: DEBUG nova.objects.instance [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Lazy-loading 'pci_devices' on Instance uuid ffa56d44-cd40-4b42-9d6d-f37ba3759b13 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:09:14 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] End _get_guest_xml xml=<domain type="kvm">
Nov 29 17:09:14 user nova-compute[75245]:   <uuid>ffa56d44-cd40-4b42-9d6d-f37ba3759b13</uuid>
Nov 29 17:09:14 user nova-compute[75245]:   <name>instance-00000034</name>
Nov 29 17:09:14 user nova-compute[75245]:   <memory>524288</memory>
Nov 29 17:09:14 user nova-compute[75245]:   <vcpu>1</vcpu>
Nov 29 17:09:14 user nova-compute[75245]:   <metadata>
Nov 29 17:09:14 user nova-compute[75245]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 17:09:14 user nova-compute[75245]:       <nova:package version="0.0.0"/>
Nov 29 17:09:14 user nova-compute[75245]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-938654112</nova:name>
Nov 29 17:09:14 user nova-compute[75245]:       <nova:creationTime>2023-11-29 17:09:14</nova:creationTime>
Nov 29 17:09:14 user nova-compute[75245]:       <nova:flavor name="m1.tiny">
Nov 29 17:09:14 user nova-compute[75245]:         <nova:memory>512</nova:memory>
Nov 29 17:09:14 user nova-compute[75245]:         <nova:disk>1</nova:disk>
Nov 29 17:09:14 user nova-compute[75245]:         <nova:swap>0</nova:swap>
Nov 29 17:09:14 user nova-compute[75245]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 17:09:14 user nova-compute[75245]:         <nova:vcpus>1</nova:vcpus>
Nov 29 17:09:14 user nova-compute[75245]:       </nova:flavor>
Nov 29 17:09:14 user nova-compute[75245]:       <nova:owner>
Nov 29 17:09:14 user nova-compute[75245]:         <nova:user uuid="93438518561c47a589c735c23ee6d6d9">tempest-SnapshotDataIntegrityTests-866351896-project-member</nova:user>
Nov 29 17:09:14 user nova-compute[75245]:         <nova:project uuid="2019bc75cdd34c3bb817000f6fe60a11">tempest-SnapshotDataIntegrityTests-866351896</nova:project>
Nov 29 17:09:14 user nova-compute[75245]:       </nova:owner>
Nov 29 17:09:14 user nova-compute[75245]:       <nova:root type="image" uuid="a291d9c3-be02-4c6c-9649-4b45c5b7f487"/>
Nov 29 17:09:14 user nova-compute[75245]:       <nova:ports>
Nov 29 17:09:14 user nova-compute[75245]:         <nova:port uuid="671bebb6-5146-45a2-b5b3-3307af4160c9">
Nov 29 17:09:14 user nova-compute[75245]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 29 17:09:14 user nova-compute[75245]:         </nova:port>
Nov 29 17:09:14 user nova-compute[75245]:       </nova:ports>
Nov 29 17:09:14 user nova-compute[75245]:     </nova:instance>
Nov 29 17:09:14 user nova-compute[75245]:   </metadata>
Nov 29 17:09:14 user nova-compute[75245]:   <sysinfo type="smbios">
Nov 29 17:09:14 user nova-compute[75245]:     <system>
Nov 29 17:09:14 user nova-compute[75245]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 17:09:14 user nova-compute[75245]:       <entry name="product">OpenStack Nova</entry>
Nov 29 17:09:14 user nova-compute[75245]:       <entry name="version">0.0.0</entry>
Nov 29 17:09:14 user nova-compute[75245]:       <entry name="serial">ffa56d44-cd40-4b42-9d6d-f37ba3759b13</entry>
Nov 29 17:09:14 user nova-compute[75245]:       <entry name="uuid">ffa56d44-cd40-4b42-9d6d-f37ba3759b13</entry>
Nov 29 17:09:14 user nova-compute[75245]:       <entry name="family">Virtual Machine</entry>
Nov 29 17:09:14 user nova-compute[75245]:     </system>
Nov 29 17:09:14 user nova-compute[75245]:   </sysinfo>
Nov 29 17:09:14 user nova-compute[75245]:   <os>
Nov 29 17:09:14 user nova-compute[75245]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 17:09:14 user nova-compute[75245]:     <boot dev="hd"/>
Nov 29 17:09:14 user nova-compute[75245]:     <smbios mode="sysinfo"/>
Nov 29 17:09:14 user nova-compute[75245]:   </os>
Nov 29 17:09:14 user nova-compute[75245]:   <features>
Nov 29 17:09:14 user nova-compute[75245]:     <acpi/>
Nov 29 17:09:14 user nova-compute[75245]:     <apic/>
Nov 29 17:09:14 user nova-compute[75245]:     <vmcoreinfo/>
Nov 29 17:09:14 user nova-compute[75245]:   </features>
Nov 29 17:09:14 user nova-compute[75245]:   <clock offset="utc">
Nov 29 17:09:14 user nova-compute[75245]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 17:09:14 user nova-compute[75245]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 17:09:14 user nova-compute[75245]:     <timer name="hpet" present="no"/>
Nov 29 17:09:14 user nova-compute[75245]:   </clock>
Nov 29 17:09:14 user nova-compute[75245]:   <cpu mode="custom" match="exact">
Nov 29 17:09:14 user nova-compute[75245]:     <model>Nehalem</model>
Nov 29 17:09:14 user nova-compute[75245]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 17:09:14 user nova-compute[75245]:   </cpu>
Nov 29 17:09:14 user nova-compute[75245]:   <devices>
Nov 29 17:09:14 user nova-compute[75245]:     <disk type="file" device="disk">
Nov 29 17:09:14 user nova-compute[75245]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 17:09:14 user nova-compute[75245]:       <source file="/opt/stack/data/nova/instances/ffa56d44-cd40-4b42-9d6d-f37ba3759b13/disk"/>
Nov 29 17:09:14 user nova-compute[75245]:       <target dev="vda" bus="virtio"/>
Nov 29 17:09:14 user nova-compute[75245]:     </disk>
Nov 29 17:09:14 user nova-compute[75245]:     <interface type="ethernet">
Nov 29 17:09:14 user nova-compute[75245]:       <mac address="fa:16:3e:70:67:f1"/>
Nov 29 17:09:14 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 17:09:14 user nova-compute[75245]:       <mtu size="1442"/>
Nov 29 17:09:14 user nova-compute[75245]:       <target dev="tap671bebb6-51"/>
Nov 29 17:09:14 user nova-compute[75245]:     </interface>
Nov 29 17:09:14 user nova-compute[75245]:     <serial type="pty">
Nov 29 17:09:14 user nova-compute[75245]:       <log file="/opt/stack/data/nova/instances/ffa56d44-cd40-4b42-9d6d-f37ba3759b13/console.log" append="off"/>
Nov 29 17:09:14 user nova-compute[75245]:     </serial>
Nov 29 17:09:14 user nova-compute[75245]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 17:09:14 user nova-compute[75245]:     <video>
Nov 29 17:09:14 user nova-compute[75245]:       <model type="virtio"/>
Nov 29 17:09:14 user nova-compute[75245]:     </video>
Nov 29 17:09:14 user nova-compute[75245]:     <rng model="virtio">
Nov 29 17:09:14 user nova-compute[75245]:       <backend model="random">/dev/urandom</backend>
Nov 29 17:09:14 user nova-compute[75245]:     </rng>
Nov 29 17:09:14 user nova-compute[75245]:     <controller type="usb" index="0" model="none"/>
Nov 29 17:09:14 user nova-compute[75245]:     <memballoon model="virtio">
Nov 29 17:09:14 user nova-compute[75245]:       <stats period="10"/>
Nov 29 17:09:14 user nova-compute[75245]:     </memballoon>
Nov 29 17:09:14 user nova-compute[75245]:   </devices>
Nov 29 17:09:14 user nova-compute[75245]: </domain>
Nov 29 17:09:14 user nova-compute[75245]:  {{(pid=75245) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 17:09:14 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T17:09:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-938654112',display_name='tempest-SnapshotDataIntegrityTests-server-938654112',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-938654112',id=52,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPJNQUOudoKx0edwqpsPintiYISj8f70ERA8ryVrTjGEARPIi7Btclu9jNU0DUa96skoE8fTVP5scZcTvt0WwtQ2ASEjX46dutfWg7v1g9pvgCfKflSEChS8uITRtfjSA==',key_name='tempest-keypair-1250106869',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2019bc75cdd34c3bb817000f6fe60a11',ramdisk_id='',reservation_id='r-83umoqcn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-866351896',owner_user_name='tempest-SnapshotDataIntegrityTests-866351896-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T17:09:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93438518561c47a589c735c23ee6d6d9',uuid=ffa56d44-cd40-4b42-9d6d-f37ba3759b13,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "671bebb6-5146-45a2-b5b3-3307af4160c9", "address": "fa:16:3e:70:67:f1", "network": {"id": "d88c85cd-909b-4c70-92cf-ae0ba3b1d136", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-301851142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2019bc75cdd34c3bb817000f6fe60a11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap671bebb6-51", "ovs_interfaceid": "671bebb6-5146-45a2-b5b3-3307af4160c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 17:09:14 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Converting VIF {"id": "671bebb6-5146-45a2-b5b3-3307af4160c9", "address": "fa:16:3e:70:67:f1", "network": {"id": "d88c85cd-909b-4c70-92cf-ae0ba3b1d136", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-301851142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2019bc75cdd34c3bb817000f6fe60a11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap671bebb6-51", "ovs_interfaceid": "671bebb6-5146-45a2-b5b3-3307af4160c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:09:14 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:67:f1,bridge_name='br-int',has_traffic_filtering=True,id=671bebb6-5146-45a2-b5b3-3307af4160c9,network=Network(d88c85cd-909b-4c70-92cf-ae0ba3b1d136),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap671bebb6-51') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:09:14 user nova-compute[75245]: DEBUG os_vif [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:67:f1,bridge_name='br-int',has_traffic_filtering=True,id=671bebb6-5146-45a2-b5b3-3307af4160c9,network=Network(d88c85cd-909b-4c70-92cf-ae0ba3b1d136),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap671bebb6-51') {{(pid=75245) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 17:09:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:09:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:09:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 17:09:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:09:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5b7dda1c-0abe-5eca-a230-5c0c18daf28a', '_type': 'linux-noop'}}, row=False) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:09:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:09:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:09:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap671bebb6-51, may_exist=True, interface_attrs={}) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:09:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap671bebb6-51, col_values=(('qos', UUID('76680d22-28cf-40b7-974d-00d550eadbfc')),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:09:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap671bebb6-51, col_values=(('external_ids', {'iface-id': '671bebb6-5146-45a2-b5b3-3307af4160c9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:70:67:f1', 'vm-uuid': 'ffa56d44-cd40-4b42-9d6d-f37ba3759b13'}),), if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:09:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:09:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:09:14 user nova-compute[75245]: INFO os_vif [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:67:f1,bridge_name='br-int',has_traffic_filtering=True,id=671bebb6-5146-45a2-b5b3-3307af4160c9,network=Network(d88c85cd-909b-4c70-92cf-ae0ba3b1d136),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap671bebb6-51')
Nov 29 17:09:14 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 17:09:14 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] No VIF found with MAC fa:16:3e:70:67:f1, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 17:09:15 user nova-compute[75245]: DEBUG nova.network.neutron [req-cc746e24-b2fa-44da-bf8e-6a9792041b5f req-fb1b04fa-addd-4387-afe2-4c048c7b4f96 service nova] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Updated VIF entry in instance network info cache for port 671bebb6-5146-45a2-b5b3-3307af4160c9. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 17:09:15 user nova-compute[75245]: DEBUG nova.network.neutron [req-cc746e24-b2fa-44da-bf8e-6a9792041b5f req-fb1b04fa-addd-4387-afe2-4c048c7b4f96 service nova] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Updating instance_info_cache with network_info: [{"id": "671bebb6-5146-45a2-b5b3-3307af4160c9", "address": "fa:16:3e:70:67:f1", "network": {"id": "d88c85cd-909b-4c70-92cf-ae0ba3b1d136", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-301851142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2019bc75cdd34c3bb817000f6fe60a11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap671bebb6-51", "ovs_interfaceid": "671bebb6-5146-45a2-b5b3-3307af4160c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:09:15 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-cc746e24-b2fa-44da-bf8e-6a9792041b5f req-fb1b04fa-addd-4387-afe2-4c048c7b4f96 service nova] Releasing lock "refresh_cache-ffa56d44-cd40-4b42-9d6d-f37ba3759b13" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:09:16 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:09:16 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:09:16 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:09:16 user nova-compute[75245]: DEBUG nova.compute.manager [req-770c5db9-a70a-45bf-b619-4ed5a6204e38 req-8fbb6086-325b-4fc7-bd1a-8044cd76efe9 service nova] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Received event network-vif-plugged-671bebb6-5146-45a2-b5b3-3307af4160c9 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:09:16 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-770c5db9-a70a-45bf-b619-4ed5a6204e38 req-8fbb6086-325b-4fc7-bd1a-8044cd76efe9 service nova] Acquiring lock "ffa56d44-cd40-4b42-9d6d-f37ba3759b13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:09:16 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-770c5db9-a70a-45bf-b619-4ed5a6204e38 req-8fbb6086-325b-4fc7-bd1a-8044cd76efe9 service nova] Lock "ffa56d44-cd40-4b42-9d6d-f37ba3759b13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:09:16 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-770c5db9-a70a-45bf-b619-4ed5a6204e38 req-8fbb6086-325b-4fc7-bd1a-8044cd76efe9 service nova] Lock "ffa56d44-cd40-4b42-9d6d-f37ba3759b13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:09:16 user nova-compute[75245]: DEBUG nova.compute.manager [req-770c5db9-a70a-45bf-b619-4ed5a6204e38 req-8fbb6086-325b-4fc7-bd1a-8044cd76efe9 service nova] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] No waiting events found dispatching network-vif-plugged-671bebb6-5146-45a2-b5b3-3307af4160c9 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:09:16 user nova-compute[75245]: WARNING nova.compute.manager [req-770c5db9-a70a-45bf-b619-4ed5a6204e38 req-8fbb6086-325b-4fc7-bd1a-8044cd76efe9 service nova] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Received unexpected event network-vif-plugged-671bebb6-5146-45a2-b5b3-3307af4160c9 for instance with vm_state building and task_state spawning.
Nov 29 17:09:16 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:09:16 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:09:16 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:09:16 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:09:18 user nova-compute[75245]: DEBUG nova.compute.manager [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Instance event wait completed in 0 seconds for  {{(pid=75245) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 17:09:18 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Guest created on hypervisor {{(pid=75245) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 17:09:18 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Instance spawned successfully.
Nov 29 17:09:18 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 17:09:18 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Found default for hw_cdrom_bus of ide {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:09:18 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Found default for hw_disk_bus of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:09:18 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Found default for hw_input_bus of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:09:18 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Found default for hw_pointer_model of None {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:09:18 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Found default for hw_video_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:09:18 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Found default for hw_vif_model of virtio {{(pid=75245) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:09:18 user nova-compute[75245]: INFO nova.compute.manager [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Took 5.45 seconds to spawn the instance on the hypervisor.
Nov 29 17:09:18 user nova-compute[75245]: DEBUG nova.compute.manager [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Checking state {{(pid=75245) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 17:09:18 user nova-compute[75245]: DEBUG nova.compute.manager [req-6069a1cd-431d-470c-b752-36129681ae8a req-15f500c0-2a5b-4931-86f1-2d5352e19829 service nova] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Received event network-vif-plugged-671bebb6-5146-45a2-b5b3-3307af4160c9 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:09:18 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-6069a1cd-431d-470c-b752-36129681ae8a req-15f500c0-2a5b-4931-86f1-2d5352e19829 service nova] Acquiring lock "ffa56d44-cd40-4b42-9d6d-f37ba3759b13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:09:18 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-6069a1cd-431d-470c-b752-36129681ae8a req-15f500c0-2a5b-4931-86f1-2d5352e19829 service nova] Lock "ffa56d44-cd40-4b42-9d6d-f37ba3759b13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:09:18 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-6069a1cd-431d-470c-b752-36129681ae8a req-15f500c0-2a5b-4931-86f1-2d5352e19829 service nova] Lock "ffa56d44-cd40-4b42-9d6d-f37ba3759b13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:09:18 user nova-compute[75245]: DEBUG nova.compute.manager [req-6069a1cd-431d-470c-b752-36129681ae8a req-15f500c0-2a5b-4931-86f1-2d5352e19829 service nova] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] No waiting events found dispatching network-vif-plugged-671bebb6-5146-45a2-b5b3-3307af4160c9 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:09:18 user nova-compute[75245]: WARNING nova.compute.manager [req-6069a1cd-431d-470c-b752-36129681ae8a req-15f500c0-2a5b-4931-86f1-2d5352e19829 service nova] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Received unexpected event network-vif-plugged-671bebb6-5146-45a2-b5b3-3307af4160c9 for instance with vm_state building and task_state spawning.
Nov 29 17:09:18 user nova-compute[75245]: INFO nova.compute.manager [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Took 6.00 seconds to build instance.
Nov 29 17:09:18 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-32fa4b9e-aec2-497e-a8d2-18a50c72cb93 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Lock "ffa56d44-cd40-4b42-9d6d-f37ba3759b13" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.090s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:09:19 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:09:19 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:09:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:09:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:09:29 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:09:29 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:09:29 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75245) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 17:09:29 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 17:09:29 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 17:09:29 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:09:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:09:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:09:36 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:09:36 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Starting heal instance info cache {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 17:09:36 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Rebuilding the list of instances to heal {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 17:09:36 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "refresh_cache-ffa56d44-cd40-4b42-9d6d-f37ba3759b13" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:09:36 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquired lock "refresh_cache-ffa56d44-cd40-4b42-9d6d-f37ba3759b13" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:09:36 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Forcefully refreshing network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 17:09:36 user nova-compute[75245]: DEBUG nova.objects.instance [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lazy-loading 'info_cache' on Instance uuid ffa56d44-cd40-4b42-9d6d-f37ba3759b13 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:09:37 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Updating instance_info_cache with network_info: [{"id": "671bebb6-5146-45a2-b5b3-3307af4160c9", "address": "fa:16:3e:70:67:f1", "network": {"id": "d88c85cd-909b-4c70-92cf-ae0ba3b1d136", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-301851142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2019bc75cdd34c3bb817000f6fe60a11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap671bebb6-51", "ovs_interfaceid": "671bebb6-5146-45a2-b5b3-3307af4160c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:09:37 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Releasing lock "refresh_cache-ffa56d44-cd40-4b42-9d6d-f37ba3759b13" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:09:37 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Updated the network info_cache for instance {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 17:09:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:09:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:09:42 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:09:42 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:09:42 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:09:42 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:09:42 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75245) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 17:09:42 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffa56d44-cd40-4b42-9d6d-f37ba3759b13/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:09:42 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffa56d44-cd40-4b42-9d6d-f37ba3759b13/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:09:42 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffa56d44-cd40-4b42-9d6d-f37ba3759b13/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:09:42 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffa56d44-cd40-4b42-9d6d-f37ba3759b13/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:09:43 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:09:43 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:09:43 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Hypervisor/Node resource view: name=user free_ram=8953MB free_disk=25.04010772705078GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75245) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 17:09:43 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:09:43 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:09:43 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance ffa56d44-cd40-4b42-9d6d-f37ba3759b13 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:09:43 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 17:09:43 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 17:09:43 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 17:09:43 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 17:09:43 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Compute_service record updated for user:user {{(pid=75245) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 17:09:43 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.279s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:09:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:09:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:09:46 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:09:47 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:09:47 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:09:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:09:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:09:52 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:09:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:09:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:09:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75245) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 17:09:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 17:09:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 17:09:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:09:55 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:09:55 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:09:55 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75245) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 17:09:59 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:10:01 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:10:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:10:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:10:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75245) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 17:10:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 17:10:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 17:10:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:10:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:10:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:10:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:10:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75245) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 17:10:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 17:10:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 17:10:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:10:19 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:10:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:10:29 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:10:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:10:38 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:10:38 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Starting heal instance info cache {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 17:10:38 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Rebuilding the list of instances to heal {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 17:10:38 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "refresh_cache-ffa56d44-cd40-4b42-9d6d-f37ba3759b13" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:10:38 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquired lock "refresh_cache-ffa56d44-cd40-4b42-9d6d-f37ba3759b13" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:10:38 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Forcefully refreshing network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 17:10:38 user nova-compute[75245]: DEBUG nova.objects.instance [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lazy-loading 'info_cache' on Instance uuid ffa56d44-cd40-4b42-9d6d-f37ba3759b13 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:10:39 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Updating instance_info_cache with network_info: [{"id": "671bebb6-5146-45a2-b5b3-3307af4160c9", "address": "fa:16:3e:70:67:f1", "network": {"id": "d88c85cd-909b-4c70-92cf-ae0ba3b1d136", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-301851142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2019bc75cdd34c3bb817000f6fe60a11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap671bebb6-51", "ovs_interfaceid": "671bebb6-5146-45a2-b5b3-3307af4160c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:10:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Releasing lock "refresh_cache-ffa56d44-cd40-4b42-9d6d-f37ba3759b13" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:10:39 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Updated the network info_cache for instance {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 17:10:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:10:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:10:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75245) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 17:10:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 17:10:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 17:10:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:10:44 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:10:44 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:10:44 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:10:44 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:10:44 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75245) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 17:10:44 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffa56d44-cd40-4b42-9d6d-f37ba3759b13/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:10:44 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffa56d44-cd40-4b42-9d6d-f37ba3759b13/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:10:44 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffa56d44-cd40-4b42-9d6d-f37ba3759b13/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:10:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:10:44 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffa56d44-cd40-4b42-9d6d-f37ba3759b13/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:10:45 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:10:45 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:10:45 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Hypervisor/Node resource view: name=user free_ram=9010MB free_disk=25.03812026977539GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75245) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 17:10:45 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:10:45 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:10:45 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance ffa56d44-cd40-4b42-9d6d-f37ba3759b13 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:10:45 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 17:10:45 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 17:10:45 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 17:10:45 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 17:10:45 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Compute_service record updated for user:user {{(pid=75245) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 17:10:45 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.187s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:10:46 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:10:48 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:10:49 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:10:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:10:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:10:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75245) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 17:10:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 17:10:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 17:10:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:10:54 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:10:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:10:56 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:10:56 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:10:56 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75245) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 17:10:59 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:11:03 user nova-compute[75245]: DEBUG nova.compute.manager [req-b8b9a194-252c-4b78-9c6d-70a511a2ee3a req-d6c5d623-b701-47c5-9359-d01d4a7e6bb7 service nova] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Received event network-changed-671bebb6-5146-45a2-b5b3-3307af4160c9 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:11:03 user nova-compute[75245]: DEBUG nova.compute.manager [req-b8b9a194-252c-4b78-9c6d-70a511a2ee3a req-d6c5d623-b701-47c5-9359-d01d4a7e6bb7 service nova] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Refreshing instance network info cache due to event network-changed-671bebb6-5146-45a2-b5b3-3307af4160c9. {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 17:11:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b8b9a194-252c-4b78-9c6d-70a511a2ee3a req-d6c5d623-b701-47c5-9359-d01d4a7e6bb7 service nova] Acquiring lock "refresh_cache-ffa56d44-cd40-4b42-9d6d-f37ba3759b13" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:11:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b8b9a194-252c-4b78-9c6d-70a511a2ee3a req-d6c5d623-b701-47c5-9359-d01d4a7e6bb7 service nova] Acquired lock "refresh_cache-ffa56d44-cd40-4b42-9d6d-f37ba3759b13" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:11:03 user nova-compute[75245]: DEBUG nova.network.neutron [req-b8b9a194-252c-4b78-9c6d-70a511a2ee3a req-d6c5d623-b701-47c5-9359-d01d4a7e6bb7 service nova] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Refreshing network info cache for port 671bebb6-5146-45a2-b5b3-3307af4160c9 {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 17:11:03 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:11:03 user nova-compute[75245]: DEBUG nova.network.neutron [req-b8b9a194-252c-4b78-9c6d-70a511a2ee3a req-d6c5d623-b701-47c5-9359-d01d4a7e6bb7 service nova] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Updated VIF entry in instance network info cache for port 671bebb6-5146-45a2-b5b3-3307af4160c9. {{(pid=75245) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 17:11:03 user nova-compute[75245]: DEBUG nova.network.neutron [req-b8b9a194-252c-4b78-9c6d-70a511a2ee3a req-d6c5d623-b701-47c5-9359-d01d4a7e6bb7 service nova] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Updating instance_info_cache with network_info: [{"id": "671bebb6-5146-45a2-b5b3-3307af4160c9", "address": "fa:16:3e:70:67:f1", "network": {"id": "d88c85cd-909b-4c70-92cf-ae0ba3b1d136", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-301851142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2019bc75cdd34c3bb817000f6fe60a11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap671bebb6-51", "ovs_interfaceid": "671bebb6-5146-45a2-b5b3-3307af4160c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:11:03 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-b8b9a194-252c-4b78-9c6d-70a511a2ee3a req-d6c5d623-b701-47c5-9359-d01d4a7e6bb7 service nova] Releasing lock "refresh_cache-ffa56d44-cd40-4b42-9d6d-f37ba3759b13" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:11:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:11:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:11:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-0ab8deab-a26a-405a-a909-0e402a9e2023 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Acquiring lock "ffa56d44-cd40-4b42-9d6d-f37ba3759b13" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:11:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-0ab8deab-a26a-405a-a909-0e402a9e2023 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Lock "ffa56d44-cd40-4b42-9d6d-f37ba3759b13" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:11:06 user nova-compute[75245]: DEBUG nova.objects.instance [None req-0ab8deab-a26a-405a-a909-0e402a9e2023 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Lazy-loading 'flavor' on Instance uuid ffa56d44-cd40-4b42-9d6d-f37ba3759b13 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:11:06 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-0ab8deab-a26a-405a-a909-0e402a9e2023 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Lock "ffa56d44-cd40-4b42-9d6d-f37ba3759b13" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:11:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-0ab8deab-a26a-405a-a909-0e402a9e2023 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Acquiring lock "ffa56d44-cd40-4b42-9d6d-f37ba3759b13" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:11:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-0ab8deab-a26a-405a-a909-0e402a9e2023 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Lock "ffa56d44-cd40-4b42-9d6d-f37ba3759b13" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:11:07 user nova-compute[75245]: INFO nova.compute.manager [None req-0ab8deab-a26a-405a-a909-0e402a9e2023 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Attaching volume da4b8d46-a3fb-46c3-b1eb-8c3be0161c58 to /dev/vdb
Nov 29 17:11:07 user nova-compute[75245]: DEBUG os_brick.utils [None req-0ab8deab-a26a-405a-a909-0e402a9e2023 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:11:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:11:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:11:07 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf26391-16d1-4826-8765-42cfd3062b94]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:69ed8ed87091\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:11:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:11:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:11:07 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c90000-e6ac-4cea-b394-d4eaaa57e9ef]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:11:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:11:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:11:07 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf80324-7dde-494b-ab40-0974767558d1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:11:07 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[4334750e-d666-436a-ae63-7d202ad87deb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:11:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-0ab8deab-a26a-405a-a909-0e402a9e2023 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Running cmd (subprocess): nvme version {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:11:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-0ab8deab-a26a-405a-a909-0e402a9e2023 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] 'nvme version' failed. Not Retrying. {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 17:11:07 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0ab8deab-a26a-405a-a909-0e402a9e2023 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] nvme not present on system {{(pid=75245) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 17:11:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:11:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 17:11:07 user nova-compute[75245]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 17:11:07 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7bf037-0b45-411e-b50f-3dafe0a57642]: (4, '') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:11:07 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-0ab8deab-a26a-405a-a909-0e402a9e2023 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75245) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 17:11:07 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-0ab8deab-a26a-405a-a909-0e402a9e2023 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 17:11:07 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-0ab8deab-a26a-405a-a909-0e402a9e2023 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] LIGHTOS: no hostnqn found. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 17:11:07 user nova-compute[75245]: DEBUG os_brick.utils [None req-0ab8deab-a26a-405a-a909-0e402a9e2023 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:69ed8ed87091', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:11:07 user nova-compute[75245]: DEBUG nova.virt.block_device [None req-0ab8deab-a26a-405a-a909-0e402a9e2023 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Updating existing volume attachment record: 1739566e-0324-437f-82f1-9291c26d64fd {{(pid=75245) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 17:11:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:11:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:11:13 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:11:14 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ab8deab-a26a-405a-a909-0e402a9e2023 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Calling os-brick to attach iSCSI Volume {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 17:11:14 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab8deab-a26a-405a-a909-0e402a9e2023 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:da4b8d46-a3fb-46c3-b1eb-8c3be0161c58', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wSrhHDVv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:11:14 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-0ab8deab-a26a-405a-a909-0e402a9e2023 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:11:14 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-0ab8deab-a26a-405a-a909-0e402a9e2023 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:11:14 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-0ab8deab-a26a-405a-a909-0e402a9e2023 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:11:14 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-0ab8deab-a26a-405a-a909-0e402a9e2023 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:11:14 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-0ab8deab-a26a-405a-a909-0e402a9e2023 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da4b8d46-a3fb-46c3-b1eb-8c3be0161c58" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:11:14 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-0ab8deab-a26a-405a-a909-0e402a9e2023 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da4b8d46-a3fb-46c3-b1eb-8c3be0161c58" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:11:14 user nova-compute[75245]: INFO os_brick.initiator.connectors.iscsi [None req-0ab8deab-a26a-405a-a909-0e402a9e2023 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 17:11:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da4b8d46-a3fb-46c3-b1eb-8c3be0161c58 -p 172.16.0.220:3260 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:11:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da4b8d46-a3fb-46c3-b1eb-8c3be0161c58 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:11:14 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a0cf0d-4756-48d9-ab6c-a0d777933a98]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:11:14 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab8deab-a26a-405a-a909-0e402a9e2023 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 17:11:14 user nova-compute[75245]:  {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:11:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da4b8d46-a3fb-46c3-b1eb-8c3be0161c58 -p 172.16.0.220:3260 --interface default --op new {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:11:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da4b8d46-a3fb-46c3-b1eb-8c3be0161c58 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:11:14 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[8154deae-5650-4c7e-ba51-823ce99283a4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:da4b8d46-a3fb-46c3-b1eb-8c3be0161c58] added\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:11:14 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab8deab-a26a-405a-a909-0e402a9e2023 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:da4b8d46-a3fb-46c3-b1eb-8c3be0161c58] added
Nov 29 17:11:14 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:11:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da4b8d46-a3fb-46c3-b1eb-8c3be0161c58 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:11:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da4b8d46-a3fb-46c3-b1eb-8c3be0161c58 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:11:14 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[707d8f65-f9d0-46ad-a904-0e77512039f6]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:11:14 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab8deab-a26a-405a-a909-0e402a9e2023 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:11:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da4b8d46-a3fb-46c3-b1eb-8c3be0161c58 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:11:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da4b8d46-a3fb-46c3-b1eb-8c3be0161c58 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:11:14 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e253d8-59d9-4be3-9835-59f82889aaa5]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:11:14 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab8deab-a26a-405a-a909-0e402a9e2023 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:11:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da4b8d46-a3fb-46c3-b1eb-8c3be0161c58 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wSrhHDVv {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:11:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da4b8d46-a3fb-46c3-b1eb-8c3be0161c58 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wSrhHDVv" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:11:14 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[3952cd80-994e-4937-a345-fdd800400d68]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:11:14 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab8deab-a26a-405a-a909-0e402a9e2023 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wSrhHDVv'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:11:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da4b8d46-a3fb-46c3-b1eb-8c3be0161c58 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:11:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da4b8d46-a3fb-46c3-b1eb-8c3be0161c58 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:11:14 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[be28d2c1-9b02-4d00-9a7e-3eefeab9fc01]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:11:14 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab8deab-a26a-405a-a909-0e402a9e2023 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:11:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:11:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:11:14 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b6c5e0-842a-496a-9211-cc4c9f5d72e7]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:11:14 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab8deab-a26a-405a-a909-0e402a9e2023 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 17:11:14 user nova-compute[75245]:  {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:11:14 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab8deab-a26a-405a-a909-0e402a9e2023 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 17:11:14 user nova-compute[75245]:  {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:11:14 user nova-compute[75245]: WARNING os_brick.initiator.connectors.iscsi [None req-0ab8deab-a26a-405a-a909-0e402a9e2023 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 17:11:14 user nova-compute[75245]: 
Nov 29 17:11:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da4b8d46-a3fb-46c3-b1eb-8c3be0161c58 -p 172.16.0.220:3260 --login {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:11:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da4b8d46-a3fb-46c3-b1eb-8c3be0161c58 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:11:14 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[512d8079-581a-47e1-99c8-2645a6302d72]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:da4b8d46-a3fb-46c3-b1eb-8c3be0161c58, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:da4b8d46-a3fb-46c3-b1eb-8c3be0161c58, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:11:14 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab8deab-a26a-405a-a909-0e402a9e2023 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:da4b8d46-a3fb-46c3-b1eb-8c3be0161c58, portal: 172.16.0.220,3260]
Nov 29 17:11:14 user nova-compute[75245]: Login to [iface: default, target: iqn.2010-10.org.openstack:da4b8d46-a3fb-46c3-b1eb-8c3be0161c58, portal: 172.16.0.220,3260] successful.
Nov 29 17:11:14 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:11:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da4b8d46-a3fb-46c3-b1eb-8c3be0161c58 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:11:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:11:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da4b8d46-a3fb-46c3-b1eb-8c3be0161c58 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:11:14 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c0f6e7-2009-46cf-a67e-a132c0628014]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:11:14 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab8deab-a26a-405a-a909-0e402a9e2023 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:11:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:11:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:11:14 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc9655b-c646-4f51-a78d-cddc36062fea]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da4b8d46-a3fb-46c3-b1eb-8c3be0161c58 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:11:14 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab8deab-a26a-405a-a909-0e402a9e2023 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da4b8d46-a3fb-46c3-b1eb-8c3be0161c58 (non-flash)
Nov 29 17:11:14 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:11:14 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab8deab-a26a-405a-a909-0e402a9e2023 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da4b8d46-a3fb-46c3-b1eb-8c3be0161c58 (non-flash)
Nov 29 17:11:14 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:11:14 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-0ab8deab-a26a-405a-a909-0e402a9e2023 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da4b8d46-a3fb-46c3-b1eb-8c3be0161c58" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:11:14 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab8deab-a26a-405a-a909-0e402a9e2023 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Connected to 172.16.0.220:3260 {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 17:11:14 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-0ab8deab-a26a-405a-a909-0e402a9e2023 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=75245) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 17:11:14 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-0ab8deab-a26a-405a-a909-0e402a9e2023 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75245) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 17:11:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:11:14 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:11:14 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3afd1f3-508e-41d5-a6de-0246eaf2422d]: (4, ('- - 0', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:11:14 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-0ab8deab-a26a-405a-a909-0e402a9e2023 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75245) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 17:11:14 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab8deab-a26a-405a-a909-0e402a9e2023 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:da4b8d46-a3fb-46c3-b1eb-8c3be0161c58', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wSrhHDVv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 17:11:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:11:15 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-0ab8deab-a26a-405a-a909-0e402a9e2023 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:11:15 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab8deab-a26a-405a-a909-0e402a9e2023 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '26465393563616538', 'path': '/dev/sdb'} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:11:15 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ab8deab-a26a-405a-a909-0e402a9e2023 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26465393563616538', 'path': '/dev/sdb'} {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 17:11:15 user nova-compute[75245]: DEBUG nova.objects.instance [None req-0ab8deab-a26a-405a-a909-0e402a9e2023 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Lazy-loading 'flavor' on Instance uuid ffa56d44-cd40-4b42-9d6d-f37ba3759b13 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:11:15 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-0ab8deab-a26a-405a-a909-0e402a9e2023 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 17:11:15 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 17:11:15 user nova-compute[75245]:   <source dev="/dev/sdb"/>
Nov 29 17:11:15 user nova-compute[75245]:   <target dev="vdb" bus="virtio"/>
Nov 29 17:11:15 user nova-compute[75245]:   <serial>da4b8d46-a3fb-46c3-b1eb-8c3be0161c58</serial>
Nov 29 17:11:15 user nova-compute[75245]: </disk>
Nov 29 17:11:15 user nova-compute[75245]:  {{(pid=75245) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 17:11:16 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-0ab8deab-a26a-405a-a909-0e402a9e2023 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 17:11:16 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-0ab8deab-a26a-405a-a909-0e402a9e2023 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 17:11:16 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-0ab8deab-a26a-405a-a909-0e402a9e2023 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] No VIF found with MAC fa:16:3e:70:67:f1, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 17:11:16 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-0ab8deab-a26a-405a-a909-0e402a9e2023 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Lock "ffa56d44-cd40-4b42-9d6d-f37ba3759b13" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.306s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:11:19 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:11:19 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:11:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:11:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:11:29 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:11:29 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:11:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-11fa3ecd-985c-45c3-88be-597aa79ab307 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Acquiring lock "ffa56d44-cd40-4b42-9d6d-f37ba3759b13" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:11:33 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-11fa3ecd-985c-45c3-88be-597aa79ab307 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Lock "ffa56d44-cd40-4b42-9d6d-f37ba3759b13" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:11:33 user nova-compute[75245]: INFO nova.compute.manager [None req-11fa3ecd-985c-45c3-88be-597aa79ab307 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Detaching volume da4b8d46-a3fb-46c3-b1eb-8c3be0161c58
Nov 29 17:11:33 user nova-compute[75245]: INFO nova.virt.block_device [None req-11fa3ecd-985c-45c3-88be-597aa79ab307 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Attempting to driver detach volume da4b8d46-a3fb-46c3-b1eb-8c3be0161c58 from mountpoint /dev/vdb
Nov 29 17:11:33 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-11fa3ecd-985c-45c3-88be-597aa79ab307 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Attempting to detach device vdb from instance ffa56d44-cd40-4b42-9d6d-f37ba3759b13 from the persistent domain config. {{(pid=75245) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 17:11:33 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-11fa3ecd-985c-45c3-88be-597aa79ab307 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 17:11:33 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 17:11:33 user nova-compute[75245]:   <source dev="/dev/sdb"/>
Nov 29 17:11:33 user nova-compute[75245]:   <target dev="vdb" bus="virtio"/>
Nov 29 17:11:33 user nova-compute[75245]:   <serial>da4b8d46-a3fb-46c3-b1eb-8c3be0161c58</serial>
Nov 29 17:11:33 user nova-compute[75245]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 17:11:33 user nova-compute[75245]: </disk>
Nov 29 17:11:33 user nova-compute[75245]:  {{(pid=75245) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 17:11:33 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-11fa3ecd-985c-45c3-88be-597aa79ab307 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Successfully detached device vdb from instance ffa56d44-cd40-4b42-9d6d-f37ba3759b13 from the persistent domain config.
Nov 29 17:11:33 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-11fa3ecd-985c-45c3-88be-597aa79ab307 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ffa56d44-cd40-4b42-9d6d-f37ba3759b13 from the live domain config. {{(pid=75245) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 17:11:33 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-11fa3ecd-985c-45c3-88be-597aa79ab307 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 17:11:33 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 17:11:33 user nova-compute[75245]:   <source dev="/dev/sdb"/>
Nov 29 17:11:33 user nova-compute[75245]:   <target dev="vdb" bus="virtio"/>
Nov 29 17:11:33 user nova-compute[75245]:   <serial>da4b8d46-a3fb-46c3-b1eb-8c3be0161c58</serial>
Nov 29 17:11:33 user nova-compute[75245]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 17:11:33 user nova-compute[75245]: </disk>
Nov 29 17:11:33 user nova-compute[75245]:  {{(pid=75245) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 17:11:33 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-11fa3ecd-985c-45c3-88be-597aa79ab307 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ffa56d44-cd40-4b42-9d6d-f37ba3759b13 {{(pid=75245) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 17:11:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:11:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:11:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:11:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:11:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75245) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 17:11:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 17:11:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 17:11:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:11:40 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:11:40 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Starting heal instance info cache {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 17:11:40 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Rebuilding the list of instances to heal {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 17:11:40 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "refresh_cache-ffa56d44-cd40-4b42-9d6d-f37ba3759b13" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:11:40 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquired lock "refresh_cache-ffa56d44-cd40-4b42-9d6d-f37ba3759b13" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:11:40 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Forcefully refreshing network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 17:11:40 user nova-compute[75245]: DEBUG nova.objects.instance [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lazy-loading 'info_cache' on Instance uuid ffa56d44-cd40-4b42-9d6d-f37ba3759b13 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:11:41 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Updating instance_info_cache with network_info: [{"id": "671bebb6-5146-45a2-b5b3-3307af4160c9", "address": "fa:16:3e:70:67:f1", "network": {"id": "d88c85cd-909b-4c70-92cf-ae0ba3b1d136", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-301851142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2019bc75cdd34c3bb817000f6fe60a11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap671bebb6-51", "ovs_interfaceid": "671bebb6-5146-45a2-b5b3-3307af4160c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:11:41 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Releasing lock "refresh_cache-ffa56d44-cd40-4b42-9d6d-f37ba3759b13" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:11:41 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Updated the network info_cache for instance {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 17:11:44 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:11:44 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:11:44 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:11:44 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:11:44 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75245) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 17:11:44 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffa56d44-cd40-4b42-9d6d-f37ba3759b13/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:11:44 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffa56d44-cd40-4b42-9d6d-f37ba3759b13/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:11:44 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffa56d44-cd40-4b42-9d6d-f37ba3759b13/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:11:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:11:44 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffa56d44-cd40-4b42-9d6d-f37ba3759b13/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:11:45 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:11:45 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:11:45 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Hypervisor/Node resource view: name=user free_ram=9001MB free_disk=25.036788940429688GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75245) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 17:11:45 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:11:45 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:11:45 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance ffa56d44-cd40-4b42-9d6d-f37ba3759b13 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:11:45 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 17:11:45 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 17:11:45 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Refreshing inventories for resource provider dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 17:11:45 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Updating ProviderTree inventory for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 17:11:45 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Updating inventory in ProviderTree for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 17:11:45 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Refreshing aggregate associations for resource provider dcc0ed27-167e-4f3a-a0de-183bb144a50c, aggregates: None {{(pid=75245) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 17:11:45 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Refreshing trait associations for resource provider dcc0ed27-167e-4f3a-a0de-183bb144a50c, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG {{(pid=75245) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 17:11:45 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 17:11:45 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 17:11:45 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Compute_service record updated for user:user {{(pid=75245) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 17:11:45 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.331s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:11:47 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:11:49 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:11:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:11:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:11:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75245) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 17:11:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 17:11:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 17:11:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:11:50 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:11:53 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-11fa3ecd-985c-45c3-88be-597aa79ab307 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ffa56d44-cd40-4b42-9d6d-f37ba3759b13 is timed out.
Nov 29 17:11:53 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-11fa3ecd-985c-45c3-88be-597aa79ab307 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Successfully detached device vdb from instance ffa56d44-cd40-4b42-9d6d-f37ba3759b13 from the live domain config.
Nov 29 17:11:53 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11fa3ecd-985c-45c3-88be-597aa79ab307 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] calling os-brick to detach iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 17:11:53 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-11fa3ecd-985c-45c3-88be-597aa79ab307 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, {'target_iqn': 'iqn.2010-10.org.openstack:da4b8d46-a3fb-46c3-b1eb-8c3be0161c58', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wSrhHDVv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:11:53 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-11fa3ecd-985c-45c3-88be-597aa79ab307 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:11:53 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-11fa3ecd-985c-45c3-88be-597aa79ab307 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:11:53 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-11fa3ecd-985c-45c3-88be-597aa79ab307 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:11:53 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:11:53 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:11:53 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[89cbaf20-6ef7-4704-9b11-fc9505b881e8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:da4b8d46-a3fb-46c3-b1eb-8c3be0161c58\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:11:53 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-11fa3ecd-985c-45c3-88be-597aa79ab307 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 17:11:53 user nova-compute[75245]: No targets found.
Nov 29 17:11:53 user nova-compute[75245]: iSNS:
Nov 29 17:11:53 user nova-compute[75245]: No targets found.
Nov 29 17:11:53 user nova-compute[75245]: STATIC:
Nov 29 17:11:53 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:da4b8d46-a3fb-46c3-b1eb-8c3be0161c58
Nov 29 17:11:53 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:11:53 user nova-compute[75245]:                 Iface Name: default
Nov 29 17:11:53 user nova-compute[75245]: FIRMWARE:
Nov 29 17:11:53 user nova-compute[75245]: No targets found.
Nov 29 17:11:53 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:11:53 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-11fa3ecd-985c-45c3-88be-597aa79ab307 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 17:11:53 user nova-compute[75245]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 17:11:53 user nova-compute[75245]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75245) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 17:11:53 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-11fa3ecd-985c-45c3-88be-597aa79ab307 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da4b8d46-a3fb-46c3-b1eb-8c3be0161c58', 0)] {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 17:11:53 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:11:53 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:11:53 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9f50ff-b837-466e-83a9-3662dc03a392]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da4b8d46-a3fb-46c3-b1eb-8c3be0161c58\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:11:53 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:11:53 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:11:53 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[837d944e-7f9f-412e-9ac5-1d87ce063634]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da4b8d46-a3fb-46c3-b1eb-8c3be0161c58 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:11:53 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-11fa3ecd-985c-45c3-88be-597aa79ab307 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da4b8d46-a3fb-46c3-b1eb-8c3be0161c58 (non-flash)
Nov 29 17:11:53 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:11:53 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-11fa3ecd-985c-45c3-88be-597aa79ab307 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da4b8d46-a3fb-46c3-b1eb-8c3be0161c58 (non-flash)
Nov 29 17:11:53 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:11:53 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-11fa3ecd-985c-45c3-88be-597aa79ab307 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0d4c1f97e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da4b8d46-a3fb-46c3-b1eb-8c3be0161c58'): ({'sdb'}, set())}) {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 17:11:53 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-11fa3ecd-985c-45c3-88be-597aa79ab307 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Removing single pathed devices sdb {{(pid=75245) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 17:11:53 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:11:53 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:11:53 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eaf6c2c-e62d-43d8-9435-6f339f84b179]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:11:53 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:11:53 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:11:53 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[5597e232-b054-4843-bffe-75e147c1d36a]: (4, ('ok\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:11:53 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-11fa3ecd-985c-45c3-88be-597aa79ab307 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Flushing IO for device /dev/sdb {{(pid=75245) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 17:11:53 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:11:53 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:11:53 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dcfc6f2-e380-4462-8f56-5cc3697bd192]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:11:53 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-11fa3ecd-985c-45c3-88be-597aa79ab307 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75245) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 17:11:53 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:11:53 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:11:53 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[92fe95a3-e322-4b6f-8b11-a3845dfd934a]: (4, ('1', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:11:53 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-11fa3ecd-985c-45c3-88be-597aa79ab307 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 17:11:53 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-11fa3ecd-985c-45c3-88be-597aa79ab307 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] SCSI volumes sdb have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 17:11:53 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-11fa3ecd-985c-45c3-88be-597aa79ab307 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da4b8d46-a3fb-46c3-b1eb-8c3be0161c58')] {{(pid=75245) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 17:11:53 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da4b8d46-a3fb-46c3-b1eb-8c3be0161c58 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:11:54 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da4b8d46-a3fb-46c3-b1eb-8c3be0161c58 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:11:54 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db3e245-8ebf-4389-bd99-699ee6241dfa]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:11:54 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-11fa3ecd-985c-45c3-88be-597aa79ab307 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:11:54 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da4b8d46-a3fb-46c3-b1eb-8c3be0161c58 -p 172.16.0.220:3260 --logout {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:11:54 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da4b8d46-a3fb-46c3-b1eb-8c3be0161c58 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:11:54 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[881c7591-2464-42fb-9a22-fed6117b4cd8]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:da4b8d46-a3fb-46c3-b1eb-8c3be0161c58, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:da4b8d46-a3fb-46c3-b1eb-8c3be0161c58, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:11:54 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-11fa3ecd-985c-45c3-88be-597aa79ab307 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:da4b8d46-a3fb-46c3-b1eb-8c3be0161c58, portal: 172.16.0.220,3260]
Nov 29 17:11:54 user nova-compute[75245]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:da4b8d46-a3fb-46c3-b1eb-8c3be0161c58, portal: 172.16.0.220,3260] successful.
Nov 29 17:11:54 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:11:54 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da4b8d46-a3fb-46c3-b1eb-8c3be0161c58 -p 172.16.0.220:3260 --op delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:11:54 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da4b8d46-a3fb-46c3-b1eb-8c3be0161c58 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:11:54 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e4a005-9d73-4073-b520-58b733506a18]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:11:54 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-11fa3ecd-985c-45c3-88be-597aa79ab307 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:11:54 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-11fa3ecd-985c-45c3-88be-597aa79ab307 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:11:54 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-11fa3ecd-985c-45c3-88be-597aa79ab307 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] <== disconnect_volume: return (302ms) None {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:11:54 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11fa3ecd-985c-45c3-88be-597aa79ab307 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Disconnected iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 17:11:54 user nova-compute[75245]: DEBUG nova.objects.instance [None req-11fa3ecd-985c-45c3-88be-597aa79ab307 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Lazy-loading 'flavor' on Instance uuid ffa56d44-cd40-4b42-9d6d-f37ba3759b13 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:11:54 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-11fa3ecd-985c-45c3-88be-597aa79ab307 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Lock "ffa56d44-cd40-4b42-9d6d-f37ba3759b13" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.677s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:11:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:11:56 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:11:56 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:11:56 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:11:56 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75245) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 17:11:56 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:11:56 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Cleaning up deleted instances {{(pid=75245) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 17:11:56 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] There are 0 instances to clean {{(pid=75245) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 17:11:59 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:12:02 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:12:02 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75245) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 17:12:03 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:12:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:12:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:12:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75245) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 17:12:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 17:12:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 17:12:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:12:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:12:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:12:19 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:12:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:12:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-23457984-a958-40fa-9a44-c26017d971b3 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Acquiring lock "ffa56d44-cd40-4b42-9d6d-f37ba3759b13" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:12:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-23457984-a958-40fa-9a44-c26017d971b3 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Lock "ffa56d44-cd40-4b42-9d6d-f37ba3759b13" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:12:26 user nova-compute[75245]: DEBUG nova.objects.instance [None req-23457984-a958-40fa-9a44-c26017d971b3 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Lazy-loading 'flavor' on Instance uuid ffa56d44-cd40-4b42-9d6d-f37ba3759b13 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:12:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-23457984-a958-40fa-9a44-c26017d971b3 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Lock "ffa56d44-cd40-4b42-9d6d-f37ba3759b13" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:12:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-23457984-a958-40fa-9a44-c26017d971b3 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Acquiring lock "ffa56d44-cd40-4b42-9d6d-f37ba3759b13" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:12:26 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-23457984-a958-40fa-9a44-c26017d971b3 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Lock "ffa56d44-cd40-4b42-9d6d-f37ba3759b13" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:12:26 user nova-compute[75245]: INFO nova.compute.manager [None req-23457984-a958-40fa-9a44-c26017d971b3 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Attaching volume 26e877bc-af2f-4ad7-b5b5-58dbe63ed9ee to /dev/vdb
Nov 29 17:12:26 user nova-compute[75245]: DEBUG os_brick.utils [None req-23457984-a958-40fa-9a44-c26017d971b3 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:12:26 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:12:26 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:12:26 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ac787b-a505-4f6d-8135-e22c8f7480f5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:69ed8ed87091\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:12:26 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:12:26 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:12:26 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed16420b-68ba-423c-84d5-b1c07ba71706]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:12:26 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:12:26 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:12:26 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[639156b2-038a-4c12-8b5d-f22a19b22b13]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:12:26 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[b99a4e95-8f00-4f60-b85d-604d4dca0c58]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:12:26 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-23457984-a958-40fa-9a44-c26017d971b3 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Running cmd (subprocess): nvme version {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:12:26 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-23457984-a958-40fa-9a44-c26017d971b3 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] 'nvme version' failed. Not Retrying. {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 17:12:26 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.nvmeof [None req-23457984-a958-40fa-9a44-c26017d971b3 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] nvme not present on system {{(pid=75245) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 17:12:26 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:12:26 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 17:12:26 user nova-compute[75245]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 17:12:26 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[b36aa6bb-938e-414d-9d18-12bb7fd00ea2]: (4, '') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:12:26 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-23457984-a958-40fa-9a44-c26017d971b3 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75245) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 17:12:26 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-23457984-a958-40fa-9a44-c26017d971b3 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 17:12:26 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-23457984-a958-40fa-9a44-c26017d971b3 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] LIGHTOS: no hostnqn found. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 17:12:26 user nova-compute[75245]: DEBUG os_brick.utils [None req-23457984-a958-40fa-9a44-c26017d971b3 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:69ed8ed87091', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:12:26 user nova-compute[75245]: DEBUG nova.virt.block_device [None req-23457984-a958-40fa-9a44-c26017d971b3 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Updating existing volume attachment record: f857ee1a-9acf-4823-95c4-6b2cdd3bec63 {{(pid=75245) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 17:12:29 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:12:29 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:12:30 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:12:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:12:36 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23457984-a958-40fa-9a44-c26017d971b3 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Calling os-brick to attach iSCSI Volume {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 17:12:36 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-23457984-a958-40fa-9a44-c26017d971b3 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:26e877bc-af2f-4ad7-b5b5-58dbe63ed9ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'byOusfkK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:12:36 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-23457984-a958-40fa-9a44-c26017d971b3 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:12:36 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-23457984-a958-40fa-9a44-c26017d971b3 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:12:36 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-23457984-a958-40fa-9a44-c26017d971b3 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:12:36 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-23457984-a958-40fa-9a44-c26017d971b3 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:12:36 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-23457984-a958-40fa-9a44-c26017d971b3 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26e877bc-af2f-4ad7-b5b5-58dbe63ed9ee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:12:36 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-23457984-a958-40fa-9a44-c26017d971b3 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26e877bc-af2f-4ad7-b5b5-58dbe63ed9ee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:12:36 user nova-compute[75245]: INFO os_brick.initiator.connectors.iscsi [None req-23457984-a958-40fa-9a44-c26017d971b3 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 17:12:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26e877bc-af2f-4ad7-b5b5-58dbe63ed9ee -p 172.16.0.220:3260 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:12:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26e877bc-af2f-4ad7-b5b5-58dbe63ed9ee -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:12:36 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[928b1a5f-7877-469b-866e-76b33aafafff]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:12:36 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-23457984-a958-40fa-9a44-c26017d971b3 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 17:12:36 user nova-compute[75245]:  {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:12:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26e877bc-af2f-4ad7-b5b5-58dbe63ed9ee -p 172.16.0.220:3260 --interface default --op new {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:12:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26e877bc-af2f-4ad7-b5b5-58dbe63ed9ee -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:12:36 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a05e9b-f632-4ec9-a286-09e17dae4ff8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:26e877bc-af2f-4ad7-b5b5-58dbe63ed9ee] added\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:12:36 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-23457984-a958-40fa-9a44-c26017d971b3 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:26e877bc-af2f-4ad7-b5b5-58dbe63ed9ee] added
Nov 29 17:12:36 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:12:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26e877bc-af2f-4ad7-b5b5-58dbe63ed9ee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:12:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26e877bc-af2f-4ad7-b5b5-58dbe63ed9ee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:12:36 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[de16c320-2a17-4228-bf36-57778a4b13cc]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:12:36 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-23457984-a958-40fa-9a44-c26017d971b3 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:12:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26e877bc-af2f-4ad7-b5b5-58dbe63ed9ee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:12:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26e877bc-af2f-4ad7-b5b5-58dbe63ed9ee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:12:36 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc35dff-27e3-40c3-adc8-980b52140164]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:12:36 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-23457984-a958-40fa-9a44-c26017d971b3 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:12:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26e877bc-af2f-4ad7-b5b5-58dbe63ed9ee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v byOusfkK {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:12:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26e877bc-af2f-4ad7-b5b5-58dbe63ed9ee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v byOusfkK" returned: 0 in 0.023s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:12:36 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[142221a4-63cc-4f99-bd64-246a2e6d42b5]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:12:36 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-23457984-a958-40fa-9a44-c26017d971b3 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'byOusfkK'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:12:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26e877bc-af2f-4ad7-b5b5-58dbe63ed9ee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:12:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26e877bc-af2f-4ad7-b5b5-58dbe63ed9ee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:12:36 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[223b8862-e0a7-4559-a753-a7a056f2defb]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:12:36 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-23457984-a958-40fa-9a44-c26017d971b3 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:12:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:12:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:12:36 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b15a6df-465b-4382-a768-3de12d73efb5]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:12:36 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-23457984-a958-40fa-9a44-c26017d971b3 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 17:12:36 user nova-compute[75245]:  {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:12:36 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-23457984-a958-40fa-9a44-c26017d971b3 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 17:12:36 user nova-compute[75245]:  {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:12:36 user nova-compute[75245]: WARNING os_brick.initiator.connectors.iscsi [None req-23457984-a958-40fa-9a44-c26017d971b3 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 17:12:36 user nova-compute[75245]: 
Nov 29 17:12:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26e877bc-af2f-4ad7-b5b5-58dbe63ed9ee -p 172.16.0.220:3260 --login {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:12:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26e877bc-af2f-4ad7-b5b5-58dbe63ed9ee -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:12:36 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c56e098-06a5-45d3-9f94-4d2da5efa639]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:26e877bc-af2f-4ad7-b5b5-58dbe63ed9ee, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:26e877bc-af2f-4ad7-b5b5-58dbe63ed9ee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:12:36 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-23457984-a958-40fa-9a44-c26017d971b3 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:26e877bc-af2f-4ad7-b5b5-58dbe63ed9ee, portal: 172.16.0.220,3260]
Nov 29 17:12:36 user nova-compute[75245]: Login to [iface: default, target: iqn.2010-10.org.openstack:26e877bc-af2f-4ad7-b5b5-58dbe63ed9ee, portal: 172.16.0.220,3260] successful.
Nov 29 17:12:36 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:12:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26e877bc-af2f-4ad7-b5b5-58dbe63ed9ee -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:12:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26e877bc-af2f-4ad7-b5b5-58dbe63ed9ee -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.121s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:12:36 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbbf341a-1ce2-4486-bf30-ca801b3342f0]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:12:36 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-23457984-a958-40fa-9a44-c26017d971b3 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:12:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:12:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:12:36 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[f162bb1c-32e8-428b-a111-e38fc4dc7103]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26e877bc-af2f-4ad7-b5b5-58dbe63ed9ee (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:12:36 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-23457984-a958-40fa-9a44-c26017d971b3 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26e877bc-af2f-4ad7-b5b5-58dbe63ed9ee (non-flash)
Nov 29 17:12:36 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:12:36 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-23457984-a958-40fa-9a44-c26017d971b3 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26e877bc-af2f-4ad7-b5b5-58dbe63ed9ee (non-flash)
Nov 29 17:12:36 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:12:36 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-23457984-a958-40fa-9a44-c26017d971b3 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26e877bc-af2f-4ad7-b5b5-58dbe63ed9ee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.368s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:12:36 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-23457984-a958-40fa-9a44-c26017d971b3 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Connected to 172.16.0.220:3260 {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 17:12:36 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-23457984-a958-40fa-9a44-c26017d971b3 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=75245) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 17:12:36 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-23457984-a958-40fa-9a44-c26017d971b3 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75245) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 17:12:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:12:36 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:12:36 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c4e6458-7f74-48e2-a787-3c2c285392e2]: (4, ('- - 0', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:12:36 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-23457984-a958-40fa-9a44-c26017d971b3 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: None {{(pid=75245) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 17:12:37 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-23457984-a958-40fa-9a44-c26017d971b3 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75245) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 17:12:37 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-23457984-a958-40fa-9a44-c26017d971b3 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:26e877bc-af2f-4ad7-b5b5-58dbe63ed9ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'byOusfkK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 17:12:37 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-23457984-a958-40fa-9a44-c26017d971b3 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.407s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:12:37 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-23457984-a958-40fa-9a44-c26017d971b3 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] <== connect_volume: return (1409ms) {'type': 'block', 'scsi_wwn': '23131336465313638', 'path': '/dev/sdb'} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:12:37 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23457984-a958-40fa-9a44-c26017d971b3 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23131336465313638', 'path': '/dev/sdb'} {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 17:12:37 user nova-compute[75245]: DEBUG nova.objects.instance [None req-23457984-a958-40fa-9a44-c26017d971b3 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Lazy-loading 'flavor' on Instance uuid ffa56d44-cd40-4b42-9d6d-f37ba3759b13 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:12:37 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-23457984-a958-40fa-9a44-c26017d971b3 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 17:12:37 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 17:12:37 user nova-compute[75245]:   <source dev="/dev/sdb"/>
Nov 29 17:12:37 user nova-compute[75245]:   <target dev="vdb" bus="virtio"/>
Nov 29 17:12:37 user nova-compute[75245]:   <serial>26e877bc-af2f-4ad7-b5b5-58dbe63ed9ee</serial>
Nov 29 17:12:37 user nova-compute[75245]: </disk>
Nov 29 17:12:37 user nova-compute[75245]:  {{(pid=75245) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 17:12:38 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-23457984-a958-40fa-9a44-c26017d971b3 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 17:12:38 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-23457984-a958-40fa-9a44-c26017d971b3 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 17:12:38 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-23457984-a958-40fa-9a44-c26017d971b3 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] No VIF found with MAC fa:16:3e:70:67:f1, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 17:12:38 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-23457984-a958-40fa-9a44-c26017d971b3 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Lock "ffa56d44-cd40-4b42-9d6d-f37ba3759b13" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.026s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:12:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:12:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:12:40 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:12:40 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Starting heal instance info cache {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 17:12:40 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Rebuilding the list of instances to heal {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 17:12:40 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "refresh_cache-ffa56d44-cd40-4b42-9d6d-f37ba3759b13" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:12:40 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquired lock "refresh_cache-ffa56d44-cd40-4b42-9d6d-f37ba3759b13" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:12:40 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Forcefully refreshing network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 17:12:40 user nova-compute[75245]: DEBUG nova.objects.instance [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lazy-loading 'info_cache' on Instance uuid ffa56d44-cd40-4b42-9d6d-f37ba3759b13 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:12:41 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Updating instance_info_cache with network_info: [{"id": "671bebb6-5146-45a2-b5b3-3307af4160c9", "address": "fa:16:3e:70:67:f1", "network": {"id": "d88c85cd-909b-4c70-92cf-ae0ba3b1d136", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-301851142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2019bc75cdd34c3bb817000f6fe60a11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap671bebb6-51", "ovs_interfaceid": "671bebb6-5146-45a2-b5b3-3307af4160c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:12:41 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-449ba558-9e97-4d10-92dc-ef7a06b614a1 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Acquiring lock "ffa56d44-cd40-4b42-9d6d-f37ba3759b13" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:12:41 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-449ba558-9e97-4d10-92dc-ef7a06b614a1 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Lock "ffa56d44-cd40-4b42-9d6d-f37ba3759b13" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:12:41 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Releasing lock "refresh_cache-ffa56d44-cd40-4b42-9d6d-f37ba3759b13" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:12:41 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Updated the network info_cache for instance {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 17:12:41 user nova-compute[75245]: INFO nova.compute.manager [None req-449ba558-9e97-4d10-92dc-ef7a06b614a1 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Detaching volume 26e877bc-af2f-4ad7-b5b5-58dbe63ed9ee
Nov 29 17:12:41 user nova-compute[75245]: INFO nova.virt.block_device [None req-449ba558-9e97-4d10-92dc-ef7a06b614a1 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Attempting to driver detach volume 26e877bc-af2f-4ad7-b5b5-58dbe63ed9ee from mountpoint /dev/vdb
Nov 29 17:12:41 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-449ba558-9e97-4d10-92dc-ef7a06b614a1 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Attempting to detach device vdb from instance ffa56d44-cd40-4b42-9d6d-f37ba3759b13 from the persistent domain config. {{(pid=75245) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 17:12:41 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-449ba558-9e97-4d10-92dc-ef7a06b614a1 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 17:12:41 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 17:12:41 user nova-compute[75245]:   <source dev="/dev/sdb"/>
Nov 29 17:12:41 user nova-compute[75245]:   <target dev="vdb" bus="virtio"/>
Nov 29 17:12:41 user nova-compute[75245]:   <serial>26e877bc-af2f-4ad7-b5b5-58dbe63ed9ee</serial>
Nov 29 17:12:41 user nova-compute[75245]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 17:12:41 user nova-compute[75245]: </disk>
Nov 29 17:12:41 user nova-compute[75245]:  {{(pid=75245) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 17:12:41 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-449ba558-9e97-4d10-92dc-ef7a06b614a1 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Successfully detached device vdb from instance ffa56d44-cd40-4b42-9d6d-f37ba3759b13 from the persistent domain config.
Nov 29 17:12:41 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-449ba558-9e97-4d10-92dc-ef7a06b614a1 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ffa56d44-cd40-4b42-9d6d-f37ba3759b13 from the live domain config. {{(pid=75245) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 17:12:41 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-449ba558-9e97-4d10-92dc-ef7a06b614a1 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 17:12:41 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 17:12:41 user nova-compute[75245]:   <source dev="/dev/sdb"/>
Nov 29 17:12:41 user nova-compute[75245]:   <target dev="vdb" bus="virtio"/>
Nov 29 17:12:41 user nova-compute[75245]:   <serial>26e877bc-af2f-4ad7-b5b5-58dbe63ed9ee</serial>
Nov 29 17:12:41 user nova-compute[75245]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 17:12:41 user nova-compute[75245]: </disk>
Nov 29 17:12:41 user nova-compute[75245]:  {{(pid=75245) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 17:12:41 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-449ba558-9e97-4d10-92dc-ef7a06b614a1 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ffa56d44-cd40-4b42-9d6d-f37ba3759b13 {{(pid=75245) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 17:12:44 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:12:44 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:12:44 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:12:44 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:12:44 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75245) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 17:12:44 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffa56d44-cd40-4b42-9d6d-f37ba3759b13/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:12:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:12:44 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffa56d44-cd40-4b42-9d6d-f37ba3759b13/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:12:44 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffa56d44-cd40-4b42-9d6d-f37ba3759b13/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:12:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:12:44 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffa56d44-cd40-4b42-9d6d-f37ba3759b13/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:12:45 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:12:45 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:12:45 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Hypervisor/Node resource view: name=user free_ram=8991MB free_disk=25.03583526611328GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75245) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 17:12:45 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:12:45 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:12:45 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance ffa56d44-cd40-4b42-9d6d-f37ba3759b13 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:12:45 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 17:12:45 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 17:12:45 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 17:12:45 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 17:12:45 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Compute_service record updated for user:user {{(pid=75245) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 17:12:45 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.173s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:12:49 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:12:49 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:12:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:12:50 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:12:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:12:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:12:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75245) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 17:12:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 17:12:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 17:12:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:12:56 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:12:57 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:12:57 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75245) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 17:12:58 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:12:59 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:13:01 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-449ba558-9e97-4d10-92dc-ef7a06b614a1 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ffa56d44-cd40-4b42-9d6d-f37ba3759b13 is timed out.
Nov 29 17:13:01 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-449ba558-9e97-4d10-92dc-ef7a06b614a1 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Successfully detached device vdb from instance ffa56d44-cd40-4b42-9d6d-f37ba3759b13 from the live domain config.
Nov 29 17:13:01 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-449ba558-9e97-4d10-92dc-ef7a06b614a1 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] calling os-brick to detach iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 17:13:01 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-449ba558-9e97-4d10-92dc-ef7a06b614a1 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, {'target_iqn': 'iqn.2010-10.org.openstack:26e877bc-af2f-4ad7-b5b5-58dbe63ed9ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'byOusfkK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:13:01 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-449ba558-9e97-4d10-92dc-ef7a06b614a1 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:13:01 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-449ba558-9e97-4d10-92dc-ef7a06b614a1 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:13:01 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-449ba558-9e97-4d10-92dc-ef7a06b614a1 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:13:01 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:13:01 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:13:01 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[499c87cd-d5da-40f5-ad4c-6010f5524adf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:26e877bc-af2f-4ad7-b5b5-58dbe63ed9ee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:13:01 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-449ba558-9e97-4d10-92dc-ef7a06b614a1 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 17:13:01 user nova-compute[75245]: No targets found.
Nov 29 17:13:01 user nova-compute[75245]: iSNS:
Nov 29 17:13:01 user nova-compute[75245]: No targets found.
Nov 29 17:13:01 user nova-compute[75245]: STATIC:
Nov 29 17:13:01 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:26e877bc-af2f-4ad7-b5b5-58dbe63ed9ee
Nov 29 17:13:01 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:13:01 user nova-compute[75245]:                 Iface Name: default
Nov 29 17:13:01 user nova-compute[75245]: FIRMWARE:
Nov 29 17:13:01 user nova-compute[75245]: No targets found.
Nov 29 17:13:01 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:13:01 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-449ba558-9e97-4d10-92dc-ef7a06b614a1 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 17:13:01 user nova-compute[75245]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 17:13:01 user nova-compute[75245]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75245) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 17:13:01 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-449ba558-9e97-4d10-92dc-ef7a06b614a1 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26e877bc-af2f-4ad7-b5b5-58dbe63ed9ee', 0)] {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 17:13:01 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:13:01 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:13:01 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f151468-cd47-4718-a0bc-5f58af0f60fa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26e877bc-af2f-4ad7-b5b5-58dbe63ed9ee\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:13:01 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:13:01 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:13:01 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[667d0352-96fc-4380-a084-ecfd26b63c4e]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26e877bc-af2f-4ad7-b5b5-58dbe63ed9ee (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:13:01 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-449ba558-9e97-4d10-92dc-ef7a06b614a1 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26e877bc-af2f-4ad7-b5b5-58dbe63ed9ee (non-flash)
Nov 29 17:13:01 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:13:01 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-449ba558-9e97-4d10-92dc-ef7a06b614a1 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26e877bc-af2f-4ad7-b5b5-58dbe63ed9ee (non-flash)
Nov 29 17:13:01 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:13:01 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-449ba558-9e97-4d10-92dc-ef7a06b614a1 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0d20753490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26e877bc-af2f-4ad7-b5b5-58dbe63ed9ee'): ({'sdb'}, set())}) {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 17:13:01 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-449ba558-9e97-4d10-92dc-ef7a06b614a1 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Removing single pathed devices sdb {{(pid=75245) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 17:13:01 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:13:01 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:13:01 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[f41d5ae1-c4b7-4726-9a07-52848b0e960e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:13:01 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:13:01 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:13:01 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[037bab40-ab47-4633-836b-5dce8cc27479]: (4, ('ok\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:13:01 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-449ba558-9e97-4d10-92dc-ef7a06b614a1 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Flushing IO for device /dev/sdb {{(pid=75245) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 17:13:01 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:13:01 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:13:01 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd019fe-a412-4703-a5a9-7b17e6d910d4]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:13:01 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-449ba558-9e97-4d10-92dc-ef7a06b614a1 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75245) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 17:13:01 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:13:01 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:13:01 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d2011de-7788-4eb4-90eb-b4bf28762146]: (4, ('1', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:13:01 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-449ba558-9e97-4d10-92dc-ef7a06b614a1 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 17:13:01 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-449ba558-9e97-4d10-92dc-ef7a06b614a1 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] SCSI volumes sdb have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 17:13:01 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-449ba558-9e97-4d10-92dc-ef7a06b614a1 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26e877bc-af2f-4ad7-b5b5-58dbe63ed9ee')] {{(pid=75245) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 17:13:01 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26e877bc-af2f-4ad7-b5b5-58dbe63ed9ee -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:13:01 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26e877bc-af2f-4ad7-b5b5-58dbe63ed9ee -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:13:01 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc5978b-8058-4d64-87d2-cfd98e377fef]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:13:01 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-449ba558-9e97-4d10-92dc-ef7a06b614a1 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:13:01 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26e877bc-af2f-4ad7-b5b5-58dbe63ed9ee -p 172.16.0.220:3260 --logout {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:13:01 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26e877bc-af2f-4ad7-b5b5-58dbe63ed9ee -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:13:01 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[260d8b2a-3e9c-420f-9701-8218beae761b]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:26e877bc-af2f-4ad7-b5b5-58dbe63ed9ee, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:26e877bc-af2f-4ad7-b5b5-58dbe63ed9ee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:13:01 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-449ba558-9e97-4d10-92dc-ef7a06b614a1 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:26e877bc-af2f-4ad7-b5b5-58dbe63ed9ee, portal: 172.16.0.220,3260]
Nov 29 17:13:01 user nova-compute[75245]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:26e877bc-af2f-4ad7-b5b5-58dbe63ed9ee, portal: 172.16.0.220,3260] successful.
Nov 29 17:13:01 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:13:01 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26e877bc-af2f-4ad7-b5b5-58dbe63ed9ee -p 172.16.0.220:3260 --op delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:13:01 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26e877bc-af2f-4ad7-b5b5-58dbe63ed9ee -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:13:01 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc0faf4-750f-4fb9-b6e3-92cadb9afa7c]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:13:01 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-449ba558-9e97-4d10-92dc-ef7a06b614a1 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:13:01 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-449ba558-9e97-4d10-92dc-ef7a06b614a1 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:13:01 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-449ba558-9e97-4d10-92dc-ef7a06b614a1 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] <== disconnect_volume: return (298ms) None {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:13:01 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-449ba558-9e97-4d10-92dc-ef7a06b614a1 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Disconnected iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 17:13:02 user nova-compute[75245]: DEBUG nova.objects.instance [None req-449ba558-9e97-4d10-92dc-ef7a06b614a1 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Lazy-loading 'flavor' on Instance uuid ffa56d44-cd40-4b42-9d6d-f37ba3759b13 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:13:02 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-449ba558-9e97-4d10-92dc-ef7a06b614a1 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Lock "ffa56d44-cd40-4b42-9d6d-f37ba3759b13" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.690s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:13:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:13:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:13:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75245) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 17:13:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 17:13:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 17:13:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:13:05 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:13:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:13:13 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:13:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:13:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:13:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75245) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 17:13:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 17:13:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 17:13:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:13:19 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:13:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:13:29 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:13:34 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-519ed50f-ca2e-40ec-9657-e9a9d4d30679 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Acquiring lock "ffa56d44-cd40-4b42-9d6d-f37ba3759b13" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:13:34 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-519ed50f-ca2e-40ec-9657-e9a9d4d30679 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Lock "ffa56d44-cd40-4b42-9d6d-f37ba3759b13" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:13:34 user nova-compute[75245]: DEBUG nova.objects.instance [None req-519ed50f-ca2e-40ec-9657-e9a9d4d30679 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Lazy-loading 'flavor' on Instance uuid ffa56d44-cd40-4b42-9d6d-f37ba3759b13 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:13:34 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-519ed50f-ca2e-40ec-9657-e9a9d4d30679 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Lock "ffa56d44-cd40-4b42-9d6d-f37ba3759b13" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:13:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:13:34 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-519ed50f-ca2e-40ec-9657-e9a9d4d30679 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Acquiring lock "ffa56d44-cd40-4b42-9d6d-f37ba3759b13" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:13:34 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-519ed50f-ca2e-40ec-9657-e9a9d4d30679 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Lock "ffa56d44-cd40-4b42-9d6d-f37ba3759b13" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:13:34 user nova-compute[75245]: INFO nova.compute.manager [None req-519ed50f-ca2e-40ec-9657-e9a9d4d30679 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Attaching volume 44cc7f6a-f6a6-4e84-bdf8-116328b4544b to /dev/vdb
Nov 29 17:13:34 user nova-compute[75245]: DEBUG os_brick.utils [None req-519ed50f-ca2e-40ec-9657-e9a9d4d30679 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:13:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:13:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:13:34 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[e127979d-caa7-4a3d-9ee4-2ccb10ff7fe6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:69ed8ed87091\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:13:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:13:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:13:34 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce0e881-4a99-453e-9138-39ef08bf89c6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:13:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:13:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:13:34 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b938f29-a9ef-4009-9a79-3fbecc104ef7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:13:34 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f9a70cb-931e-4c0e-8a4d-7289ff6e750e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:13:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-519ed50f-ca2e-40ec-9657-e9a9d4d30679 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Running cmd (subprocess): nvme version {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:13:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-519ed50f-ca2e-40ec-9657-e9a9d4d30679 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] 'nvme version' failed. Not Retrying. {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 17:13:34 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.nvmeof [None req-519ed50f-ca2e-40ec-9657-e9a9d4d30679 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] nvme not present on system {{(pid=75245) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 17:13:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:13:34 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 17:13:34 user nova-compute[75245]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 17:13:34 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a750b0-88d9-411a-a431-a1963873c522]: (4, '') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:13:34 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-519ed50f-ca2e-40ec-9657-e9a9d4d30679 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75245) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 17:13:34 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-519ed50f-ca2e-40ec-9657-e9a9d4d30679 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 17:13:34 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-519ed50f-ca2e-40ec-9657-e9a9d4d30679 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] LIGHTOS: no hostnqn found. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 17:13:34 user nova-compute[75245]: DEBUG os_brick.utils [None req-519ed50f-ca2e-40ec-9657-e9a9d4d30679 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:69ed8ed87091', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:13:34 user nova-compute[75245]: DEBUG nova.virt.block_device [None req-519ed50f-ca2e-40ec-9657-e9a9d4d30679 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Updating existing volume attachment record: 24bac62a-ba4a-48e8-800e-ad875738a446 {{(pid=75245) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 17:13:34 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:13:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:13:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:13:42 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-519ed50f-ca2e-40ec-9657-e9a9d4d30679 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Calling os-brick to attach iSCSI Volume {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 17:13:42 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-519ed50f-ca2e-40ec-9657-e9a9d4d30679 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:44cc7f6a-f6a6-4e84-bdf8-116328b4544b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zhxivpbJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:13:42 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-519ed50f-ca2e-40ec-9657-e9a9d4d30679 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:13:42 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-519ed50f-ca2e-40ec-9657-e9a9d4d30679 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:13:42 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-519ed50f-ca2e-40ec-9657-e9a9d4d30679 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:13:42 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-519ed50f-ca2e-40ec-9657-e9a9d4d30679 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:13:42 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-519ed50f-ca2e-40ec-9657-e9a9d4d30679 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44cc7f6a-f6a6-4e84-bdf8-116328b4544b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:13:42 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-519ed50f-ca2e-40ec-9657-e9a9d4d30679 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44cc7f6a-f6a6-4e84-bdf8-116328b4544b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:13:42 user nova-compute[75245]: INFO os_brick.initiator.connectors.iscsi [None req-519ed50f-ca2e-40ec-9657-e9a9d4d30679 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 17:13:42 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44cc7f6a-f6a6-4e84-bdf8-116328b4544b -p 172.16.0.220:3260 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:13:42 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44cc7f6a-f6a6-4e84-bdf8-116328b4544b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:13:42 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea18469-4048-4b6d-8f73-687cecd5c2fe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:13:42 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-519ed50f-ca2e-40ec-9657-e9a9d4d30679 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 17:13:42 user nova-compute[75245]:  {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:13:42 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44cc7f6a-f6a6-4e84-bdf8-116328b4544b -p 172.16.0.220:3260 --interface default --op new {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:13:42 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44cc7f6a-f6a6-4e84-bdf8-116328b4544b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:13:42 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f81b373-9d8d-4c4f-96bb-5d5fe9568fb6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:44cc7f6a-f6a6-4e84-bdf8-116328b4544b] added\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:13:42 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-519ed50f-ca2e-40ec-9657-e9a9d4d30679 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:44cc7f6a-f6a6-4e84-bdf8-116328b4544b] added
Nov 29 17:13:42 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:13:42 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44cc7f6a-f6a6-4e84-bdf8-116328b4544b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:13:42 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44cc7f6a-f6a6-4e84-bdf8-116328b4544b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:13:42 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f0da02-dc13-486c-aca7-c68fb99eb922]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:13:42 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-519ed50f-ca2e-40ec-9657-e9a9d4d30679 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:13:42 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44cc7f6a-f6a6-4e84-bdf8-116328b4544b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:13:42 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44cc7f6a-f6a6-4e84-bdf8-116328b4544b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:13:42 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[13dea6bb-a043-4e69-9803-fa87f55671d7]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:13:42 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-519ed50f-ca2e-40ec-9657-e9a9d4d30679 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:13:42 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44cc7f6a-f6a6-4e84-bdf8-116328b4544b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zhxivpbJ {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:13:42 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44cc7f6a-f6a6-4e84-bdf8-116328b4544b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zhxivpbJ" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:13:42 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d1d152d-652b-4a61-b04d-c20887b3f203]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:13:42 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-519ed50f-ca2e-40ec-9657-e9a9d4d30679 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zhxivpbJ'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:13:42 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44cc7f6a-f6a6-4e84-bdf8-116328b4544b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:13:42 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44cc7f6a-f6a6-4e84-bdf8-116328b4544b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:13:42 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[292f2d98-17d8-493b-9b85-abdb8e30cae5]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:13:42 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-519ed50f-ca2e-40ec-9657-e9a9d4d30679 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:13:42 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:13:42 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:13:42 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb4894a-ba33-4746-afaf-1dc11f40a6e8]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:13:42 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-519ed50f-ca2e-40ec-9657-e9a9d4d30679 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 17:13:42 user nova-compute[75245]:  {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:13:42 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-519ed50f-ca2e-40ec-9657-e9a9d4d30679 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 17:13:42 user nova-compute[75245]:  {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:13:42 user nova-compute[75245]: WARNING os_brick.initiator.connectors.iscsi [None req-519ed50f-ca2e-40ec-9657-e9a9d4d30679 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 17:13:42 user nova-compute[75245]: 
Nov 29 17:13:42 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44cc7f6a-f6a6-4e84-bdf8-116328b4544b -p 172.16.0.220:3260 --login {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:13:42 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44cc7f6a-f6a6-4e84-bdf8-116328b4544b -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:13:42 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04b5f12-5ad0-460a-9c46-d65bd38a3d2f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:44cc7f6a-f6a6-4e84-bdf8-116328b4544b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:44cc7f6a-f6a6-4e84-bdf8-116328b4544b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:13:42 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-519ed50f-ca2e-40ec-9657-e9a9d4d30679 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:44cc7f6a-f6a6-4e84-bdf8-116328b4544b, portal: 172.16.0.220,3260]
Nov 29 17:13:42 user nova-compute[75245]: Login to [iface: default, target: iqn.2010-10.org.openstack:44cc7f6a-f6a6-4e84-bdf8-116328b4544b, portal: 172.16.0.220,3260] successful.
Nov 29 17:13:42 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:13:42 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44cc7f6a-f6a6-4e84-bdf8-116328b4544b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:13:42 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44cc7f6a-f6a6-4e84-bdf8-116328b4544b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:13:42 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d4a359-82e0-43ea-bbe8-d13f210da198]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:13:42 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-519ed50f-ca2e-40ec-9657-e9a9d4d30679 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:13:42 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:13:42 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:13:42 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[009606bf-2ba8-424e-ae70-d1a834a514b7]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44cc7f6a-f6a6-4e84-bdf8-116328b4544b (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:13:42 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-519ed50f-ca2e-40ec-9657-e9a9d4d30679 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44cc7f6a-f6a6-4e84-bdf8-116328b4544b (non-flash)
Nov 29 17:13:42 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:13:42 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-519ed50f-ca2e-40ec-9657-e9a9d4d30679 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44cc7f6a-f6a6-4e84-bdf8-116328b4544b (non-flash)
Nov 29 17:13:42 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:13:42 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-519ed50f-ca2e-40ec-9657-e9a9d4d30679 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44cc7f6a-f6a6-4e84-bdf8-116328b4544b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.247s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:13:42 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-519ed50f-ca2e-40ec-9657-e9a9d4d30679 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Connected to 172.16.0.220:3260 {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 17:13:42 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-519ed50f-ca2e-40ec-9657-e9a9d4d30679 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=75245) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 17:13:42 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-519ed50f-ca2e-40ec-9657-e9a9d4d30679 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75245) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 17:13:42 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:13:42 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:13:42 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1419fd9-b461-4d9e-8b28-fb131ca7f260]: (4, ('- - 0', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:13:42 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-519ed50f-ca2e-40ec-9657-e9a9d4d30679 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: None {{(pid=75245) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 17:13:42 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:13:42 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Starting heal instance info cache {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 17:13:42 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Rebuilding the list of instances to heal {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 17:13:42 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "refresh_cache-ffa56d44-cd40-4b42-9d6d-f37ba3759b13" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:13:42 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquired lock "refresh_cache-ffa56d44-cd40-4b42-9d6d-f37ba3759b13" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:13:42 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Forcefully refreshing network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 17:13:42 user nova-compute[75245]: DEBUG nova.objects.instance [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lazy-loading 'info_cache' on Instance uuid ffa56d44-cd40-4b42-9d6d-f37ba3759b13 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:13:43 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Updating instance_info_cache with network_info: [{"id": "671bebb6-5146-45a2-b5b3-3307af4160c9", "address": "fa:16:3e:70:67:f1", "network": {"id": "d88c85cd-909b-4c70-92cf-ae0ba3b1d136", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-301851142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2019bc75cdd34c3bb817000f6fe60a11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap671bebb6-51", "ovs_interfaceid": "671bebb6-5146-45a2-b5b3-3307af4160c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:13:43 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Releasing lock "refresh_cache-ffa56d44-cd40-4b42-9d6d-f37ba3759b13" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:13:43 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Updated the network info_cache for instance {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 17:13:43 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-519ed50f-ca2e-40ec-9657-e9a9d4d30679 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75245) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 17:13:43 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-519ed50f-ca2e-40ec-9657-e9a9d4d30679 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:44cc7f6a-f6a6-4e84-bdf8-116328b4544b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zhxivpbJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 17:13:43 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-519ed50f-ca2e-40ec-9657-e9a9d4d30679 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.280s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:13:43 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-519ed50f-ca2e-40ec-9657-e9a9d4d30679 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] <== connect_volume: return (1281ms) {'type': 'block', 'scsi_wwn': '23433623666636166', 'path': '/dev/sdb'} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:13:43 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-519ed50f-ca2e-40ec-9657-e9a9d4d30679 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23433623666636166', 'path': '/dev/sdb'} {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 17:13:43 user nova-compute[75245]: DEBUG nova.objects.instance [None req-519ed50f-ca2e-40ec-9657-e9a9d4d30679 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Lazy-loading 'flavor' on Instance uuid ffa56d44-cd40-4b42-9d6d-f37ba3759b13 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:13:43 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-519ed50f-ca2e-40ec-9657-e9a9d4d30679 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 17:13:43 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 17:13:43 user nova-compute[75245]:   <source dev="/dev/sdb"/>
Nov 29 17:13:43 user nova-compute[75245]:   <target dev="vdb" bus="virtio"/>
Nov 29 17:13:43 user nova-compute[75245]:   <serial>44cc7f6a-f6a6-4e84-bdf8-116328b4544b</serial>
Nov 29 17:13:43 user nova-compute[75245]: </disk>
Nov 29 17:13:43 user nova-compute[75245]:  {{(pid=75245) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 17:13:43 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-519ed50f-ca2e-40ec-9657-e9a9d4d30679 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 17:13:43 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-519ed50f-ca2e-40ec-9657-e9a9d4d30679 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 17:13:43 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-519ed50f-ca2e-40ec-9657-e9a9d4d30679 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] No VIF found with MAC fa:16:3e:70:67:f1, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 17:13:44 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-519ed50f-ca2e-40ec-9657-e9a9d4d30679 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Lock "ffa56d44-cd40-4b42-9d6d-f37ba3759b13" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.286s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:13:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:13:44 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:13:45 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:13:45 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:13:45 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:13:45 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:13:45 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75245) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 17:13:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffa56d44-cd40-4b42-9d6d-f37ba3759b13/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:13:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffa56d44-cd40-4b42-9d6d-f37ba3759b13/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:13:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffa56d44-cd40-4b42-9d6d-f37ba3759b13/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:13:45 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffa56d44-cd40-4b42-9d6d-f37ba3759b13/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:13:45 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75245) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 17:13:46 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:13:46 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:13:46 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Hypervisor/Node resource view: name=user free_ram=8991MB free_disk=25.03490447998047GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75245) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 17:13:46 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:13:46 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:13:46 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-be47e1f3-046d-4c76-98c8-795e2352bd24 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Acquiring lock "ffa56d44-cd40-4b42-9d6d-f37ba3759b13" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:13:46 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-be47e1f3-046d-4c76-98c8-795e2352bd24 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Lock "ffa56d44-cd40-4b42-9d6d-f37ba3759b13" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:13:46 user nova-compute[75245]: INFO nova.compute.manager [None req-be47e1f3-046d-4c76-98c8-795e2352bd24 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Detaching volume 44cc7f6a-f6a6-4e84-bdf8-116328b4544b
Nov 29 17:13:46 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance ffa56d44-cd40-4b42-9d6d-f37ba3759b13 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:13:46 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 17:13:46 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 17:13:46 user nova-compute[75245]: INFO nova.virt.block_device [None req-be47e1f3-046d-4c76-98c8-795e2352bd24 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Attempting to driver detach volume 44cc7f6a-f6a6-4e84-bdf8-116328b4544b from mountpoint /dev/vdb
Nov 29 17:13:46 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-be47e1f3-046d-4c76-98c8-795e2352bd24 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Attempting to detach device vdb from instance ffa56d44-cd40-4b42-9d6d-f37ba3759b13 from the persistent domain config. {{(pid=75245) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 17:13:46 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-be47e1f3-046d-4c76-98c8-795e2352bd24 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 17:13:46 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 17:13:46 user nova-compute[75245]:   <source dev="/dev/sdb"/>
Nov 29 17:13:46 user nova-compute[75245]:   <target dev="vdb" bus="virtio"/>
Nov 29 17:13:46 user nova-compute[75245]:   <serial>44cc7f6a-f6a6-4e84-bdf8-116328b4544b</serial>
Nov 29 17:13:46 user nova-compute[75245]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 17:13:46 user nova-compute[75245]: </disk>
Nov 29 17:13:46 user nova-compute[75245]:  {{(pid=75245) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 17:13:46 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-be47e1f3-046d-4c76-98c8-795e2352bd24 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Successfully detached device vdb from instance ffa56d44-cd40-4b42-9d6d-f37ba3759b13 from the persistent domain config.
Nov 29 17:13:46 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-be47e1f3-046d-4c76-98c8-795e2352bd24 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ffa56d44-cd40-4b42-9d6d-f37ba3759b13 from the live domain config. {{(pid=75245) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 17:13:46 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-be47e1f3-046d-4c76-98c8-795e2352bd24 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 17:13:46 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 17:13:46 user nova-compute[75245]:   <source dev="/dev/sdb"/>
Nov 29 17:13:46 user nova-compute[75245]:   <target dev="vdb" bus="virtio"/>
Nov 29 17:13:46 user nova-compute[75245]:   <serial>44cc7f6a-f6a6-4e84-bdf8-116328b4544b</serial>
Nov 29 17:13:46 user nova-compute[75245]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 17:13:46 user nova-compute[75245]: </disk>
Nov 29 17:13:46 user nova-compute[75245]:  {{(pid=75245) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 17:13:46 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 17:13:46 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 17:13:46 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Compute_service record updated for user:user {{(pid=75245) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 17:13:46 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.207s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:13:46 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-be47e1f3-046d-4c76-98c8-795e2352bd24 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ffa56d44-cd40-4b42-9d6d-f37ba3759b13 {{(pid=75245) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 17:13:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:13:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:13:50 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:13:50 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:13:52 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:13:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:13:57 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:13:58 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:13:59 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:13:59 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75245) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 17:13:59 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:14:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:14:05 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:14:06 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-be47e1f3-046d-4c76-98c8-795e2352bd24 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ffa56d44-cd40-4b42-9d6d-f37ba3759b13 is timed out.
Nov 29 17:14:06 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-be47e1f3-046d-4c76-98c8-795e2352bd24 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Successfully detached device vdb from instance ffa56d44-cd40-4b42-9d6d-f37ba3759b13 from the live domain config.
Nov 29 17:14:06 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be47e1f3-046d-4c76-98c8-795e2352bd24 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] calling os-brick to detach iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 17:14:06 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-be47e1f3-046d-4c76-98c8-795e2352bd24 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, {'target_iqn': 'iqn.2010-10.org.openstack:44cc7f6a-f6a6-4e84-bdf8-116328b4544b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zhxivpbJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:14:06 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-be47e1f3-046d-4c76-98c8-795e2352bd24 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:14:06 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-be47e1f3-046d-4c76-98c8-795e2352bd24 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:14:06 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-be47e1f3-046d-4c76-98c8-795e2352bd24 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:14:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:14:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:14:06 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd589696-101e-463b-82a7-d5386fb23ed6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:44cc7f6a-f6a6-4e84-bdf8-116328b4544b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:14:06 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-be47e1f3-046d-4c76-98c8-795e2352bd24 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 17:14:06 user nova-compute[75245]: No targets found.
Nov 29 17:14:06 user nova-compute[75245]: iSNS:
Nov 29 17:14:06 user nova-compute[75245]: No targets found.
Nov 29 17:14:06 user nova-compute[75245]: STATIC:
Nov 29 17:14:06 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:44cc7f6a-f6a6-4e84-bdf8-116328b4544b
Nov 29 17:14:06 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:14:06 user nova-compute[75245]:                 Iface Name: default
Nov 29 17:14:06 user nova-compute[75245]: FIRMWARE:
Nov 29 17:14:06 user nova-compute[75245]: No targets found.
Nov 29 17:14:06 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:14:06 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-be47e1f3-046d-4c76-98c8-795e2352bd24 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 17:14:06 user nova-compute[75245]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 17:14:06 user nova-compute[75245]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75245) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 17:14:06 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-be47e1f3-046d-4c76-98c8-795e2352bd24 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44cc7f6a-f6a6-4e84-bdf8-116328b4544b', 0)] {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 17:14:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:14:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:14:06 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba80a29-9d1a-4a43-92eb-5c068a4b862d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44cc7f6a-f6a6-4e84-bdf8-116328b4544b\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:14:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:14:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:14:06 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9747d2d-a273-4a44-8635-bd83abbca178]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44cc7f6a-f6a6-4e84-bdf8-116328b4544b (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:14:06 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-be47e1f3-046d-4c76-98c8-795e2352bd24 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44cc7f6a-f6a6-4e84-bdf8-116328b4544b (non-flash)
Nov 29 17:14:06 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:14:06 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-be47e1f3-046d-4c76-98c8-795e2352bd24 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44cc7f6a-f6a6-4e84-bdf8-116328b4544b (non-flash)
Nov 29 17:14:06 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:14:06 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-be47e1f3-046d-4c76-98c8-795e2352bd24 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0d443cf010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44cc7f6a-f6a6-4e84-bdf8-116328b4544b'): ({'sdb'}, set())}) {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 17:14:06 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-be47e1f3-046d-4c76-98c8-795e2352bd24 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Removing single pathed devices sdb {{(pid=75245) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 17:14:06 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:14:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:14:07 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[8163df09-d800-4c55-bbb3-823db3df92ab]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:14:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:14:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:14:07 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3fac59-1e56-41bb-a7af-a43aad4ff4fb]: (4, ('ok\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:14:07 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-be47e1f3-046d-4c76-98c8-795e2352bd24 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Flushing IO for device /dev/sdb {{(pid=75245) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 17:14:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:14:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:14:07 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4cb306e-41b0-4074-83e6-4b4e36513404]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:14:07 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-be47e1f3-046d-4c76-98c8-795e2352bd24 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75245) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 17:14:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:14:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:14:07 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[139a9a33-59d3-4af5-9030-9c297dd168b9]: (4, ('1', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:14:07 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-be47e1f3-046d-4c76-98c8-795e2352bd24 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 17:14:07 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-be47e1f3-046d-4c76-98c8-795e2352bd24 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] SCSI volumes sdb have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 17:14:07 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-be47e1f3-046d-4c76-98c8-795e2352bd24 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44cc7f6a-f6a6-4e84-bdf8-116328b4544b')] {{(pid=75245) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 17:14:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44cc7f6a-f6a6-4e84-bdf8-116328b4544b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:14:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44cc7f6a-f6a6-4e84-bdf8-116328b4544b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:14:07 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[277c94ad-0aa6-4a42-badf-5174d36cd599]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:14:07 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-be47e1f3-046d-4c76-98c8-795e2352bd24 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:14:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44cc7f6a-f6a6-4e84-bdf8-116328b4544b -p 172.16.0.220:3260 --logout {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:14:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44cc7f6a-f6a6-4e84-bdf8-116328b4544b -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:14:07 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc080f65-93c1-4093-9246-5c135520e95b]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:44cc7f6a-f6a6-4e84-bdf8-116328b4544b, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:44cc7f6a-f6a6-4e84-bdf8-116328b4544b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:14:07 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-be47e1f3-046d-4c76-98c8-795e2352bd24 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:44cc7f6a-f6a6-4e84-bdf8-116328b4544b, portal: 172.16.0.220,3260]
Nov 29 17:14:07 user nova-compute[75245]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:44cc7f6a-f6a6-4e84-bdf8-116328b4544b, portal: 172.16.0.220,3260] successful.
Nov 29 17:14:07 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:14:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44cc7f6a-f6a6-4e84-bdf8-116328b4544b -p 172.16.0.220:3260 --op delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:14:07 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44cc7f6a-f6a6-4e84-bdf8-116328b4544b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:14:07 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[671bc05d-278c-4365-a05e-5493000f42f8]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:14:07 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-be47e1f3-046d-4c76-98c8-795e2352bd24 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:14:07 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-be47e1f3-046d-4c76-98c8-795e2352bd24 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:14:07 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-be47e1f3-046d-4c76-98c8-795e2352bd24 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] <== disconnect_volume: return (285ms) None {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:14:07 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be47e1f3-046d-4c76-98c8-795e2352bd24 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Disconnected iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 17:14:07 user nova-compute[75245]: DEBUG nova.objects.instance [None req-be47e1f3-046d-4c76-98c8-795e2352bd24 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Lazy-loading 'flavor' on Instance uuid ffa56d44-cd40-4b42-9d6d-f37ba3759b13 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:14:07 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-be47e1f3-046d-4c76-98c8-795e2352bd24 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Lock "ffa56d44-cd40-4b42-9d6d-f37ba3759b13" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.651s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:14:09 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:14:14 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:14:19 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:14:19 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:14:19 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75245) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 17:14:19 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 17:14:19 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 17:14:19 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:14:24 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:14:30 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:14:30 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:14:30 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75245) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 17:14:30 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 17:14:30 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 17:14:30 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:14:35 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:14:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-a1c04aa2-ec7f-4883-98df-c12b9772d66d tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Acquiring lock "ffa56d44-cd40-4b42-9d6d-f37ba3759b13" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:14:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-a1c04aa2-ec7f-4883-98df-c12b9772d66d tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Lock "ffa56d44-cd40-4b42-9d6d-f37ba3759b13" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:14:39 user nova-compute[75245]: DEBUG nova.objects.instance [None req-a1c04aa2-ec7f-4883-98df-c12b9772d66d tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Lazy-loading 'flavor' on Instance uuid ffa56d44-cd40-4b42-9d6d-f37ba3759b13 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:14:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-a1c04aa2-ec7f-4883-98df-c12b9772d66d tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Lock "ffa56d44-cd40-4b42-9d6d-f37ba3759b13" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:14:39 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:14:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-a1c04aa2-ec7f-4883-98df-c12b9772d66d tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Acquiring lock "ffa56d44-cd40-4b42-9d6d-f37ba3759b13" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:14:39 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-a1c04aa2-ec7f-4883-98df-c12b9772d66d tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Lock "ffa56d44-cd40-4b42-9d6d-f37ba3759b13" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:14:39 user nova-compute[75245]: INFO nova.compute.manager [None req-a1c04aa2-ec7f-4883-98df-c12b9772d66d tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Attaching volume be0d153d-f033-4892-9628-54f5e45b3b77 to /dev/vdb
Nov 29 17:14:39 user nova-compute[75245]: DEBUG os_brick.utils [None req-a1c04aa2-ec7f-4883-98df-c12b9772d66d tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:14:39 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:14:39 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:14:39 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1e10cb-5adb-4742-be71-11f1e3c69e1c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:69ed8ed87091\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:14:39 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:14:39 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:14:39 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8fbf10-3a5e-49fc-a112-79af2c466aed]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:14:39 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:14:39 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:14:39 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc1f67d-6694-4e27-acc9-c397f1461a8f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:14:39 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b997921-32d7-4d4e-a01c-b957715d71d0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:14:39 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-a1c04aa2-ec7f-4883-98df-c12b9772d66d tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Running cmd (subprocess): nvme version {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:14:39 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-a1c04aa2-ec7f-4883-98df-c12b9772d66d tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] 'nvme version' failed. Not Retrying. {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 17:14:39 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a1c04aa2-ec7f-4883-98df-c12b9772d66d tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] nvme not present on system {{(pid=75245) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 17:14:39 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:14:39 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 17:14:39 user nova-compute[75245]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 17:14:39 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fdf6468-b883-420e-b6b5-1adc7c3e89b8]: (4, '') {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:14:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-a1c04aa2-ec7f-4883-98df-c12b9772d66d tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75245) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 17:14:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-a1c04aa2-ec7f-4883-98df-c12b9772d66d tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 17:14:40 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.lightos [None req-a1c04aa2-ec7f-4883-98df-c12b9772d66d tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] LIGHTOS: no hostnqn found. {{(pid=75245) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 17:14:40 user nova-compute[75245]: DEBUG os_brick.utils [None req-a1c04aa2-ec7f-4883-98df-c12b9772d66d tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:69ed8ed87091', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:14:40 user nova-compute[75245]: DEBUG nova.virt.block_device [None req-a1c04aa2-ec7f-4883-98df-c12b9772d66d tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Updating existing volume attachment record: 58df27d8-20ea-4cae-ad39-3279c924ce6d {{(pid=75245) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 17:14:40 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:14:44 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:14:44 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Starting heal instance info cache {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 17:14:44 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Rebuilding the list of instances to heal {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 17:14:44 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "refresh_cache-ffa56d44-cd40-4b42-9d6d-f37ba3759b13" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:14:44 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquired lock "refresh_cache-ffa56d44-cd40-4b42-9d6d-f37ba3759b13" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:14:44 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Forcefully refreshing network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 17:14:44 user nova-compute[75245]: DEBUG nova.objects.instance [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lazy-loading 'info_cache' on Instance uuid ffa56d44-cd40-4b42-9d6d-f37ba3759b13 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:14:45 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:14:45 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:14:45 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75245) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 17:14:45 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 17:14:45 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 17:14:45 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:14:45 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Updating instance_info_cache with network_info: [{"id": "671bebb6-5146-45a2-b5b3-3307af4160c9", "address": "fa:16:3e:70:67:f1", "network": {"id": "d88c85cd-909b-4c70-92cf-ae0ba3b1d136", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-301851142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2019bc75cdd34c3bb817000f6fe60a11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap671bebb6-51", "ovs_interfaceid": "671bebb6-5146-45a2-b5b3-3307af4160c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:14:45 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Releasing lock "refresh_cache-ffa56d44-cd40-4b42-9d6d-f37ba3759b13" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:14:45 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Updated the network info_cache for instance {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 17:14:46 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1c04aa2-ec7f-4883-98df-c12b9772d66d tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Calling os-brick to attach iSCSI Volume {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 17:14:46 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1c04aa2-ec7f-4883-98df-c12b9772d66d tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:be0d153d-f033-4892-9628-54f5e45b3b77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jKgtDhOR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:14:46 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-a1c04aa2-ec7f-4883-98df-c12b9772d66d tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:14:46 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-a1c04aa2-ec7f-4883-98df-c12b9772d66d tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:14:46 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-a1c04aa2-ec7f-4883-98df-c12b9772d66d tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:14:46 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-a1c04aa2-ec7f-4883-98df-c12b9772d66d tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:14:46 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-a1c04aa2-ec7f-4883-98df-c12b9772d66d tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be0d153d-f033-4892-9628-54f5e45b3b77" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:14:46 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-a1c04aa2-ec7f-4883-98df-c12b9772d66d tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be0d153d-f033-4892-9628-54f5e45b3b77" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:14:46 user nova-compute[75245]: INFO os_brick.initiator.connectors.iscsi [None req-a1c04aa2-ec7f-4883-98df-c12b9772d66d tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 17:14:46 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be0d153d-f033-4892-9628-54f5e45b3b77 -p 172.16.0.220:3260 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:14:46 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be0d153d-f033-4892-9628-54f5e45b3b77 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:14:46 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac2c673-2249-49c8-bdaf-f83630f2563e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:14:46 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1c04aa2-ec7f-4883-98df-c12b9772d66d tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 17:14:46 user nova-compute[75245]:  {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:14:46 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be0d153d-f033-4892-9628-54f5e45b3b77 -p 172.16.0.220:3260 --interface default --op new {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:14:46 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be0d153d-f033-4892-9628-54f5e45b3b77 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:14:46 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[976ba8b1-0785-4be5-97d9-d0655cdbe91d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:be0d153d-f033-4892-9628-54f5e45b3b77] added\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:14:46 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1c04aa2-ec7f-4883-98df-c12b9772d66d tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:be0d153d-f033-4892-9628-54f5e45b3b77] added
Nov 29 17:14:46 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:14:46 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be0d153d-f033-4892-9628-54f5e45b3b77 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:14:46 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be0d153d-f033-4892-9628-54f5e45b3b77 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:14:46 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed22e99-cb40-441b-b258-f499ffbb6294]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:14:46 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1c04aa2-ec7f-4883-98df-c12b9772d66d tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:14:46 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be0d153d-f033-4892-9628-54f5e45b3b77 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:14:46 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be0d153d-f033-4892-9628-54f5e45b3b77 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:14:46 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[d76ef944-cdd7-43ce-b001-7a5ea17af44f]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:14:46 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1c04aa2-ec7f-4883-98df-c12b9772d66d tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:14:46 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be0d153d-f033-4892-9628-54f5e45b3b77 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jKgtDhOR {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:14:46 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be0d153d-f033-4892-9628-54f5e45b3b77 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jKgtDhOR" returned: 0 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:14:46 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a14b1ab-e471-40da-b33f-438b2134263e]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:14:46 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1c04aa2-ec7f-4883-98df-c12b9772d66d tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jKgtDhOR'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:14:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be0d153d-f033-4892-9628-54f5e45b3b77 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:14:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be0d153d-f033-4892-9628-54f5e45b3b77 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:14:47 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[d199023d-8f63-4db1-a573-205d70000b02]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:14:47 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1c04aa2-ec7f-4883-98df-c12b9772d66d tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:14:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:14:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:14:47 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7f9d52-e61d-463d-bf1e-c00e7914400a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:14:47 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1c04aa2-ec7f-4883-98df-c12b9772d66d tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 17:14:47 user nova-compute[75245]:  {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:14:47 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1c04aa2-ec7f-4883-98df-c12b9772d66d tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 17:14:47 user nova-compute[75245]:  {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:14:47 user nova-compute[75245]: WARNING os_brick.initiator.connectors.iscsi [None req-a1c04aa2-ec7f-4883-98df-c12b9772d66d tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 17:14:47 user nova-compute[75245]: 
Nov 29 17:14:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be0d153d-f033-4892-9628-54f5e45b3b77 -p 172.16.0.220:3260 --login {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:14:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be0d153d-f033-4892-9628-54f5e45b3b77 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:14:47 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[1047c655-6fc5-42b0-9118-1c1c1b7c2f8a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:be0d153d-f033-4892-9628-54f5e45b3b77, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:be0d153d-f033-4892-9628-54f5e45b3b77, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:14:47 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1c04aa2-ec7f-4883-98df-c12b9772d66d tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:be0d153d-f033-4892-9628-54f5e45b3b77, portal: 172.16.0.220,3260]
Nov 29 17:14:47 user nova-compute[75245]: Login to [iface: default, target: iqn.2010-10.org.openstack:be0d153d-f033-4892-9628-54f5e45b3b77, portal: 172.16.0.220,3260] successful.
Nov 29 17:14:47 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:14:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be0d153d-f033-4892-9628-54f5e45b3b77 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:14:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be0d153d-f033-4892-9628-54f5e45b3b77 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:14:47 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9201dee-751f-4148-b084-d28b98a47d33]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:14:47 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1c04aa2-ec7f-4883-98df-c12b9772d66d tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:14:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:14:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:14:47 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03e5afa-ebe7-4882-8875-4275f43d1aba]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be0d153d-f033-4892-9628-54f5e45b3b77 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:14:47 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1c04aa2-ec7f-4883-98df-c12b9772d66d tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be0d153d-f033-4892-9628-54f5e45b3b77 (non-flash)
Nov 29 17:14:47 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:14:47 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1c04aa2-ec7f-4883-98df-c12b9772d66d tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be0d153d-f033-4892-9628-54f5e45b3b77 (non-flash)
Nov 29 17:14:47 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:14:47 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-a1c04aa2-ec7f-4883-98df-c12b9772d66d tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be0d153d-f033-4892-9628-54f5e45b3b77" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.242s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:14:47 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1c04aa2-ec7f-4883-98df-c12b9772d66d tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Connected to 172.16.0.220:3260 {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 17:14:47 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-a1c04aa2-ec7f-4883-98df-c12b9772d66d tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=75245) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 17:14:47 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-a1c04aa2-ec7f-4883-98df-c12b9772d66d tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75245) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 17:14:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:14:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:14:47 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f93ecb9-9c59-40ba-ac73-c7e3c5f818c1]: (4, ('- - 0', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:14:47 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-a1c04aa2-ec7f-4883-98df-c12b9772d66d tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: None {{(pid=75245) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 17:14:47 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:14:47 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:14:47 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:14:47 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:14:47 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75245) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 17:14:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffa56d44-cd40-4b42-9d6d-f37ba3759b13/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:14:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffa56d44-cd40-4b42-9d6d-f37ba3759b13/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:14:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffa56d44-cd40-4b42-9d6d-f37ba3759b13/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:14:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffa56d44-cd40-4b42-9d6d-f37ba3759b13/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:14:48 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-a1c04aa2-ec7f-4883-98df-c12b9772d66d tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75245) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 17:14:48 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1c04aa2-ec7f-4883-98df-c12b9772d66d tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:be0d153d-f033-4892-9628-54f5e45b3b77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jKgtDhOR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75245) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 17:14:48 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-a1c04aa2-ec7f-4883-98df-c12b9772d66d tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.417s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:14:48 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1c04aa2-ec7f-4883-98df-c12b9772d66d tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] <== connect_volume: return (1418ms) {'type': 'block', 'scsi_wwn': '23137663736326165', 'path': '/dev/sdb'} {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:14:48 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1c04aa2-ec7f-4883-98df-c12b9772d66d tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23137663736326165', 'path': '/dev/sdb'} {{(pid=75245) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 17:14:48 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:14:48 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:14:48 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Hypervisor/Node resource view: name=user free_ram=8985MB free_disk=25.033954620361328GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75245) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 17:14:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:14:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:14:48 user nova-compute[75245]: DEBUG nova.objects.instance [None req-a1c04aa2-ec7f-4883-98df-c12b9772d66d tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Lazy-loading 'flavor' on Instance uuid ffa56d44-cd40-4b42-9d6d-f37ba3759b13 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:14:48 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-a1c04aa2-ec7f-4883-98df-c12b9772d66d tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 17:14:48 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 17:14:48 user nova-compute[75245]:   <source dev="/dev/sdb"/>
Nov 29 17:14:48 user nova-compute[75245]:   <target dev="vdb" bus="virtio"/>
Nov 29 17:14:48 user nova-compute[75245]:   <serial>be0d153d-f033-4892-9628-54f5e45b3b77</serial>
Nov 29 17:14:48 user nova-compute[75245]: </disk>
Nov 29 17:14:48 user nova-compute[75245]:  {{(pid=75245) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 17:14:48 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance ffa56d44-cd40-4b42-9d6d-f37ba3759b13 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:14:48 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 17:14:48 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 17:14:48 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 17:14:48 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 17:14:48 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Compute_service record updated for user:user {{(pid=75245) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 17:14:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.307s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:14:48 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-a1c04aa2-ec7f-4883-98df-c12b9772d66d tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] No BDM found with device name vda, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 17:14:48 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-a1c04aa2-ec7f-4883-98df-c12b9772d66d tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75245) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 17:14:48 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-a1c04aa2-ec7f-4883-98df-c12b9772d66d tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] No VIF found with MAC fa:16:3e:70:67:f1, not building metadata {{(pid=75245) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 17:14:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-a1c04aa2-ec7f-4883-98df-c12b9772d66d tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Lock "ffa56d44-cd40-4b42-9d6d-f37ba3759b13" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.131s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:14:49 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:14:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:14:51 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-65002fb0-3d71-4f55-90bf-2ba71ef64510 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Acquiring lock "ffa56d44-cd40-4b42-9d6d-f37ba3759b13" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:14:51 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-65002fb0-3d71-4f55-90bf-2ba71ef64510 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Lock "ffa56d44-cd40-4b42-9d6d-f37ba3759b13" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:14:51 user nova-compute[75245]: INFO nova.compute.manager [None req-65002fb0-3d71-4f55-90bf-2ba71ef64510 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Detaching volume be0d153d-f033-4892-9628-54f5e45b3b77
Nov 29 17:14:51 user nova-compute[75245]: INFO nova.virt.block_device [None req-65002fb0-3d71-4f55-90bf-2ba71ef64510 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Attempting to driver detach volume be0d153d-f033-4892-9628-54f5e45b3b77 from mountpoint /dev/vdb
Nov 29 17:14:51 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-65002fb0-3d71-4f55-90bf-2ba71ef64510 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Attempting to detach device vdb from instance ffa56d44-cd40-4b42-9d6d-f37ba3759b13 from the persistent domain config. {{(pid=75245) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 17:14:51 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-65002fb0-3d71-4f55-90bf-2ba71ef64510 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 17:14:51 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 17:14:51 user nova-compute[75245]:   <source dev="/dev/sdb"/>
Nov 29 17:14:51 user nova-compute[75245]:   <target dev="vdb" bus="virtio"/>
Nov 29 17:14:51 user nova-compute[75245]:   <serial>be0d153d-f033-4892-9628-54f5e45b3b77</serial>
Nov 29 17:14:51 user nova-compute[75245]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 17:14:51 user nova-compute[75245]: </disk>
Nov 29 17:14:51 user nova-compute[75245]:  {{(pid=75245) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 17:14:51 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-65002fb0-3d71-4f55-90bf-2ba71ef64510 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Successfully detached device vdb from instance ffa56d44-cd40-4b42-9d6d-f37ba3759b13 from the persistent domain config.
Nov 29 17:14:51 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-65002fb0-3d71-4f55-90bf-2ba71ef64510 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ffa56d44-cd40-4b42-9d6d-f37ba3759b13 from the live domain config. {{(pid=75245) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 17:14:51 user nova-compute[75245]: DEBUG nova.virt.libvirt.guest [None req-65002fb0-3d71-4f55-90bf-2ba71ef64510 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 17:14:51 user nova-compute[75245]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 17:14:51 user nova-compute[75245]:   <source dev="/dev/sdb"/>
Nov 29 17:14:51 user nova-compute[75245]:   <target dev="vdb" bus="virtio"/>
Nov 29 17:14:51 user nova-compute[75245]:   <serial>be0d153d-f033-4892-9628-54f5e45b3b77</serial>
Nov 29 17:14:51 user nova-compute[75245]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 17:14:51 user nova-compute[75245]: </disk>
Nov 29 17:14:51 user nova-compute[75245]:  {{(pid=75245) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 17:14:51 user nova-compute[75245]: DEBUG nova.virt.libvirt.driver [None req-65002fb0-3d71-4f55-90bf-2ba71ef64510 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ffa56d44-cd40-4b42-9d6d-f37ba3759b13 {{(pid=75245) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 17:14:52 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:14:52 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:14:54 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:14:54 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:14:55 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:14:58 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:14:58 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:15:00 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:15:00 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:15:00 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75245) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 17:15:05 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:15:07 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:15:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:15:11 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-65002fb0-3d71-4f55-90bf-2ba71ef64510 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ffa56d44-cd40-4b42-9d6d-f37ba3759b13 is timed out.
Nov 29 17:15:11 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-65002fb0-3d71-4f55-90bf-2ba71ef64510 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Successfully detached device vdb from instance ffa56d44-cd40-4b42-9d6d-f37ba3759b13 from the live domain config.
Nov 29 17:15:11 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65002fb0-3d71-4f55-90bf-2ba71ef64510 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] calling os-brick to detach iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 17:15:11 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-65002fb0-3d71-4f55-90bf-2ba71ef64510 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0d4455ce50>, {'target_iqn': 'iqn.2010-10.org.openstack:be0d153d-f033-4892-9628-54f5e45b3b77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jKgtDhOR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:15:11 user nova-compute[75245]: WARNING os_brick.initiator.connectors.base [None req-65002fb0-3d71-4f55-90bf-2ba71ef64510 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:15:11 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-65002fb0-3d71-4f55-90bf-2ba71ef64510 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:15:11 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-65002fb0-3d71-4f55-90bf-2ba71ef64510 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:15:11 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:15:11 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:15:11 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[24324b46-7093-440b-a55e-0840bd9f3205]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:be0d153d-f033-4892-9628-54f5e45b3b77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:15:11 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-65002fb0-3d71-4f55-90bf-2ba71ef64510 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 17:15:11 user nova-compute[75245]: No targets found.
Nov 29 17:15:11 user nova-compute[75245]: iSNS:
Nov 29 17:15:11 user nova-compute[75245]: No targets found.
Nov 29 17:15:11 user nova-compute[75245]: STATIC:
Nov 29 17:15:11 user nova-compute[75245]: Target: iqn.2010-10.org.openstack:be0d153d-f033-4892-9628-54f5e45b3b77
Nov 29 17:15:11 user nova-compute[75245]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:15:11 user nova-compute[75245]:                 Iface Name: default
Nov 29 17:15:11 user nova-compute[75245]: FIRMWARE:
Nov 29 17:15:11 user nova-compute[75245]: No targets found.
Nov 29 17:15:11 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:15:11 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-65002fb0-3d71-4f55-90bf-2ba71ef64510 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 17:15:11 user nova-compute[75245]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 17:15:11 user nova-compute[75245]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75245) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 17:15:11 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-65002fb0-3d71-4f55-90bf-2ba71ef64510 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be0d153d-f033-4892-9628-54f5e45b3b77', 0)] {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 17:15:11 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:15:11 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:15:11 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc8c8b4f-6ae1-40b6-8f5c-2a6afbc2fae8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be0d153d-f033-4892-9628-54f5e45b3b77\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:15:11 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:15:11 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:15:11 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[172f296a-f3ce-4224-9824-d45fefc3e9a9]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be0d153d-f033-4892-9628-54f5e45b3b77 (non-flash)\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:15:11 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-65002fb0-3d71-4f55-90bf-2ba71ef64510 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be0d153d-f033-4892-9628-54f5e45b3b77 (non-flash)
Nov 29 17:15:11 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:15:11 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-65002fb0-3d71-4f55-90bf-2ba71ef64510 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be0d153d-f033-4892-9628-54f5e45b3b77 (non-flash)
Nov 29 17:15:11 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:15:11 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-65002fb0-3d71-4f55-90bf-2ba71ef64510 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0d442e3c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be0d153d-f033-4892-9628-54f5e45b3b77'): ({'sdb'}, set())}) {{(pid=75245) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 17:15:11 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-65002fb0-3d71-4f55-90bf-2ba71ef64510 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Removing single pathed devices sdb {{(pid=75245) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 17:15:11 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:15:11 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:15:11 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb52ccd5-de3d-4d0c-a9f4-b59bb228964c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:15:11 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:15:11 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:15:11 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa10f80f-4341-4fa4-99c9-24df461f2a02]: (4, ('ok\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:15:11 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-65002fb0-3d71-4f55-90bf-2ba71ef64510 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Flushing IO for device /dev/sdb {{(pid=75245) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 17:15:11 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:15:11 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:15:11 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab08de8-b627-4eba-85b9-69d806c37201]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:15:11 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-65002fb0-3d71-4f55-90bf-2ba71ef64510 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75245) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 17:15:11 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:15:11 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:15:11 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6c3ac7-a2b1-4bb0-8c60-a6acddb38cbb]: (4, ('1', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:15:11 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-65002fb0-3d71-4f55-90bf-2ba71ef64510 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 17:15:11 user nova-compute[75245]: DEBUG os_brick.initiator.linuxscsi [None req-65002fb0-3d71-4f55-90bf-2ba71ef64510 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] SCSI volumes sdb have been removed. {{(pid=75245) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 17:15:11 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-65002fb0-3d71-4f55-90bf-2ba71ef64510 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be0d153d-f033-4892-9628-54f5e45b3b77')] {{(pid=75245) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 17:15:11 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be0d153d-f033-4892-9628-54f5e45b3b77 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:15:11 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be0d153d-f033-4892-9628-54f5e45b3b77 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:15:11 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e5a292-c46b-4625-bfd0-ca358c695c57]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:15:11 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-65002fb0-3d71-4f55-90bf-2ba71ef64510 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:15:11 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be0d153d-f033-4892-9628-54f5e45b3b77 -p 172.16.0.220:3260 --logout {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:15:11 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be0d153d-f033-4892-9628-54f5e45b3b77 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:15:11 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb867ceb-b031-4e38-bfbf-441372ea431a]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:be0d153d-f033-4892-9628-54f5e45b3b77, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:be0d153d-f033-4892-9628-54f5e45b3b77, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:15:11 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-65002fb0-3d71-4f55-90bf-2ba71ef64510 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:be0d153d-f033-4892-9628-54f5e45b3b77, portal: 172.16.0.220,3260]
Nov 29 17:15:11 user nova-compute[75245]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:be0d153d-f033-4892-9628-54f5e45b3b77, portal: 172.16.0.220,3260] successful.
Nov 29 17:15:11 user nova-compute[75245]:  stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:15:11 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be0d153d-f033-4892-9628-54f5e45b3b77 -p 172.16.0.220:3260 --op delete {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:15:11 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be0d153d-f033-4892-9628-54f5e45b3b77 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86166) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:15:11 user nova-compute[75245]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a9c423d-161c-4fee-8f43-e0765591a9bb]: (4, ('', '')) {{(pid=86166) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:15:11 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-65002fb0-3d71-4f55-90bf-2ba71ef64510 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75245) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:15:11 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.base [None req-65002fb0-3d71-4f55-90bf-2ba71ef64510 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:15:11 user nova-compute[75245]: DEBUG os_brick.initiator.connectors.iscsi [None req-65002fb0-3d71-4f55-90bf-2ba71ef64510 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] <== disconnect_volume: return (303ms) None {{(pid=75245) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:15:11 user nova-compute[75245]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65002fb0-3d71-4f55-90bf-2ba71ef64510 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Disconnected iSCSI Volume {{(pid=75245) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 17:15:12 user nova-compute[75245]: DEBUG nova.objects.instance [None req-65002fb0-3d71-4f55-90bf-2ba71ef64510 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Lazy-loading 'flavor' on Instance uuid ffa56d44-cd40-4b42-9d6d-f37ba3759b13 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:15:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-65002fb0-3d71-4f55-90bf-2ba71ef64510 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Lock "ffa56d44-cd40-4b42-9d6d-f37ba3759b13" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.660s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:15:15 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:15:18 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:15:20 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:15:25 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:15:30 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:15:35 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:15:40 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:15:45 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:15:46 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:15:46 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Starting heal instance info cache {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 17:15:46 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Rebuilding the list of instances to heal {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 17:15:46 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "refresh_cache-ffa56d44-cd40-4b42-9d6d-f37ba3759b13" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:15:46 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquired lock "refresh_cache-ffa56d44-cd40-4b42-9d6d-f37ba3759b13" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:15:46 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Forcefully refreshing network info cache for instance {{(pid=75245) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 17:15:46 user nova-compute[75245]: DEBUG nova.objects.instance [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lazy-loading 'info_cache' on Instance uuid ffa56d44-cd40-4b42-9d6d-f37ba3759b13 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:15:47 user nova-compute[75245]: DEBUG nova.network.neutron [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Updating instance_info_cache with network_info: [{"id": "671bebb6-5146-45a2-b5b3-3307af4160c9", "address": "fa:16:3e:70:67:f1", "network": {"id": "d88c85cd-909b-4c70-92cf-ae0ba3b1d136", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-301851142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2019bc75cdd34c3bb817000f6fe60a11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap671bebb6-51", "ovs_interfaceid": "671bebb6-5146-45a2-b5b3-3307af4160c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:15:47 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Releasing lock "refresh_cache-ffa56d44-cd40-4b42-9d6d-f37ba3759b13" {{(pid=75245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:15:47 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Updated the network info_cache for instance {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 17:15:47 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:15:47 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:15:47 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:15:47 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:15:47 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75245) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 17:15:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffa56d44-cd40-4b42-9d6d-f37ba3759b13/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:15:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffa56d44-cd40-4b42-9d6d-f37ba3759b13/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:15:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffa56d44-cd40-4b42-9d6d-f37ba3759b13/disk --force-share --output=json {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:15:47 user nova-compute[75245]: DEBUG oslo_concurrency.processutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffa56d44-cd40-4b42-9d6d-f37ba3759b13/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:15:48 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:15:48 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:15:48 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Hypervisor/Node resource view: name=user free_ram=9004MB free_disk=25.033061981201172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75245) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 17:15:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:15:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:15:48 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Instance ffa56d44-cd40-4b42-9d6d-f37ba3759b13 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75245) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:15:48 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 17:15:48 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 17:15:48 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 17:15:48 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 17:15:48 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Compute_service record updated for user:user {{(pid=75245) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 17:15:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.166s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:15:50 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:15:53 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:15:53 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:15:55 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:15:55 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:15:58 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:16:00 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:16:00 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:16:00 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:16:00 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75245) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 17:16:05 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:16:05 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:16:05 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75245) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 17:16:05 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 17:16:05 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 17:16:05 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:16:09 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:16:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:16:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d652d8d8-fdb3-4f19-b986-77d166ce4c82 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Acquiring lock "ffa56d44-cd40-4b42-9d6d-f37ba3759b13" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:16:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d652d8d8-fdb3-4f19-b986-77d166ce4c82 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Lock "ffa56d44-cd40-4b42-9d6d-f37ba3759b13" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:16:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d652d8d8-fdb3-4f19-b986-77d166ce4c82 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Acquiring lock "ffa56d44-cd40-4b42-9d6d-f37ba3759b13-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:16:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d652d8d8-fdb3-4f19-b986-77d166ce4c82 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Lock "ffa56d44-cd40-4b42-9d6d-f37ba3759b13-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:16:10 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d652d8d8-fdb3-4f19-b986-77d166ce4c82 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Lock "ffa56d44-cd40-4b42-9d6d-f37ba3759b13-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:16:10 user nova-compute[75245]: INFO nova.compute.manager [None req-d652d8d8-fdb3-4f19-b986-77d166ce4c82 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Terminating instance
Nov 29 17:16:10 user nova-compute[75245]: DEBUG nova.compute.manager [None req-d652d8d8-fdb3-4f19-b986-77d166ce4c82 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Start destroying the instance on the hypervisor. {{(pid=75245) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 17:16:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:16:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:16:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:16:10 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:16:11 user nova-compute[75245]: DEBUG nova.compute.manager [req-e84b1eea-fb81-4aa4-9333-b56d2d628cc0 req-2e682f95-cf6b-499f-b1e8-e55b2b6d2278 service nova] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Received event network-vif-unplugged-671bebb6-5146-45a2-b5b3-3307af4160c9 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:16:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-e84b1eea-fb81-4aa4-9333-b56d2d628cc0 req-2e682f95-cf6b-499f-b1e8-e55b2b6d2278 service nova] Acquiring lock "ffa56d44-cd40-4b42-9d6d-f37ba3759b13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:16:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-e84b1eea-fb81-4aa4-9333-b56d2d628cc0 req-2e682f95-cf6b-499f-b1e8-e55b2b6d2278 service nova] Lock "ffa56d44-cd40-4b42-9d6d-f37ba3759b13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:16:11 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-e84b1eea-fb81-4aa4-9333-b56d2d628cc0 req-2e682f95-cf6b-499f-b1e8-e55b2b6d2278 service nova] Lock "ffa56d44-cd40-4b42-9d6d-f37ba3759b13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:16:11 user nova-compute[75245]: DEBUG nova.compute.manager [req-e84b1eea-fb81-4aa4-9333-b56d2d628cc0 req-2e682f95-cf6b-499f-b1e8-e55b2b6d2278 service nova] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] No waiting events found dispatching network-vif-unplugged-671bebb6-5146-45a2-b5b3-3307af4160c9 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:16:11 user nova-compute[75245]: DEBUG nova.compute.manager [req-e84b1eea-fb81-4aa4-9333-b56d2d628cc0 req-2e682f95-cf6b-499f-b1e8-e55b2b6d2278 service nova] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Received event network-vif-unplugged-671bebb6-5146-45a2-b5b3-3307af4160c9 for instance with task_state deleting. {{(pid=75245) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 17:16:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:16:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:16:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:16:11 user nova-compute[75245]: INFO nova.virt.libvirt.driver [-] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Instance destroyed successfully.
Nov 29 17:16:11 user nova-compute[75245]: DEBUG nova.objects.instance [None req-d652d8d8-fdb3-4f19-b986-77d166ce4c82 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Lazy-loading 'resources' on Instance uuid ffa56d44-cd40-4b42-9d6d-f37ba3759b13 {{(pid=75245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:16:11 user nova-compute[75245]: DEBUG nova.virt.libvirt.vif [None req-d652d8d8-fdb3-4f19-b986-77d166ce4c82 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T17:09:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-938654112',display_name='tempest-SnapshotDataIntegrityTests-server-938654112',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-938654112',id=52,image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPJNQUOudoKx0edwqpsPintiYISj8f70ERA8ryVrTjGEARPIi7Btclu9jNU0DUa96skoE8fTVP5scZcTvt0WwtQ2ASEjX46dutfWg7v1g9pvgCfKflSEChS8uITRtfjSA==',key_name='tempest-keypair-1250106869',keypairs=<?>,launch_index=0,launched_at=2023-11-29T17:09:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2019bc75cdd34c3bb817000f6fe60a11',ramdisk_id='',reservation_id='r-83umoqcn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a291d9c3-be02-4c6c-9649-4b45c5b7f487',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-866351896',owner_user_name='tempest-SnapshotDataIntegrityTests-866351896-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T17:09:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93438518561c47a589c735c23ee6d6d9',uuid=ffa56d44-cd40-4b42-9d6d-f37ba3759b13,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "671bebb6-5146-45a2-b5b3-3307af4160c9", "address": "fa:16:3e:70:67:f1", "network": {"id": "d88c85cd-909b-4c70-92cf-ae0ba3b1d136", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-301851142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2019bc75cdd34c3bb817000f6fe60a11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap671bebb6-51", "ovs_interfaceid": "671bebb6-5146-45a2-b5b3-3307af4160c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 17:16:11 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-d652d8d8-fdb3-4f19-b986-77d166ce4c82 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Converting VIF {"id": "671bebb6-5146-45a2-b5b3-3307af4160c9", "address": "fa:16:3e:70:67:f1", "network": {"id": "d88c85cd-909b-4c70-92cf-ae0ba3b1d136", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-301851142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2019bc75cdd34c3bb817000f6fe60a11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap671bebb6-51", "ovs_interfaceid": "671bebb6-5146-45a2-b5b3-3307af4160c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:16:11 user nova-compute[75245]: DEBUG nova.network.os_vif_util [None req-d652d8d8-fdb3-4f19-b986-77d166ce4c82 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:70:67:f1,bridge_name='br-int',has_traffic_filtering=True,id=671bebb6-5146-45a2-b5b3-3307af4160c9,network=Network(d88c85cd-909b-4c70-92cf-ae0ba3b1d136),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap671bebb6-51') {{(pid=75245) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:16:11 user nova-compute[75245]: DEBUG os_vif [None req-d652d8d8-fdb3-4f19-b986-77d166ce4c82 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:67:f1,bridge_name='br-int',has_traffic_filtering=True,id=671bebb6-5146-45a2-b5b3-3307af4160c9,network=Network(d88c85cd-909b-4c70-92cf-ae0ba3b1d136),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap671bebb6-51') {{(pid=75245) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 17:16:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:16:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap671bebb6-51, bridge=br-int, if_exists=True) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:16:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:16:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:16:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:16:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=76680d22-28cf-40b7-974d-00d550eadbfc) {{(pid=75245) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:16:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:16:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:16:11 user nova-compute[75245]: INFO os_vif [None req-d652d8d8-fdb3-4f19-b986-77d166ce4c82 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:67:f1,bridge_name='br-int',has_traffic_filtering=True,id=671bebb6-5146-45a2-b5b3-3307af4160c9,network=Network(d88c85cd-909b-4c70-92cf-ae0ba3b1d136),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap671bebb6-51')
Nov 29 17:16:11 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-d652d8d8-fdb3-4f19-b986-77d166ce4c82 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Deleting instance files /opt/stack/data/nova/instances/ffa56d44-cd40-4b42-9d6d-f37ba3759b13_del
Nov 29 17:16:11 user nova-compute[75245]: INFO nova.virt.libvirt.driver [None req-d652d8d8-fdb3-4f19-b986-77d166ce4c82 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Deletion of /opt/stack/data/nova/instances/ffa56d44-cd40-4b42-9d6d-f37ba3759b13_del complete
Nov 29 17:16:11 user nova-compute[75245]: INFO nova.compute.manager [None req-d652d8d8-fdb3-4f19-b986-77d166ce4c82 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 29 17:16:11 user nova-compute[75245]: DEBUG oslo.service.loopingcall [None req-d652d8d8-fdb3-4f19-b986-77d166ce4c82 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75245) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 17:16:11 user nova-compute[75245]: DEBUG nova.compute.manager [-] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Deallocating network for instance {{(pid=75245) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 17:16:11 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] deallocate_for_instance() {{(pid=75245) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 17:16:12 user nova-compute[75245]: DEBUG nova.network.neutron [-] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Updating instance_info_cache with network_info: [] {{(pid=75245) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:16:12 user nova-compute[75245]: INFO nova.compute.manager [-] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Took 0.83 seconds to deallocate network for instance.
Nov 29 17:16:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d652d8d8-fdb3-4f19-b986-77d166ce4c82 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:16:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d652d8d8-fdb3-4f19-b986-77d166ce4c82 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:16:12 user nova-compute[75245]: DEBUG nova.compute.manager [req-3e0a7944-a162-4c1c-899d-93c0cdc46a81 req-23ee45e5-c82f-4115-b39d-125d43b4cdf5 service nova] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Received event network-vif-deleted-671bebb6-5146-45a2-b5b3-3307af4160c9 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:16:12 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-d652d8d8-fdb3-4f19-b986-77d166ce4c82 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 17:16:12 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-d652d8d8-fdb3-4f19-b986-77d166ce4c82 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 17:16:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d652d8d8-fdb3-4f19-b986-77d166ce4c82 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.158s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:16:12 user nova-compute[75245]: INFO nova.scheduler.client.report [None req-d652d8d8-fdb3-4f19-b986-77d166ce4c82 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Deleted allocations for instance ffa56d44-cd40-4b42-9d6d-f37ba3759b13
Nov 29 17:16:12 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-d652d8d8-fdb3-4f19-b986-77d166ce4c82 tempest-SnapshotDataIntegrityTests-866351896 tempest-SnapshotDataIntegrityTests-866351896-project-member] Lock "ffa56d44-cd40-4b42-9d6d-f37ba3759b13" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.068s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:16:13 user nova-compute[75245]: DEBUG nova.compute.manager [req-ced8644e-4a78-4aba-b27e-c62a48af9679 req-372fec10-470d-48c7-bd56-ae5159ee0d2c service nova] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Received event network-vif-plugged-671bebb6-5146-45a2-b5b3-3307af4160c9 {{(pid=75245) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:16:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-ced8644e-4a78-4aba-b27e-c62a48af9679 req-372fec10-470d-48c7-bd56-ae5159ee0d2c service nova] Acquiring lock "ffa56d44-cd40-4b42-9d6d-f37ba3759b13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:16:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-ced8644e-4a78-4aba-b27e-c62a48af9679 req-372fec10-470d-48c7-bd56-ae5159ee0d2c service nova] Lock "ffa56d44-cd40-4b42-9d6d-f37ba3759b13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:16:13 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [req-ced8644e-4a78-4aba-b27e-c62a48af9679 req-372fec10-470d-48c7-bd56-ae5159ee0d2c service nova] Lock "ffa56d44-cd40-4b42-9d6d-f37ba3759b13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:16:13 user nova-compute[75245]: DEBUG nova.compute.manager [req-ced8644e-4a78-4aba-b27e-c62a48af9679 req-372fec10-470d-48c7-bd56-ae5159ee0d2c service nova] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] No waiting events found dispatching network-vif-plugged-671bebb6-5146-45a2-b5b3-3307af4160c9 {{(pid=75245) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:16:13 user nova-compute[75245]: WARNING nova.compute.manager [req-ced8644e-4a78-4aba-b27e-c62a48af9679 req-372fec10-470d-48c7-bd56-ae5159ee0d2c service nova] [instance: ffa56d44-cd40-4b42-9d6d-f37ba3759b13] Received unexpected event network-vif-plugged-671bebb6-5146-45a2-b5b3-3307af4160c9 for instance with vm_state deleted and task_state None.
Nov 29 17:16:16 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:16:21 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:16:21 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:16:21 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75245) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 17:16:21 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 17:16:21 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 17:16:21 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:16:26 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:16:31 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:16:36 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:16:41 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:16:46 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:16:48 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:16:48 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Starting heal instance info cache {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 17:16:48 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Rebuilding the list of instances to heal {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 17:16:48 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Didn't find any instances for network info cache update. {{(pid=75245) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 17:16:48 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:16:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:16:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:16:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:16:48 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75245) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 17:16:48 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:16:48 user nova-compute[75245]: WARNING nova.virt.libvirt.driver [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:16:48 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Hypervisor/Node resource view: name=user free_ram=9136MB free_disk=25.060321807861328GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75245) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 17:16:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:16:48 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:16:49 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 17:16:49 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75245) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 17:16:49 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Refreshing inventories for resource provider dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 17:16:49 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Updating ProviderTree inventory for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 17:16:49 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Updating inventory in ProviderTree for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 17:16:49 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Refreshing aggregate associations for resource provider dcc0ed27-167e-4f3a-a0de-183bb144a50c, aggregates: None {{(pid=75245) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 17:16:49 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Refreshing trait associations for resource provider dcc0ed27-167e-4f3a-a0de-183bb144a50c, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG {{(pid=75245) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 17:16:49 user nova-compute[75245]: DEBUG nova.compute.provider_tree [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed in ProviderTree for provider: dcc0ed27-167e-4f3a-a0de-183bb144a50c {{(pid=75245) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 17:16:49 user nova-compute[75245]: DEBUG nova.scheduler.client.report [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Inventory has not changed for provider dcc0ed27-167e-4f3a-a0de-183bb144a50c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75245) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 17:16:49 user nova-compute[75245]: DEBUG nova.compute.resource_tracker [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Compute_service record updated for user:user {{(pid=75245) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 17:16:49 user nova-compute[75245]: DEBUG oslo_concurrency.lockutils [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.338s {{(pid=75245) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:16:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:16:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:16:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75245) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 17:16:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 17:16:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 17:16:51 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:16:54 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:16:54 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:16:56 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:16:57 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:17:00 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:17:01 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:17:01 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:17:01 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75245) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 17:17:01 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:17:01 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:17:01 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75245) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 17:17:01 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 17:17:01 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:17:01 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75245) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 17:17:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:17:04 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:17:04 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75245) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 17:17:04 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:17:06 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:17:07 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:17:09 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:17:09 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Cleaning up deleted instances {{(pid=75245) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 17:17:09 user nova-compute[75245]: DEBUG nova.compute.manager [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] There are 0 instances to clean {{(pid=75245) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 17:17:10 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:17:11 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:17:16 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:17:19 user nova-compute[75245]: DEBUG oslo_service.periodic_task [None req-1ac49faa-817f-4115-a7f6-d221d36ad8a2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75245) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:17:21 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:17:26 user nova-compute[75245]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75245) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}